SearcharxivSearch

arXiv subjects

Wenjie Yu

Publications and source records attributed to Wenjie Yu.

8 recordsLinked to original sources

AMDP: Asynchronous Multi-Directional Pipeline Parallelism for Large-Scale Models Training

Pipeline parallelism is essential for large-scale model training, but existing asynchronous approaches often degrade convergence due to parameter mismatch between forward and backward passes. We propose Asynchronous Multi-Directional Pipeline parallelism (AMDP) to mitigate this issue while sustaining high utilization. AMDP limits the first stage of each pipeline to process at most two minibatches before backpropagation, bounding the number of parameter updates between forward and backward passes. To alleviate the resulting pipeline bubbles, AMDP launches multiple concurrent pipelines and adapts their number according to pipeline depth. In addition, AMDP accumulates gradients across minibatches and applies them in a single update, ensuring that only a bounded number of minibatches experience parameter mismatch, limited to within one optimization step. Experiments on GPT- and BERT-style models demonstrate that AMDP significantly accelerates training while preserving convergence.

cs.DC

Multi-Agent Honeypot-Based Request-Response Context Dataset for Improved SQL Injection Detection Performance

SQL injection remains a major threat to web applications, as existing defenses often fail against obfuscation and evolving attacks because of neglecting the request-response context. This paper presents a context-enriched SQL injection detection framework, focusing on constructing a high-quality request-response dataset via a multi-agent honeypot system: the Request Generator Agent produces diverse malicious/benign requests, the Database Response Agent mediates interactions to ensure authentic responses while protecting production data, and the Traffic Monitor pairs requests with responses, assigns labels, and cleans data, yielding totally 140,973 labeled pairs with contextual cues absent in payload-only data. Experiments show that models trained on this context dataset outperform payload-only counterparts: CNN and BiLSTM achieve over 40\% accuracy improvement in different tasks, validating that the request-response context enhances the detection of evolving and obfuscated attacks.

cs.CR

AI Code in the Wild: Measuring Security Risks and Ecosystem Shifts of AI-Generated Code in Modern Software

Large language models (LLMs) for code generation are becoming integral to modern software development, but their real-world prevalence and security impact remain poorly understood. We present the first large-scale empirical study of AI-generated code (AIGCode) in the wild. We build a high-precision detection pipeline and a representative benchmark to distinguish AIGCode from human-written code, and apply them to (i) development commits from the top 1,000 GitHub repositories (2022-2025) and (ii) 7,000+ recent CVE-linked code changes. This lets us label commits, files, and functions along a human/AI axis and trace how AIGCode moves through projects and vulnerability life cycles. Our measurements show three ecological patterns. First, AIGCode is already a substantial fraction of new code, but adoption is structured: AI concentrates in glue code, tests, refactoring, documentation, and other boilerplate, while core logic and security-critical configurations remain mostly human-written. Second, adoption has security consequences: some CWE families are overrepresented in AI-tagged code, and near-identical insecure templates recur across unrelated projects, suggesting "AI-induced vulnerabilities" propagated by shared models rather than shared maintainers. Third, in human-AI edit chains, AI introduces high-throughput changes while humans act as security gatekeepers; when review is shallow, AI-introduced defects persist longer, remain exposed on network-accessible surfaces, and spread to more files and repositories. We will open-source the complete dataset and release analysis artifacts and fine-grained documentation of our methodology and findings.

cs.SE

Dynamic Simulation Method for Low-permeability Reservoirs with Fracturing-flooding Based on a Dual-Porous and Dual-Permeable Media Model

The fracturing-flooding technology is a new process for the development of low-permeability oil reservoirs, achieving a series of successful applications in oilfield production. However, existing numerical simulation methods for pressure drive struggle to efficiently and accurately simulate the dynamic changes in reservoir properties during the fracturing-flooding process, particularly the expansion and closure of fractures within the reservoir. This paper introduces a Darcy flow model with dual-porous and dual-permeable characteristics based on seepage mechanics theory, utilizing two sets of rock stress-sensitive parameter tables to describe the physical property changes of the matrix and fractures during the fracturing-flooding process. Different parameters are set for the X and Y directions to characterize the anisotropic features of the reservoir. A numerical simulation method aimed at dynamic analysis of fracturing-flooding is established, along with an automatic history fitting method based on the CMA-ES algorithm to derive rock mechanics parameters that align with actual block conditions.

math.OC

BitPipe: Bidirectional Interleaved Pipeline Parallelism for Accelerating Large Models Training

With the increasing scale of models, the need for efficient distributed training has become increasingly urgent. Recently, many synchronous pipeline parallelism approaches have been proposed to improve training throughput. However, these approaches still suffer from two major issues, i.e., pipeline bubbles caused by periodic flushing and extra communication due to the increasing number of pipeline stages. To this end, we propose BitPipe, a bidirectional interleaved pipeline parallelism for accelerating large models training. Specifically, a hybrid scheme of fusing interleaved pipelines with bidirectional pipelines is proposed to reduce the computational time of each single micro-batch and multiply the number of devices executing simultaneously. A V-shaped schedule with eager gradient synchronization is introduced to reduce and overlap the communication between devices. Experiments conducted on up to 32 GPUs show that BitPipe improves the training throughput of GPT-style and BERT-style models by 1.05x-1.28x compared to the state-of-the-art synchronous approaches. The code of our implementation is available at https://github.com/wuhouming/BitPipe.

cs.LG

Complete mode conversion for elastic waves reflected by elastic metamaterial slab with double hexapole resonances

In this study, we investigate the phenomenon of mode conversion in elastic bulk waves using coupled hexapole resonances. A metamaterial slab is proposed enabling the complete conversion between longitudinal and transverse modes. Each unit of the elastic metamaterial slab comprises a pair of scatterers, and their relative direction is oriented at an oblique angle. The interaction between the coupled hexapoles and the background results in oblique displacements, which are responsible for the mode conversion. Moreover, this conversion exhibits a broader frequency range compared to the quadrupole resonance. This innovative design significantly broadens the range of possibilities for developing mode-converting metamaterials.

physics.app-ph

Evidence the ferromagnetic order on CoSb layer of LaCoSb$_2$

The emergence of unconventional superconductivity is generally considered to be related to spin fluctuations. Unveiling the intriguing behaviors of spin fluctuations in parent compounds with layered transition-metal ions may shed light on the search for exotic unconventional superconductors. Here, based on the framework of the first-principles calculations, we theoretically propose that LaCoSb$_2$ is a weak antiferromagnetic layered metal with an in-plane ferromagnetic moment of 0.88 $μ_B$ at the Co sites, as a candidate parent compound of the cobalt-based superconductors. Importantly, this theoretical finding is experimentally supported by our magnetization measurements on polycrystalline samples of LaCo$_{0.78}$Sb$_2$. Following the symmetry analysis, we suggest a possible $p$-wave superconductivity hosted in doped LaCoSb$_2$ emerging at the verge of ferromagnetic spin fluctuations, which implies potential applications in topological quantum computing in future.

cond-mat.supr-con

Design of a Planar Eleven Antenna for Optimal MIMO Performance as a Wideband Micro Base-station Antenna

A new low-profile planar Eleven antenna is designed for optimal MIMO performance as a wideband MIMO antenna for micro base-stations in future wireless communication systems. The design objective has been to optimize both the reflection coefficient at the input port of the antenna and the 1-bitstream and 2-bitstream MIMO efficiency of the antenna at the same time, in both the Rich Isotropic MultiPath (RIMP) and Random Line-of-Sight (Random-LOS) environments. The planar Eleven antenna can be operated in 2-, 4-, and 8-port modes with slight modifications. The optimization is performed using genetic algorithms. The effects of polarization deficiencies and antenna total embedded efficiency on the MIMO performance of the antenna are further studied. A prototype of the antenna has been fabricated and the design has been verified by measurements against the simulations.

eess.SP