arXiv subjects

Bowen Li

Publications and source records attributed to Bowen Li.

At least 127 records · Page 7Linked to original sources

arXiv2025

Towards Lightweight and Stable Zero-shot TTS with Self-distilled Representation Disentanglement

Zero-shot Text-To-Speech (TTS) synthesis shows great promise for personalized voice customization through voice cloning. However, current methods for achieving zero-shot TTS heavily rely on large model scales and extensive training datasets to ensure satisfactory performance and generalizability across various speakers. This raises concerns regarding both deployment costs and data security. In this paper, we present a lightweight and stable zero-shot TTS system. We introduce a novel TTS architecture designed to effectively model linguistic content and various speaker attributes from source speech and prompt speech, respectively. Furthermore, we present a two-stage self-distillation framework that constructs parallel data pairs for effectively disentangling linguistic content and speakers from the perspective of training data. Extensive experiments show that our system exhibits excellent performance and superior stability on the zero-shot TTS tasks. Moreover, it shows markedly superior computational efficiency, with RTFs of 0.13 and 0.012 on the CPU and GPU, respectively.

cs.SD↗

arXiv2025

Quantum space-time Poincaré inequality for Lindblad dynamics

We investigate the mixing properties of primitive Markovian Lindblad dynamics (i.e., quantum Markov semigroups), where the detailed balance is disrupted by a coherent drift term. It is known that the sharp $L^2$-exponential convergence rate of Lindblad dynamics is determined by the spectral gap of the generator. We show that incorporating a Hamiltonian component into a detailed balanced Lindbladian can generically enhance its spectral gap, thereby accelerating the mixing. In addition, we analyze the asymptotic behavior of the spectral gap for Lindblad dynamics with a large coherent contribution. However, estimating the spectral gap, particularly for a non-detailed balanced Lindbladian, presents a significant challenge. In the case of hypocoercive Lindblad dynamics, we extend the variational framework originally developed for underdamped Langevin dynamics to derive fully explicit and constructive exponential decay estimates for convergence in the noncommutative $L^2$-norm. This analysis relies on establishing a quantum analog of space-time Poincaré inequality. Furthermore, we provide several examples with connections to quantum noise and quantum Gibbs samplers as applications of our theoretical results.

quant-ph↗

arXiv2025

GraphDART: Graph Distillation for Efficient Advanced Persistent Threat Detection

Cyber-physical-social systems (CPSSs) have emerged in many applications over recent decades, requiring increased attention to security concerns. The rise of sophisticated threats like Advanced Persistent Threats (APTs) makes ensuring security in CPSSs particularly challenging. Provenance graph analysis has proven effective for tracing and detecting anomalies within systems, but the sheer size and complexity of these graphs hinder the efficiency of existing methods, especially those relying on graph neural networks (GNNs). To address these challenges, we present GraphDART, a modular framework designed to distill provenance graphs into compact yet informative representations, enabling scalable and effective anomaly detection. GraphDART can take advantage of diverse graph distillation techniques, including classic and modern graph distillation methods, to condense large provenance graphs while preserving essential structural and contextual information. This approach significantly reduces computational overhead, allowing GNNs to learn from distilled graphs efficiently and enhance detection performance. Extensive evaluations on benchmark datasets demonstrate the robustness of GraphDART in detecting malicious activities across cyber-physical-social systems. By optimizing computational efficiency, GraphDART provides a scalable and practical solution to safeguard interconnected environments against APTs.

cs.CR↗

arXiv2025

Graph2text or Graph2token: A Perspective of Large Language Models for Graph Learning

Graphs are data structures used to represent irregular networks and are prevalent in numerous real-world applications. Previous methods directly model graph structures and achieve significant success. However, these methods encounter bottlenecks due to the inherent irregularity of graphs. An innovative solution is converting graphs into textual representations, thereby harnessing the powerful capabilities of Large Language Models (LLMs) to process and comprehend graphs. In this paper, we present a comprehensive review of methodologies for applying LLMs to graphs, termed LLM4graph. The core of LLM4graph lies in transforming graphs into texts for LLMs to understand and analyze. Thus, we propose a novel taxonomy of LLM4graph methods in the view of the transformation. Specifically, existing methods can be divided into two paradigms: Graph2text and Graph2token, which transform graphs into texts or tokens as the input of LLMs, respectively. We point out four challenges during the transformation to systematically present existing methods in a problem-oriented perspective. For practical concerns, we provide a guideline for researchers on selecting appropriate models and LLMs for different graphs and hardware constraints. We also identify five future research directions for LLM4graph.

cs.LG↗

arXiv2024

NumbOD: A Spatial-Frequency Fusion Attack Against Object Detectors

With the advancement of deep learning, object detectors (ODs) with various architectures have achieved significant success in complex scenarios like autonomous driving. Previous adversarial attacks against ODs have been focused on designing customized attacks targeting their specific structures (e.g., NMS and RPN), yielding some results but simultaneously constraining their scalability. Moreover, most efforts against ODs stem from image-level attacks originally designed for classification tasks, resulting in redundant computations and disturbances in object-irrelevant areas (e.g., background). Consequently, how to design a model-agnostic efficient attack to comprehensively evaluate the vulnerabilities of ODs remains challenging and unresolved. In this paper, we propose NumbOD, a brand-new spatial-frequency fusion attack against various ODs, aimed at disrupting object detection within images. We directly leverage the features output by the OD without relying on its internal structures to craft adversarial examples. Specifically, we first design a dual-track attack target selection strategy to select high-quality bounding boxes from OD outputs for targeting. Subsequently, we employ directional perturbations to shift and compress predicted boxes and change classification results to deceive ODs. Additionally, we focus on manipulating the high-frequency components of images to confuse ODs' attention on critical objects, thereby enhancing the attack efficiency. Our extensive experiments on nine ODs and two datasets show that NumbOD achieves powerful attack performance and high stealthiness.

cs.CV↗

arXiv2024

Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case Study

Recent advancements in large language models (LLMs) have significantly enhanced their coding capabilities. However, existing benchmarks predominantly focused on simplified or isolated aspects of coding, such as single-file code generation or repository issue debugging, falling short of measuring the full spectrum of challenges raised by real-world programming activities. In this case study, we explore the performance of LLMs across the entire software development lifecycle with DevEval, encompassing stages including software design, environment setup, implementation, acceptance testing, and unit testing. DevEval features four programming languages, multiple domains, high-quality data collection, and carefully designed and verified metrics for each task. Empirical studies show that current LLMs, including GPT-4, fail to solve the challenges presented within DevEval. Our findings offer actionable insights for the future development of LLMs toward real-world programming applications.

cs.CL↗

arXiv2024

Stability Theorems for Forbidden Configurations

Stability is a well investigated concept in extremal combinatorics. The main idea is that if some object is close in size to an extremal object, then it retains the structure of the extremal construction. In the present paper we study stability in the context of forbidden configurations. $(0,1)$-matrix $F$ is a configuration in a $(0,1)$-matrix $A$ if $F$ is a row and columns permutation of a submatrix of $A$. $\mathrm{Avoid}(m,F)$ denotes the set of $m$-rowed $(0,1)$-matrices with pairwise distinct columns without configuration $F$, $\mathrm{forb}(m,F)$ is the largest number of columns of a matrix in $\mathrm{Avoid}(m,F)$, while $\mathrm{ext}(m,F)$ is the set of matrices in $\mathrm{Avoid}(m,F)$ of size $\mathrm{forb}(m,F)$. We show cases (i) when each element of $\mathrm{Avoid}(m,F)$ have the structure of element(s) in $\mathrm{ext}(m,F)$, (ii) $\mathrm{forb}(m,F)=Θ(m^2)$ and the size of $A\in \mathrm{Avoid}(m,F)$ deviates from $\mathrm{forb}(m,F)$ by a linear amount, or (iii) $\mathrm{forb}(m,F)=Θ(m)$ and the size of $A$ is smaller by a constant, then the structure of $A$ is same as the structure of a matrix in $\mathrm{ext}(m,F)$.

math.CO↗

arXiv2024

Efficient quantum Gibbs samplers with Kubo--Martin--Schwinger detailed balance condition

Lindblad dynamics and other open-system dynamics provide a promising path towards efficient Gibbs sampling on quantum computers. In these proposals, the Lindbladian is obtained via an algorithmic construction akin to designing an artificial thermostat in classical Monte Carlo or molecular dynamics methods, rather than treated as an approximation to weakly coupled system-bath unitary dynamics. Recently, Chen, Kastoryano, and Gilyén (arXiv:2311.09207) introduced the first efficiently implementable Lindbladian satisfying the Kubo--Martin--Schwinger (KMS) detailed balance condition, which ensures that the Gibbs state is a fixed point of the dynamics and is applicable to non-commuting Hamiltonians. This Gibbs sampler uses a continuously parameterized set of jump operators, and the energy resolution required for implementing each jump operator depends only logarithmically on the precision and the mixing time. In this work, we build upon the structural characterization of KMS detailed balanced Lindbladians by Fagnola and Umanità, and develop a family of efficient quantum Gibbs samplers using a finite set of jump operators (the number can be as few as one), \re{akin to the classical Markov chain-based sampling algorithm. Compared to the existing works, our quantum Gibbs samplers have a comparable quantum simulation cost but with greater design flexibility and a much simpler implementation and error analysis.} Moreover, it encompasses the construction of Chen, Kastoryano, and Gilyén as a special instance.

quant-ph↗

arXiv2024

Dynamic strain sensing using Doppler-shift-immune phase-sensitive OFDR with ultra-weak reflection array and frequency-tracking

In distributed fiber-optic sensing based on optical frequency domain reflectometry (OFDR), Doppler frequency shifts due to the changes of disturbances during one sweep period introduce demodulation errors that accumulate along both the distance and time, impairing the sensing performance. Here, we report distributed dynamic strain sensing using Doppler-shift-immune phase-sensitive OFDR based on frequency-tracking and spectrum-zooming with ultra-weak reflection array. Theoretical study has been carried out with the introduction of mismatch coefficient, unveiling quantitatively the impact of Doppler shift. Following a numerical analysis of the proposed method, a retained precision has been experimentally verified regardless of the position mismatch due to the Doppler effect. Doppler-shift-immune sensing for dynamic strains covering continuous spatial resolution over a distance of 1000 m with a 2.5 cm sensing spatial resolution has been demonstrated, verifying the high fidelity promised by the proposed method.

physics.optics↗

arXiv2024

PhysORD: A Neuro-Symbolic Approach for Physics-infused Motion Prediction in Off-road Driving

Motion prediction is critical for autonomous off-road driving, however, it presents significantly more challenges than on-road driving because of the complex interaction between the vehicle and the terrain. Traditional physics-based approaches encounter difficulties in accurately modeling dynamic systems and external disturbance. In contrast, data-driven neural networks require extensive datasets and struggle with explicitly capturing the fundamental physical laws, which can easily lead to poor generalization. By merging the advantages of both methods, neuro-symbolic approaches present a promising direction. These methods embed physical laws into neural models, potentially significantly improving generalization capabilities. However, no prior works were evaluated in real-world settings for off-road driving. To bridge this gap, we present PhysORD, a neural-symbolic approach integrating the conservation law, i.e., the Euler-Lagrange equation, into data-driven neural models for motion prediction in off-road driving. Our experiments showed that PhysORD can accurately predict vehicle motion and tolerate external disturbance by modeling uncertainties. The learned dynamics model achieves 46.7% higher accuracy using only 3.1% of the parameters compared to data-driven methods, demonstrating the data efficiency and superior generalization ability of our neural-symbolic method.

cs.RO↗

arXiv2024

Observation of quantum superposition of topological defects in a trapped ion quantum simulator

Topological defects are discontinuities of a system protected by global properties, with wide applications in mathematics and physics. While previous experimental studies mostly focused on their classical properties, it has been predicted that topological defects can exhibit quantum superposition. Despite the fundamental interest and potential applications in understanding symmetry-breaking dynamics of quantum phase transitions, its experimental realization still remains a challenge. Here, we report the observation of quantum superposition of topological defects in a trapped-ion quantum simulator. By engineering long-range spin-spin interactions, we observe a spin kink splitting into a superposition of kinks at different positions, creating a ``Schrodinger kink'' that manifests non-locality and quantum interference. Furthermore, by preparing superposition states of neighboring kinks with different phases, we observe the propagation of the wave packet in different directions, thus unambiguously verifying the quantum coherence in the superposition states. Our work provides useful tools for non-equilibrium dynamics in quantum Kibble-Zurek physics.

quant-ph↗

arXiv2024

Numerical Solution for Nonlinear 4D Variational Data Assimilation (4D-Var) via ADMM

The four-dimensional variational data assimilation (4D-Var) has emerged as an important methodology, widely used in numerical weather prediction, oceanographic modeling, and climate forecasting. Classical unconstrained gradient-based algorithms often struggle with local minima, making their numerical performance highly sensitive to the initial guess. In this study, we exploit the separable structure of the 4D-Var problem to propose a practical variant of the alternating direction method of multipliers (ADMM), referred to as the linearized multi-block ADMM with regularization. Unlike classical first-order optimization methods that primarily focus on initial conditions, our approach derives the Euler-Lagrange equation for the entire dynamical system, enabling more comprehensive and effective utilization of observational data. When the initial condition is poorly chosen, the arg min operation steers the iteration towards the observational data, thereby reducing sensitivity to the initial guess. The quadratic subproblems further simplify the solution process, while the parallel structure enhances computational efficiency, especially when utilizing modern hardware. To validate our approach, we demonstrate its superior performance using the Lorenz system, even in the presence of noisy observational data. Furthermore, we showcase the effectiveness of the linearized multi-block ADMM with regularization in solving the 4D-Var problems for the viscous Burgers' equation, across various numerical schemes, including finite difference, finite element, and spectral methods. Finally, we illustrate the recovery of dynamics under noisy observational data in a 2D turbulence scenario, particularly focusing on vorticity concentration, highlighting the robustness of our algorithm in handling complex physical phenomena.

math.NA↗

arXiv2024

Parameter Efficient Reinforcement Learning from Human Feedback

While Reinforcement Learning from Human Feedback (RLHF) effectively aligns pretrained Large Language and Vision-Language Models (LLMs, and VLMs) with human preferences, its computational cost and complexity hamper its wider adoption. To alleviate some of the computational burden of fine-tuning, parameter efficient methods, like LoRA were introduced. In this work, we empirically evaluate the setup of Parameter Efficient Reinforcement Learning from Human Feedback (PE-RLHF) that leverages LoRA fine-tuning for Reward Modeling, and Reinforcement Learning. We benchmark the PE-RLHF setup on six diverse datasets spanning summarization, harmless/helpful response generation, UI automation, and visual question answering in terms of effectiveness of the trained models, and the training resources required. Our findings show, for the first time, that PE-RLHF achieves comparable performance to RLHF, while significantly reducing training time (up to 90% faster for reward models, and 30% faster for RL), and memory footprint (up to 50% reduction for reward models, and 27% for RL). We provide comprehensive ablations across LoRA ranks, and model sizes for both reward modeling and reinforcement learning. By mitigating the computational burden associated with RLHF, we push for a broader adoption of PE-RLHF as an alignment technique for LLMs and VLMs.

cs.LG↗

arXiv2024

On Bounds for Greedy Schemes in String Optimization based on Greedy Curvatures

We consider the celebrated bound introduced by Conforti and Cornuéjols (1984) for greedy schemes in submodular optimization. The bound assumes a submodular function defined on a collection of sets forming a matroid and is based on greedy curvature. We show that the bound holds for a very general class of string problems that includes maximizing submodular functions over set matroids as a special case. We also derive a bound that is computable in the sense that they depend only on quantities along the greedy trajectory. We prove that our bound is superior to the greedy curvature bound of Conforti and Cornuéjols. In addition, our bound holds under a condition that is weaker than submodularity.

eess.SY↗

arXiv2024

Slow Dephasing of Coherent Optical Phonons in Two-dimensional Lead Organic Chalcogenides

Hybrid organic-inorganic semiconductors with strong electron-phonon interactions provide a programmable platform for developing a variety of electronic, optoelectronic, and quantum materials by controlling these interactions. However, in current hybrid semiconductors, such as halide perovskites, anharmonic vibrations with rapid dephasing hinder the ability to coherently manipulate phonons. Here, we report the observation of long-lived coherent phonons in lead organic chalcogenides (LOCs), a new family of hybrid two-dimensional semiconductors. These materials feature harmonic phonon dynamics despite distorted lattices, combining long phonon dephasing times with tunable semiconducting properties. Dephasing time as long as 75 ps at 10 K, with up to 500 cycles of phonon oscillation between scattering events, was observed, corresponding to a dimensionless harmonicity parameter more than an order of magnitude larger than that of halide perovskites. The phonon dephasing time is significantly influenced by anharmonicity and centrosymmetry, both of which can be tuned through the design of the organic ligands thanks to the direct bonding between the organic and inorganic motifs. This research opens new opportunities for the manipulation of electronic properties with coherent phonons in hybrid semiconductors.

cond-mat.mtrl-sci↗

arXiv2024

On Gauge Equivalence of Twisted Quantum Doubles

We study the quantum double of a finite abelian group $G$ twisted by a $3$-cocycle and give a sufficient condition when such a twisted quantum double will be gauge equivalent to a ordinary quantum double of a finite group. Moreover, we will determine when a twisted quantum double of a cyclic group is genuine. As an application, we contribute to the classification of coradically graded finite-dimensional pointed coquasi-Hopf algebras over abelian groups. As a byproduct, we show that the Nichols algebras $\mathcal{B}(M_1\oplus M_2 \oplus M_3)$ are infinite-dimensional where $M_1,M_2,M_3$ are three different simple Yetter-Drinfeld modules of $D_8$.

math.QA↗

arXiv2024

DPA-2: a large atomic model as a multi-task learner

The rapid advancements in artificial intelligence (AI) are catalyzing transformative changes in atomic modeling, simulation, and design. AI-driven potential energy models have demonstrated the capability to conduct large-scale, long-duration simulations with the accuracy of ab initio electronic structure methods. However, the model generation process remains a bottleneck for large-scale applications. We propose a shift towards a model-centric ecosystem, wherein a large atomic model (LAM), pre-trained across multiple disciplines, can be efficiently fine-tuned and distilled for various downstream tasks, thereby establishing a new framework for molecular modeling. In this study, we introduce the DPA-2 architecture as a prototype for LAMs. Pre-trained on a diverse array of chemical and materials systems using a multi-task approach, DPA-2 demonstrates superior generalization capabilities across multiple downstream tasks compared to the traditional single-task pre-training and fine-tuning methodologies. Our approach sets the stage for the development and broad application of LAMs in molecular and materials simulation research.

physics.chem-ph↗

arXiv2024

Tool Learning with Foundation Models

Humans possess an extraordinary ability to create and utilize tools, allowing them to overcome physical limitations and explore new frontiers. With the advent of foundation models, AI systems have the potential to be equally adept in tool use as humans. This paradigm, i.e., tool learning with foundation models, combines the strengths of specialized tools and foundation models to achieve enhanced accuracy, efficiency, and automation in problem-solving. Despite its immense potential, there is still a lack of a comprehensive understanding of key challenges, opportunities, and future endeavors in this field. To this end, we present a systematic investigation of tool learning in this paper. We first introduce the background of tool learning, including its cognitive origins, the paradigm shift of foundation models, and the complementary roles of tools and models. Then we recapitulate existing tool learning research into tool-augmented and tool-oriented learning. We formulate a general tool learning framework: starting from understanding the user instruction, models should learn to decompose a complex task into several subtasks, dynamically adjust their plan through reasoning, and effectively conquer each sub-task by selecting appropriate tools. We also discuss how to train models for improved tool-use capabilities and facilitate the generalization in tool learning. Considering the lack of a systematic tool learning evaluation in prior works, we experiment with 18 representative tools and show the potential of current foundation models in skillfully utilizing tools. Finally, we discuss several open problems that require further investigation for tool learning. In general, we hope this paper could inspire future research in integrating tools with foundation models.

cs.CL↗