Searcharxiv⌕ Search

arXiv subjects

Na Li

Publications and source records attributed to Na Li.

At least 55 records · Page 3Linked to original sources

Decentralized Diffusion Policy Learning for Enhanced Exploration in Cooperative Multi-agent Reinforcement Learning

Cooperative multi-agent reinforcement learning (MARL) involves complex agent interactions and requires effective exploration strategies. A prominent class of MARL algorithms, decentralized softmax policy gradient (DecSPG), addresses this through energy-based policy updates. In practice, however, such energy-based policies are intractable to maintain and are commonly projected onto the Gaussian policy class. In this work, we show that the limited expressiveness of Gaussian policies severely hinders exploration in DecSPG, and this limitation worsens as the number of agents grows. To address this issue, we propose decentralized diffusion policy learning (DDPL), which parameterizes each agent's policy with a denoising diffusion probabilistic model, an expressive generative model that captures multi-modal action distributions for enhanced exploration. DDPL enables efficient online training of diffusion policies via importance sampling score matching (ISSM), a novel training method with theoretical guarantee. We evaluate DDPL on representative continuous-action MARL benchmarks, including multi-agent particle environment, multi-agent MuJoCo, IsaacLab, and JAX-reimplemented StarCraft multi-agent challenge, and observe consistently improved performance.

cs.MA↗

AdamFLIP: Adaptive Momentum Feedback Linearization Optimization for Hard Constrained PINN Training

Physics-informed neural networks (PINNs) provide a flexible framework for solving forward and inverse problems governed by partial differential equations (PDEs), but standard PINN training typically relies on soft penalty formulations that combine PDE residuals, data mismatch, and initial/boundary conditions using manually chosen weights. This often leads to ill-conditioning, sensitivity to loss weights, and poor constraint satisfaction. In this work, we reformulate PINN training as an equality-constrained optimization problem and propose a novel Adaptive Momentum Feedback Linearization Optimization for Hard Constrained PINN (AdamFLIP). The key idea is to view the constraint residuals as the output of a controlled dynamical system and to compute the Lagrange multiplier as a feedback input that locally drives these residuals toward stable linear contraction dynamics. AdamFLIP then applies Adam-style first- and second-moment adaptation to the resulting feedback-linearized Lagrangian gradient, combining principled constraint handling with the scalability and robustness of adaptive neural-network optimization. We test AdamFLIP on a range of benchmark forward and inverse PDE problem, and it consistently outperforms both the standard soft-constrained PINN and state-of-the-art constrained optimizers. Specifically, on the Navier--Stokes equations benchmark, AdamFLIP \textbf{reduces relative $L_2$ error by more than two thirds} for the predicted solution compared to the next best method. Our AdamFLIP framework provides an effective and computationally scalable hard constraint optimization method for PINN training.

cs.LG↗

Community-to-Vehicle: Integrating Electric Vehicles into Energy Communities -- A Swiss Case Study

The institutional separation between local energy communities and public electric vehicle (EV) charging limits the efficient use of locally generated renewable energy. This paper introduces the concept of community-to-vehicle (C2V) as an institutional design mechanism to bridge this gap by enabling EV charging within the community boundary, where locally generated photovoltaic (PV) surplus is preferentially allocated and offered to external users at a community charging price. Building on the recently introduced local electricity community framework in Switzerland, we design scenarios that capture the transition from full separation to coordinated EV charging and evaluate their impacts on EV users and the community. The results show that C2V significantly improves local PV utilization and enhances economic performance, reducing EV charging costs relative to commercial alternatives while generating additional revenue streams for the community. These findings highlight the potential of C2V as a practical, implementable mechanism for integrating EV charging into local energy communities, providing a clear pathway for adopting coordinated community-EV interaction within existing regulatory frameworks.

eess.SY↗

From Individual Consumers to Energy Communities: A Techno-economic Assessment of Swiss Local Electricity Communities

As energy communities move from policy design to implementation in Switzerland, understanding their performance in practice has become increasingly important. A techno-economic assessment of a regulation-compliant LEC is presented under the new Swiss legal framework in this study. A reference case without local electricity exchange is compared to a LEC scenario with internal electricity sharing. Results show that LEC participation increases local renewable utilization, reduces grid exports, and delivers economic benefits to both consumers and prosumers. A sensitivity analysis further indicates that internal electricity pricing plays a critical role in shaping trade-offs between overall efficiency and fairness in benefit distribution. This exploratory study provides practical insights to support informed decision-making and the future development of LEC in Switzerland.

eess.SY↗

Joint Identification of Linear Dynamics and Noise Covariance via Distributional Estimation

In this paper, we propose a novel framework for the joint identification of system dynamics and noise covariance in linear systems, under general noise distributions beyond Gaussian. Specifically, we would like to simultaneously estimate the dynamical matrix $A$ and the noise covariance matrix $\varSigma$ using state transition data. The formulation builds upon a novel parameterization of the state-transition distribution, which enables more effective use of distributional "shape" information for improved identification accuracy. We introduce two practical estimators, namely the maximum likelihood estimator (MLE) and the score-matching estimator (SME), to solve the joint dynamics-covariance identification problem, and provide rigorous analysis of their statistical properties and sample complexity. Simulation results show that the proposed estimators outperform the ordinary least squares (OLS) baseline.

eess.SY↗

Analysis of molecular state ${η_cD^*}$ and ${J/ψD^*}$ in the effective Lagrangian approach

In this work, we investigate the production and decay of the molecular states $cc\bar c\bar q$ with $J^P=1^+$ using the phenomenological analysis and effective Lagrangian approach. Based on an SU(3) flavor symmetry analysis to identify golden channels, we further explore the dynamics of these processes under the molecular assumptions of ${η_c D^*}$ and ${J/ψD^*}$. Our results indicate that the production branching ratio from $B_c$ meson is sizable, it can reach the order of $10^{-4}$ for the molecular configuration ${η_cD^*}$, and $10^{-5}$ for molecule ${J/ψD^*}$. In addition, we find that the decay widths of the two molecular configurations ${η_cD^*}$ and ${J/ψD^*}$ are not significant, being at level of $\cal{O}$($\rm {MeV}$).

hep-ph↗

Perturb-and-Restore: Simulation-driven Structural Augmentation Framework for Imbalance Chromosomal Anomaly Detection

Detecting structural chromosomal abnormalities is crucial for accurate diagnosis and management of genetic disorders. However, collecting sufficient structural abnormality data is extremely challenging and costly in clinical practice, and not all abnormal types can be readily collected. As a result, deep learning approaches face significant performance degradation due to the severe imbalance and scarcity of abnormal chromosome data. To address this challenge, we propose a Perturb-and-Restore (P&R), a simulation-driven structural augmentation framework that effectively alleviates data imbalance in chromosome anomaly detection. The P&R framework comprises two key components: (1) Structure Perturbation and Restoration Simulation, which generates synthetic abnormal chromosomes by perturbing chromosomal banding patterns of normal chromosomes followed by a restoration diffusion network that reconstructs continuous chromosome content and edges, thus eliminating reliance on rare abnormal samples; and (2) Energy-guided Adaptive Sampling, an energy score-based online selection strategy that dynamically prioritizes high-quality synthetic samples by referencing the energy distribution of real samples. To evaluate our method, we construct a comprehensive structural anomaly dataset consisting of over 260,000 chromosome images, including 4,242 abnormal samples spanning 24 categories. Experimental results demonstrate that the P&R framework achieves state-of-the-art (SOTA) performance, surpassing existing methods with an average improvement of 8.92% in sensitivity, 8.89% in precision, and 13.79% in F1-score across all categories.

cs.CV↗

Monetizing Generative AI: YouTubers' Collective Knowledge on Earning from Generative AI Content

Generative Artificial Intelligence (GenAI) is reshaping creative labor by enabling the rapid production of text, images, and videos. On YouTube, creators are developing new ways to leverage these tools and share knowledge about how to pursue income through such strategies. However, little is known about what GenAI knowledge has been collectively constructed around monetizing GenAI as a community practice of acting both with and against algorithmically mediated platforms. We analyze 377 YouTube videos in which creators publicly promote workflows, revenue claims, and monetization strategies for GenAI-enabled content. Our analysis identifies ten shared use cases that frame AI-supported income opportunities, and examines how this GenAI knowledge repository embodies a collective effort to leverage platform infrastructures for monetization -- including advertising, direct sales, affiliate marketing, and revenue-sharing models. We further surface structural tensions in AI-mediated creative labor, including unverifiable income claims, content misappropriation, synthetic engagement practices, and shifting authorship norms. We conceptualize creators' collective understanding and adoption of GenAI in the context of monetizing creative labor, with implications for the design of creator-centered GenAI technologies and responsible platform policy.

cs.HC↗

Gate-tunable anisotropic Josephson diode effect in topological Dirac semimetal Cd$_3$As$_2$ nanowires

The intrinsic Josephson diode effect (JDE) has recently attracted considerable attention due to its sensitivity to broken symmetries in Josephson junctions, offering a powerful probe for uncovering hidden symmetry-breaking mechanisms in materials. The presence of higher-harmonic components in the current-phase relation, together with spin-orbital coupling, makes topological materials ideal platforms to explore this effect. In this work, we present a systematic study of the JDE in type-I topological Dirac semimetal Cd$_3$As$_2$ nanowire-based Josephson junctions. We observe a pronounced gate-tunable and highly anisotropic diode response under different magnetic-field orientations. By developing a comprehensive phenomenological model, we capture the angular dependence of the diode effect and, through temperature-dependent measurements, disentangle the respective contributions from bulk and topological surface states. Notably, anomalies in the temperature dependence of the diode efficiency reveal the coexistence of multiple transport channels, highlighting the Josephson diode effect as a sensitive probe of hidden topological superconducting states.

cond-mat.mes-hall↗

Data-Driven Bed Capacity Planning Using $M_t/G_t/\infty$ Queueing Models with an Application to Neonatal Intensive Care Units

Hospitals face challenges in long-term intensive care unit (ICU) capacity planning under uncertain demand. Admission rates fluctuate over time, and LOS distributions vary with patient heterogeneity, hospital location, case mix, and clinical practice. Common approaches rely on steady-state queueing models or heuristic rules with fixed parameters, which often fail to capture real occupancy dynamics. The widely used 85% occupancy rule, for example, recommends keeping average utilization below this level to preserve responsiveness, yet it is grounded in stationary assumptions and may lack resilience in time-varying systems. Our analysis shows that even when long-run utilization targets are satisfied, daily occupancy often exceeds 100% capacity. We propose a data-driven framework to estimate ICU bed occupancy using an $M_t/G_t/\infty$ queueing model with time-varying arrival rates and empirically fitted LOS distributions. The approach combines statistical decomposition and parametric fitting to capture temporal patterns in admissions and LOS, and is applied to multi-year data from neonatal ICUs (NICUs) in Calgary. We evaluate capacity scenarios including average-based thresholds and Poisson-based surge estimates. Results show that static heuristics are inadequate under fluctuating demand and underscore the importance of modeling LOS variability when estimating bed needs. Although the case study focuses on NICUs, the framework has potential applicability to other ICU settings and provides interpretable, data-informed support for systems facing rising demand and constrained capacity.

stat.AP↗

R1-Code-Interpreter: LLMs Reason with Code via Supervised and Multi-stage Reinforcement Learning

Practical guidance on training Large Language Models (LLMs) to leverage Code Interpreter across diverse tasks remains lacking. We present R1-Code-Interpreter, an extension of a text-only LLM trained via multi-turn supervised fine-tuning (SFT) and reinforcement learning (RL) to autonomously generate multiple code queries during step-by-step reasoning. Unlike prior RL + tool-use efforts focused on narrow domains such as math or retrieval, we curate 144 diverse reasoning and planning tasks and show that training a general-purpose Code Interpreter across them presents significant challenges due to task heterogeneity and scarcity of effective samples. To address this, we introduce a multi-stage curriculum learning approach that partitions training samples by measured improvement potential. The RL training prioritizes samples with higher potential and gradually shifts to lower-potential ones, increasing the average RL gains from merely +3.4% to +9.3% across Qwen-2.5 models (3/7/14B). Our final model, R1-CI-14B, improves average accuracy on the 37 test tasks from 44.1% to 72.4%, outperforming text-only GPT-4o (58.6%) and GPT-4o with Code Interpreter (70.9%). Notably, R1-CI-14B also exhibits emergent self-checking behavior through code generation. Datasets, Codes, and Models are available at https://github.com/yongchao98/R1-Code-Interpreter and https://huggingface.co/yongchao98.

cs.AI↗

TARDis: Time Attenuated Representation Disentanglement for Incomplete Multi-Modal Tumor Segmentation and Classification

The accurate diagnosis and segmentation of tumors in contrast-enhanced Computed Tomography (CT) are fundamentally driven by the distinctive hemodynamic profiles of contrast agents over time. However, in real-world clinical practice, complete temporal dynamics are often hard to capture by strict radiation dose limits and inconsistent acquisition protocols across institutions, leading to a prevalent missing modality problem. Existing deep learning approaches typically treat missing phases as absent independent channels, ignoring the inherent temporal continuity of hemodynamics. In this work, we propose Time Attenuated Representation Disentanglement (TARDis), a novel physics-aware framework that redefines missing modalities as missing sample points on a continuous Time-Attenuation Curve. We first hypothesize that the latent feature can be disentangled into a time-invariant static component (anatomy) and a time-dependent dynamic component (perfusion). We achieve this via a dual-path architecture: a quantization-based path using a learnable embedding dictionary to extract consistent anatomical structures, and a probabilistic path using a Hemodynamic Conditional Variational Autoencoder to model dynamic enhancement conditioned on the estimated scan time. This design allows the network to infer missing hemodynamic features by sampling from the learned latent distribution. Extensive experiments on a large-scale multi-modal private abdominal CT dataset (2,282 patients) and two public datasets demonstrate that TARDis significantly outperforms state-of-the-art incomplete modality frameworks. Notably, our method maintains robust diagnostic performance even in extreme data-sparsity scenarios, highlighting its potential for reducing radiation exposure while maintaining diagnostic precision.

cs.CV↗

Convergence Analysis of a Linear, Unconditionally Energy-Stable SAV Finite Element Method for the Cahn-Hilliard Equation

This paper proposes a finite element scheme, based on the Scalar Auxiliary Variable (SAV) approach, for the Cahn-Hilliard equation--a model that possesses significant physical relevance and a rich mathematical structure. A convergence analysis of the fully discrete scheme is conducted under suitable regularity assumptions, confirming optimal-order convergence in both time and space for the phase variable, chemical potential, and auxiliary variable in the H1-norm. Furthermore, the scheme is proven to be unconditionally energy stable. Finally, a numerical example is presented to demonstrate the effectiveness of the method and to confirm the theoretical convergence rates.

math.NA↗

The distinction of time-reversal-like degeneracy by electronic transport in a new compound

We report the discovery of a new compound, Ce$_3$MgBi$_5$, and reveal the hidden time-reversal-like degenerate states within it. Ce$_3$MgBi$_5$ is an antiferromagnet with the distorted kagome lattice of Ce atoms, in which several fractional magnetization plateaus emerge with the increase of magnetic field. At the 1/2 magnetization plateau, obvious hysteresis has been observed in the magnetoresistance and Hall resistivity during the rise and fall of the magnetic field. However, hysteresis vanishes in the corresponding measurements of magnetization, indicating the existence of degenerate states with the same net magnetization but different electronic transport properties. The degenerate states can be connected by the time-reversal-like operation. In addition, by comparing with HoAgGe, it is suggested that the special crystal structure in Ce$_3$MgBi$_5$ may have a shielding effect on the time-reversal-like operation, thereby affecting the distinction of degenerate states. Our work establishes Ce$_3$MgBi$_5$ as an example of utilizing electronic transport properties to identify and distinguish hidden symmetries in frustrated magnetic systems.

cond-mat.str-el↗

Spectral Ghost in Representation Learning: from Component Analysis to Self-Supervised Learning

Self-supervised learning (SSL) has improved empirical performance by unleashing the power of unlabeled data for practical applications. Specifically, SSL extracts the representation from massive unlabeled data, which will be transferred to a plenty of down streaming tasks with limited data. The significant improvement on diverse applications of representation learning has attracted increasing attention, resulting in a variety of dramatically different self-supervised learning objectives for representation extraction, with an assortment of learning procedures, but the lack of a clear and unified understanding. Such an absence hampers the ongoing development of representation learning, leaving a theoretical understanding missing, principles for efficient algorithm design unclear, and the use of representation learning methods in practice unjustified. The urgency for a unified framework is further motivated by the rapid growth in representation learning methods. In this paper, we are therefore compelled to develop a principled foundation of representation learning. We first theoretically investigate the sufficiency of the representation from a spectral representation view, which reveals the spectral essence of the existing successful SSL algorithms and paves the path to a unified framework for understanding and analysis. Such a framework work also inspires the development of more efficient and easy-to-use representation learning algorithms with principled way in real-world applications.

cs.LG↗

Human-AI Co-Embodied Intelligence for Scientific Experimentation and Manufacturing

Scientific experimentation and manufacturing rely on prolonged protocol development and complex, multi-step implementation, which require continuous human expertise for precise execution and decision-making, limiting interpretability and scalability. Here, we introduce human-artificial intelligence (AI) co-embodied intelligence, a new form of physical AI that unites human researchers, agentic AI, and wearable hardware. In this paradigm, humans provide precise execution, while agentic AI contributes contextual reasoning, adaptive planning, and analysis. The wearable interface continuously captures experimentation and manufacturing, facilitating seamless communication between humans and AI. We instantiate this paradigm in a microfabrication cleanroom, leading to the agentic-physical experimentation (APEX) system which understands fabrication procedure with accuracy 51% higher than state-of-the-art multimodal large language models/vision language models (LLMs/VLMs), detects and corrects fabrication errors in real-time, and transfers procedural expertise to novice users. Critically, APEX system enables the co-development of fabrication protocols in cleanrooms, overcoming the incompatibility of elastomeric materials in standard microfabrication processes and enabling previously unattainable fabrication outcomes, as demonstrated by the wafer-scale realization of brain-level soft neural probe capable of single-unit-resolution neural recording. These results establish the human-AI co-embodied intelligence that extends agentic reasoning beyond computation into the physical domain, transforming scientific experimentation and manufacturing into autonomous, traceable, interpretable and scalable processes.

cs.AI↗

Equilibrium Selection for Multi-agent Reinforcement Learning: A Unified Framework

While multi-agent reinforcement learning (MARL) has produced numerous algorithms that converge to Nash or related equilibria, such equilibria are often non-unique and can exhibit widely varying efficiency. This raises a fundamental question: how can one design learning dynamics that not only converge to equilibrium but also select equilibria with desirable performance, such as high social welfare? In contrast to the MARL literature, equilibrium selection has been extensively studied in normal-form games, where decentralized dynamics are known to converge to potential-maximizing or Pareto-optimal Nash equilibria (NEs). Motivated by these results, we study equilibrium selection in finite-horizon stochastic games. We propose a unified actor-critic framework in which a critic learns state-action value functions, and an actor applies a classical equilibrium-selection rule state-wise, treating learned values as stage-game payoffs. We show that, under standard stochastic stability assumptions, the stochastically stable policies of the resulting dynamics inherit the equilibrium selection properties of the underlying normal-form learning rule. As consequences, we obtain potential-maximizing policies in Markov potential games and Pareto-optimal (Markov perfect) equilibria in general-sum stochastic games, together with sample-based implementation of the framework.

cs.GT↗

Constrained Optimization From a Control Perspective via Feedback Linearization

Tools from control and dynamical systems have proven valuable for analyzing and developing optimization methods. In this paper, we establish rigorous theoretical foundations for using feedback linearization (FL) -- a well-established nonlinear control technique -- to solve constrained optimization problems. For equality-constrained optimization, we establish global convergence rates to first-order Karush-Kuhn-Tucker (KKT) points and uncover the close connection between the FL method and the Sequential Quadratic Programming (SQP) algorithm. Building on this relationship, we extend the FL approach to handle inequality-constrained problems. Furthermore, we introduce a momentum-accelerated feedback linearization algorithm and provide a rigorous convergence guarantee.

math.OC↗