Searcharxiv⌕ Search

arXiv subjects

Yifei Li

Publications and source records attributed to Yifei Li.

At least 91 records · Page 5Linked to original sources

Impact of Grid-Forming Inverters on Protective Relays: A Perspective for Current Limiting Control Design

Grid-forming (GFM) inverters can significantly alter the fault characteristics of power systems, which challenges the proper function of protective relays. This paper gives a holistic analysis of the interaction between GFM inverter-based resources (IBRs) and the supervising elements in protective relays, including directional and phase selection elements. It is revealed that the current limiting control (CLC) that is based on the current reference saturation method, adversely affects the performance of supervising elements that rely on the negative-sequence quantities. In contrast, adopting highly inductive virtual impedance in the CLC enables a reliable operation of such elements. This finding provides insights into the design of CLC for GFM IBRs from a protection perspective. It is further found that even with a highly inductive virtual impedance, the altered virtual impedance dynamics introduced by the CLC can still lead to malfunctions of the incremental quantity-based supervising elements. These theoretical findings are corroborated by simulations and controller hardware-in-the-loop (CHIL) tests.

eess.SY↗

A combinatorial proof of a symmetry for a refinement of the Narayana numbers

We establish a tantalizing symmetry of certain numbers refining the Narayana numbers. In terms of Dyck paths, this symmetry is interpreted in the following way: if $w_{n,k,m}$ is the number of Dyck paths of semilength $n$ with $k$ occurrences of $UD$ and $m$ occurrences of $UUD$, then $w_{2k+1,k,m}=w_{2k+1,k,k+1-m}$. We give a combinatorial proof of this fact, relying on the cycle lemma, and showing that the numbers $w_{2k+1,k,m}$ are multiples of the Narayana numbers. We prove a more general fact establishing a relationship between the numbers $w_{n,k,m}$ and a family of generalized Narayana numbers due to Callan. A closed-form expression for the even more general numbers $w_{n,k_{1},k_{2},\ldots , k_{r}}$ counting the semilength-$n$ Dyck paths with $k_{1}$ $UD$-factors, $k_{2}$ $UUD$-factors, $\ldots$ , and $k_{r}$ $U^{r}D$-factors is also obtained, as well as a more general form of the discussed symmetry for these numbers in the case when all rise runs are of certain minimal length. Finally, we investigate properties of the polynomials $W_{n,k}(t)= \sum_{m=0}^k w_{n,k,m} t^m$, including real-rootedness, $γ$-positivity, and a symmetric decomposition.

math.CO↗

A Protection-Interoperable Fault Ride-Through Control for Grid-Forming Inverters

Differing from synchronous generators (SGs), grid-forming inverter-based resources (GFM-IBRs) exhibit rapid variations in their output impedances during transmission line faults due to the overcurrent limitation. As a result, the source dynamics during the fault period deviate significantly from those under pre-fault conditions. This fundamental difference alters the fault responses of incremental quantities, thereby jeopardizing the reliability of the supervising elements in protective relays that are based on these quantities. To address this challenge, a protection-interoperable fault ride-through (FRT) method for GFM-IBRs is proposed. This method dynamically adjusts power control of GFM-IBRs in response to the changes in output impedance, effectively mitigating variations in source dynamics and thereby preserving the reliability of incremental quantity-based supervising elements. This method also ensures effective overcurrent limitation and transient stability of GFM-IBRs. Controller hardware-in-the-loop (CHIL) and experimental tests validate the effectiveness of the proposed method.

eess.SY↗

Wan: Open and Advanced Large-Scale Video Generative Models

This report presents Wan, a comprehensive and open suite of video foundation models designed to push the boundaries of video generation. Built upon the mainstream diffusion transformer paradigm, Wan achieves significant advancements in generative capabilities through a series of innovations, including our novel VAE, scalable pre-training strategies, large-scale data curation, and automated evaluation metrics. These contributions collectively enhance the model's performance and versatility. Specifically, Wan is characterized by four key features: Leading Performance: The 14B model of Wan, trained on a vast dataset comprising billions of images and videos, demonstrates the scaling laws of video generation with respect to both data and model size. It consistently outperforms the existing open-source models as well as state-of-the-art commercial solutions across multiple internal and external benchmarks, demonstrating a clear and significant performance superiority. Comprehensiveness: Wan offers two capable models, i.e., 1.3B and 14B parameters, for efficiency and effectiveness respectively. It also covers multiple downstream applications, including image-to-video, instruction-guided video editing, and personal video generation, encompassing up to eight tasks. Consumer-Grade Efficiency: The 1.3B model demonstrates exceptional resource efficiency, requiring only 8.19 GB VRAM, making it compatible with a wide range of consumer-grade GPUs. Openness: We open-source the entire series of Wan, including source code and all models, with the goal of fostering the growth of the video generation community. This openness seeks to significantly expand the creative possibilities of video production in the industry and provide academia with high-quality video foundation models. All the code and models are available at https://github.com/Wan-Video/Wan2.1.

cs.CV↗

Analysis of Power Swing Characteristics of Grid-Forming VSC System Considering the Current Limitation Mode

This paper investigates power swing characteristics of grid-forming voltage source converter (GFM-VSC) systems considering the current limitation mode in both non-inertial and inertial GFM-VSC systems. Following grid faults, non-inertial GFM-VSC systems can re-synchronize with the grid but may experience significant power swings driven by its control dynamics, while inertial GFM-VSC systems may exhibit loss of synchronization (LOS), characterized by the divergence of the output angle in the active power control loop. These behaviours are different from conventional synchronous generator (SG)-based systems, where power swings are typically characterized by physical angle deviations among power sources. Based on these findings, this paper explores the performance of traditional impedance-based swing detection schemes in GFM-VSC systems. The theoretical analysis is validated through various simulations using the PSCAD/EMTDC platform, covering both single and multi-machine system scenarios.

eess.SY↗

ADMM Algorithms for Residual Network Training: Convergence Analysis and Parallel Implementation

We propose both serial and parallel proximal (linearized) alternating direction method of multipliers (ADMM) algorithms for training residual neural networks. In contrast to backpropagation-based approaches, our methods inherently mitigate the exploding gradient issue and are well-suited for parallel and distributed training through regional updates. Theoretically, we prove that the proposed algorithms converge at an R-linear (sublinear) rate for both the iteration points and the objective function values. These results hold without imposing stringent constraints on network width, depth, or training data size. Furthermore, we theoretically analyze our parallel/distributed ADMM algorithms, highlighting their reduced time complexity and lower per-node memory consumption. To facilitate practical deployment, we develop a control protocol for parallel ADMM implementation using Python's multiprocessing and interprocess communication. Experimental results validate the proposed ADMM algorithms, demonstrating rapid and stable convergence, improved performance, and high computational efficiency. Finally, we highlight the improved scalability and efficiency achieved by our parallel ADMM training strategy.

cs.LG↗

ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery

The advancements of large language models (LLMs) have piqued growing interest in developing LLM-based language agents to automate scientific discovery end-to-end, which has sparked both excitement and skepticism about their true capabilities. In this work, we call for rigorous assessment of agents on individual tasks in a scientific workflow before making bold claims on end-to-end automation. To this end, we present ScienceAgentBench, a new benchmark for evaluating language agents for data-driven scientific discovery. To ensure the scientific authenticity and real-world relevance of our benchmark, we extract 102 tasks from 44 peer-reviewed publications in four disciplines and engage nine subject matter experts to validate them. We unify the target output for every task to a self-contained Python program file and employ an array of evaluation metrics to examine the generated programs, execution results, and costs. Each task goes through multiple rounds of manual validation by annotators and subject matter experts to ensure its annotation quality and scientific plausibility. We also propose two effective strategies to mitigate data contamination concerns. Using ScienceAgentBench, we evaluate five open-weight and proprietary LLMs, each with three frameworks: direct prompting, OpenHands CodeAct, and self-debug. Given three attempts for each task, the best-performing agent can only solve 32.4% of the tasks independently and 34.3% with expert-provided knowledge. In addition, we evaluate OpenAI o1-preview with direct prompting and self-debug, which can boost the performance to 42.2%, demonstrating the effectiveness of increasing inference-time compute but with more than 10 times the cost of other LLMs. Still, our results underscore the limitations of current language agents in generating code for data-driven discovery, let alone end-to-end automation for scientific research.

cs.CL↗

OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?

Temporal Awareness, the ability to reason dynamically based on the timestamp when a question is raised, is the key distinction between offline and online video LLMs. Unlike offline models, which rely on complete videos for static, post hoc analysis, online models process video streams incrementally and dynamically adapt their responses based on the timestamp at which the question is posed. Despite its significance, temporal awareness has not been adequately evaluated in existing benchmarks. To fill this gap, we present OVO-Bench (Online-VideO-Benchmark), a novel video benchmark that emphasizes the importance of timestamps for advanced online video understanding capability benchmarking. OVO-Bench evaluates the ability of video LLMs to reason and respond to events occurring at specific timestamps under three distinct scenarios: (1) Backward tracing: trace back to past events to answer the question. (2) Real-time understanding: understand and respond to events as they unfold at the current timestamp. (3) Forward active responding: delay the response until sufficient future information becomes available to answer the question accurately. OVO-Bench comprises 12 tasks, featuring 644 unique videos and approximately human-curated 2,800 fine-grained meta-annotations with precise timestamps. We combine automated generation pipelines with human curation. With these high-quality samples, we further developed an evaluation pipeline to systematically query video LLMs along the video timeline. Evaluations of nine Video-LLMs reveal that, despite advancements on traditional benchmarks, current models struggle with online video understanding, showing a significant gap compared to human agents. We hope OVO-Bench will drive progress in video LLMs and inspire future research in online video reasoning. Our benchmark and code can be accessed at https://github.com/JoeLeelyf/OVO-Bench.

cs.CV↗

Universal Lesion Segmentation Challenge 2023: A Comparative Research of Different Algorithms

In recent years, machine learning algorithms have achieved much success in segmenting lesions across various tissues. There is, however, not one satisfying model that works well on all tissue types universally. In response to this need, we attempt to train a model that 1) works well on all tissue types, and 2) is capable of still performing fast inferences. To this end, we design our architectures, test multiple existing architectures, compare their results, and settle upon SwinUnet. We document our rationales, successes, and failures. Finally, we propose some further directions that we think are worth exploring. codes: https://github.com/KWFredShi/ULS2023NGKD.git

cs.CV↗

A structure-preserving parametric finite element method with optimal energy stability condition for anisotropic surface diffusion

We propose and analyze a structure-preserving parametric finite element method (SP-PFEM) for the evolution of closed curves under anisotropic surface diffusion with surface energy density $\hatγ(θ)$. Our primary theoretical contribution establishes that the condition $3\hatγ(θ)-\hatγ(θ-π)\geq 0$ is both necessary and sufficient for unconditional energy stability within the framework of local energy estimates. The proposed method introduces a symmetric surface energy matrix $\hat{\boldsymbol{Z}}_k(θ)$ with a stabilizing function $k(θ)$, leading to a conservative weak formulation. Its fully discretization via SP-PFEM rigorously preserves the two geometric structures: enclosed area conservation and energy dissipation unconditionally under our energy stability condition. Numerical results are reported to demonstrate the efficiency and accuracy of the proposed method, along with its area conservation and energy dissipation properties.

math.NA↗

Static Batching of Irregular Workloads on GPUs: Framework and Application to Efficient MoE Model Inference

It has long been a problem to arrange and execute irregular workloads on massively parallel devices. We propose a general framework for statically batching irregular workloads into a single kernel with a runtime task mapping mechanism on GPUs. We further apply this framework to Mixture-of-Experts (MoE) model inference and implement an optimized and efficient CUDA kernel. Our MoE kernel achieves up to 91% of the peak Tensor Core throughput on NVIDIA H800 GPU and 95% on NVIDIA H20 GPU.

cs.DC↗

RadiK: Scalable and Optimized GPU-Parallel Radix Top-K Selection

Top-k selection, which identifies the largest or smallest k elements from a data set, is a fundamental operation in data-intensive domains such as databases and deep learning, so its scalability and efficiency are critical for these high-performance systems. However, previous studies on its efficient GPU implementation are mostly merge-based and rely heavily on the fast but size-limited on-chip memory, thereby limiting the scalability with a restricted upper bound on k. This work introduces a scalable and optimized GPU-parallel radix top-k selection that supports significantly larger k values than existing methods without compromising efficiency, regardless of input length and batch size. Our method incorporates a novel optimization framework tailored for high memory bandwidth and resource utilization, achieving up to 2.5x speedup over the prior art for non-batch queries and up to 4.8x speedup for batch queries. In addition, we propose an adaptive scaling technique that strengthens the robustness, which further provides up to 2.7x speedup on highly adversarial input distributions.

cs.DS↗

Timestamp calibration for time-series single cell RNA-seq expression data

Timestamp automatic annotation (TAA) is a crucial procedure for analyzing time-series ScRNA-seq data, as they unveil dynamic biological developments and cell regeneration process. However, current TAA methods heavily rely on manual timestamps, often overlooking their reliability. This oversight can significantly degrade the performance of timestamp automatic annotation due to noisy timestamps. Nevertheless, the current approach for addressing this issue tends to select less critical cleaned samples for timestamp calibration. To tackle this challenge, we have developed a novel timestamp calibration model called ScPace for handling noisy labeled time-series ScRNA-seq data. This approach incorporates a latent variable indicator within a base classifier instead of probability sampling to detect noisy samples effectively. To validate our proposed method, we conducted experiments on both simulated and real time-series ScRNA-seq datasets. Cross-validation experiments with different artificial mislabeling rates demonstrate that ScPace outperforms previous approaches. Furthermore, after calibrating the timestamps of the original time-series ScRNA-seq data using our method, we performed supervised pseudotime analysis, revealing that ScPace enhances its performance significantly. These findings suggest that ScPace is an effective tool for timestamp calibration by enabling reclassification and deletion of detected noisy labeled samples while maintaining robustness across diverse ranges of time-series ScRNA-seq datasets. The source code is available at https://github.com/OPUS-Lightphenexx/ScPace.

q-bio.GN↗

Photon-Number Conserved Universal Quantum Logic Employing Continuous-Time Quantum Walk on Dual-Rail Qubit Arrays

We demonstrate a synergy between dual-rail qubit encoding and continuous-time quantum walks (CTQW) to realize universal quantum logic in superconducting circuits. Utilizing the photon-number-conserving dynamics of CTQW on dual-rail transmons, which systematically transform leakage and relaxation into erasure events, our architecture facilitates the suppression of population leakage and the implementation of high-fidelity quantum gates. We construct single-, two-, and three-qubit operations that preserve dual-rail encoding, facilitated by tunable coupler strengths compatible with current superconducting qubit platforms. Numerical simulations confirm robust behavior against dephasing, relaxation, and imperfections in coupling, underscoring the erasure-friendly nature of the system. This hardware-efficient scheme thus provides a practical pathway to early fault-tolerant quantum computation.

quant-ph↗

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

Creating AI systems that can interact with environments over long periods, similar to human cognition, has been a longstanding research goal. Recent advancements in multimodal large language models (MLLMs) have made significant strides in open-world understanding. However, the challenge of continuous and simultaneous streaming perception, memory, and reasoning remains largely unexplored. Current MLLMs are constrained by their sequence-to-sequence architecture, which limits their ability to process inputs and generate responses simultaneously, akin to being unable to think while perceiving. Furthermore, relying on long contexts to store historical data is impractical for long-term interactions, as retaining all information becomes costly and inefficient. Therefore, rather than relying on a single foundation model to perform all functions, this project draws inspiration from the concept of the Specialized Generalist AI and introduces disentangled streaming perception, reasoning, and memory mechanisms, enabling real-time interaction with streaming video and audio input. The proposed framework InternLM-XComposer2.5-OmniLive (IXC2.5-OL) consists of three key modules: (1) Streaming Perception Module: Processes multimodal information in real-time, storing key details in memory and triggering reasoning in response to user queries. (2) Multi-modal Long Memory Module: Integrates short-term and long-term memory, compressing short-term memories into long-term ones for efficient retrieval and improved accuracy. (3) Reasoning Module: Responds to queries and executes reasoning tasks, coordinating with the perception and memory modules. This project simulates human-like cognition, enabling multimodal large language models to provide continuous and adaptive service over time.

cs.CV↗

Classic Round-Up Variant of Fast Unsigned Division by Constants: Algorithm and Full Proof

Integer division instruction is generally expensive in most architectures. If the divisor is constant, the division can be transformed into combinations of several inexpensive integer instructions. This article discusses the classic round-up variant of the fast unsigned division by constants algorithm, and provides full proof of its correctness and feasibility. Additionally, a simpler variant for bounded dividends is presented.

cs.DS↗

Lattice-based stochastic models motivate non-linear diffusion descriptions of memory-based dispersal

The role of memory and cognition in the movement of individuals (e.g. animals) within a population, is thought to play an important role in population dispersal. In response, there has been increasing interest in incorporating spatial memory effects into classical partial differential equation (PDE) models of animal dispersal. However, the specific detail of the transport terms, such as diffusion and advection terms, that ought to be incorporated into PDE models to accurately reflect the memory effect remains unclear. To bridge this gap, we propose a straightforward lattice-based model where the movement of individuals depends on both crowding effects and the historic distribution within the simulation. The advantage of working with the individual-based model is that it is straightforward to propose and implement memory effects within the simulation in a way that is more biologically intuitive than simply proposing heuristic extensions of classical PDE models. Through deriving the continuum limit description of our stochastic model, we obtain a novel nonlinear diffusion equation which encompasses memory-based diffusion terms. For the first time we reveal the relationship between memory-based diffusion and the individual-based movement mechanisms that depend upon memory effects. Through repeated stochastic simulation and numerical explorations of the mean-field PDE model, we show that the new PDE model accurately describes the expected behaviour of the stochastic model, and we also explore how memory effects impact population dispersal.

q-bio.PE↗

Automating Exploratory Proteomics Research via Language Models

With the development of artificial intelligence, its contribution to science is evolving from simulating a complex problem to automating entire research processes and producing novel discoveries. Achieving this advancement requires both specialized general models grounded in real-world scientific data and iterative, exploratory frameworks that mirror human scientific methodologies. In this paper, we present PROTEUS, a fully automated system for scientific discovery from raw proteomics data. PROTEUS uses large language models (LLMs) to perform hierarchical planning, execute specialized bioinformatics tools, and iteratively refine analysis workflows to generate high-quality scientific hypotheses. The system takes proteomics datasets as input and produces a comprehensive set of research objectives, analysis results, and novel biological hypotheses without human intervention. We evaluated PROTEUS on 12 proteomics datasets collected from various biological samples (e.g. immune cells, tumors) and different sample types (single-cell and bulk), generating 191 scientific hypotheses. These were assessed using both automatic LLM-based scoring on 5 metrics and detailed reviews from human experts. Results demonstrate that PROTEUS consistently produces reliable, logically coherent results that align well with existing literature while also proposing novel, evaluable hypotheses. The system's flexible architecture facilitates seamless integration of diverse analysis tools and adaptation to different proteomics data types. By automating complex proteomics analysis workflows and hypothesis generation, PROTEUS has the potential to considerably accelerate the pace of scientific discovery in proteomics research, enabling researchers to efficiently explore large-scale datasets and uncover biological insights.

cs.AI↗