SearcharxivSearch

arXiv subjects

Fangzhou Ai

Publications and source records attributed to Fangzhou Ai.

10 recordsLinked to original sources

Avatar-Forever: Decoupled Parallel Training for High-Quality Real-Time Infinite Avatars

Existing streaming video systems often rely on sequential, distillation-centered training pipelines to enable few-step long-video generation. However, this paradigm suffers from two limitations. First, failures or distribution shifts introduced in earlier stages affect later optimization, complicating the training process to converge. Second, the distillation-centric objective favours short-term generation but is prone to quality degradation when autoregressive errors accumulate over long rollouts. We propose Avatar-Forever, a decoupled parallel training framework for high-quality real-time infinite interactive avatars. Instead of coupling generation efficiency and long-horizon robustness under a sequential distillation pipeline, we treat them as two independent capabilities that can be trained in parallel. One branch performs full-parameter distillation to train an efficient generator with high visual quality, while another trains a lightweight long-horizon adapter via Recovery-oriented Rollout Training (RRT), which improves generation robustness under long-horizon inference conditions. Our decoupled parallel training design simplifies the overall training process and avoids unnecessary objective conflicts between few-step generation and long-horizon adaptation. We further introduce ForeverCache, a chunk-wise feature caching mechanism to substantially reduce redundant history computation during streaming inference. Built upon a 22B video foundation model, Avatar-Forever supports unbounded audio-driven avatar generation while maintaining identity consistency, motion coherence, and visual fidelity, enabling an end-to-end throughput of high-resolution 768x512 videos at 27.2 FPS on a single H100 GPU and providing a practical path toward stable digital humans.

cs.CV

Long-Horizon Streaming Video Generation via Hybrid Attention with Decoupled Distillation

Streaming video generation (SVG) distills a pretrained bidirectional video diffusion model into an autoregressive model equipped with sliding window attention (SWA). However, SWA inevitably loses distant history during long video generation, and its computational overhead remains a critical challenge to real-time deployment. In this work, we propose Hybrid Forcing, which jointly optimizes temporal information retention and computational efficiency through a hybrid attention design. First, we introduce lightweight linear temporal attention to preserve long-range dependencies beyond the sliding window. In particular, we maintain a compact key-value state to incrementally absorb evicted tokens, retaining temporal context with negligible memory and computational overhead. Second, we incorporate block-sparse attention into the local sliding window to reduce redundant computation within short-range modeling, reallocating computational capacity toward more critical dependencies. Finally, we introduce a decoupled distillation strategy tailored to the hybrid attention design. A few-step initial distillation is performed under dense attention, then the distillation of our proposed linear temporal and block-sparse attention is activated for streaming modeling, ensuring stable optimization. Extensive experiments on both short- and long-form video generation benchmarks demonstrate that Hybrid Forcing consistently achieves state-of-the-art performance. Notably, our model achieves real-time, unbounded 832x480 video generation at 29.5 FPS on a single NVIDIA H100 GPU without quantization or model compression. The source code and trained models are available at https://github.com/leeruibin/hybrid-forcing.

cs.CV

Periodic phase diagrams in micromagnetics with an eigenvalue solver

This work introduces an approach to compute periodic phase diagram of micromagnetic systems by solving a periodic linearized Landau-Lifshitz-Gilbert (LLG) equation using an eigenvalue solver with the Finite Element Method formalism. The linear operator in the eigenvalue problem is defined as a function of the periodic phase shift wave vector. The dispersion diagrams are obtained by solving the eigenvalue problem for complex eigen frequencies and corresponding eigen states for a range of prescribed wave vectors. The presented approach incorporates a calculation of the periodic effective field, including the exchange and magnetostatic field components. The approach is general in that it allows handling 3D problems with any 1D, 2D, and 3D periodicities. The ability to calculated periodic diagrams provides insights into the spin wave propagation and localized resonances in complex micromagnetic structures.

cond-mat.mtrl-sci

Periodic micromagnetic finite element method

Periodic micromagnetic finite element method (PM-FEM) is introduced to solve periodic unit cell problems using the Landau-Lifshitz-Gilbert equation. PM-FEM is applicable to general problems with 1D, 2D, and 3D periodicities. PM-FEM is based on a non-periodic FEM-based micromagnetic solver and extends it in several aspects to account for periodicities, including the computation of exchange and magnetostatic fields. For the exchange field, PM-FEM modifies the sparse matrix construction for computing the Laplace operator to include additional elements arising due to the periodicities. For the magnetostatic field, the periodic extensions include modifications in the local operators, such as gradient, divergence, and surface magnetic charges as well as the long-range superposition operator for computing the periodic scalar potential. The local operators are extended to account for the periodicities similar to handling the Laplace operator. For the long-range superposition operator, PM-FEM utilizes a periodic Green's function (PGF) and fast spatial convolutions. The PGF is computed rapidly via exponentially rapidly convergent sums. The spatial convolutions are accomplished via a modified fast Fourier transform based adaptive integral method that allows calculating spatial convolutions with non-uniform meshes in $O(N\log N)$ numerical operations. PM-FEM is implemented on CPU and GPU based computer architectures. PM-FEM allows efficiently handling cases of structures contained withing the periodic unit cell touching or not touching its boundaries as well as structures that protrude beyond the unit cell boundaries. PM-FEM is demonstrated to have about the same or even higher performance than its parent non-periodic code. The demonstrated numerical examples show the efficiency of PM-FEM for highly complex structures with 1D, 2D, and 3D periodicities.

math.NA

Spin-wave assisted synchronization in 2D arrays of spin torque oscillators

Synchronization of coupled oscillators is a fundamental phenomenon that has been observed in many natural and engineered systems, ranging from biological cells to electronic circuits. In recent years, spin torque nano-oscillators (STNOs) have emerged as a promising platform for a variety of applications in nanoscale systems such as neuromorphic computing, due to their compact size, low power consumption, and tunable properties. However, achieving synchronization in a large array of STNOs remains a challenge, for the complexity of the interactions between the oscillators. To address this challenge, we report on the achievement of synchronization across a 2D array of STNOs. We designed a honeycomb model that created a network of interactions among the oscillators that only involved nearest neighbors. Using micromagnetic simulations, we demonstrated the effectiveness of our design and observed that global synchronization across the whole array. Such global synchronization can also be tuned by enable/disenable next-nearest neighbor interactions. We also found that our design enables synchronization at room temperature, which is crucial for practical applications. Our work contributes to the growing body of research on the synchronization of coupled oscillators in spintronics and could pave the way for the development of new types of spintronic devices and potential applications.

cond-mat.mes-hall

Fast Fourier Transform periodic interpolation method for superposition sums in a periodic unit cell

We propose a Fast Fourier Transform based Periodic Interpolation Method (FFT-PIM), a flexible and computationally efficient approach for computing the scalar potential given by a superposition sum in a unit cell of an infinitely periodic array. Under the same umbrella, FFT-PIM allows computing the potential for 1D, 2D, and 3D periodicities for dynamic and static problems, including problems with and without a periodic phase shift. The computational complexity of the FFT-PIM is of $O(N \log N)$ for $N$ spatially coinciding sources and observer points. The FFT-PIM uses rapidly converging series representations of the Green's function serving as a kernel in the superposition sum. Based on these representations, the FFT-PIM splits the potential into its near-zone component, which includes a small number of images surrounding the unit cell of interest, and far-zone component, which includes the rest of an infinite number of images. The far-zone component is evaluated by projecting the non-uniform sources onto a sparse uniform grid, performing superposition sums on this sparse grid, and interpolating the potential from the uniform grid to the non-uniform observation points. The near-zone component is evaluated using an FFT-based method, which is adapted to efficiently handle non-uniform source-observer distributions within the periodic unit cell. The FFT-PIM can be used for a broad range of applications, such as periodic problems involving integral equations in computational electromagnetic and acoustic, micromagnetic solvers, and density functional theory solvers.

math.NA

Real time 3D coherent X-ray diffraction imaging

Coherent X-ray Diffraction Imaging (CXDI) technique offers unique insights into the nanoscale world, enabling the reconstruction of 3D structures with a nanoscale resolution achieved through computational phase reconstruction from measured scattered intensity maps. Computational demands of 3D CXDI, however, limit its real-time application in experimental settings. This work presents a carousel phase retrieval algorithm (CPRA) that enables the real-time, high-resolution reconstruction of computationally complex 3D objects. CPRA is based on representing the 3D reconstruction problem as a set of 2D reconstructions of projected images corresponding to different experimentally collected angles via the Fourier slice theorem. Consistency between the 2D reconstructed images is based on an iterative procedure, in which each 2D reconstruction accounts for the adjacent 2D reconstructed images in a periodic (carousel) manner. Demonstrations on complex systems, including a lithium-rich layered oxide particle and a Staphylococcus aureus biological cell, demonstrate that CPRA significantly enhances the reconstruction quality and enables the reconstruction process to be completed in real time during experiment.

physics.comp-ph

A Self-enhancement Approach for Domain-specific Chatbot Training via Knowledge Mining and Digest

Large Language Models (LLMs), despite their great power in language generation, often encounter challenges when dealing with intricate and knowledge-demanding queries in specific domains. This paper introduces a novel approach to enhance LLMs by effectively extracting the relevant knowledge from domain-specific textual sources, and the adaptive training of a chatbot with domain-specific inquiries. Our two-step approach starts from training a knowledge miner, namely LLMiner, which autonomously extracts Question-Answer pairs from relevant documents through a chain-of-thought reasoning process. Subsequently, we blend the mined QA pairs with a conversational dataset to fine-tune the LLM as a chatbot, thereby enriching its domain-specific expertise and conversational capabilities. We also developed a new evaluation benchmark which comprises four domain-specific text corpora and associated human-crafted QA pairs for testing. Our model shows remarkable performance improvement over generally aligned LLM and surpasses domain-adapted models directly fine-tuned on domain corpus. In particular, LLMiner achieves this with minimal human intervention, requiring only 600 seed instances, thereby providing a pathway towards self-improvement of LLMs through model-synthesized training data.

cs.CL

Projective Quasiparticle Interference of a Single Scatterer to Analyze the Electronic Band Structure of ZrSiS

Quasiparticle interference (QPI) of the electronic states has been widely applied in scanning tunneling microscopy (STM) to analyze the electronic band structure of materials. Single-defect induced QPI reveals defect-dependent interaction between a single atomic defect and electronic states, which deserves special attention. Due to the weak signal of single-defect-induced QPI, the signal-to-noise ratio (SNR) is relatively low in a standard two-dimensional QPI measurement. In this paper, we introduce a projective quasiparticle interference (PQPI) method, in which a one-dimensional measurement is taken along high-symmetry directions centered on a specified defect. We apply the PQPI method to a topological nodal-line semimetal ZrSiS. We focus on two special types of atomic defects that scatter the surface and bulk electronic bands. With enhanced SNR in PQPI, the energy dispersions are clearly resolved along high symmetry directions. We discuss the defect-dependent scattering of bulk bands with the non-symmorphic symmetry-enforced selection rules. Furthermore, an energy shift of the surface floating band is observed and a new branch of energy dispersion (q6) is resolved. This PQPI method can be applied to other complex materials to explore defect-dependent interactions in the future.

cond-mat.mtrl-sci

The study of intrinsic defect state of FeSe with scanning tunneling microscopy

We apply high resolution scanning tunneling microscopy to study intrinsic defect states of bulk FeSe. Four types of intrinsic defects including the type I dumbbell, type II dumbbell, top-layer Se vacancy and inner-layer Se-site defect are extensively analyzed by scanning tunneling spectroscopy. From characterized depression and enhancement of density of states measured in a large energy range, the type I dumbbell and type II dumbbell are determined to be the Fe vacancy and Se$_\mathrm{Fe}$ defect, respectively. The top-layer Se vacancy and possible inner-layer Se-site vacancy are also determined by spectroscopy analysis. The determination of defects are compared and largely confirmed in the annular dark-field scanning transmission electron microscopy measurement of the exfoliated FeSe. The detailed mapping of defect states in our experiment lays the foundation for a comparison with complex theoretical calculations in the future.

cond-mat.supr-con