Searcharxiv⌕ Search

arXiv subjects

Wei Li

Publications and source records attributed to Wei Li.

At least 361 records · Page 20Linked to original sources

Towards Large-Spin Effective Theory I: Three-Particle States in AdS $ϕ^4$ Theory

We describe how to construct an effective Hamiltonian for leading twist states in $d\ge 3$ CFTs based on the separation of scales that emerges at large spin $J$ between the AdS radius $\ell_{\rm AdS}$ and the characteristic distance $\sim \ell_{\rm AdS} \log J$ between particles rotating in AdS with angular momentum $J$. As a controlled example, we work specifically with the toy model of a bulk complex scalar field $ϕ$ with a $λ|ϕ|^4$ coupling in AdS, up to $O(λ^2)$. For a given choice of twist cutoff $Λ_τ$ in the effective theory, interactions are separated into long-distance nonlocal potential terms, arising from $t$-channel exchange of states with twist $\le Λ_τ$, and short-distance local terms fixed by matching to low spin CFT data. At $O(λ^2)$, the effective Hamiltonian for the toy model has two-body nonlocal potential terms from one-loop bulk diagrams as well as three-body nonlocal potential terms from tree-level exchange of $ϕ$. We describe in detail how these contributions are evaluated and how they are related to the CFT data entering in the large spin expansion. We discuss how to apply the construction of such effective Hamiltonians for models which do not have a large central charge or a sparse spectrum and are not typically considered holographic.

hep-th↗

Towards Large-Spin Effective Theory II: $O(2)$ model in $d=4-ε$

We show how to construct a holographic effective theory for the leading-twist operators in the $O(2)$ model in the $4-d=ε$ expansion up to $O(ε^2)$, based on the separation of short-distance and long-distance effects that arises as a function of spin $J$. We obtain the Hamiltonian of the theory and show that it correctly reproduces all the dimensions at $O(ε^2)$ of the leading twist operators for all values of the charge $Q$ and spin $J$. The holographic Hamiltonian is given by the bulk exchange of a charged scalar $ϕ$, neutral scalar $s \sim ϕϕ^*$, and a `ghost' field $c$, as well as a single local bulk interaction $(ϕϕ^*)^2$. We analyze various aspects of the spectrum and discuss their interpretation in light of the bulk description.

hep-th↗

OpenHuEval: Evaluating Large Language Model on Hungarian Specifics

We introduce OpenHuEval, the first benchmark for LLMs focusing on the Hungarian language and specifics. OpenHuEval is constructed from a vast collection of Hungarian-specific materials sourced from multiple origins. In the construction, we incorporated the latest design principles for evaluating LLMs, such as using real user queries from the internet, emphasizing the assessment of LLMs' generative capabilities, and employing LLM-as-judge to enhance the multidimensionality and accuracy of evaluations. Ultimately, OpenHuEval encompasses eight Hungarian-specific dimensions, featuring five tasks and 3953 questions. Consequently, OpenHuEval provides the comprehensive, in-depth, and scientifically accurate assessment of LLM performance in the context of the Hungarian language and its specifics. We evaluated current mainstream LLMs, including both traditional LLMs and recently developed Large Reasoning Models. The results demonstrate the significant necessity for evaluation and model optimization tailored to the Hungarian language and specifics. We also established the framework for analyzing the thinking processes of LRMs with OpenHuEval, revealing intrinsic patterns and mechanisms of these models in non-English languages, with Hungarian serving as a representative example. We will release OpenHuEval at https://github.com/opendatalab/OpenHuEval .

cs.CL↗

Enhancing DSMC simulations of rarefied gas mixtures using a fast-converging and asymptotic-preserving scheme

The numerical simulation of rarefied gas mixture dynamics with disparate masses using the direct simulation Monte Carlo (DSMC) method is slow, primarily because the time step is constrained by that of the lighter species, necessitating an enormous number of evolution steps to reach a steady state. Here, we address this issue by developing a general synthetic iterative scheme, in which the traditional DSMC simulation is intermittently enhanced using a macroscopic synthetic equation. Specifically, after running the DSMC for a certain number of time steps, the high-order constitutive relations for stress and heat flux, as well as the momentum and energy exchange terms from inter-species collisions, are extracted from the DSMC and incorporated into the macroscopic synthetic equations. These equations are solved to obtain the steady state, and the solution is then used to update the particle distribution in DSMC, thereby skipping unnecessary intermediate evolutions. This two-way coupling not only accelerates convergence to the steady state but also asymptotically preserves the Navier-Stokes limit in the continuum flow regime, allowing the spatial cell size to be much larger than the molecular mean free path. The accuracy of our method is validated for one-dimensional force-driven Poiseuille flow and two-dimensional hypersonic flow past cylinders, considering Maxwell and hard-sphere gases with mass ratios of 10 and 100. Although our in-house DSMC method is approximately an order of magnitude slower than the open-source DSMC code SPARTA, intermittently augmenting it with the synthetic equation makes it roughly 30 times faster at a Knudsen number of 0.01, with even greater computational gains anticipated at smaller Knudsen numbers. This work represents a critical step toward developing fast-converging and asymptotic-preserving schemes for hypersonic chemical reactions.

physics.flu-dyn↗

JCo-MVTON: Jointly Controllable Multi-Modal Diffusion Transformer for Mask-Free Virtual Try-on

Virtual try-on systems have long been hindered by heavy reliance on human body masks, limited fine-grained control over garment attributes, and poor generalization to real-world, in-the-wild scenarios. In this paper, we propose JCo-MVTON (Jointly Controllable Multi-Modal Diffusion Transformer for Mask-Free Virtual Try-On), a novel framework that overcomes these limitations by integrating diffusion-based image generation with multi-modal conditional fusion. Built upon a Multi-Modal Diffusion Transformer (MM-DiT) backbone, our approach directly incorporates diverse control signals -- such as the reference person image and the target garment image -- into the denoising process through dedicated conditional pathways that fuse features within the self-attention layers. This fusion is further enhanced with refined positional encodings and attention masks, enabling precise spatial alignment and improved garment-person integration. To address data scarcity and quality, we introduce a bidirectional generation strategy for dataset construction: one pipeline uses a mask-based model to generate realistic reference images, while a symmetric ``Try-Off'' model, trained in a self-supervised manner, recovers the corresponding garment images. The synthesized dataset undergoes rigorous manual curation, allowing iterative improvement in visual fidelity and diversity. Experiments demonstrate that JCo-MVTON achieves state-of-the-art performance on public benchmarks including DressCode, significantly outperforming existing methods in both quantitative metrics and human evaluations. Moreover, it shows strong generalization in real-world applications, surpassing commercial systems.

cs.CV↗

Intern-S1: A Scientific Multimodal Foundation Model

In recent years, a plethora of open-source foundation models have emerged, achieving remarkable progress in some widely attended fields, with performance being quite close to that of closed-source models. However, in high-value but more challenging scientific professional fields, either the fields still rely on expert models, or the progress of general foundation models lags significantly compared to those in popular areas, far from sufficient for transforming scientific research and leaving substantial gap between open-source models and closed-source models in these scientific domains. To mitigate this gap and explore a step further toward Artificial General Intelligence (AGI), we introduce Intern-S1, a specialized generalist equipped with general understanding and reasoning capabilities with expertise to analyze multiple science modal data. Intern-S1 is a multimodal Mixture-of-Experts (MoE) model with 28 billion activated parameters and 241 billion total parameters, continually pre-trained on 5T tokens, including over 2.5T tokens from scientific domains. In the post-training stage, Intern-S1 undergoes offline and then online reinforcement learning (RL) in InternBootCamp, where we propose Mixture-of-Rewards (MoR) to synergize the RL training on more than 1000 tasks simultaneously. Through integrated innovations in algorithms, data, and training systems, Intern-S1 achieved top-tier performance in online RL training. On comprehensive evaluation benchmarks, Intern-S1 demonstrates competitive performance on general reasoning tasks among open-source models and significantly outperforms open-source models in scientific domains, surpassing closed-source state-of-the-art models in professional tasks, such as molecular synthesis planning, reaction condition prediction, predicting thermodynamic stabilities for crystals. Our models are available at https://huggingface.co/internlm/Intern-S1.

cs.LG↗

4D Virtual Imaging Platform for Dynamic Joint Assessment via Uni-Plane X-ray and 2D-3D Registration

Conventional computed tomography (CT) lacks the ability to capture dynamic, weight-bearing joint motion. Functional evaluation, particularly after surgical intervention, requires four-dimensional (4D) imaging, but current methods are limited by excessive radiation exposure or incomplete spatial information from 2D techniques. We propose an integrated 4D joint analysis platform that combines: (1) a dual robotic arm cone-beam CT (CBCT) system with a programmable, gantry-free trajectory optimized for upright scanning; (2) a hybrid imaging pipeline that fuses static 3D CBCT with dynamic 2D X-rays using deep learning-based preprocessing, 3D-2D projection, and iterative optimization; and (3) a clinically validated framework for quantitative kinematic assessment. In simulation studies, the method achieved sub-voxel accuracy (0.235 mm) with a 99.18 percent success rate, outperforming conventional and state-of-the-art registration approaches. Clinical evaluation further demonstrated accurate quantification of tibial plateau motion and medial-lateral variance in post-total knee arthroplasty (TKA) patients. This 4D CBCT platform enables fast, accurate, and low-dose dynamic joint imaging, offering new opportunities for biomechanical research, precision diagnostics, and personalized orthopedic care.

cs.CV↗

Edge-state competition in a 2D topological insulator-semiconductor heterostructure

Quantum spin Hall edge transport in two-dimensional transition-metal dichalcogenides depends on whether their one-dimensional edge channels are preserved under realistic substrates and device boundaries. Here we implement spin-orbit coupling in DFTB and GFN-xTB within the Amsterdam Modeling Suite, and apply it to 1T$'$/2H WSe$_2$ heterostructures. Edge-projected spectra reveal robust edge states in 1T$'$ ribbons; and these states remain robust against a laterally infinite 2H substrate, which only shifts the Dirac point via long-wavelength corrugation without introducing additional in-gap states. By contrast, terminated 2H edges generate trivial dispersion branches in the same energy window that hybridize only weakly with the topological edge modes. In the bulk, Fermi-level states are 1T$'$-derived; at the small twist angle, lattice-relaxation-induced strain drives miniband reconstruction, whereas at the large twist angle, the layers become electronically decoupled. These findings suggest the conditions -- controlled twist angle and avoidance of terminated 2H edges -- for achieving quantized conductance and unambiguous spectroscopic

cond-mat.mes-hall↗

Uniform and Tunable Structural Colors based on Ultrathin Lignin Optical Coatings

Structural coloration offers a sustainable and non-fading alternative to conventional pigment- and dye-based colorants. In this study, we present a scalable strategy for generating vivid, tunable structural colors using ultrathin films of industrial kraft lignin. By employing solvent fractionation to isolate a methanol-soluble lignin fraction, followed by spin-coating onto silicon substrates, we achieve highly uniform films with controllable thickness. The observed colors originate from thin-film interference and span the entire visible spectrum by adjusting lignin concentration and spin speed. Spectroscopic ellipsometry and transfer matrix modeling confirm that the interference is modulated by the film thickness. The lignin films exhibit robust mechanical properties, limited angular color shift, and fast, reversible optical response to humidity changes, enabling real-time environmental sensing. This approach circumvents the need for nanoparticle synthesis or self-assembly and highlights the potential of lignin, a widely available and underutilized biopolymer, as a functional photonic material for sustainable optical coatings and colorimetric sensors.

physics.optics↗

Learning phase transitions by siamese neural network

The wide application of machine learning (ML) techniques in statistics physics has presented new avenues for research in this field. In this paper, we introduce a semi-supervised learning method based on Siamese Neural Networks (SNN), trying to explore the potential of neural network (NN) in the study of critical behaviors beyond the approaches of supervised and unsupervised learning. By focusing on the (1+1) dimensional bond directed percolation (DP) model of nonequilibrium phase transition and the 2 dimensional Ising model of equilibrium phase transition, we use the SNN to predict the critical values and critical exponents of the systems. Different from traditional ML methods, the input of SNN is a set of configuration data pairs and the output prediction is similarity, which prompts to find an anchor point of data for pair comparison during the test. In our study, during test we set different bond probability $p$ or temperature $T$ as anchors, and discuss the impact of the configurations at this anchors on predictions. In addition, we use an iterative method to find the optimal training interval to make the algorithm more efficient, and the prediction results are comparable to other ML methods.

physics.comp-ph↗

Request-Only Optimization for Recommendation Systems

Deep Learning Recommendation Models (DLRMs) represent one of the largest machine learning applications on the planet. Industry-scale DLRMs are trained with petabytes of recommendation data to serve billions of users every day. To utilize the rich user signals in the long user history, DLRMs have been scaled up to unprecedented complexity, up to trillions of floating-point operations (TFLOPs) per example. This scale, coupled with the huge amount of training data, necessitates new storage and training algorithms to efficiently improve the quality of these complex recommendation systems. In this paper, we present a Request-Only Optimizations (ROO) training and modeling paradigm. ROO simultaneously improves the storage and training efficiency as well as the model quality of recommendation systems. We holistically approach this challenge through co-designing data (i.e., request-only data), infrastructure (i.e., request-only based data processing pipeline), and model architecture (i.e., request-only neural architectures). Our ROO training and modeling paradigm treats a user request as a unit of the training data. Compared with the established practice of treating a user impression as a unit, our new design achieves native feature deduplication in data logging, consequently saving data storage. Second, by de-duplicating computations and communications across multiple impressions in a request, this new paradigm enables highly scaled-up neural network architectures to better capture user interest signals, such as Generative Recommenders (GRs) and other request-only friendly architectures.

cs.IR↗

Deep Code Search with Naming-Agnostic Contrastive Multi-View Learning

Software development is a repetitive task, as developers usually reuse or get inspiration from existing implementations. Code search, which refers to the retrieval of relevant code snippets from a codebase according to the developer's intent that has been expressed as a query, has become increasingly important in the software development process. Due to the success of deep learning in various applications, a great number of deep learning based code search approaches have sprung up and achieved promising results. However, developers may not follow the same naming conventions and the same variable may have different variable names in different implementations, bringing a challenge to deep learning based code search methods that rely on explicit variable correspondences to understand source code. To overcome this challenge, we propose a naming-agnostic code search method (NACS) based on contrastive multi-view code representation learning. NACS strips information bound to variable names from Abstract Syntax Tree (AST), the representation of the abstract syntactic structure of source code, and focuses on capturing intrinsic properties solely from AST structures. We use semantic-level and syntax-level augmentation techniques to prepare realistically rational data and adopt contrastive learning to design a graph-view modeling component in NACS to enhance the understanding of code snippets. We further model ASTs in a path view to strengthen the graph-view modeling component through multi-view learning. Extensive experiments show that NACS provides superior code search performance compared to baselines and NACS can be adapted to help existing code search methods overcome the impact of different naming conventions. Our implementation is available at https://github.com/KDEGroup/NACS.

cs.IR↗

Universal Magnetocaloric Effect near Quantum Critical Point of Magnon Bose-Einstein Condensation

Bose-Einstein condensation (BEC), a macroscopic quantum phenomenon arising from phase coherence and bosonic statistics, has been realized in quantum magnets. Here, we report the observation of a universal magnetocaloric effect (MCE) near a BEC quantum critical point (QCP) in copper sulfate crystal ($CuSO_4 \cdot 5H_2O$). By conducting magnetocaloric and nuclear magnetic resonance measurements, we uncover a field-driven BEC QCP, evidenced by the universal scaling law $T_c \propto (B_c - B)^{2/3}$ and the perfect data collapse of the magnetic Grüneisen ratio. Thermal excitation triggers a dimensional crossover to a 1D quantum-critical regime, where the MCE scaling strictly matches the universality class of 1D Fermi gases. Notably, the quantum-critical MCE enables cooling down to 12.8 mK without helium-3, with very fast thermal relaxation rate that is critical for high cooling power. This work demonstrates the universal MCE in magnon BEC systems, using a common copper sulfate compound as a paradigmatic example, and paves the way for next-generation sub-Kelvin cooling.

cond-mat.str-el↗

EnergyPatchTST: Multi-scale Time Series Transformers with Uncertainty Estimation for Energy Forecasting

Accurate and reliable energy time series prediction is of great significance for power generation planning and allocation. At present, deep learning time series prediction has become the mainstream method. However, the multi-scale time dynamics and the irregularity of real data lead to the limitations of the existing methods. Therefore, we propose EnergyPatchTST, which is an extension of the Patch Time Series Transformer specially designed for energy forecasting. The main innovations of our method are as follows: (1) multi-scale feature extraction mechanism to capture patterns with different time resolutions; (2) probability prediction framework to estimate uncertainty through Monte Carlo elimination; (3) integration path of future known variables (such as temperature and wind conditions); And (4) Pre-training and Fine-tuning examples to enhance the performance of limited energy data sets. A series of experiments on common energy data sets show that EnergyPatchTST is superior to other commonly used methods, the prediction error is reduced by 7-12%, and reliable uncertainty estimation is provided, which provides an important reference for time series prediction in the energy field.

cs.LG↗

Identification and multiply robust estimation of causal effects via instrumental variables from an auxiliary population

Estimating causal effects in a target population with unmeasured confounders is challenging, especially when instrumental variables (IVs) are unavailable. However, IVs from auxiliary populations with similar problems can help infer causal effects in the target population. While the homogeneous conditional average treatment effect assumption has been widely used for effect transportability, it has not been explored in IV-based data fusion. We include it as a basic approach, though it may be biased when treatment effect heterogeneity exists. As an alternative approach, we introduce the equi-confounding assumption that the unmeasured confounding bias remains the same after adjusting for observed covariates, while allowing conditional average treatment effects to differ across populations. This allows us to identify the confounding bias in the auxiliary population and remove it from the treatment-outcome association in the target population to recover the causal effect. We develop multiply robust estimators under both approaches and demonstrate them through simulation studies and a real data application.

stat.ME↗

SpectralX: Parameter-efficient Domain Generalization for Spectral Remote Sensing Foundation Models

Recent advances in Remote Sensing Foundation Models (RSFMs) have led to significant breakthroughs in the field. While many RSFMs have been pretrained with massive optical imagery, more multispectral/hyperspectral data remain lack of the corresponding foundation models. To leverage the advantages of spectral imagery in earth observation, we explore whether existing RSFMs can be effectively adapted to process diverse spectral modalities without requiring extensive spectral pretraining. In response to this challenge, we proposed SpectralX, an innovative parameter-efficient fine-tuning framework that adapt existing RSFMs as backbone while introducing a two-stage training approach to handle various spectral inputs, thereby significantly improving domain generalization performance. In the first stage, we employ a masked-reconstruction task and design a specialized Hyper Tokenizer (HyperT) to extract attribute tokens from both spatial and spectral dimensions. Simultaneously, we develop an Attribute-oriented Mixture of Adapter (AoMoA) that dynamically aggregates multi-attribute expert knowledge while performing layer-wise fine-tuning. With semantic segmentation as downstream task in the second stage, we insert an Attribute-refined Adapter (Are-adapter) into the first stage framework. By iteratively querying low-level semantic features with high-level representations, the model learns to focus on task-beneficial attributes, enabling customized adjustment of RSFMs. Following this two-phase adaptation process, SpectralX is capable of interpreting spectral imagery from new regions or seasons. The codes will be available from the website: https://github.com/YuxiangZhang-BIT.

cs.CV↗

Sliding two-dimensional superconductivity and charge-density-wave state in a bulk crystal

Superconductivity in the two-dimensional (2D) limit is a fertile ground for exotic quantum phenomena-many of which remain elusive in their 3D counterparts. While studies of 2D superconductivity have predominantly focused on mono- or few-layer systems, we demonstrate an alternative route-interlayer sliding in bulk crystals. Through a precisely controlled growth strategy, we engineer interlayer sliding in bulk 3R-NbSe2, deliberately disrupting [001] mirror symmetry and drastically suppressing interlayer coupling. Remarkably, this structural manipulation stabilizes Ising-type superconductivity coexisting with an unconventional charge-density-wave (CDW) state akin to that of monolayer 2H-NbSe2. The sliding phase exhibits a pronounced suppression of the upper critical field at low temperatures, revealing a delicate competition between Ising and Rashba spin-orbit coupling (SOC) in the globally noncentrosymmetric lattice. Intriguingly, the superconducting state displays two-fold symmetry, a signature that may arise from asymmetric SOC or a multi-component pairing order parameter. Our work establishes interlayer sliding as a symmetry-breaking tool to promote 2D superconductivity in bulk materials-without resorting to extrinsic intercalation or doping. More broadly, this approach sets a paradigm for unlocking hidden quantum states in layered materials, offering a new dimension in design of quantum matter.

cond-mat.supr-con↗

LLaVA-Video: Video Instruction Tuning With Synthetic Data

The development of video large multimodal models (LMMs) has been hindered by the difficulty of curating large amounts of high-quality raw data from the web. To address this, we propose an alternative approach by creating a high-quality synthetic dataset specifically for video instruction-following, namely LLaVA-Video-178K. This dataset includes key tasks such as detailed captioning, open-ended question-answering (QA), and multiple-choice QA. By training on this dataset, in combination with existing visual instruction tuning data, we introduce LLaVA-Video, a new video LMM. Our experiments demonstrate that LLaVA-Video achieves strong performance across various video benchmarks, highlighting the effectiveness of our dataset. We plan to release the dataset, its generation pipeline, and the model checkpoints.

cs.CV↗