Searcharxiv⌕ Search

arXiv subjects

Wei Zhu

Publications and source records attributed to Wei Zhu.

At least 109 records · Page 6Linked to original sources

Ultra-sensitive integrated circuit sensors based on high-order nonHermitian topological physics

High-precision sensors are of fundamental importance in modern society and technology.Although numerous sensors have been developed, obtaining sensors with higher levels of sensitivity and stronger robustness has always been expected. Here, we propose theoretically and demonstrate experimentally a novel class of sensors with superior performances based on exotic properties of highorder non-Hermitian topological physics. The frequency shift induced by perturbations for these sensors can show an exponential growth with respect to the size of the device, which can well beyond the limitations of conventional sensors. The fully integrated circuit chips have been designed and fabricated in a standard 65nm complementary metal oxide semiconductor process technology. The sensitivity of systems not only less than 0.001fF has been experimentally verified, they are also robust against disorders.Our proposed ultra-sensitive integrated circuit sensors can possess a wide range of applications in various fields and show an exciting prospect for next-generation sensing technologies.

quant-ph↗

Short-Period Small Planets with High Mutual Inclinations are more Common around Metal-Rich Stars

We present a correlation between the stellar metallicities and the mutual inclinations of multi-planet systems hosting short-period small planets (a/Rs<12, Rp<4Re). We analyzed 89 multi-planet systems discovered by Kepler, K2, and TESS, where the innermost planets have periods shorter than 10 days. We found that the mutual inclinations of the innermost two planets are higher and more diverse around metal-rich stars. The mutual inclinations are calculated as the absolute differences between the best-fit inclinations of the innermost two planets from transit modeling, which represent the lower limits of the true mutual inclinations. The mean and variance of the mutual inclination distribution of the metal-rich systems are 3.1+-0.5 and 3.1+-0.4 degrees, while for the metal-poor systems they are 1.3+-0.2 and 1.0+-0.2 degrees. This finding suggests that inner planetary systems around metal-rich stars are dynamically hotter. We summarized the theories that could plausibly explain this correlation, including the influence of giant planets, higher solid densities in protoplanetary disks around metal-rich stars, or secular chaos coupled with an excess of angular momentum deficits. Planet formation and population synthesis models tracking the mutual inclination evolution would be essential to fully understand this correlation.

astro-ph.EP↗

PARA: Parameter-Efficient Fine-tuning with Prompt Aware Representation Adjustment

In the realm of parameter-efficient fine-tuning (PEFT) methods, while options like LoRA are available, there is a persistent demand in the industry for a PEFT approach that excels in both efficiency and performance within the context of single-backbone multi-tenant applications. This paper introduces a new and straightforward PEFT technique, termed \underline{P}rompt \underline{A}ware \underline{R}epresentation \underline{A}djustment (PARA). The core of our proposal is to integrate a lightweight vector generator within each Transformer layer. This generator produces vectors that are responsive to input prompts, thereby adjusting the hidden representations accordingly. Our extensive experimentation across diverse tasks has yielded promising results. Firstly, the PARA method has been shown to surpass current PEFT benchmarks in terms of performance, despite having a similar number of adjustable parameters. Secondly, it has proven to be more efficient than LoRA in the single-backbone multi-tenant scenario, highlighting its significant potential for industrial adoption.

cs.CL↗

Electric-field switchable chirality in rhombohedral graphene Chern insulators stabilized by tungsten diselenide

Chern insulators host topologically protected chiral edge currents with quantized conductance characterized by their Chern number. Switching the chirality of a Chern insulator, namely, the direction of the edge current, is highly challenging due to topologically forbidden backscattering but is of considerable importance for the design of topological devices. Nevertheless, this can be achieved by reversing the sign of the Chern number through a topological phase transition. Here, we report electrically switchable chirality in rhombohedral multilayer graphene-based Chern insulators. By introducing moire superlattices in rhombohedral heptalayer graphene, we observed a cascade of topological phase transitions at quarter electron filling of a moire band with the Chern number tunable from -1, 1 to 2. Furthermore, integrating monolayer tungsten diselenide at the moireless interface of rhombohedral decalayer graphene/h-BN superlattices stabilizes the Chern insulators, enabling quantized anomalous Hall resistance of h/2e^2. Remarkably, the Chern number can be switched from -1 to 2 using displacement fields. Our work establishes rhombohedral multilayer graphene moire superlattices as a versatile platform for topological engineering, with switchable chirality offering significant promise for integrating chiral edge currents into topological electronic circuits.

cond-mat.mes-hall↗

Detecting Planetary Oblateness in the Era of JWST: A Case Study of Kepler-167e

Planets may be rotationally flattened, and their oblateness thus provide useful information on their formation and evolution. Here we develop a new algorithm that can compute the transit light curve due to an oblate planet very efficiently and use it to study the detectability of planet oblateness (and spin obliquity) with the James Webb Space Telescope (JWST). Using the Jupiter analog, Kepler-167e, as an example, we show that observations of a single transit with JWST are able to detect a Saturn-like oblateness ($f=0.1$) with high confidence, or set a stringent upper limit on the oblateness parameter, as long as the planetary spin is slightly misaligned ($\gtrsim 20^\circ$) with respect to its orbital direction. Based on known obliquity measurements and theoretical arguments, it is reasonable to believe that this level of misalignment may be common. We estimate the sensitivity limit of JWST in oblateness detections and highlight the importance of better characterizations of cold planets in planning future JWST transit observations. The potential to detect rings, moons, and atmospheric species of the cold giants with JWST is also discussed.

astro-ph.EP↗

TS-HTFA: Advancing Time Series Forecasting via Hierarchical Text-Free Alignment with Large Language Models

Given the significant potential of large language models (LLMs) in sequence modeling, emerging studies have begun applying them to time-series forecasting. Despite notable progress, existing methods still face two critical challenges: 1) their reliance on large amounts of paired text data, limiting the model applicability, and 2) a substantial modality gap between text and time series, leading to insufficient alignment and suboptimal performance. In this paper, we introduce \textbf{H}ierarchical \textbf{T}ext-\textbf{F}ree \textbf{A}lignment (\textbf{TS-HTFA}), a novel method that leverages hierarchical alignment to fully exploit the representation capacity of LLMs while eliminating the dependence on text data. Specifically, we replace paired text data with adaptive virtual text based on QR decomposition word embeddings and learnable prompt. Furthermore, we establish comprehensive cross-modal alignment at three levels: input, feature, and output. Extensive experiments on multiple time-series benchmarks demonstrate that HTFA achieves state-of-the-art performance, significantly improving prediction accuracy and generalization.

cs.AI↗

A possible evidence of pion condensation

This work demonstrates that once a large number of pion is condensed in a high-energy hadron collision, the gamma-ray spectrum from $π^0$ decay takes on a typical broken power-law shape, which has been documented in many astronomical observations, but we have not yet recognized it. We show that this pion condensation is caused by a large number of soft gluons condensed in protons.

hep-ph↗

Single Trajectory Distillation for Accelerating Image and Video Style Transfer

Diffusion-based stylization methods typically denoise from a specific partial noise state for image-to-image and video-to-video tasks. This multi-step diffusion process is computationally expensive and hinders real-world application. A promising solution to speed up the process is to obtain few-step consistency models through trajectory distillation. However, current consistency models only force the initial-step alignment between the probability flow ODE (PF-ODE) trajectories of the student and the imperfect teacher models. This training strategy can not ensure the consistency of whole trajectories. To address this issue, we propose single trajectory distillation (STD) starting from a specific partial noise state. We introduce a trajectory bank to store the teacher model's trajectory states, mitigating the time cost during training. Besides, we use an asymmetric adversarial loss to enhance the style and quality of the generated images. Extensive experiments on image and video stylization demonstrate that our method surpasses existing acceleration models in terms of style similarity and aesthetic evaluations. Our code and results will be available on the project page: https://single-trajectory-distillation.github.io.

cs.CV↗

Neural Networks for Threshold Dynamics Reconstruction

We introduce two convolutional neural network (CNN) architectures, inspired by the Merriman-Bence-Osher (MBO) algorithm and by cellular automatons, to model and learn threshold dynamics for front evolution from video data. The first model, termed the (single-dynamics) MBO network, learns a specific kernel and threshold for each input video without adapting to new dynamics, while the second, a meta-learning MBO network, generalizes across diverse threshold dynamics by adapting its parameters per input. Both models are evaluated on synthetic and real-world videos (ice melting and fire front propagation), with performance metrics indicating effective reconstruction and extrapolation of evolving boundaries, even under noisy conditions. Empirical results highlight the robustness of both networks across varied synthetic and real-world dynamics.

cs.LG↗

An Eccentric Binary with a Misaligned Circumbinary Disk

We present spectroscopic and photometric observations of Bernhard-2, which was previously identified as a candidate system to host a misaligned circumbinary disk. Our spectroscopic measurements confirm that Bernhard-2 indeed contains an eccentric ($e=0.69 \pm 0.08$) binary and thus that the periodic variability in the photometric light curve is best explained by the occultation by the misaligned circumbinary disk. By modeling the spectral energy distributions at different phases, we infer the masses of the two binary components to be $\sim 1.1\,M_\odot$ and $\sim 0.9\,M_\odot$, respectively. The system age is determined to be $\lesssim$ 20 Myr by combining the stellar isochrone model with lithium abundance. Our new photometric observations show clear deviations from the model prediction based on the archival data, suggesting ongoing precession of the circumbinary disk. The H$α$ line of Bernhard-2 also shows an inverse P-Cygni profile at epochs close to the pericenter passage, which could be attributed to the pulsed accretion around the pericenter. Bernhard-2 therefore closely resembles the well studied KH 15D system. Further detailed observations and studies of such rare systems can provide useful information about disk physics and evolution.

astro-ph.SR↗

DRUM: Learning Demonstration Retriever for Large MUlti-modal Models

Recently, large language models (LLMs) have demonstrated impressive capabilities in dealing with new tasks with the help of in-context learning (ICL). In the study of Large Vision-Language Models (LVLMs), when implementing ICL, researchers usually adopts the naive strategies like fixed demonstrations across different samples, or selecting demonstrations directly via a visual-language embedding model. These methods does not guarantee the configured demonstrations fit the need of the LVLMs. To address this issue, we now propose a novel framework, \underline{d}emonstration \underline{r}etriever for large m\underline{u}lti-modal \underline{m}odel (DRUM), which fine-tunes the visual-language embedding model to better meet the LVLM's needs. First, we discuss the retrieval strategies for a visual-language task, assuming an embedding model is given. And we propose to concate the image and text embeddings to enhance the retrieval performance. Second, we propose to re-rank the demonstrations retrieved by the embedding model via the LVLM's feedbacks, and calculate a list-wise ranking loss for training the embedding model. Third, we propose an iterative demonstration mining strategy to improve the training of the embedding model. Through extensive experiments on 3 types of visual-language tasks, 7 benchmark datasets, our DRUM framework is proven to be effective in boosting the LVLM's in-context learning performance via retrieving more proper demonstrations.

cs.CL↗

EM-based Fast Uncertainty Quantification for Bayesian Multi-setup Operational Modal Analysis

The current Bayesian FFT algorithm relies on direct differentiation to obtain the posterior covariance matrix (PCM), which is time-consuming, memory-intensive, and hard to code, especially for the multi-setup operational modal analysis (OMA). Aiming at accelerating the uncertainty quantification in multi-setup OMA, an expectation-maximization (EM)-based algorithm is proposed by reformulating the Hessian matrix of the negative log-likelihood function (NLLF) as a sum of simplified components corresponding to the complete-data NLLF. Matrix calculus is employed to derive these components in a compact manner, resulting in expressions similar to those in the single-setup case. This similarity allows for the reuse of existing Bayesian single-setup OMA codes, simplifying implementation. The singularity caused by mode shape norm constraints is addressed through null space projection, eliminating potential numerical errors from the conventional pseudoinverse operation. A sparse assembly strategy is further adopted, avoiding unnecessary calculations and storage of predominant zero elements in the Hessian matrix. The proposed method is then validated through a comprehensive parametric study and applied to a multi-setup OMA of a high-rise building. Results demonstrate that the proposed method efficiently calculates the PCM within seconds, even for cases with hundreds of parameters. This represents an efficiency improvement of at least one order of magnitude over the state-of-the-art method. Such performance paves the way for a real-time modal identification of large-scale structures, including those with closely-spaced modes.

stat.CO↗

Sample Complexity of Probability Divergences under Group Symmetry

We rigorously quantify the improvement in the sample complexity of variational divergence estimations for group-invariant distributions. In the cases of the Wasserstein-1 metric and the Lipschitz-regularized $α$-divergences, the reduction of sample complexity is proportional to the group size if the group is finite. In addition to the published version at ICML 2023, our proof indeed has included the case when the group is infinite such as compact Lie groups, the convergence rate can be further improved and depends on the intrinsic dimension of the fundamental domain characterized by the scaling of its covering number. Our approach is different from that in [Tahmasebi & Jegelka, ICML 2024] and our work also applies to asymmetric divergences, such as the Lipschitz-regularized $α$-divergences. For the maximum mean discrepancy (MMD), the improvement of sample complexity is more nuanced, as it depends on not only the group size but also the choice of kernel. Numerical simulations verify our theories.

math.ST↗

Universal time evolution of string order parameter in quantum critical systems with boundary invertible or non-invertible symmetry breaking

The global symmetry, either invertible or non-invertible, has been extensively studied in two dimensional conformal field theories in recent years. When the theory is defined on a manifold with open boundaries, however, many interesting conformal boundary conditions will fully or partially break such global symmetry. In this work, we study the effect of symmetry-breaking boundaries or interfaces when the system is out of equilibrium. We show that the boundary or interface symmetry-breaking can be detected by the time evolution of string order parameters, which are constructed from the symmetry operators that implement the symmetry transformations. While the string order parameters are independent of time if the symmetry is preserved over the whole system, they evolve in time in a universal way if the boundary or interface breaks the symmetry. More explicitly, in the presence of boundary or interface symmetry-breaking, the string order parameters decay exponentially in time after a global quantum quench, and decay as a power-law in time after a local quantum quench. We also generalize our study to the case when the string order parameters are defined in a subsystem, which are related to the full counting statistics. It is found there are also universal features in the time evolution of string order parameters in this case. We verify our field theory results by studying the time evolution of these two different types of string order parameters in lattice models.

cond-mat.str-el↗

Dynamics of Binary Planets within Star Clusters

We develop analytical tools and perform three-body simulations to investigate the orbital evolution and dynamical stability of binary planets within star clusters. Our analytical results show that the orbital stability of a planetary-mass binary against passing stars is mainly related to its orbital period. Critical flybys, defined as stellar encounters with energy kicks comparable to the binary binding energy, can efficiently produce a wide range of semimajor axes ($a$) and eccentricities ($e$) from a dominant population of primordially tight JuMBOs. The critical flyby criterion we derived offers an improvement over the commonly used tidal radius criterion, particularly in high-speed stellar encounters. Applying our results to the recently discovered Jupiter-Mass Binary Objects (JuMBOs) by the James Webb Space Telescope (JWST), our simulations suggest that to match the observed $\sim$9% wide binary fraction, an initial semimajor axis of $a_0 \sim$ 10-20 au and a density-weighted residence time of $χ\gtrsim 10^4$ Myr pc$^{-3}$ are favored. These results imply that the JWST JuMBOs probably formed as tight binaries near the cluster core.

astro-ph.EP↗

An extremely low-density exoplanet spins slow

We present constraints on the shape of Kepler-51d, which is a super-puff with a mass $\sim6\,M_\oplus$ and a radius $\sim9\,R_\oplus$, based on detailed modeling of the transit light curve from JWST NIRSpec. The projected shape of this extremely low-density planet is consistent with being spherical, and a projected oblateness $f_\perp>0.2$ can be excluded regardless of the spin obliquity angles. If this is taken as the limit on the true shape of the planet, Kepler-51d is rotating at $\lesssim 50\%$ of its break-up spin rate, or its rotation period is $\gtrsim 33\,$hr. In the more plausible situation that the planetary spin is aligned with its orbital direction to within $30^\circ$, then its oblateness is $<0.08$, which corresponds to a dimensionless spin rate $\lesssim30\%$ of the break-up rotation and a dimensional rotation period $\gtrsim 53\,$hr. This seems to contradict the theoretical expectation that planets with such low masses may be spinning near break-up. We point out the usefulness of the stellar mean density and the orbital eccentricity in constraining the shape of the transiting planet, so planets with well-characterized host and orbital parameters are preferred in the detection of planetary oblateness with the JWST transit method.

astro-ph.EP↗

MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning

Low-rank adaptation (LoRA) and its mixture-of-experts (MOE) variants are highly effective parameter-efficient fine-tuning (PEFT) methods. However, they introduce significant latency in multi-tenant settings due to the LoRA modules and MOE routers added to multiple linear modules in the Transformer layer. To address this issue, we propose Mixture of Low-Rank Adaptation (MiLoRA), a novel and efficient LoRA variant. MiLoRA differs from previous MOE-style LoRA methods by considering each LoRA module as an expert and employing a prompt-aware routing mechanism. This mechanism calculates expert routing results once before generating the first new token and reuses these results for subsequent tokens, reducing latency. Extensive experiments and analysis on commonsense reasoning tasks, math reasoning tasks, and widely used LLM evaluation benchmarks demonstrate that MiLoRA consistently outperforms strong PEFT baselines with comparable tunable parameter budgets. Additionally, MiLoRA significantly reduces latency in multi-tenant settings compared to previous LoRA-based methods.

cs.CL↗