arXiv subjects

Yi Liang

Publications and source records attributed to Yi Liang.

At least 37 records · Page 2Linked to original sources

arXiv2024

AdaDiff: Accelerating Diffusion Models through Step-Wise Adaptive Computation

Diffusion models achieve great success in generating diverse and high-fidelity images, yet their widespread application, especially in real-time scenarios, is hampered by their inherently slow generation speed. The slow generation stems from the necessity of multi-step network inference. While some certain predictions benefit from the full computation of the model in each sampling iteration, not every iteration requires the same amount of computation, potentially leading to inefficient computation. Unlike typical adaptive computation challenges that deal with single-step generation problems, diffusion processes with a multi-step generation need to dynamically adjust their computational resource allocation based on the ongoing assessment of each step's importance to the final image output, presenting a unique set of challenges. In this work, we propose AdaDiff, an adaptive framework that dynamically allocates computation resources in each sampling step to improve the generation efficiency of diffusion models. To assess the effects of changes in computational effort on image quality, we present a timestep-aware uncertainty estimation module (UEM). Integrated at each intermediate layer, the UEM evaluates the predictive uncertainty. This uncertainty measurement serves as an indicator for determining whether to terminate the inference process. Additionally, we introduce an uncertainty-aware layer-wise loss aimed at bridging the performance gap between full models and their adaptive counterparts.

cs.CV↗

arXiv2024

Online Drift Detection with Maximum Concept Discrepancy

Continuous learning from an immense volume of data streams becomes exceptionally critical in the internet era. However, data streams often do not conform to the same distribution over time, leading to a phenomenon called concept drift. Since a fixed static model is unreliable for inferring concept-drifted data streams, establishing an adaptive mechanism for detecting concept drift is crucial. Current methods for concept drift detection primarily assume that the labels or error rates of downstream models are given and/or underlying statistical properties exist in data streams. These approaches, however, struggle to address high-dimensional data streams with intricate irregular distribution shifts, which are more prevalent in real-world scenarios. In this paper, we propose MCD-DD, a novel concept drift detection method based on maximum concept discrepancy, inspired by the maximum mean discrepancy. Our method can adaptively identify varying forms of concept drift by contrastive learning of concept embeddings without relying on labels or statistical properties. With thorough experiments under synthetic and real-world scenarios, we demonstrate that the proposed method outperforms existing baselines in identifying concept drifts and enables qualitative analysis with high explainability.

cs.LG↗

arXiv2024

Realizing a spatially correlated lattice interferometer

Atom interferometers provide a powerful tool for measuring physical constants and testifying fundamental physics with unprecedented precision. Conventional atom interferometry focuses on the phase difference between two paths and utilizes matter waves with fixed coherence. Here, we report on realizing a Ramsey-Bordé interferometer of coherent matter waves dressed by a moving optical lattice in the gravity direction, and explore the resulting interference along multiple paths with tunable coherence. We investigate spatial correlations of atoms both within the lattice and between two arms by interferometry, and observe the emerging multiple interference peaks owing to the long-range coherence nature of the Bose-Einstein condensate. Our findings agree well with theoretical simulations, paving the way for high-precision interferometry with ultracold atoms.

cond-mat.quant-gas↗

arXiv2024

Magnetic-field oscillation model of pulsar radio emission: prediction of an observable effect

Since the discovery of pulsars, the rotating-lighthouse model has been the choice of model to explain the radiation pulsation of pulsars. After discovering that some main sequence stars (e.g., CU Virginis) and ultracool dwarfs (e.g., TVLM 513-46546) also behave like pulsars, the lighthouse model was again adopted to explain their pulse signals. Our research found that if we use the magnetic-field oscillation (MO) model, we can explain the pulse radiation results better regardless of whether its source is a neutron star, a main-sequence star or an ultracool dwarf. We propose a verifiable prediction that can be used to evaluate the MO model. Our prediction is that there is a 90 degree phase lag between the magnetic field and radio signal of TVLM 513-46546, and the zero-crossing point of the magnetic field is the moment when the direction of the light's circular polarization is reversed. No new observations are needed to check this prediction, but certain existing data needs to be re-mined.

astro-ph.HE↗

arXiv2024

Making Pre-trained Language Models Better Continual Few-Shot Relation Extractors

Continual Few-shot Relation Extraction (CFRE) is a practical problem that requires the model to continuously learn novel relations while avoiding forgetting old ones with few labeled training data. The primary challenges are catastrophic forgetting and overfitting. This paper harnesses prompt learning to explore the implicit capabilities of pre-trained language models to address the above two challenges, thereby making language models better continual few-shot relation extractors. Specifically, we propose a Contrastive Prompt Learning framework, which designs prompt representation to acquire more generalized knowledge that can be easily adapted to old and new categories, and margin-based contrastive learning to focus more on hard samples, therefore alleviating catastrophic forgetting and overfitting issues. To further remedy overfitting in low-resource scenarios, we introduce an effective memory augmentation strategy that employs well-crafted prompts to guide ChatGPT in generating diverse samples. Extensive experiments demonstrate that our method outperforms state-of-the-art methods by a large margin and significantly mitigates catastrophic forgetting and overfitting in low-resource scenarios.

cs.CL↗

arXiv2024

Influence of thermal effects on atomic Bloch oscillation

Advancements in the experimental toolbox of cold atoms have enabled the meticulous control of atomic Bloch oscillation within optical lattices, thereby enhancing the capabilities of gravity interferometers. This work delves into the impact of thermal effects on Bloch oscillation in 1D accelerated optical lattices aligned with gravity by varying the system's initial temperature. Through the application of Raman cooling, we effectively reduce the longitudinal thermal effect, stabilizing the longitudinal coherence length over the timescale of its lifetime. The atomic losses over multiple Bloch oscillation is measured, which are primarily attributed to transverse excitation. Furthermore, we identify two distinct inverse scaling behaviors in the oscillation lifetime scaled by the corresponding density with respect to temperatures, implying diverse equilibrium processes within or outside the Bose-Einstein condensate regime. The competition between the system's coherence and atomic density leads to a relatively smooth variation in the actual lifetime versus temperature. Our findings provide valuable insights into the interaction between thermal effects and Bloch oscillation, offering avenues for the refinement of quantum measurement technologies.

cond-mat.quant-gas↗

arXiv2024

Intrinsic Orbital Angular Momentum Originated from Optical Catastrophe Superposition

Conventionally, intrinsic orbital angular momentum (OAM) is associated with phase vortices. However, our investigation into the propagation dynamics of 2D superimposed catastrophe beams, termed cyclone catastrophe beams (CCBs), reveals that these beams inherently exhibit rotation and possess OAM, distinct from the typical connection to phase vortices. Our observations clearly show these beams rotating during autofocusing propagation and particle manipulation, confirming the presence of OAM. Theoretical calculations affirm that the OAM of these beams is intrinsic and can be adjusted by varying the number of superimposed beams. Furthermore, our interference and phase studies indicate that, although CCBs exhibit phase vortices, they do not rotate around the singularities of phase vortices and their total topological charges are zero. This implies that the manifestation of OAM within CCBs does not rely on nonzero topological charge of the presented phase vortices within CCBs. Especially, eigenstates decomposition analysis illustrates that CCBs can be decomposed as a composite of Laguerre-Gaussian (LG) modes with uneven fidelity, where the topological charges of LG modes align with multiples of the superimposed catastrophe beams but do not equal to the value of the OAM per photon within CCBs, emphasizing the intrinsic OAM within CCBs and the absence of a connection to phase vortices. Our findings not only advance the understanding of the relationship between OAM and phase vortices but also pave the way for different applications of OAM waves, catalyzing their development in optics and other domains.

physics.optics↗

arXiv2023

Investigation on trapping capability of circular swallowtail beams

Circular swallowtail beams (CSBs) with their remarkable autofocusing capability have garnered significant interests due to their potential applications in optical trapping. This study delves into a comprehensive investigation of the trapping force properties of CSBs. Through a combination of experimental observations and theoretical analysis, we systematically explore the quantitative manipulation of trapping forces by adjusting specific parameters. This detailed investigation provides insights into the trapping force performance and stability of CSBs. Furthermore, the experimental validation of particle trapping using CSBs underscores their effectiveness, emphasizing their significant potential for optical manipulation and trapping applications.

physics.optics↗

arXiv2023

Non-Intrusive Adaptation: Input-Centric Parameter-efficient Fine-Tuning for Versatile Multimodal Modeling

Large language models (LLMs) and vision language models (VLMs) demonstrate excellent performance on a wide range of tasks by scaling up parameter counts from O(10^9) to O(10^{12}) levels and further beyond. These large scales make it impossible to adapt and deploy fully specialized models given a task of interest. Parameter-efficient fine-tuning (PEFT) emerges as a promising direction to tackle the adaptation and serving challenges for such large models. We categorize PEFT techniques into two types: intrusive and non-intrusive. Intrusive PEFT techniques directly change a model's internal architecture. Though more flexible, they introduce significant complexities for training and serving. Non-intrusive PEFT techniques leave the internal architecture unchanged and only adapt model-external parameters, such as embeddings for input. In this work, we describe AdaLink as a non-intrusive PEFT technique that achieves competitive performance compared to SoTA intrusive PEFT (LoRA) and full model fine-tuning (FT) on various tasks. We evaluate using both text-only and multimodal tasks, with experiments that account for both parameter-count scaling and training regime (with and without instruction tuning).

cs.CL↗

arXiv2023

Automated Evaluation of Personalized Text Generation using Large Language Models

Personalized text generation presents a specialized mechanism for delivering content that is specific to a user's personal context. While the research progress in this area has been rapid, evaluation still presents a challenge. Traditional automated metrics such as BLEU and ROUGE primarily measure lexical similarity to human-written references, and are not able to distinguish personalization from other subtle semantic aspects, thus falling short of capturing the nuances of personalized generated content quality. On the other hand, human judgments are costly to obtain, especially in the realm of personalized evaluation. Inspired by these challenges, we explore the use of large language models (LLMs) for evaluating personalized text generation, and examine their ability to understand nuanced user context. We present AuPEL, a novel evaluation method that distills three major semantic aspects of the generated text: personalization, quality and relevance, and automatically measures these aspects. To validate the effectiveness of AuPEL, we design carefully controlled experiments and compare the accuracy of the evaluation judgments made by LLMs versus that of judgements made by human annotators, and conduct rigorous analyses of the consistency and sensitivity of the proposed metric. We find that, compared to existing evaluation metrics, AuPEL not only distinguishes and ranks models based on their personalization abilities more accurately, but also presents commendable consistency and efficiency for this task. Our work suggests that using LLMs as the evaluators of personalized text generation is superior to traditional text similarity metrics, even though interesting new challenges still remain.

cs.CL↗

arXiv2023

Robust moiré flatbands within a broad band-offset range

Photonic analogs of the moiré superlattices mediated by interlayer electromagnetic coupling are expected to give rise to rich phenomena such as nontrivial flatband topology. Here, we propose and demonstrate a scheme to tune the flatbands in a bilayer moiré superlattice by employing the band offset. The band offset is changed by fixing the bands of one slab while shifting those of the other slab, which is accomplished by modifying the thickness of the latter slab. Our results show that the band-offset tuning not only makes some flatbands emerge and disappear, but also leads to two sets of flatbands that are robustly formed even with the change of band offset over a broad range. These robust flatbands form either at the AA-stack site or at the AB-stack site, and as a result, a single-cell superlattice can support a pair of high-quality localized modes with tunable frequencies. Moreover, we develop a diagrammatic model to provide an intuitive insight into the formation of the robust flatbands. Our work demonstrates a simple yet efficient way to design and control complex moiré flatbands, providing new opportunities to utilize photonic moiré superlattices for advanced light-matter interaction including lasing and nonlinear harmonic generation.

physics.optics↗

arXiv2023

Robust autofocusing propagation in turbulence

We conducted a comprehensive study on the robust propagation of the same spot-size Gaussian beam (SSGB), same envelope Gaussian beam (SEGB), Circular Airy beam (CAB) and Circular Pearcey beam (CPB) in complex environments. Our findings clearly demonstrate that autofocusing beams exhibit higher stability in propagation compared with the Gaussian beams. To validate our results, we statistically analyze the intensity fluctuation of autofocusing beams and Gaussian beams. The analysis reveals that the intensity fluctuations of autofocusing beams are significantly smaller than that of Gaussian beams. Furthermore, we study the variation of the coherence factor and find that the coherence of autofocusing beams is better than that of Gaussian beams under turbulence. Additionally, we observe the change of the scintillation index (SI) with the propagation distance z, and our results show that autofocusing beams exhibit less oscillation than Gaussian beams, indicating that autofocusing beams propagate in complex environments with less distortion and fewer intensity fluctuation. Overall, our results suggest that autofocusing beams are promising for applications such as optical trapping and manipulation in complex environments. Our study provides valuable insights into the selection of stable beams that exhibit high intensity and high field gradient at the focal position in complex environments.

physics.optics↗

arXiv2023

Teach LLMs to Personalize -- An Approach inspired by Writing Education

Personalized text generation is an emerging research area that has attracted much attention in recent years. Most studies in this direction focus on a particular domain by designing bespoke features or models. In this work, we propose a general approach for personalized text generation using large language models (LLMs). Inspired by the practice of writing education, we develop a multistage and multitask framework to teach LLMs for personalized generation. In writing instruction, the task of writing from sources is often decomposed into multiple steps that involve finding, evaluating, summarizing, synthesizing, and integrating information. Analogously, our approach to personalized text generation consists of multiple stages: retrieval, ranking, summarization, synthesis, and generation. In addition, we introduce a multitask setting that helps the model improve its generation ability further, which is inspired by the observation in education that a student's reading proficiency and writing ability are often correlated. We evaluate our approach on three public datasets, each of which covers a different and representative domain. Our results show significant improvements over a variety of baselines.

cs.CL↗

arXiv2023

Caustic analysis of partially coherent self-accelerating beams: Investigating self-healing property

We employed caustic theory to analyze the propagation dynamics of partially coherent self-accelerating beams such as self-healing of partially coherent Airy beams. Our findings revealed that as the spatial coherence decreases, the self-healing ability of beams increases. This result have been demonstrated both in simulation and experiment. This is an innovative application of the caustic theory to the field of partially coherent structured beams, and provides a comprehensive understanding of self-healing property. Our results have significant implications for practical applications of partially coherent beams in fields such as optical communication, encryption, and imaging.

physics.optics↗

arXiv2023

Controllable nonlinear propagation of partially incoherent Airy beams

The self-accelerating beams such as the Airy beam show great potentials in many applications including optical manipulation, imaging and communication. However, their superior features during linear propagation could be easily corrupted by optical nonlinearity or spatial incoherence individually. Here we investigate how the interaction of spatial incoherence and nonlinear propagation affect the beam quality of Airy beam, and find that the two destroying factors can in fact balance each other. Our results show that the influence of coherence and nonlinearity on the propagation of partially incoherent Airy beams (PIABs) can be formulated as two exponential functions that have factors of opposite signs. With appropriate spatial coherence length, the PIABs not only resist the corruption of beam profile caused by self-focusing nonlinearity, but also exhibits less anomalous diffraction caused by the self-defocusing nonlinearity. Our work provides deep insight into how to maintain the beam quality of self-accelerating Airy beams by exploiting the interaction between partially incoherence and optical nonlinearity. Our results may bring about new possibilities for optimizing partially incoherent structured field and developing related applications such as optical communication, incoherent imaging and optical manipulations.

physics.optics↗

arXiv2023

Regulated Polarization Degree of Upconversion Luminescence and Multiple Anti-Counterfeit Applications

Polarized upconversion luminescence (PUCL) of lanthanide (Ln3+) ions has been widely used in single particle tracking, microfluidics detection, three-dimensional displays, and so on. However, no effective strategy has been developed for modulating PUCL. Here, we report a strategy to regulate PUCL in Ho3+-doped NaYF4 single nanorods based on the number of upconversion photons. By constructing a multiphoton upconversion system for Ho3+, we regulate the degree of polarization (DOP) of PUCL from 0.6 for two-photon luminescence to 0.929 for three-photon upconversion luminescence (UCL). Furthermore, our strategy is verified by cross-relaxation between Ho3+ and Yb3+, excitation wavelength, excitation power density, and local site symmetry. And this regulation strategy of PUCL has also been achieved in Tm3+, where DOP is ranged from 0.233 for two-photon luminescence to 0.925 for four-photon UCL. Besides, multi-dimensional anti-counterfeiting display has been explored with PUCL. This work provides an effective strategy for the regulation of PUCL and also provides more opportunities for the development of polarization display, optical encoding, anti-counterfeiting, and integrated optical devices.

physics.optics↗

arXiv2023

You Need Multiple Exiting: Dynamic Early Exiting for Accelerating Unified Vision Language Model

Large-scale Transformer models bring significant improvements for various downstream vision language tasks with a unified architecture. The performance improvements come with increasing model size, resulting in slow inference speed and increased cost for severing. While some certain predictions benefit from the full complexity of the large-scale model, not all of inputs need the same amount of computation to conduct, potentially leading to computation resource waste. To handle this challenge, early exiting is proposed to adaptively allocate computational power in term of input complexity to improve inference efficiency. The existing early exiting strategies usually adopt output confidence based on intermediate layers as a proxy of input complexity to incur the decision of skipping following layers. However, such strategies cannot apply to encoder in the widely-used unified architecture with both encoder and decoder due to difficulty of output confidence estimation in the encoder. It is suboptimal in term of saving computation power to ignore the early exiting in encoder component. To handle this challenge, we propose a novel early exiting strategy for unified visual language models, which allows dynamically skip the layers in encoder and decoder simultaneously in term of input layer-wise similarities with multiple times of early exiting, namely \textbf{MuE}. By decomposing the image and text modalities in the encoder, MuE is flexible and can skip different layers in term of modalities, advancing the inference efficiency while minimizing performance drop. Experiments on the SNLI-VE and MS COCO datasets show that the proposed approach MuE can reduce expected inference time by up to 50\% and 40\% while maintaining 99\% and 96\% performance respectively.

cs.CV↗

arXiv2023

Some Computations on Instanton Knot Homology

In a recent paper, the first author and his collaborator developed a method to compute an upper bound of the dimension of instanton Floer homology via Heegaard Diagrams of 3-manifolds. For a knot inside S3, we further develop an algorithm that can compute an upper bound of the dimension of instanton knot homology from knot diagrams. We test the effectiveness of the algorithm and found that for all knots up to seven crossings, the algorithm provides sharp bounds. In the second half of the paper, we show that, if the instanton knot Floer homology of a knot has a specified form, then the knot must an instanton L-space knot.

math.GT↗