Searcharxiv⌕ Search

arXiv subjects

Bo Liu

Publications and source records attributed to Bo Liu.

At least 271 records · Page 15Linked to original sources

Approaching the double-Heisenberg scaling sensitivity in the Tavis-Cummings model

The pursuit of quantum-enhanced parameter estimations without the need for nonclassical initial states has long been driven by the goal of achieving experimentally accessible quantum metrology. In this work, employing a coherent averaging mechanism, we prove that the prototypical cavity quantum electrodynamics (QED) system, such as the Tavis-Cummings model, enables us to achieve not only the Heisenberg scaling (HS) precision in terms of the average photon number but also the double-HS sensitivity concerning both the average photon and atom numbers. Such a double sensibility can be experimentally realized by introducing either photon- or atom-number fluctuations through quantum squeezing. Furthermore, we discuss the methodology to achieve this double-HS precision in a realistic experimental circumstance where the squeezing is not perfect. Our results provide insights into understanding the coherent averaging mechanism for evaluating quantum-enhanced precision measurements and also present a usable metrological application of the cavity QED systems and superconducting circuits.

quant-ph↗

Multi-Class Segmentation of Aortic Branches and Zones in Computed Tomography Angiography: The AortaSeg24 Challenge

Multi-class segmentation of the aorta in computed tomography angiography (CTA) scans is essential for diagnosing and planning complex endovascular treatments for patients with aortic dissections. However, existing methods reduce aortic segmentation to a binary problem, limiting their ability to measure diameters across different branches and zones. Furthermore, no open-source dataset is currently available to support the development of multi-class aortic segmentation methods. To address this gap, we organized the AortaSeg24 MICCAI Challenge, introducing the first dataset of 100 CTA volumes annotated for 23 clinically relevant aortic branches and zones. This dataset was designed to facilitate both model development and validation. The challenge attracted 121 teams worldwide, with participants leveraging state-of-the-art frameworks such as nnU-Net and exploring novel techniques, including cascaded models, data augmentation strategies, and custom loss functions. We evaluated the submitted algorithms using the Dice Similarity Coefficient (DSC) and Normalized Surface Distance (NSD), highlighting the approaches adopted by the top five performing teams. This paper presents the challenge design, dataset details, evaluation metrics, and an in-depth analysis of the top-performing algorithms. The annotated dataset, evaluation code, and implementations of the leading methods are publicly available to support further research. All resources can be accessed at https://aortaseg24.grand-challenge.org.

eess.IV↗

Isolated attosecond free-electron laser based on a sub-cycle driver from hollow capillary fibers

The attosecond light source provides an advanced tool for investigating electron motion using time-resolved-spectroscopy techniques. Isolated attosecond pulses, especially, will significantly advance the study of electron dynamics. However, achieving high-intensity isolated attosecond pulses is still challenging at the present stage. In this paper, we propose a novel scheme for generating high-intensity, isolated attosecond soft X-ray free-electron lasers (FELs) using a mid-infrared (MIR) sub-cycle modulation laser from gas-filled hollow capillary fibers (HCFs). The multi-cycle MIR pulses are first compressed to sub-cycle using a helium-filled HCF with decreasing pressure gradient due to soliton self-compression effect. By utilizing such sub-cycle MIR laser pulse to modulate the electron beam, we can obtain a quasi-isolated current peak, which can then produce an isolated FEL pulse with high signal-to-noise ratio (SNR), naturally synchronizing with the sub-cycle MIR laser pulse. Numerical simulations have been carried out, including the sub-cycle pulse generation, electron beam modulation and FEL radiation processes. The simulation results indicate that an isolated attosecond pulse with wavelength of 1 nm, peak power of ~28 GW, pulse duration of ~600 attoseconds and SNR of ~96.4% can be generated by our proposed method. The numerical results demonstrated here pave a new way for generating the high-intensity isolated attosecond soft X-ray pulse, which may have many applications in nonlinear spectroscopy and atomic-site electronic process.

physics.acc-ph↗

Data-Free Model-Related Attacks: Unleashing the Potential of Generative AI

Generative AI technology has become increasingly integrated into our daily lives, offering powerful capabilities to enhance productivity. However, these same capabilities can be exploited by adversaries for malicious purposes. While existing research on adversarial applications of generative AI predominantly focuses on cyberattacks, less attention has been given to attacks targeting deep learning models. In this paper, we introduce the use of generative AI for facilitating model-related attacks, including model extraction, membership inference, and model inversion. Our study reveals that adversaries can launch a variety of model-related attacks against both image and text models in a data-free and black-box manner, achieving comparable performance to baseline methods that have access to the target models' training data and parameters in a white-box manner. This research serves as an important early warning to the community about the potential risks associated with generative AI-powered attacks on deep learning models.

cs.CR↗

Cavity-based compact light source for extreme ultraviolet lithography

A critical technology for high-volume manufacturing of nanoscale integrated circuits is a high-power extreme ultraviolet (EUV) light source. Over the past decades, laser-produced plasma (LPP) sources have been actively utilized in this field. However, current LPP light sources may provide insufficient average power to enable future manufacturing at the 3 nm node and below. In this context,accelerator-based light sources are being considered as promising tools for EUV lithography. This paper proposes a regenerative amplifier free-electron laser EUV source with harmonic lasing, drivenby a superconducting energy-recovery linac (ERL). By utilizing the nth harmonic, the required electron beam energy is reduced to 1/sqrt(n) of that in conventional schemes. The proposed configuration, employing an electron beam energy of approximately 0.33 GeV with a short-period (16 mm) undulator, is estimated to provide an average EUV power of about 2 kW. This approach significantly reduces the required electron energy and facility size relative to other accelerator-based proposals,thereby offering new possibilities for constructing high-power EUV sources with low-energy ERLs.

physics.acc-ph↗

KIF: Knowledge Identification and Fusion for Language Model Continual Learning

Language model continual learning (CL) has recently attracted significant interest for its ability to adapt large language models (LLMs) to dynamic real-world scenarios without retraining. A major challenge in this domain is catastrophic forgetting, where models lose previously acquired knowledge upon learning new tasks. Existing approaches commonly utilize multiple parameter-efficient fine-tuning (PEFT) blocks to acquire task-specific knowledge, yet these methods are inefficient and fail to leverage potential knowledge transfer across tasks. In this paper, we introduce a novel CL framework for language models, named Knowledge Identification and Fusion (KIF), which boosts knowledge transfer without depending on memory replay. KIF initially segregates the model into 'skill units' based on parameter dependencies, allowing for more precise control. Subsequently, it employs a novel group-wise knowledge identification technique to ascertain the importance distribution of skill units for a new task. By comparing this importance distribution with those from previous tasks, we implement a fine-grained knowledge fusion strategy that retains task-specific knowledge, thereby preventing forgetting, and updates task-shared knowledge, which facilitates bi-directional knowledge transfer. As a result, KIF achieves an optimal balance between retaining prior knowledge and excelling in new tasks. KIF also demonstrates strong generalizability, making it suitable for various base models and adaptable to PEFT methods like LoRA. Furthermore, it offers notable extensibility, supporting enhancements through integration with memory replay techniques. Comprehensive experiments conducted on two CL benchmarks, involving models ranging from 220M to 7B parameters, affirm the effectiveness of KIF and its variants across different settings.

cs.CL↗

HiMix: Reducing Computational Complexity in Large Vision-Language Models

Benefiting from recent advancements in large language models and modality alignment techniques, existing Large Vision-Language Models(LVLMs) have achieved prominent performance across a wide range of scenarios. However, the excessive computational complexity limits the widespread use of these models in practical applications. We argue that one main bottleneck in computational complexity is caused by the involvement of redundant vision sequences in model computation. This is inspired by a reassessment of the efficiency of vision and language information transmission in the language decoder of LVLMs. Then, we propose a novel hierarchical vision-language interaction mechanism called Hierarchical Vision injection for Mixture Attention (HiMix). In HiMix, only the language sequence undergoes full forward propagation, while the vision sequence interacts with the language at specific stages within each language decoder layer. It is striking that our approach significantly reduces computational complexity with minimal performance loss. Specifically, HiMix achieves a 10x reduction in the computational cost of the language decoder across multiple LVLM models while maintaining comparable performance. This highlights the advantages of our method, and we hope our research brings new perspectives to the field of vision-language understanding. Project Page: https://xuange923.github.io/HiMix

cs.CV↗

AI-based Identity Fraud Detection: A Systematic Review

With the rapid development of digital services, a large volume of personally identifiable information (PII) is stored online and is subject to cyberattacks such as Identity fraud. Most recently, the use of Artificial Intelligence (AI) enabled deep fake technologies has significantly increased the complexity of identity fraud. Fraudsters may use these technologies to create highly sophisticated counterfeit personal identification documents, photos and videos. These advancements in the identity fraud landscape pose challenges for identity fraud detection and society at large. There is a pressing need to review and understand identity fraud detection methods, their limitations and potential solutions. This research aims to address this important need by using the well-known systematic literature review method. This paper reviewed a selected set of 43 papers across 4 major academic literature databases. In particular, the review results highlight the two types of identity fraud prevention and detection methods, in-depth and open challenges. The results were also consolidated into a taxonomy of AI-based identity fraud detection and prevention methods including key insights and trends. Overall, this paper provides a foundational knowledge base to researchers and practitioners for further research and development in this important area of digital identity fraud.

cs.AI↗

Non-Hermiticity enhanced topological immunity of one-dimensional $p$-wave superconducting chain

Studying the immunity of topological superconductors against non-local disorder is one of the key issues in both fundamental researches and potential applications. Here, we demonstrate that the non-Hermiticity can enhance the robustness of topological edge states against non-local disorder. To illustrate that, we consider a one-dimensional (1D) generalized Kitaev model with the asymmetric hopping in the presence of disorder. It is shown that the region supporting Majorana zero modes (MZMs) against non-local disorder will be enlarged by the non-Hermiticity. Through both the numerical and analytical analyses, we show that non-Hermiticity can stabilize the topological superconducting (SC) phase against higher disorder strength. Our studies would offer new insights into the interplay between non-Hermiticity and topology.

cond-mat.supr-con↗

Rate-My-LoRA: Efficient and Adaptive Federated Model Tuning for Cardiac MRI Segmentation

Cardiovascular disease (CVD) and cardiac dyssynchrony are major public health problems in the United States. Precise cardiac image segmentation is crucial for extracting quantitative measures that help categorize cardiac dyssynchrony. However, achieving high accuracy often depends on centralizing large datasets from different hospitals, which can be challenging due to privacy concerns. To solve this problem, Federated Learning (FL) is proposed to enable decentralized model training on such data without exchanging sensitive information. However, bandwidth limitations and data heterogeneity remain as significant challenges in conventional FL algorithms. In this paper, we propose a novel efficient and adaptive federate learning method for cardiac segmentation that improves model performance while reducing the bandwidth requirement. Our method leverages the low-rank adaptation (LoRA) to regularize model weight update and reduce communication overhead. We also propose a \mymethod{} aggregation technique to address data heterogeneity among clients. This technique adaptively penalizes the aggregated weights from different clients by comparing the validation accuracy in each client, allowing better generalization performance and fast local adaptation. In-client and cross-client evaluations on public cardiac MR datasets demonstrate the superiority of our method over other LoRA-based federate learning approaches.

cs.CV↗

CustomTTT: Motion and Appearance Customized Video Generation via Test-Time Training

Benefiting from large-scale pre-training of text-video pairs, current text-to-video (T2V) diffusion models can generate high-quality videos from the text description. Besides, given some reference images or videos, the parameter-efficient fine-tuning method, i.e. LoRA, can generate high-quality customized concepts, e.g., the specific subject or the motions from a reference video. However, combining the trained multiple concepts from different references into a single network shows obvious artifacts. To this end, we propose CustomTTT, where we can joint custom the appearance and the motion of the given video easily. In detail, we first analyze the prompt influence in the current video diffusion model and find the LoRAs are only needed for the specific layers for appearance and motion customization. Besides, since each LoRA is trained individually, we propose a novel test-time training technique to update parameters after combination utilizing the trained customized models. We conduct detailed experiments to verify the effectiveness of the proposed methods. Our method outperforms several state-of-the-art works in both qualitative and quantitative evaluations.

cs.CV↗

Many-body interferometry of one-dimensional integrable systems

We propose using many-body Ramsey interferometry to measure non-equilibrium correlation functions of one-dimensional (1D) integrable systems. The 1D transverse-field Ising model, which is conjectured to equilibrate into non-thermal Gibbs ensemble (GGE) steady states, is studied. It is shown that retarded Green's functions, as opposed to ordinary spin-spin correlators considered previously, can convincingly distinguish between the GGE and thermal post-quench steady states, justifying the assumption of convergence towards the GGE as the system equilibrates. We also propose the experimental protocol for measuring the response functions with Ramsey interferometry, which can be used to distinguish between different post-quench phases of the model. Our proposal can be realized with current ultracold atom techniques, and opens up the possibility to study dynamics in non-thermal ensembles.

cond-mat.quant-gas↗

Experimental investigation of the uncertainty relation in pre- and postselected systems

Uncertainty principle is one of the fundamental principles of quantum mechanics. Exploring such uncertainty relations in pre- and postselected (PPS) systems, where weak measurements on post-selected states have been used as a powerful tool for exploring the foundation of quantum mechanics, has so far eluded experimental effort. In this work, we experimentally investigate the Robertson-Heisenberg-type uncertainty relation for two incompatible observables in a PPS system. Through conducting a von Neumann-type measurement, uncertainty relations between two non-commuting Pauli observables are experimentally unveiled. Such uncertainty relations in the PPS system impose limitations on the joint sharp preparation of pre- and postselected states for two incompatible observables. Our experiments would be useful for the development of amplification techniques for precision measurements.

physics.optics↗

SemiDFL: A Semi-Supervised Paradigm for Decentralized Federated Learning

Decentralized federated learning (DFL) realizes cooperative model training among connected clients without relying on a central server, thereby mitigating communication bottlenecks and eliminating the single-point failure issue present in centralized federated learning (CFL). Most existing work on DFL focuses on supervised learning, assuming each client possesses sufficient labeled data for local training. However, in real-world applications, much of the data is unlabeled. We address this by considering a challenging yet practical semisupervised learning (SSL) scenario in DFL, where clients may have varying data sources: some with few labeled samples, some with purely unlabeled data, and others with both. In this work, we propose SemiDFL, the first semi-supervised DFL method that enhances DFL performance in SSL scenarios by establishing a consensus in both data and model spaces. Specifically, we utilize neighborhood information to improve the quality of pseudo-labeling, which is crucial for effectively leveraging unlabeled data. We then design a consensusbased diffusion model to generate synthesized data, which is used in combination with pseudo-labeled data to create mixed datasets. Additionally, we develop an adaptive aggregation method that leverages the model accuracy of synthesized data to further enhance SemiDFL performance. Through extensive experimentation, we demonstrate the remarkable performance superiority of the proposed DFL-Semi method over existing CFL and DFL schemes in both IID and non-IID SSL scenarios.

cs.LG↗

Positive Text Reframing under Multi-strategy Optimization

Differing from sentiment transfer, positive reframing seeks to substitute negative perspectives with positive expressions while preserving the original meaning. With the emergence of pre-trained language models (PLMs), it is possible to achieve acceptable results by fine-tuning PLMs. Nevertheless, generating fluent, diverse and task-constrained reframing text remains a significant challenge. To tackle this issue, a \textbf{m}ulti-\textbf{s}trategy \textbf{o}ptimization \textbf{f}ramework (MSOF) is proposed in this paper. Starting from the objective of positive reframing, we first design positive sentiment reward and content preservation reward to encourage the model to transform the negative expressions of the original text while ensuring the integrity and consistency of the semantics. Then, different decoding optimization approaches are introduced to improve the quality of text generation. Finally, based on the modeling formula of positive reframing, we propose a multi-dimensional re-ranking method that further selects candidate sentences from three dimensions: strategy consistency, text similarity and fluency. Extensive experiments on two Seq2Seq PLMs, BART and T5, demonstrate our framework achieves significant improvements on unconstrained and controlled positive reframing tasks.

cs.CL↗

SKIM: Any-bit Quantization Pushing The Limits of Post-Training Quantization

Large Language Models (LLMs) exhibit impressive performance across various tasks, but deploying them for inference poses challenges. Their high resource demands often necessitate complex, costly multi-GPU pipelines, or the use of smaller, less capable models. While quantization offers a promising solution utilizing lower precision for model storage, existing methods frequently experience significant performance drops at lower precision levels. Additionally, they typically provide only a limited set of solutions at specific bit levels, many of which are extensively manually tuned. To address these challenges, we propose a new method called SKIM: Scaled K-means clustering wIth Mixed precision. Our approach introduces two novel techniques: 1. A greedy algorithm to solve approximately optimal bit allocation across weight channels, and 2. A trainable scaling vector for non-differentiable K-means clustering. These techniques substantially improve performance and can be adapted to any given bit. Notably, in terms of model perplexity, our method narrows the gap between 3-bit quantized LLaMA models and their full precision counterparts by 16.3% on average.

cs.LG↗

AdaFlow: Imitation Learning with Variance-Adaptive Flow-Based Policies

Diffusion-based imitation learning improves Behavioral Cloning (BC) on multi-modal decision-making, but comes at the cost of significantly slower inference due to the recursion in the diffusion process. It urges us to design efficient policy generators while keeping the ability to generate diverse actions. To address this challenge, we propose AdaFlow, an imitation learning framework based on flow-based generative modeling. AdaFlow represents the policy with state-conditioned ordinary differential equations (ODEs), which are known as probability flows. We reveal an intriguing connection between the conditional variance of their training loss and the discretization error of the ODEs. With this insight, we propose a variance-adaptive ODE solver that can adjust its step size in the inference stage, making AdaFlow an adaptive decision-maker, offering rapid inference without sacrificing diversity. Interestingly, it automatically reduces to a one-step generator when the action distribution is uni-modal. Our comprehensive empirical evaluation shows that AdaFlow achieves high performance with fast inference speed.

cs.LG↗

Face De-identification: State-of-the-art Methods and Comparative Studies

The widespread use of image acquisition technologies, along with advances in facial recognition, has raised serious privacy concerns. Face de-identification usually refers to the process of concealing or replacing personal identifiers, which is regarded as an effective means to protect the privacy of facial images. A significant number of methods for face de-identification have been proposed in recent years. In this survey, we provide a comprehensive review of state-of-the-art face de-identification methods, categorized into three levels: pixel-level, representation-level, and semantic-level techniques. We systematically evaluate these methods based on two key criteria, the effectiveness of privacy protection and preservation of image utility, highlighting their advantages and limitations. Our analysis includes qualitative and quantitative comparisons of the main algorithms, demonstrating that deep learning-based approaches, particularly those using Generative Adversarial Networks (GANs) and diffusion models, have achieved significant advancements in balancing privacy and utility. Experimental results reveal that while recent methods demonstrate strong privacy protection, trade-offs remain in visual fidelity and computational complexity. This survey not only summarizes the current landscape but also identifies key challenges and future research directions in face de-identification.

cs.CV↗