arXiv subjects

Ziyang Chen

Publications and source records attributed to Ziyang Chen.

At least 109 records · Page 6Linked to original sources

arXiv2024

Dual-comb-enhanced microwave clock synchronization over commercial fiber

The large-scale clock network is the key ingredient to obtain high precision in many scenarios, from fundamental research to cutting-edge applications. The advantage of the time synchronization among microwave clocks is their cost, size, and accessibility. Here, we demonstrate a femtosecond-level time synchronization of microwave clocks through a commercial link of 205.86 km via dual-comb-enhanced optical two-way time transfer, which achieves a 6.23-fs residual time deviation between synchronized timescales at 1 s and an instability below 6E-18 at 10,000 s. Further, the high-precision time synchronization of microwave clocks significantly enhances the probe ability of subtle reciprocity changes of fiber to the sub-picosecond level. This work provides a path toward secure fiber time-frequency networks to support future microwave-clock-based precise timing and sensing systems.

physics.optics↗

arXiv2024

Gain-Bandwidth-Product-Induced Technical Bound in Time Transfer System without Inline Amplifiers

Time transfer plays a dispensable role in many fields including navigation and positioning, geodesy, and fundamental tests. However, in certain scenarios where effective relay node deployment is often not feasible, such as harsh environments with extremely poor infrastructure and emergency conditions, effective time transfer without inline amplifiers becomes crucial. In this situation, the maximum transmission distance is limited by the receiver's measurement capability, particularly its ability to amplify the signal. Here we propose a theoretical model, giving a technical lower bound of the detected signal stability at different transmission distances, induced by limited gain-bandwidth products. The results under common gain-bandwidth products show that while for shorter transmission distances, stability is mainly limited by the background noise of the time interval counter, for longer distances reaching the scale of 300 kilometers, the technical lower bound is below the level of 10 nanoseconds without any inline amplification devices. Therefore, the given technical bound offers guidance on managing the balance between distance and stability, together with the optimization of the receiver in long-distance time transfer without inline amplification.

physics.ins-det↗

arXiv2024

Integrated high-performance error correction for continuous-variable quantum key distribution

An integrated error-correction scheme with high throughput, low frame errors rate (FER) and high reconciliation efficiency under low signal to noise ratio (SNR) is one of the major bottlenecks to realize high-performance and low-cost continuous variable quantum key distribution (CV-QKD). To solve this long-standing problem, a novel two-stage error correction method with limited precision that is suitable for integration given limited on-chip hardware resource while maintaining excellent decoding performance is proposed, and experimentally verified on a commercial FPGA. Compared to state-of-art results, the error-correction throughput can be improved more than one order of magnitude given FER<0.1 based on the proposed method, where 544.03 Mbps and 393.33 Mbps real-time error correction is achieved for typical 0.2 and 0.1 code rate, respectively. Besides, compared with traditional decoding method, the secure key rate (SKR) for CV-QKD under composable security framework can be improved by 140.09% and 122.03% by using the proposed two-stage decoding method for codes rate 0.2 and 0.1, which can support 32.70 Mbps and 5.66 Mbps real-time SKR under typical transmission distances of 25 km and 50 km, correspondingly. The record-breaking results paves the way for large-scale deployment of high-rate integrated CV-QKD systems in metropolitan quantum secure network.

quant-ph↗

arXiv2024

Machine Unlearning with Minimal Gradient Dependence for High Unlearning Ratios

In the context of machine unlearning, the primary challenge lies in effectively removing traces of private data from trained models while maintaining model performance and security against privacy attacks like membership inference attacks. Traditional gradient-based unlearning methods often rely on extensive historical gradients, which becomes impractical with high unlearning ratios and may reduce the effectiveness of unlearning. Addressing these limitations, we introduce Mini-Unlearning, a novel approach that capitalizes on a critical observation: unlearned parameters correlate with retrained parameters through contraction mapping. Our method, Mini-Unlearning, utilizes a minimal subset of historical gradients and leverages this contraction mapping to facilitate scalable, efficient unlearning. This lightweight, scalable method significantly enhances model accuracy and strengthens resistance to membership inference attacks. Our experiments demonstrate that Mini-Unlearning not only works under higher unlearning ratios but also outperforms existing techniques in both accuracy and security, offering a promising solution for applications requiring robust unlearning capabilities.

cs.LG↗

arXiv2024

Secure Combination of Untrusted Time information Based on Optimized Dempster-Shafer Theory

Secure precision time synchronization is important for applications of Cyber-Physical Systems. However, several attacks, especially the Time Delay Attack (TDA), deteriorates the performance of time synchronization system seriously. Multiple paths scheme is thought as an effective security countermeasure to decrease the influence of TDA. However, the effective secure combination algorithm is still missed for precision time synchronization. In this paper, a secure combination algorithm based on Dempster-Shafer theory is proposed for multiple paths method. Special optimizations are done for the combination algorithm to solve the potential problems due to untrusted evidence. Theoretical simulation shows that the proposed algorithm works much better than Fault Tolerant Algorithm (FTA) and the attack detection method based on single path. And experimental demonstration proves the feasibility and superiority of the proposed algorithm, where the time stability with 27.97 ps, 1.57 ps, and 1.12 ps at average time 1s, 10s, 100s is achieved under TDA and local clock jump. The proposed algorithm can be used to improve the security and resilience of many importance synchronization protocol, such as NTP, PTP, and TWFTT.

cs.CR↗

arXiv2024

Each Test Image Deserves A Specific Prompt: Continual Test-Time Adaptation for 2D Medical Image Segmentation

Distribution shift widely exists in medical images acquired from different medical centres and poses a significant obstacle to deploying the pre-trained semantic segmentation model in real-world applications. Test-time adaptation has proven its effectiveness in tackling the cross-domain distribution shift during inference. However, most existing methods achieve adaptation by updating the pre-trained models, rendering them susceptible to error accumulation and catastrophic forgetting when encountering a series of distribution shifts (i.e., under the continual test-time adaptation setup). To overcome these challenges caused by updating the models, in this paper, we freeze the pre-trained model and propose the Visual Prompt-based Test-Time Adaptation (VPTTA) method to train a specific prompt for each test image to align the statistics in the batch normalization layers. Specifically, we present the low-frequency prompt, which is lightweight with only a few parameters and can be effectively trained in a single iteration. To enhance prompt initialization, we equip VPTTA with a memory bank to benefit the current prompt from previous ones. Additionally, we design a warm-up mechanism, which mixes source and target statistics to construct warm-up statistics, thereby facilitating the training process. Extensive experiments demonstrate the superiority of our VPTTA over other state-of-the-art methods on two medical image segmentation benchmark tasks. The code and weights of pre-trained source models are available at https://github.com/Chen-Ziyang/VPTTA.

cs.CV↗

arXiv2024

Temporal Knowledge Question Answering via Abstract Reasoning Induction

In this study, we address the challenge of enhancing temporal knowledge reasoning in Large Language Models (LLMs). LLMs often struggle with this task, leading to the generation of inaccurate or misleading responses. This issue mainly arises from their limited ability to handle evolving factual knowledge and complex temporal logic. To overcome these limitations, we propose Abstract Reasoning Induction (ARI) framework, which divides temporal reasoning into two distinct phases: Knowledge-agnostic and Knowledge-based. This framework offers factual knowledge support to LLMs while minimizing the incorporation of extraneous noisy data. Concurrently, informed by the principles of constructivism, ARI provides LLMs the capability to engage in proactive, self-directed learning from both correct and incorrect historical reasoning samples. By teaching LLMs to actively construct knowledge and methods, it can significantly boosting their temporal reasoning abilities. Our approach achieves remarkable improvements, with relative gains of 29.7% and 9.27% on two temporal QA datasets, underscoring its efficacy in advancing temporal reasoning in LLMs. The code can be found at https://github.com/czy1999/ARI-QA

cs.CL↗

arXiv2024

Real Acoustic Fields: An Audio-Visual Room Acoustics Dataset and Benchmark

We present a new dataset called Real Acoustic Fields (RAF) that captures real acoustic room data from multiple modalities. The dataset includes high-quality and densely captured room impulse response data paired with multi-view images, and precise 6DoF pose tracking data for sound emitters and listeners in the rooms. We used this dataset to evaluate existing methods for novel-view acoustic synthesis and impulse response generation which previously relied on synthetic data. In our evaluation, we thoroughly assessed existing audio and audio-visual models against multiple criteria and proposed settings to enhance their performance on real-world data. We also conducted experiments to investigate the impact of incorporating visual data (i.e., images and depth) into neural acoustic field models. Additionally, we demonstrated the effectiveness of a simple sim2real approach, where a model is pre-trained with simulated data and fine-tuned with sparse real-world data, resulting in significant improvements in the few-shot learning approach. RAF is the first dataset to provide densely captured room acoustic data, making it an ideal resource for researchers working on audio and audio-visual neural acoustic field modeling techniques. Demos and datasets are available on our project page: https://facebookresearch.github.io/real-acoustic-fields/

cs.SD↗

arXiv2024

Detection of pairwise kinetic Sunyaev-Zel'dovich effect with DESI galaxy groups and Planck in Fourier space

We report a $\sim5.2σ$ detection of the kinetic Sunyaev-Zel'dovich (kSZ) effect in Fourier space, by combining the DESI galaxy groups and the Planck data. We use the density-weighted pairwise kSZ power spectrum as the summary statistic, and the detailed procedure of its measurement is presented in this paper. Meanwhile, we analyze the redshift space group density power spectrum to constrain its bias parameters and photo-z uncertainties. These best-fitted parameters are substituted to a nonlinear kSZ model, and we fit the measured kSZ power spectrum with this model to constrain the group optical depth $\barτ$. Selected by a varying lower mass threshold $M_{\rm th}$, the galaxy group catalogs with different median masses ($\tilde{M}$) are constructed from the DR9 data of the DESI Legacy Imaging Surveys. $\tilde{M}$ spans a wide range of $\sim10^{13}-10^{14}M_\odot/h$ and the heaviest $\tilde{M}\sim10^{14} M_\odot/h$ is larger than those of most other kSZ detections. When the aperture photometric filter radius $θ_{\rm AP}$ is set to be $4.2$ arcmin, the $\tilde{M}=1.75\times10^{13}M_\odot/h$ group sample at the median redshift $\tilde{z}=0.64$ has the highest kSZ detection ${\rm S/N}=5.2$. By fitting $\barτ$s from various samples against their $\tilde{M}$s, we obtain a linear $\log\barτ-\log \tilde{M}$ relation: $\log\barτ = γ(\log \tilde{M}-14)+\logβ$, in which $γ=0.55\pm0.1$. We also vary the aperture photometric filter radius and measure the $\barτ$ profiles of group samples, whose constraints on the baryon distribution within and around dark matter halos will be discussed in a companion paper.

astro-ph.CO↗

arXiv2024

Binding Touch to Everything: Learning Unified Multimodal Tactile Representations

The ability to associate touch with other modalities has huge implications for humans and computational systems. However, multimodal learning with touch remains challenging due to the expensive data collection process and non-standardized sensor outputs. We introduce UniTouch, a unified tactile model for vision-based touch sensors connected to multiple modalities, including vision, language, and sound. We achieve this by aligning our UniTouch embeddings to pretrained image embeddings already associated with a variety of other modalities. We further propose learnable sensor-specific tokens, allowing the model to learn from a set of heterogeneous tactile sensors, all at the same time. UniTouch is capable of conducting various touch sensing tasks in the zero-shot setting, from robot grasping prediction to touch image question answering. To the best of our knowledge, UniTouch is the first to demonstrate such capabilities. Project page: https://cfeng16.github.io/UniTouch/

cs.CV↗

arXiv2023

Hundred-Femtosecond-Level Concise Optical Time Delay Measurement System Based on Linear Optical Sampling

Fiber-delay measurement is one of the key fundamental technologies in numerous fields. Here we propose and experimentally demonstrate a high-precision and concise optical time delay measurement system based on the technique of linear optical sampling, reaching the precision better than 100 fs under averaging. The use of only two optical frequency combs without locking the carrier-envelope-offset frequency greatly simplifies the structure of the time-delay measurement system. We also experimentally investigate the current limitations on the precision of the system. The timing jitter noises of two sources are mainly non-common mode, and are both restricted to the frequency sources. Our results indicate that the proposed device can measure fiber length fluctuations below 10 $μ{\rm{m}}$, paving the way for further analyses of the external disturbances on the fiber link.

physics.optics↗

arXiv2023

Node-downloadable frequency transfer system based on a mode-locked laser with over 100 km of fiber

To meet the requirements of time-frequency networks and enable frequency downloadability for nodes along the link, we demonstrated the extraction of stable frequency signals at nodes using a mode-locked laser under the condition of 100 km laboratory fiber. The node consists of a simple structure that utilizes widely used optoelectronic devices and enables plug-and-play applications. In addition, the node can recover frequency signals with multiple frequencies, which are useful for scenarios that require different frequencies. Here, we experimentally demonstrated a short-term frequency instability of $2.83\times {{10}^{-13}}$@1 s and a long-term frequency instability of $1.18\times {{10}^{-15}}$@10,000 s at the node, which is similar to that at the remote site of the frequency transfer system. At the same time, frequency signals with different frequencies also achieved stable extraction with the same performance at the node. Our results can support the distributed application under large-scale time-frequency networks.

physics.optics↗

arXiv2023

Time-interval Measurement with Linear Optical Sampling at the Femtosecond Level

High-precision time-interval measurement is a fundamental technique in many advanced applications, including time and distance metrology, particle physics, and ultra-precision machining. However, many of these applications are confined by the imprecise time-interval measurement of electrical signals, restricting the performance of the ultimate system to a few picoseconds, which limits ultra-high-precision applications. Here, we demonstrate an optical means of the time-interval measurement of electrical signals that can successfully achieve femtosecond (fs)-level precision. The setup is established using the optical-frequency-comb (OFC)-based linear optical sampling technique to realize timescale-stretched measurement. We achieve the measurement precision of 82 fs for a single LOS scan measurement and 3.05 fs for the 100-times average with post-processing, which is three orders of magnitude higher than the results of older electrical methods. The high-precision time interval measurement of electrical signals can substantially improve precision measurement technologies.

physics.optics↗

arXiv2023

SegRap2023: A Benchmark of Organs-at-Risk and Gross Tumor Volume Segmentation for Radiotherapy Planning of Nasopharyngeal Carcinoma

Radiation therapy is a primary and effective NasoPharyngeal Carcinoma (NPC) treatment strategy. The precise delineation of Gross Tumor Volumes (GTVs) and Organs-At-Risk (OARs) is crucial in radiation treatment, directly impacting patient prognosis. Previously, the delineation of GTVs and OARs was performed by experienced radiation oncologists. Recently, deep learning has achieved promising results in many medical image segmentation tasks. However, for NPC OARs and GTVs segmentation, few public datasets are available for model development and evaluation. To alleviate this problem, the SegRap2023 challenge was organized in conjunction with MICCAI2023 and presented a large-scale benchmark for OAR and GTV segmentation with 400 Computed Tomography (CT) scans from 200 NPC patients, each with a pair of pre-aligned non-contrast and contrast-enhanced CT scans. The challenge's goal was to segment 45 OARs and 2 GTVs from the paired CT scans. In this paper, we detail the challenge and analyze the solutions of all participants. The average Dice similarity coefficient scores for all submissions ranged from 76.68\% to 86.70\%, and 70.42\% to 73.44\% for OARs and GTVs, respectively. We conclude that the segmentation of large-size OARs is well-addressed, and more efforts are needed for GTVs and small-size or thin-structure OARs. The benchmark will remain publicly available here: https://segrap2023.grand-challenge.org

eess.IV↗

arXiv2023

A Survey of Large Language Models Attribution

Open-domain generative systems have gained significant attention in the field of conversational AI (e.g., generative search engines). This paper presents a comprehensive review of the attribution mechanisms employed by these systems, particularly large language models. Though attribution or citation improve the factuality and verifiability, issues like ambiguous knowledge reservoirs, inherent biases, and the drawbacks of excessive attribution can hinder the effectiveness of these systems. The aim of this survey is to provide valuable insights for researchers, aiding in the refinement of attribution methodologies to enhance the reliability and veracity of responses generated by open-domain generative systems. We believe that this field is still in its early stages; hence, we maintain a repository to keep track of ongoing studies at https://github.com/HITsz-TMG/awesome-llm-attributions.

cs.CL↗

arXiv2023

Continual Self-supervised Learning: Towards Universal Multi-modal Medical Data Representation Learning

Self-supervised learning is an efficient pre-training method for medical image analysis. However, current research is mostly confined to specific-modality data pre-training, consuming considerable time and resources without achieving universality across different modalities. A straightforward solution is combining all modality data for joint self-supervised pre-training, which poses practical challenges. Firstly, our experiments reveal conflicts in representation learning as the number of modalities increases. Secondly, multi-modal data collected in advance cannot cover all real-world scenarios. In this paper, we reconsider versatile self-supervised learning from the perspective of continual learning and propose MedCoSS, a continuous self-supervised learning approach for multi-modal medical data. Unlike joint self-supervised learning, MedCoSS assigns different modality data to different training stages, forming a multi-stage pre-training process. To balance modal conflicts and prevent catastrophic forgetting, we propose a rehearsal-based continual learning method. We introduce the k-means sampling strategy to retain data from previous modalities and rehearse it when learning new modalities. Instead of executing the pretext task on buffer data, a feature distillation strategy and an intra-modal mixup strategy are applied to these data for knowledge retention. We conduct continuous self-supervised pre-training on a large-scale multi-modal unlabeled dataset, including clinical reports, X-rays, CT scans, MRI scans, and pathological images. Experimental results demonstrate MedCoSS's exceptional generalization ability across nine downstream datasets and its significant scalability in integrating new modality data. Code and pre-trained weight are available at https://github.com/yeerwen/MedCoSS.

cs.CV↗

arXiv2023

Large Language Models Meet Harry Potter: A Bilingual Dataset for Aligning Dialogue Agents with Characters

In recent years, Dialogue-style Large Language Models (LLMs) such as ChatGPT and GPT4 have demonstrated immense potential in constructing open-domain dialogue agents. However, aligning these agents with specific characters or individuals remains a considerable challenge due to the complexities of character representation and the lack of comprehensive annotations. In this paper, we introduce the Harry Potter Dialogue (HPD) dataset, designed to advance the study of dialogue agents and character alignment. The dataset encompasses all dialogue sessions (in both English and Chinese) from the Harry Potter series and is annotated with vital background information, including dialogue scenes, speakers, character relationships, and attributes. These extensive annotations may empower LLMs to unlock character-driven dialogue capabilities. Furthermore, it can serve as a universal benchmark for evaluating how well can a LLM aligning with a specific character. We benchmark LLMs on HPD using both fine-tuning and in-context learning settings. Evaluation results reveal that although there is substantial room for improvement in generating high-quality, character-aligned responses, the proposed dataset is valuable in guiding models toward responses that better align with the character of Harry Potter.

cs.CL↗

arXiv2023

Statistics of thermal gas pressure as a probe of cosmology and galaxy formation

The statistics of thermal gas pressure are a new and promising probe of cosmology and astrophysics. The large-scale cross-correlation between galaxies and the thermal Sunyaev-Zeldovich effect gives the bias-weighted mean electron pressure, $\langle b_\mathrm{h}P_e\rangle$. In this paper, we show that $\langle b_\mathrm{h}P_e\rangle$ is sensitive to the amplitude of fluctuations in matter density, for example $\langle b_\mathrm{h}P_e\rangle\propto \left(σ_8Ω_\mathrm{m}^{0.81}h^{0.67}\right)^{3.14}$ at redshift $z=0$. We find that at $z<0.5$ the observed $\langle b_\mathrm{h}P_e\rangle$ is smaller than that predicted by the state-of-the-art hydrodynamical simulations of galaxy formation, MillenniumTNG, by a factor of $0.93$. This can be explained by a lower value of $σ_8$ and $Ω_\mathrm{m}$, similar to the so-called "$S_8$ tension'' seen in the gravitational lensing effect, although the influence of astrophysics cannot be completely excluded. The difference between Magneticum and MillenniumTNG at $z<2$ is small, indicating that the difference in the galaxy formation models used by these simulations has little impact on $\langle b_\mathrm{h}P_e\rangle$ at this redshift range. At higher $z$, we find that both simulations are in a modest tension with the existing upper bounds on $\langle b_\mathrm{h}P_e\rangle$. We also find a significant difference between these simulations there, which we attribute to a larger sensitivity to the galaxy formation models in the high redshift regime. Therefore, more precise measurements of $\langle b_\mathrm{h}P_e\rangle$ at all redshifts will provide a new test of our understanding of cosmology and galaxy formation.

astro-ph.CO↗