arXiv subjects

Jun Chen

Publications and source records attributed to Jun Chen.

At least 181 records · Page 10Linked to original sources

arXiv2025

The Codec Language Model-based Zero-Shot Spontaneous Style TTS System for CoVoC Challenge 2024

This paper describes the zero-shot spontaneous style TTS system for the ISCSLP 2024 Conversational Voice Clone Challenge (CoVoC). We propose a LLaMA-based codec language model with a delay pattern to achieve spontaneous style voice cloning. To improve speech intelligibility, we introduce the Classifier-Free Guidance (CFG) strategy in the language model to strengthen conditional guidance on token prediction. To generate high-quality utterances, we adopt effective data preprocessing operations and fine-tune our model with selected high-quality spontaneous speech data. The official evaluations in the CoVoC constrained track show that our system achieves the best speech naturalness MOS of 3.80 and obtains considerable speech quality and speaker similarity results.

cs.SD↗

arXiv2025

Ferroelectricity in layered bismuth oxide down to 1 nanometer

Atomic-scale ferroelectrics are of great interest for high-density electronics, particularly field-effect transistors, low-power logic, and nonvolatile memories. We devised a film with a layered structure of bismuth oxide that can stabilize the ferroelectric state down to 1 nanometer through samarium bondage. This film can be grown on a variety of substrates with a cost-effective chemical solution deposition. We observed a standard ferroelectric hysteresis loop down to a thickness of ~1 nanometer. The thin films with thicknesses that range from 1 to 4.56 nanometers possess a relatively large remanent polarization from 17 to 50 microcoulombs per square centimeter. We verified the structure with first-principles calculations, which also pointed to the material being a lone pair-driven ferroelectric material. The structure design of the ultrathin ferroelectric films has great potential for the manufacturing of atomic-scale electronic devices.

cond-mat.mtrl-sci↗

arXiv2025

Quantum Twin Interferometers

Quantum-correlated interferometer is a newly emerging tool in quantum technology that offers classical-limit-breaking phase sensitivity. But to date, there exists a configurational bottleneck for its practicability due to the low phase-sensitive photon numbers limited by the current detection strategies. Here we establish an innovative development termed as ``quantum twin interferometer'' with dual pairs of entangled twin beams arranged in the parallel configuration, allowing fully exploits the quantum resource through the new configuration of entangled detection. We observe the distributed phase sensing with 3 dB quantum noise reduction in phase-sensing power at the level of milliwatts, which advances the record of signal-to-noise ratio so far achieved in photon-correlated interferometers by three orders of magnitude. The developed techniques in this work can be used to revolutionize a diversity of quantum devices requiring phase measurement.

physics.atom-ph↗

arXiv2025

Hyperbolic Binary Neural Network

Binary Neural Network (BNN) converts full-precision weights and activations into their extreme 1-bit counterparts, making it particularly suitable for deployment on lightweight mobile devices. While binary neural networks are typically formulated as a constrained optimization problem and optimized in the binarized space, general neural networks are formulated as an unconstrained optimization problem and optimized in the continuous space. This paper introduces the Hyperbolic Binary Neural Network (HBNN) by leveraging the framework of hyperbolic geometry to optimize the constrained problem. Specifically, we transform the constrained problem in hyperbolic space into an unconstrained one in Euclidean space using the Riemannian exponential map. On the other hand, we also propose the Exponential Parametrization Cluster (EPC) method, which, compared to the Riemannian exponential map, shrinks the segment domain based on a diffeomorphism. This approach increases the probability of weight flips, thereby maximizing the information gain in BNNs. Experimental results on CIFAR10, CIFAR100, and ImageNet classification datasets with VGGsmall, ResNet18, and ResNet34 models illustrate the superior performance of our HBNN over state-of-the-art methods.

cs.LG↗

arXiv2024

Low-Light Image Enhancement via Generative Perceptual Priors

Although significant progress has been made in enhancing visibility, retrieving texture details, and mitigating noise in Low-Light (LL) images, the challenge persists in applying current Low-Light Image Enhancement (LLIE) methods to real-world scenarios, primarily due to the diverse illumination conditions encountered. Furthermore, the quest for generating enhancements that are visually realistic and attractive remains an underexplored realm. In response to these challenges, we introduce a novel \textbf{LLIE} framework with the guidance of \textbf{G}enerative \textbf{P}erceptual \textbf{P}riors (\textbf{GPP-LLIE}) derived from vision-language models (VLMs). Specifically, we first propose a pipeline that guides VLMs to assess multiple visual attributes of the LL image and quantify the assessment to output the global and local perceptual priors. Subsequently, to incorporate these generative perceptual priors to benefit LLIE, we introduce a transformer-based backbone in the diffusion process, and develop a new layer normalization (\textit{\textbf{GPP-LN}}) and an attention mechanism (\textit{\textbf{LPP-Attn}}) guided by global and local perceptual priors. Extensive experiments demonstrate that our model outperforms current SOTA methods on paired LL datasets and exhibits superior generalization on real-world data. The code is released at \url{https://github.com/LowLevelAI/GPP-LLIE}.

cs.CV↗

arXiv2024

Channel-Aware Optimal Transport: A Theoretical Framework for Generative Communication

Optimal transport has numerous applications, particularly in machine learning tasks involving generative models. In practice, the transportation process often encounters an information bottleneck, typically arising from the conversion of a communication channel into a rate-limited bit pipeline using error correction codes. While this conversion enables a channel-oblivious approach to optimal transport, it fails to fully exploit the available degrees of freedom. Motivated by the emerging paradigm of generative communication, this paper examines the problem of channel-aware optimal transport, where a block of i.i.d. random variables is transmitted through a memoryless channel to generate another block of i.i.d. random variables with a prescribed marginal distribution such that the end-to-end distortion is minimized. With unlimited common randomness available to the encoder and decoder, the source-channel separation architecture is shown to be asymptotically optimal as the blocklength approaches infinity. On the other hand, in the absence of common randomness, the source-channel separation architecture is generally suboptimal. For this scenario, a hybrid coding scheme is proposed, which partially retains the generative capabilities of the given channel while enabling reliable transmission of digital information. It is demonstrated that the proposed hybrid coding scheme can outperform both separation-based and uncoded schemes.

cs.IT↗

arXiv2024

Phantom hairy black holes and wormholes in Einstein-bumblebee gravity

In this paper we study Einstein-bumblebee gravity theory minimally coupled with external matter -- a phantom/non-phantom(conventional) scalar field, and derive a series of hairy solutions -- bumblebee-phantom(BP) and BP-dS/AdS black hole solutions, regular Ellis-bumblebee-phantom (EBP) and BP-AdS wormholes, etc. We first find that the Lorentz violation (LV) effect can change the so called black hole no-hair theorem and these scalar fields can give a hair to a black hole. If LV coupling constant $\ell>-1$, the phantom field is admissible and the conventional scalar field is forbidden; if $\ell<-1$, the phantom field is forbidden and the conventional scalar field is admissible. By defining the Killing potential $ω^{ab}$, we study the Smarr formula and the first law for the BP black hole, find that the appearance of LV can improve the structure of these phantom hairy black holes -- the conventional Smarr formula and the first law of black hole thermodynamics still hold; but for no LV case, i.e., the regular phantom black hole reported in [Phys. Rev. Lett. {\bf96}, 251101], the first law cannot be constructed at all. When the bumblebee potential is linear, we find that the phantom potential and the Lagrange-multiplier $λ$ behave as a cosmological constant $Λ$.

gr-qc↗

arXiv2024

Learning Discretized Neural Networks under Ricci Flow

In this paper, we study Discretized Neural Networks (DNNs) composed of low-precision weights and activations, which suffer from either infinite or zero gradients due to the non-differentiable discrete function during training. Most training-based DNNs in such scenarios employ the standard Straight-Through Estimator (STE) to approximate the gradient w.r.t. discrete values. However, the use of STE introduces the problem of gradient mismatch, arising from perturbations in the approximated gradient. To address this problem, this paper reveals that this mismatch can be interpreted as a metric perturbation in a Riemannian manifold, viewed through the lens of duality theory. Building on information geometry, we construct the Linearly Nearly Euclidean (LNE) manifold for DNNs, providing a background for addressing perturbations. By introducing a partial differential equation on metrics, i.e., the Ricci flow, we establish the dynamical stability and convergence of the LNE metric with the $L^2$-norm perturbation. In contrast to previous perturbation theories with convergence rates in fractional powers, the metric perturbation under the Ricci flow exhibits exponential decay in the LNE manifold. Experimental results across various datasets demonstrate that our method achieves superior and more stable performance for DNNs compared to other representative training-based methods.

cs.LG↗

arXiv2024

Improving Retrieval Augmented Language Model with Self-Reasoning

The Retrieval-Augmented Language Model (RALM) has shown remarkable performance on knowledge-intensive tasks by incorporating external knowledge during inference, which mitigates the factual hallucinations inherited in large language models (LLMs). Despite these advancements, challenges persist in the implementation of RALMs, particularly concerning their reliability and traceability. To be specific, the irrelevant document retrieval may result in unhelpful response generation or even deteriorate the performance of LLMs, while the lack of proper citations in generated outputs complicates efforts to verify the trustworthiness of the models. To this end, we propose a novel self-reasoning framework aimed at improving the reliability and traceability of RALMs, whose core idea is to leverage reasoning trajectories generated by the LLM itself. The framework involves constructing self-reason trajectories with three processes: a relevance-aware process, an evidence-aware selective process, and a trajectory analysis process. We have evaluated our framework across four public datasets (two short-form QA datasets, one long-form QA dataset, and one fact verification dataset) to demonstrate the superiority of our method, which can outperform existing state-of-the-art models and can achieve comparable performance with GPT-4, while only using 2,000 training samples.

cs.CL↗

arXiv2024

Light-induced thermal noise \textit{anomaly} governed by quantum metric

Traditionally, thermal noise in electric currents, arising from thermal agitation, is expected to increase with temperature $T$ and disappear as $T$ approaches zero. Contrary to this expectation, we discover that the resonant DC thermal noise (DTN) in photocurrents not only persists at $T=0$ but also exhibits a divergence proportional to $1/T$. This thermal noise \textit{anomaly} arises from the unique electron-photon interactions near the Fermi surface, manifesting as the interplay between the inherent Fermi-surface property and the resonant optical selection rules of DTN, and thereby represents an unexplored noise regime. Notably, we reveal that this \textit{anomalous} DTN, especially in time-reversal-invariant systems, is intrinsically linked to the quantum metric. We illustrate this \textit{anomalous} DTN in massless Dirac materials, including two-dimensional graphene, the surfaces of three-dimensional topological insulators, and three-dimensional Weyl semimetals, where the quantum metric plays a pivotal role. Finally, we find that the total noise spectrum at low temperatures, which includes both the DC shot noise and the \textit{anomalous} DTN, will universally peak at $ω_p=2|μ|$ with $ω_p$ the frequency of light and $μ$ the chemical potential of the bulk crystals.

cond-mat.mes-hall↗

arXiv2024

Document Haystacks: Vision-Language Reasoning Over Piles of 1000+ Documents

Large multimodal models (LMMs) have achieved impressive progress in vision-language understanding, yet they face limitations in real-world applications requiring complex reasoning over a large number of images. Existing benchmarks for multi-image question-answering are limited in scope, each question is paired with only up to 30 images, which does not fully capture the demands of large-scale retrieval tasks encountered in the real-world usages. To reduce these gaps, we introduce two document haystack benchmarks, dubbed DocHaystack and InfoHaystack, designed to evaluate LMM performance on large-scale visual document retrieval and understanding. Additionally, we propose V-RAG, a novel, vision-centric retrieval-augmented generation (RAG) framework that leverages a suite of multimodal vision encoders, each optimized for specific strengths, and a dedicated question-document relevance module. V-RAG sets a new standard, with a 9% and 11% improvement in Recall@1 on the challenging DocHaystack-1000 and InfoHaystack-1000 benchmarks, respectively, compared to the previous best baseline models. Additionally, integrating V-RAG with LMMs enables them to efficiently operate across thousands of images, yielding significant improvements on our DocHaystack and InfoHaystack benchmarks. Our code and datasets are available at https://github.com/Vision-CAIR/dochaystacks

cs.CV↗

arXiv2024

Confined Magnetization at the Sublattice-Matched Ruthenium Oxide Heterointerface

Creating a heterostructure by combining two magnetically and structurally distinct ruthenium oxides is a crucial approach for investigating their emergent magnetic states and interactions. Previously, research has predominantly concentrated on the intrinsic properties of the ferromagnet SrRuO3 and recently discovered altermagnet RuO2 solely. Here, we engineered an ultrasharp sublattice-matched heterointerface using pseudo-cubic SrRuO3 and rutile RuO2, conducting an in-depth analysis of their spin interactions. Structurally, to accommodate the lattice symmetry mismatch, the inverted RuO2 layer undergoes an in-plane rotation of 18 degrees during epitaxial growth on SrRuO3 layer, resulting in an interesting and rotational interface with perfect crystallinity and negligible chemical intermixing. Performance-wise, the interfacial layer of 6 nm in RuO2 adjacent to SrRuO3 exhibits a nonzero magnetic moment, contributing to an enhanced anomalous Hall effect (AHE) at low temperatures. Furthermore, our observations indicate that, in contrast to SrRuO3 single layers, the AHE of [(RuO2)15/(SrRuO3)n] heterostructures shows nonlinear behavior and reaches its maximum when the SrRuO3 thickness reaches tens of nm. These results suggest that the interfacial magnetic interaction surpasses that of all-perovskite oxides (~5-unit cells). This study underscores the significance and potential applications of magnetic interactions based on the crystallographic asymmetric interfaces in the design of spintronic devices.

cond-mat.mtrl-sci↗

arXiv2024

Electrically functionalized body surface for deep-tissue bioelectrical recording

Directly probing deep tissue activities from body surfaces offers a noninvasive approach to monitoring essential physiological processes1-3. However, this method is technically challenged by rapid signal attenuation toward the body surface and confounding motion artifacts4-6 primarily due to excessive contact impedance and mechanical mismatch with conventional electrodes. Herein, by formulating and directly spray coating biocompatible two-dimensional nanosheet ink onto the human body under ambient conditions, we create microscopically conformal and adaptive van der Waals thin films (VDWTFs) that seamlessly merge with non-Euclidean, hairy, and dynamically evolving body surfaces. Unlike traditional deposition methods, which often struggle with conformality and adaptability while retaining high electronic performance, this gentle process enables the formation of high-performance VDWTFs directly on the body surface under bio-friendly conditions, making it ideal for biological applications. This results in low-impedance electrically functionalized body surfaces (EFBS), enabling highly robust monitoring of biopotential and bioimpedance modulations associated with deep-tissue activities, such as blood circulation, muscle movements, and brain activities. Compared to commercial solutions, our VDWTF-EFBS exhibits nearly two-orders of magnitude lower contact impedance and substantially reduces the extrinsic motion artifacts, enabling reliable extraction of bioelectrical signals from irregular surfaces, such as unshaved human scalps. This advancement defines a technology for continuous, noninvasive monitoring of deep-tissue activities during routine body movements.

physics.med-ph↗

arXiv2024

Investigating the Convergence of Sigmoid-Based Fuzzy General Grey Cognitive Maps

The Fuzzy General Grey Cognitive Map (FGGCM) and Fuzzy Grey Cognitive Map (FGCM) extend the Fuzzy Cognitive Map (FCM) by integrating uncertainty from multiple interval data or fuzzy numbers. Despite extensive studies on the convergence of FCM and FGCM, the convergence behavior of FGGCM under sigmoid activation functions remains underexplored. This paper addresses this gap by deriving sufficient conditions for the convergence of FGGCM to a unique fixed point. Using the Banach and Browder-Gohde-Kirk fixed point theorems, and Cauchy-Schwarz inequality, the study establishes conditions for the kernels and greyness of FGGCM to converge to unique fixed points. A Web Experience FCM is adapted to design an FGGCM with weights modified to GGN. Comparisons with existing FCM and FGCM convergence theorems confirm that they are special cases of the theorems proposed here. The conclusions support the application of FGGCM in domains such as control, prediction, and decision support systems.

eess.SY↗

arXiv2024

In Search of Truth: In memory of Balraj Singh

Born in Punjab (India) in December 1941, Balraj Singh is not only the single most prolific nuclear data evaluator and disseminator of nuclear structure and decay data with 148 evaluations in Nuclear Data Sheets -- 85 as the first and often only author -- plus other journals, but his upmost curiosity and dedication brought him to be one of the finest nuclear physicists, with an everlasting influence on many of us. Balraj passed away about a year ago on 9 October 2023 in Ottawa, Ontario (Canada) at the age of 81, and at Atomic Data and Nuclear Data Tables we would like to commemorate some of his scientific achievements.

nucl-th↗

arXiv2024

Landing Trajectory Prediction for UAS Based on Generative Adversarial Network

Models for trajectory prediction are an essential component of many advanced air mobility studies. These models help aircraft detect conflict and plan avoidance maneuvers, which is especially important in Unmanned Aircraft systems (UAS) landing management due to the congested airspace near vertiports. In this paper, we propose a landing trajectory prediction model for UAS based on Generative Adversarial Network (GAN). The GAN is a prestigious neural network that has been developed for many years. In previous research, GAN has achieved many state-of-the-art results in many generation tasks. The GAN consists of one neural network generator and a neural network discriminator. Because of the learning capacity of the neural networks, the generator is capable to understand the features of the sample trajectory. The generator takes the previous trajectory as input and outputs some random status of a flight. According to the results of the experiences, the proposed model can output more accurate predictions than the baseline method(GMR) in various datasets. To evaluate the proposed model, we also create a real UAV landing dataset that includes more than 2600 trajectories of drone control manually by real pilots.

cs.RO↗

arXiv2024

Transformer-based Heuristic for Advanced Air Mobility Planning

Safety is extremely important for urban flights of autonomous Unmanned Aerial Vehicles (UAVs). Risk-aware path planning is one of the most effective methods to guarantee the safety of UAVs. This type of planning can be represented as a Constrained Shortest Path (CSP) problem, which seeks to find the shortest route that meets a predefined safety constraint. Solving CSP problems is NP-hard, presenting significant computational challenges. Although traditional methods can accurately solve CSP problems, they tend to be very slow. Previously, we introduced an additional safety dimension to the traditional A* algorithm, known as ASD A*, to effectively handle Constrained Shortest Path (CSP) problems. Then, we developed a custom learning-based heuristic using transformer-based neural networks, which significantly reduced computational load and enhanced the performance of the ASD A* algorithm. In this paper, we expand our dataset to include more risk maps and tasks, improve the proposed model, and increase its performance. We also introduce a new heuristic strategy and a novel neural network, which enhance the overall effectiveness of our approach.

cs.RO↗

arXiv2024

Quantum Locking of Intrinsic Spin Squeezed State in Earth-field-range Magnetometry

In the Earth-field range, the nonlinear Zeeman (NLZ) effect has been a bottleneck limiting the sensitivity and accuracy of atomic magnetometry from physical mechanism. To break this bottleneck, various techniques are introduced to suppress the NLZ effect. Here we revisit the spin dynamics in the Earth-field-range magnetometry and identify the existence of the intrinsic spin squeezed state (SSS) generated from the geomagnetically induced NLZ effect with the oscillating squeezing degree and squeezing axis. Such oscillating features of the SSS prevent its direct observation and as well, accessibility to magnetic sensing. To exploit quantum advantage of the intrinsic SSS in the Earth-field-range magnetometry, it's essential to lock the oscillating SSS to a persistent one. Hence, we develop a quantum locking technique to achieve a persistent SSS, benefiting from which the sensitivity of the Earth-field-range magnetometer is quantum-enhanced. This work presents an innovative way turning the drawback of NLZ effect into the quantum advantage and opens a new access to quantum-enhanced magnetometry in the Earth-field range.

physics.atom-ph↗