arXiv subjects

Jun Chen

Publications and source records attributed to Jun Chen.

At least 199 records · Page 11Linked to original sources

arXiv2024

Minimum Entropy Coupling with Bottleneck

This paper investigates a novel lossy compression framework operating under logarithmic loss, designed to handle situations where the reconstruction distribution diverges from the source distribution. This framework is especially relevant for applications that require joint compression and retrieval, and in scenarios involving distributional shifts due to processing. We show that the proposed formulation extends the classical minimum entropy coupling framework by integrating a bottleneck, allowing for a controlled degree of stochasticity in the coupling. We explore the decomposition of the Minimum Entropy Coupling with Bottleneck (MEC-B) into two distinct optimization problems: Entropy-Bounded Information Maximization (EBIM) for the encoder, and Minimum Entropy Coupling (MEC) for the decoder. Through extensive analysis, we provide a greedy algorithm for EBIM with guaranteed performance, and characterize the optimal solution near functional mappings, yielding significant theoretical insights into the structural complexity of this problem. Furthermore, we illustrate the practical application of MEC-B through experiments in Markov Coding Games (MCGs) under rate limits. These games simulate a communication scenario within a Markov Decision Process, where an agent must transmit a compressed message from a sender to a receiver through its actions. Our experiments highlight the trade-offs between MDP rewards and receiver accuracy across various compression rates, showcasing the efficacy of our method compared to conventional compression baseline.

cs.LG↗

arXiv2024

ECMamba: Consolidating Selective State Space Model with Retinex Guidance for Efficient Multiple Exposure Correction

Exposure Correction (EC) aims to recover proper exposure conditions for images captured under over-exposure or under-exposure scenarios. While existing deep learning models have shown promising results, few have fully embedded Retinex theory into their architecture, highlighting a gap in current methodologies. Additionally, the balance between high performance and efficiency remains an under-explored problem for exposure correction task. Inspired by Mamba which demonstrates powerful and highly efficient sequence modeling, we introduce a novel framework based on Mamba for Exposure Correction (ECMamba) with dual pathways, each dedicated to the restoration of reflectance and illumination map, respectively. Specifically, we firstly derive the Retinex theory and we train a Retinex estimator capable of mapping inputs into two intermediary spaces, each approximating the target reflectance and illumination map, respectively. This setup facilitates the refined restoration process of the subsequent Exposure Correction Mamba Module (ECMM). Moreover, we develop a novel 2D Selective State-space layer guided by Retinex information (Retinex-SS2D) as the core operator of ECMM. This architecture incorporates an innovative 2D scanning strategy based on deformable feature aggregation, thereby enhancing both efficiency and effectiveness. Extensive experiment results and comprehensive ablation studies demonstrate the outstanding performance and the importance of each component of our proposed ECMamba. Code is available at https://github.com/LowlevelAI/ECMamba.

cs.CV↗

arXiv2024

LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understanding

Multimodal Large Language Models (MLLMs) have shown promising progress in understanding and analyzing video content. However, processing long videos remains a significant challenge constrained by LLM's context size. To address this limitation, we propose LongVU, a spatiotemporal adaptive compression mechanism thats reduces the number of video tokens while preserving visual details of long videos. Our idea is based on leveraging cross-modal query and inter-frame dependencies to adaptively reduce temporal and spatial redundancy in videos. Specifically, we leverage DINOv2 features to remove redundant frames that exhibit high similarity. Then we utilize text-guided cross-modal query for selective frame feature reduction. Further, we perform spatial token reduction across frames based on their temporal dependencies. Our adaptive compression strategy effectively processes a large number of frames with little visual information loss within given context length. Our LongVU consistently surpass existing methods across a variety of video understanding benchmarks, especially on hour-long video understanding tasks such as VideoMME and MLVU. Given a light-weight LLM, our LongVU also scales effectively into a smaller size with state-of-the-art video understanding performance.

cs.CV↗

arXiv2024

Noncollinear ferrielectricity and hydrogen-induced ferromagnetic polar half-metallicity in MnO$_3$Cl

Collinear dipole orders such as ferroelectricity and antiferroelectricity have developed rapidly in last decades. While, the noncollinear dipole orders are rarely touched in solids. Noncollinear dipole orders can provide a route to realize ferrielectricity. Based on first-principles calculations, an inorganic molecular crystal MnO$_3$Cl has been demonstrated to own intrinsic noncollinear ferrielectricity, which originates from the stereo orientations of polar molecules. The large negative piezoelectricity effect ($d_{33}\sim-27$ pC/N) is also predicted. A strong light absorption and moderate optical anisotropy are found for this molecular crystal in the ultraviolet light window. Additionally, by electron doping via hydrogen intercalation, a ferromagnetic polar half-metals can be obtained. Our study here provide a material platform to explore the intriguing physics of noncollinear ferrielectricity and potential applications in devices.

cond-mat.mtrl-sci↗

arXiv2024

Band alignment effect in the topological photonic alloy

Recently, a photonic alloy with non-trivial topological properties has been proposed, based on the random mixing of Yttrium Iron Garnet (YIG) and magnetized YIG rods. When the doping concentration of magnetized YIG rods is less than one, a chiral edge state (CES) of the topological photonic alloy appears in the frequency range of the non-trivial topological gap of the magnetized YIG crystal. In this work, we surprisingly find that by randomly mixing the Perfect Electric Conductor (PEC) and magnetized YIG rods in a square lattice, the photonic alloy system with appropriate doping concentrations can present CES in special frequency intervals even when both components support the propagation of bulk states. Analyzing the band structure of two components, we noticed a shift between the first trivial bandgap for PEC and the first topological bandgap for magnetized YIG. When calculating the transmission spectrum of the photonic alloy, we discovered that the frequency range for the topological gap gradually opens from the lower limit frequency of the bandgap for PEC to the bandgap for the magnetized YIG rods. The topological gap opening occurs as the doping concentration of magnetized YIG rods increases, creating an effective band alignment effect. Moreover, the topological gap for the photonic alloy is confirmed by calculating the reflection phase winding with the scattering method. Lastly, the gradual appearance of the CES is identified by applying Fourier transformation to real-space electromagnetic fields. Our work broadens the possibilities for flexible topological gap engineering in the photonic alloy system.

physics.optics↗

arXiv2024

Data-driven Probabilistic Trajectory Learning with High Temporal Resolution in Terminal Airspace

Predicting flight trajectories is a research area that holds significant merit. In this paper, we propose a data-driven learning framework, that leverages the predictive and feature extraction capabilities of the mixture models and seq2seq-based neural networks while addressing prevalent challenges caused by error propagation and dimensionality reduction. After training with this framework, the learned model can improve long-step prediction accuracy significantly given the past trajectories and the context information. The accuracy and effectiveness of the approach are evaluated by comparing the predicted trajectories with the ground truth. The results indicate that the proposed method has outperformed the state-of-the-art predicting methods on a terminal airspace flight trajectory dataset. The trajectories generated by the proposed method have a higher temporal resolution(1 timestep per second vs 0.1 timestep per second) and are closer to the ground truth.

cs.RO↗

arXiv2024

Learning-accelerated A* Search for Risk-aware Path Planning

Safety is a critical concern for urban flights of autonomous Unmanned Aerial Vehicles. In populated environments, risk should be accounted for to produce an effective and safe path, known as risk-aware path planning. Risk-aware path planning can be modeled as a Constrained Shortest Path (CSP) problem, aiming to identify the shortest possible route that adheres to specified safety thresholds. CSP is NP-hard and poses significant computational challenges. Although many traditional methods can solve it accurately, all of them are very slow. Our method introduces an additional safety dimension to the traditional A* (called ASD A*), enabling A* to handle CSP. Furthermore, we develop a custom learning-based heuristic using transformer-based neural networks, which significantly reduces the computational load and improves the performance of the ASD A* algorithm. The proposed method is well-validated with both random and realistic simulation scenarios.

cs.RO↗

arXiv2024

RobustSVC: HuBERT-based Melody Extractor and Adversarial Learning for Robust Singing Voice Conversion

Singing voice conversion (SVC) is hindered by noise sensitivity due to the use of non-robust methods for extracting pitch and energy during the inference. As clean signals are key for the source audio in SVC, music source separation preprocessing offers a viable solution for handling noisy audio, like singing with background music (BGM). However, current separating methods struggle to fully remove noise or excessively suppress signal components, affecting the naturalness and similarity of the processed audio. To tackle this, our study introduces RobustSVC, a novel any-to-one SVC framework that converts noisy vocals into clean vocals sung by the target singer. We replace the non-robust feature with a HuBERT-based melody extractor and use adversarial training mechanisms with three discriminators to reduce information leakage in self-supervised representations. Experimental results show that RobustSVC is noise-robust and achieves higher similarity and naturalness than baseline methods in both noisy and clean vocal conditions.

cs.SD↗

arXiv2024

On the Convergence of Sigmoid and tanh Fuzzy General Grey Cognitive Maps

Fuzzy General Grey Cognitive Map (FGGCM) and Fuzzy Grey Cognitive Map (FGCM) are extensions of Fuzzy Cognitive Map (FCM) in terms of uncertainty. FGGCM allows for the processing of general grey number with multiple intervals, enabling FCM to better address uncertain situations. Although the convergence of FCM and FGCM has been discussed in many literature, the convergence of FGGCM has not been thoroughly explored. This paper aims to fill this research gap. First, metrics for the general grey number space and its vector space is given and proved using the Minkowski inequality. By utilizing the characteristic that Cauchy sequences are convergent sequences, the completeness of these two space is demonstrated. On this premise, utilizing Banach fixed point theorem and Browder-Gohde-Kirk fixed point theorem, combined with Lagrange's mean value theorem and Cauchy's inequality, deduces the sufficient conditions for FGGCM to converge to a unique fixed point when using tanh and sigmoid functions as activation functions. The sufficient conditions for the kernels and greyness of FGGCM to converge to a unique fixed point are also provided separately. Finally, based on Web Experience and Civil engineering FCM, designed corresponding FGGCM with sigmoid and tanh as activation functions by modifying the weights to general grey numbers. By comparing with the convergence theorems of FCM and FGCM, the effectiveness of the theorems proposed in this paper was verified. It was also demonstrated that the convergence theorems of FCM are special cases of the theorems proposed in this paper. The study for convergence of FGGCM is of great significance for guiding the learning algorithm of FGGCM, which is needed for designing FGGCM with specific fixed points, lays a solid theoretical foundation for the application of FGGCM in fields such as control, prediction, and decision support systems.

eess.SY↗

arXiv2024

Gaussian Rate-Distortion-Perception Coding and Entropy-Constrained Scalar Quantization

This paper investigates the best known bounds on the quadratic Gaussian distortion-rate-perception function with limited common randomness for the Kullback-Leibler divergence-based perception measure, as well as their counterparts for the squared Wasserstein-2 distance-based perception measure, recently established by Xie et al. These bounds are shown to be nondegenerate in the sense that they cannot be deduced from each other via a refined version of Talagrand's transportation inequality. On the other hand, an improved lower bound is established when the perception measure is given by the squared Wasserstein-2 distance. In addition, it is revealed by exploiting the connection between rate-distortion-perception coding and entropy-constrained scalar quantization that all the aforementioned bounds are generally not tight in the weak perception constraint regime.

cs.IT↗

arXiv2024

Cross-subject Brain Functional Connectivity Analysis for Multi-task Cognitive State Evaluation

Cognition refers to the function of information perception and processing, which is the fundamental psychological essence of human beings. It is responsible for reasoning and decision-making, while its evaluation is significant for the aviation domain in mitigating potential safety risks. Existing studies tend to use varied methods for cognitive state evaluation yet have limitations in timeliness, generalisation, and interpretability. Accordingly, this study adopts brain functional connectivity with electroencephalography signals to capture associations in brain regions across multiple subjects for evaluating real-time cognitive states. Specifically, a virtual reality-based flight platform is constructed with multi-screen embedded. Three distinctive cognitive tasks are designed and each has three degrees of difficulty. Thirty subjects are acquired for analysis and evaluation. The results are interpreted through different perspectives, including inner-subject and cross-subject for task-wise and gender-wise underlying brain functional connectivity. Additionally, this study incorporates questionnaire-based, task performance-based, and physiological measure-based approaches to fairly label the trials. A multi-class cognitive state evaluation is further conducted with the active brain connections. Benchmarking results demonstrate that the identified brain regions have considerable influences in cognition, with a multi-class accuracy rate of 95.83% surpassing existing studies. The derived findings bring significance to understanding the dynamic relationships among human brain functional regions, cross-subject cognitive behaviours, and decision-making, which have promising practical application values.

cs.HC↗

arXiv2024

EmbSum: Leveraging the Summarization Capabilities of Large Language Models for Content-Based Recommendations

Content-based recommendation systems play a crucial role in delivering personalized content to users in the digital world. In this work, we introduce EmbSum, a novel framework that enables offline pre-computations of users and candidate items while capturing the interactions within the user engagement history. By utilizing the pretrained encoder-decoder model and poly-attention layers, EmbSum derives User Poly-Embedding (UPE) and Content Poly-Embedding (CPE) to calculate relevance scores between users and candidate items. EmbSum actively learns the long user engagement histories by generating user-interest summary with supervision from large language model (LLM). The effectiveness of EmbSum is validated on two datasets from different domains, surpassing state-of-the-art (SoTA) methods with higher accuracy and fewer parameters. Additionally, the model's ability to generate summaries of user interests serves as a valuable by-product, enhancing its usefulness for personalized content recommendations.

cs.IR↗

arXiv2024

Distributed Multi-Robot Multi-Target Tracking Using Heterogeneous Limited-Range Sensors

This paper presents a cooperative multi-robot multi-target tracking framework aimed at enhancing the efficiency of the heterogeneous sensor network and, consequently, improving overall target tracking accuracy. The concept of normalized unused sensing capacity is introduced to quantify the information a sensor is currently gathering relative to its theoretical maximum. This measurement can be computed using entirely local information and is applicable to various sensor models, distinguishing it from previous literature on the subject. It is then utilized to develop a distributed coverage control strategy for a heterogeneous sensor network, adaptively balancing the workload based on each sensor's current unused capacity. The algorithm is validated through a series of ROS and MATLAB simulations, demonstrating superior results compared to standard approaches that do not account for heterogeneity or current usage rates.

cs.RO↗

arXiv2024

Dzyaloshinskii-Moriya interaction torques and domain wall dynamics in van der Waals heterostructures

Since the discovery of two-dimensional ferroelectric and ferromagnetic materials, the van der Waals (vdW) heterostructures constructed by ferroelectric and ferromagnetic monolayers have soon become the ideal platforms to achieve converse magnetoelectric functions at the nanoscale, namely to use electric field to control magnetization. In this Letter, by employing density functional theory calculations and dynamic simulations of atomic spin model, we study the key role of interfacial Dzyaloshinshii-Moriya interaction (DMI) in CrI$_3$-In$_2$Se$_3$ vdW heterostructures. Our work demonstrates feasible DMI torques pumped by ferroelectric switching, which can drive current-free and low-energy consumption domain wall motion. Moreover, such interfacial DMI can also significantly enlarge the Walker field in magnetic field-driven domain wall technique.

cond-mat.mtrl-sci↗

arXiv2024

Asymmetric Hard X-ray Radiation of Two Ribbons in a Thermal-Dominated C-Class Flare

The asymmetry in hard X-ray (HXR) emission at the footpoints (FPs) of flare loops is a ubiquitous feature closely associated with nonthermal electron transport. We analyze the asymmetric HXR radiation at two flare ribbons which is thermal-dominated during a long-duration C4.4 flare that occurred on March 20, 2023, combining multi-view and multi-waveband observations from the ASO-S, SolO, and SDO spacecraft. We find that the H I Ly$α$ emission captures similar features to the He II $λ$304 in both light curve and spatio-temporal evolution of a pair of conjugate flare ribbons. The spectra and imaging analysis of the HXR emission, detected by STIX in 4-18 keV, reveal that the two-ribbon flare radiation is thermal dominated by over 95%, and the radiation source mainly concentrates on the northern ribbon, leading to an asymmetric distribution. To understand the underlying reasons for the HXR radiation asymmetry, we extrapolate the magnetic field within the active region using the NLFFF model. For 78% of the magnetic field lines starting from the northern flare ribbon, their lengths from the loop-tops (LTs) to the northern FPs are shorter than those to the southern FPs. For 62% of the field lines, their magnetic field strengths at the southern FPs exceed those at the northern FPs. In addition, considering the larger density, $\approx1.0\times10^{10}$ cm$^{-3}$, of the low-lying flare loops (< 32 Mm), we find the shorter path from the LT to the northern FP enables more electrons to reach the northern FP more easily after collisions with the surrounding plasma. Therefore, in this thermal-dominated C-class flare, the asymmetric location of the flare LT relative to its two FPs plays a dominant role in the HXR radiation asymmetry, while such asymmetry is also slightly influenced by the magnetic mirror effect resulting in larger HXR radiation at the FPs with weaker magnetic strength.

astro-ph.SR↗

arXiv2024

GLARE: Low Light Image Enhancement via Generative Latent Feature based Codebook Retrieval

Most existing Low-light Image Enhancement (LLIE) methods either directly map Low-Light (LL) to Normal-Light (NL) images or use semantic or illumination maps as guides. However, the ill-posed nature of LLIE and the difficulty of semantic retrieval from impaired inputs limit these methods, especially in extremely low-light conditions. To address this issue, we present a new LLIE network via Generative LAtent feature based codebook REtrieval (GLARE), in which the codebook prior is derived from undegraded NL images using a Vector Quantization (VQ) strategy. More importantly, we develop a generative Invertible Latent Normalizing Flow (I-LNF) module to align the LL feature distribution to NL latent representations, guaranteeing the correct code retrieval in the codebook. In addition, a novel Adaptive Feature Transformation (AFT) module, featuring an adjustable function for users and comprising an Adaptive Mix-up Block (AMB) along with a dual-decoder architecture, is devised to further enhance fidelity while preserving the realistic details provided by codebook prior. Extensive experiments confirm the superior performance of GLARE on various benchmark datasets and real-world data. Its effectiveness as a preprocessing tool in low-light object detection tasks further validates GLARE for high-level vision applications. Code is released at https://github.com/LowLevelAI/GLARE.

cs.CV↗

arXiv2024

Timestep-Aware Correction for Quantized Diffusion Models

Diffusion models have marked a significant breakthrough in the synthesis of semantically coherent images. However, their extensive noise estimation networks and the iterative generation process limit their wider application, particularly on resource-constrained platforms like mobile devices. Existing post-training quantization (PTQ) methods have managed to compress diffusion models to low precision. Nevertheless, due to the iterative nature of diffusion models, quantization errors tend to accumulate throughout the generation process. This accumulation of error becomes particularly problematic in low-precision scenarios, leading to significant distortions in the generated images. We attribute this accumulation issue to two main causes: error propagation and exposure bias. To address these problems, we propose a timestep-aware correction method for quantized diffusion model, which dynamically corrects the quantization error. By leveraging the proposed method in low-precision diffusion models, substantial enhancement of output quality could be achieved with only negligible computation overhead. Extensive experiments underscore our method's effectiveness and generalizability. By employing the proposed correction strategy, we achieve state-of-the-art (SOTA) results on low-precision models.

cs.CV↗

arXiv2024

MiniGPT-Med: Large Language Model as a General Interface for Radiology Diagnosis

Recent advancements in artificial intelligence (AI) have precipitated significant breakthroughs in healthcare, particularly in refining diagnostic procedures. However, previous studies have often been constrained to limited functionalities. This study introduces MiniGPT-Med, a vision-language model derived from large-scale language models and tailored for medical applications. MiniGPT-Med demonstrates remarkable versatility across various imaging modalities, including X-rays, CT scans, and MRIs, enhancing its utility. The model is capable of performing tasks such as medical report generation, visual question answering (VQA), and disease identification within medical imagery. Its integrated processing of both image and textual clinical data markedly improves diagnostic accuracy. Our empirical assessments confirm MiniGPT-Med's superior performance in disease grounding, medical report generation, and VQA benchmarks, representing a significant step towards reducing the gap in assisting radiology practice. Furthermore, it achieves state-of-the-art performance on medical report generation, higher than the previous best model by 19\% accuracy. MiniGPT-Med promises to become a general interface for radiology diagnoses, enhancing diagnostic efficiency across a wide range of medical imaging applications.

cs.AI↗