arXiv subjects

Guo Chen

Publications and source records attributed to Guo Chen.

At least 73 records · Page 4Linked to original sources

arXiv2025

Bridging Perspectives: A Survey on Cross-view Collaborative Intelligence with Egocentric-Exocentric Vision

Perceiving the world from both egocentric (first-person) and exocentric (third-person) perspectives is fundamental to human cognition, enabling rich and complementary understanding of dynamic environments. In recent years, allowing the machines to leverage the synergistic potential of these dual perspectives has emerged as a compelling research direction in video understanding. In this survey, we provide a comprehensive review of video understanding from both exocentric and egocentric viewpoints. We begin by highlighting the practical applications of integrating egocentric and exocentric techniques, envisioning their potential collaboration across domains. We then identify key research tasks to realize these applications. Next, we systematically organize and review recent advancements into three main research directions: (1) leveraging egocentric data to enhance exocentric understanding, (2) utilizing exocentric data to improve egocentric analysis, and (3) joint learning frameworks that unify both perspectives. For each direction, we analyze a diverse set of tasks and relevant works. Additionally, we discuss benchmark datasets that support research in both perspectives, evaluating their scope, diversity, and applicability. Finally, we discuss limitations in current works and propose promising future research directions. By synthesizing insights from both perspectives, our goal is to inspire advancements in video understanding and artificial intelligence, bringing machines closer to perceiving the world in a human-like manner. A GitHub repo of related works can be found at https://github.com/ayiyayi/Awesome-Egocentric-and-Exocentric-Vision.

cs.CV↗

arXiv2025

The stability of independence polynomials of complete bipartite graphs

The independence polynomial of a graph is termed {\it stable} if all its roots are located in the left half-plane $\{z \in \mathbb{C} : \mathrm{Re}(z) \leq 0\}$, and the graph itself is also referred to as stable. Brown and Cameron (Electron. J. Combin. 25(1) (2018) \#P1.46) proved that the complete bipartite graph $K_{1,n}$ is stable and posed the question: \textbf{Are all complete bipartite graphs stable?} We answer this question by establishing the following results: \begin{itemize} \item The complete bipartite graphs $K_{2,n}$ and $K_{3,n}$ are stable. \item For any integer $k\geq0$, there exists an integer $N(k)\in \mathbb{N}$ such that $K_{m,m+k}$ is stable for all $m>N(k)$. \item For any rational $\ell> 1$, there exists an integer $N(\ell) \in \mathbb{N}$ such that whenever $m >N(\ell)$ and $\ell \cdot m$ is an integer, $K_{m, \ell \cdot m}$ is \textbf{not} stable. \end{itemize}

math.CO↗

arXiv2025

Active Hyperuniform Networks of Chiral Magnetic Micro-Robotic Spinners

Disorder hyperuniform (DHU) systems possess a hidden long-range order manifested as the complete suppression of normalized large-scale density fluctuations like crystals, which endows them with many unique properties. Here, we demonstrate a new organization mechanism for achieving stable DHU structures in active-particle systems via investigating the self-assembly of robotic spinners with three-fold symmetric magnetic binding sites up to a heretofore experimentally unattained system size, i.e., with $\sim 1000$ robots. The spinners can self-organize into a wide spectrum of actively rotating three-coordinated network structures, among which a set of stable DHU networks robustly emerge. These DHU networks are topological transformations of a honeycomb network by continuously introducing the Stone-Wales defects, which are resulted from the competition between tunable magnetic binding and local twist due to active rotation of the robots. Our results reveal novel mechanisms for emergent DHU states in active systems and achieving novel DHU materials with desirable properties.

cond-mat.soft↗

arXiv2025

Decentralized Nonconvex Robust Optimization over Unsafe Multiagent Systems: System Modeling, Utility, Resilience, and Privacy Analysis

Privacy leakage and Byzantine failures are two adverse factors to the intelligent decision-making process of multi-agent systems (MASs). Considering the presence of these two issues, this paper targets the resolution of a class of nonconvex optimization problems under the Polyak-Łojasiewicz (P-Ł) condition. To address this problem, we first identify and construct the adversary system model. To enhance the robustness of stochastic gradient descent methods, we mask the local gradients with Gaussian noises and adopt a resilient aggregation method self-centered clipping (SCC) to design a differentially private (DP) decentralized Byzantine-resilient algorithm, namely DP-SCC-PL, which simultaneously achieves differential privacy and Byzantine resilience. The convergence analysis of DP-SCC-PL is challenging since the convergence error can be contributed jointly by privacy-preserving and Byzantine-resilient mechanisms, as well as the nonconvex relaxation, which is addressed via seeking the contraction relationships among the disagreement measure of reliable agents before and after aggregation, together with the optimal gap. Theoretical results reveal that DP-SCC-PL achieves consensus among all reliable agents and sublinear (inexact) convergence with well-designed step-sizes. It has also been proved that if there are no privacy issues and Byzantine agents, then the asymptotic exact convergence can be recovered. Numerical experiments verify the utility, resilience, and differential privacy of DP-SCC-PL by tackling a nonconvex optimization problem satisfying the P-Ł condition under various Byzantine attacks.

math.OC↗

arXiv2025

Time-Frequency-Based Attention Cache Memory Model for Real-Time Speech Separation

Existing causal speech separation models often underperform compared to non-causal models due to difficulties in retaining historical information. To address this, we propose the Time-Frequency Attention Cache Memory (TFACM) model, which effectively captures spatio-temporal relationships through an attention mechanism and cache memory (CM) for historical information storage. In TFACM, an LSTM layer captures frequency-relative positions, while causal modeling is applied to the time dimension using local and global representations. The CM module stores past information, and the causal attention refinement (CAR) module further enhances time-based feature representations for finer granularity. Experimental results showed that TFACM achieveed comparable performance to the SOTA TF-GridNet-Causal model, with significantly lower complexity and fewer trainable parameters. For more details, visit the project page: https://cslikai.cn/TFACM/.

cs.SD↗

arXiv2025

(Corrected Version) Push-LSVRG-UP: Distributed Stochastic Optimization over Unbalanced Directed Networks with Uncoordinated Triggered Probabilities

Distributed stochastic optimization, arising in the crossing and integration of traditional stochastic optimization, distributed computing and storage, and network science, has advantages of high efficiency and a low per-iteration computational complexity in resolving large-scale optimization problems. This paper concentrates on resolving a large-scale convex finite-sum optimization problem in a multi-agent system over unbalanced directed networks. To tackle this problem in an efficient way, a distributed consensus optimization algorithm, adopting the push-sum technique and a distributed loopless stochastic variance-reduced gradient (LSVRG) method with uncoordinated triggered probabilities, is developed and named Push-LSVRG-UP. Each agent under this algorithmic framework performs only local computation and communicates only with its neighbors without leaking their private information. The convergence analysis of Push-LSVRG-UP is relied on analyzing the contraction relationships between four error terms associated with the multi-agent system. Theoretical results provide an explicit feasible range of the constant step-size, a linear convergence rate, and an iteration complexity of Push-LSVRG-UP when achieving the globally optimal solution. It is shown that Push-LSVRG-UP achieves the superior characteristics of accelerated linear convergence, fewer storage costs, and a lower per-iteration computational complexity than most existing works. Meanwhile, the introduction of an uncoordinated probabilistic triggered mechanism allows Push-LSVRG-UP to facilitate the independence and flexibility of agents in computing local batch gradients. In simulations, the practicability and improved performance of Push-LSVRG-UP are manifested via resolving two distributed learning problems based on real-world datasets.

math.OC↗

arXiv2025

Closeby Habitable Exoplanet Survey (CHES). IV. Synergy between astrometry and direct imaging missions of the Habitable World Observatory for detecting Earth-like planets

The detection and characterization of habitable planets around nearby stars persist as one of the foremost objectives in contemporary astrophysics. This work investigates the synergistic integration of astrometric and direct imaging techniques by capitalizing on the complementary capabilities of the Closeby Habitable Exoplanet Survey (CHES) and Habitable Worlds Observatory (HWO). Planetary brightness and position vary over time due to phase effects and orbital architectures, information that can be precisely provided by CHES's astrometric measurements. By combining the precise orbital constraints from CHES with the imaging capabilities of HWO, we evaluate the improvements in detection efficiency, signal-to-noise ratio and overall planet yield. Completeness is quantified as the fraction of injected planets that are successfully detected, while yields are estimated for various scenarios using terrestrial planet occurrence rates derived from the Kepler dataset. Our results indicate that prior astrometric data significantly enhance detection efficiency. Under the adopted detection limit, our analysis indicates that prior CHES observations can increase completeness by approximately 10% and improve detection efficiency by factors ranging from two to thirty. The findings underscore the importance of interdisciplinary approaches in the search for and characterization of habitable worlds.

astro-ph.EP↗

arXiv2025

Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Models

We introduce Eagle 2.5, a family of frontier vision-language models (VLMs) for long-context multimodal learning. Our work addresses the challenges in long video comprehension and high-resolution image understanding, introducing a generalist framework for both tasks. The proposed training framework incorporates Automatic Degrade Sampling and Image Area Preservation, two techniques that preserve contextual integrity and visual details. The framework also includes numerous efficiency optimizations in the pipeline for long-context data training. Finally, we propose Eagle-Video-110K, a novel dataset that integrates both story-level and clip-level annotations, facilitating long-video understanding. Eagle 2.5 demonstrates substantial improvements on long-context multimodal benchmarks, providing a robust solution to the limitations of existing VLMs. Notably, our best model Eagle 2.5-8B achieves 72.4% on Video-MME with 512 input frames, matching the results of top-tier commercial model such as GPT-4o and large-scale open-source models like Qwen2.5-VL-72B and InternVL2.5-78B.

cs.CV↗

arXiv2025

Dynamical analysis of the H^2 + H^-2 Dark Energy model considering viscosity and interaction

In this study, we further developed and investigated the dual parameter phenomenological dark energy model (H^2 + H^-2 dark energy model) derived from Kaniadakis holographic dark energy. On the theoretical basis of the original H^2 + H^-2 dark energy model (HHDE), four types of viscosities and seven types of interactions were introduced. These were combined pairwise, and a dynamical analysis was conducted on a total of 35 Modified H^2 + H^-2 Viscous Interacting Dark Energy (MHH-VIDE) models. The advantage of the HHDE model and MHH-VIDE models is that these models can greatly relieve the Hubble tension and cicumventing the potential issue of a 'big rip', and the dark energy is Quintom-like. In this article, we performed a three-dimensional dynamical analysis of the aforementioned models with interactions and viscosity, testing their viability. The results suggest that the nature of this dark energy is closer to a property of spacetime than a cosmological component. The phase diagram analysis reveals a modified radiation-dominated epoch, a transitional matter-dominated phase, and a late-time attractor corresponding to the dark-energy-driven acceleration phase.

astro-ph.CO↗

arXiv2025

EgoExo-Gen: Ego-centric Video Prediction by Watching Exo-centric Videos

Generating videos in the first-person perspective has broad application prospects in the field of augmented reality and embodied intelligence. In this work, we explore the cross-view video prediction task, where given an exo-centric video, the first frame of the corresponding ego-centric video, and textual instructions, the goal is to generate futur frames of the ego-centric video. Inspired by the notion that hand-object interactions (HOI) in ego-centric videos represent the primary intentions and actions of the current actor, we present EgoExo-Gen that explicitly models the hand-object dynamics for cross-view video prediction. EgoExo-Gen consists of two stages. First, we design a cross-view HOI mask prediction model that anticipates the HOI masks in future ego-frames by modeling the spatio-temporal ego-exo correspondence. Next, we employ a video diffusion model to predict future ego-frames using the first ego-frame and textual instructions, while incorporating the HOI masks as structural guidance to enhance prediction quality. To facilitate training, we develop an automated pipeline to generate pseudo HOI masks for both ego- and exo-videos by exploiting vision foundation models. Extensive experiments demonstrate that our proposed EgoExo-Gen achieves better prediction performance compared to previous video prediction models on the Ego-Exo4D and H2O benchmark datasets, with the HOI masks significantly improving the generation of hands and interactive objects in the ego-centric videos.

cs.CV↗

arXiv2025

Asymmetry and Dynamical Constraints in 2-Limbs Retrieval of WASP-39 b Inferring from JWST Data

Transmission spectroscopy has provided unprecedented insight into the makeup of exoplanet atmospheres. A transmission spectrum contains contributions from a planet's morning and evening limbs, which can differ in temperature, composition and aerosol properties due to atmospheric circulation. While high-resolution ground-based observations have identified limb asymmetry in several ultra-hot/hot exoplanets, space-based studies of limb asymmetry are still in their early stages. The prevalence of limb asymmetry across a broad range of exoplanets remains largely unexplored. We conduct a comparative analysis of retrievals on transmission spectra, including traditional 1D approaches and four 2D models that account for limb asymmetry. Two of these 2D models include our newly proposed dynamical constraints derived from shallow-water simulations to provide physically-motivated temperature differences between limbs. Our analysis of WASP-39 b using JWST observations and previous combined datasets (HST, VLT, and Spitzer) strongly favors 2D retrievals over traditional 1D approaches, confirming significant limb asymmetry in this hot Jupiter. Within our 2D framework, unconstrained models recover larger temperature contrasts than dynamically-constrained models, with improved fits to specific spectral features, although Bayesian evidence cannot definitively distinguish between these 2D approaches. Our results support the presence of homogeneous C/O in both the morning and evening atmospheres, but with temperature differences leading to variations in clouds and hazes. Using this treatment, we can study a larger sample of hot Jupiters to gain insights into atmospheric limb asymmetries on these planets.

astro-ph.EP↗

arXiv2025

EagleVision: Object-level Attribute Multimodal LLM for Remote Sensing

Recent advances in multimodal large language models (MLLMs) have demonstrated impressive results in various visual tasks. However, in remote sensing (RS), high resolution and small proportion of objects pose challenges to existing MLLMs, which struggle with object-centric tasks, particularly in precise localization and fine-grained attribute description for each object. These RS MLLMs have not yet surpassed classical visual perception models, as they only provide coarse image understanding, leading to limited gains in real-world scenarios. To address this gap, we establish EagleVision, an MLLM tailored for remote sensing that excels in object detection and attribute comprehension. Equipped with the Attribute Disentangle module, EagleVision learns disentanglement vision tokens to express distinct attributes. To support object-level visual-language alignment, we construct EVAttrs-95K, the first large-scale object attribute understanding dataset in RS for instruction tuning, along with a novel evaluation benchmark, EVBench. EagleVision achieves state-of-the-art performance on both fine-grained object detection and object attribute understanding tasks, highlighting the mutual promotion between detection and understanding capabilities in MLLMs. The code, model, data, and demo will be available at https://github.com/XiangTodayEatsWhat/EagleVision.

cs.CV↗

arXiv2025

Closeby Habitable Exoplanet Survey (CHES). III. Retrieval of Planetary Masses in Binaries Using the N-body Model with RV and Astrometry Synergy

Given that secular perturbations in a binary system not only excite high orbital eccentricities but also alter the planetary orbital inclination, the classical Keplerian orbital model is no longer applicable for orbital retrieval. The combination of a dynamical model and observational data is essential for characterizing the configuration and planetary mass in close binaries. We calculate the theoretical radial velocity (RV) signal in the N-body framework and observe a drift in the RV semi-amplitude, which leads to a reduction in the $m$sin$i$ detection threshold by 20 $M_{\oplus}$, with $\sim$ 100% detection probability in the $m_1$sin$i_1$-$a_1$ parameter space. High-precision RV data with an accuracy of 1 m/s can detect such dynamical effects. For four close-in binaries-GJ 86, GJ 3021, HD 196885, and HD 41004, the deviation between the minimum mass derived from the Keplerian and N-body models is found to be $> 0.2 ~ M_{\mathrm{Jup}}$. High-precision astrometric data are also necessary to resolve the 3D orbits and true masses exoplanets. We generate astrometric simulation data with accuracies corresponding to Gaia (57.8 $μ$as) and the Closeby Habitable Exoplanet Survey (CHES) (1 $μ$as), respectively. Joint orbit fitting is performed for RV + Gaia and RV + CHES synergy methods. Compared with the fitting results from the astrometry-only model, the synergy models more effectively constrain the range of orbital inclinations. Using simulation data, we derive precise uncertainties for the true planetary mass, which are critical for determining the evolution of planets around binary stars and multi-planet systems.

astro-ph.EP↗

arXiv2025

Edge Exposure as the Trigger for Structural Instability in LP-N and HLP-N

LP-N and HLP-N are promising high-energy-density materials. However, these materials synthesized under high pressure cannot be maintained stable at ambient conditions. The mechanism behind their instability remains unclear. Our research, based on first-principles calculations and ab initio molecular dynamics simulations, reveals that while not edge exposed, LP-N and HLP-N exhibit substantial structural, dynamic, and mechanical stability under ambient conditions. The stability of HLP-N is governed by an interlocking mechanism, which becomes ineffective upon exposure of the edges, leading to internal breakdown. As a result, H saturated adsorption has no impact on it. In contrast, LP-N benefits modestly from H saturated adsorption due to its edge-initiated dissociation. The interlocking mechanism offer valuable insights into the design of new materials.

cond-mat.mtrl-sci↗

arXiv2025

Unsaturated Dinitrogen Difluoride under Pressure: toward high-Energy Density Polymerized NF Chains

Based on first-principles calculations and ab initio molecular dynamics simulations, the polymerisation of the unsaturated cis dinitrogen-difluoride (cis-N2F2) molecular compound is investigated. The thermodynamic, dynamical and thermal stabilities of the nitrogen fluorine NF system are investigated at conditions of 0-3000 K and 0-200 GPa. The cis-N2F2 molecule is a suitable precursor to obtain one-dimensional polymerized nitrogen-fluorine (poly-NF) chains at a pressure above 90 GPa and at a temperature around 1900 K. Importantly, these poly-NF chains can be quenched to room conditions, and potentially serve as a High-energy-density materials (HEDM). It has been established that when Al is utilised as a reducing agent, poly-NF chains exhibit a gravimetric energy density of 13.55 kJ/g, which exceeds that of cubic gauche nitrogen (cg-N, 9.70 kJ/g). This is attributable to the presence of both polymerised nitrogen and strong oxidising F atoms.

cond-mat.mtrl-sci↗

arXiv2025

EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real World

Being able to map the activities of others into one's own point of view is one fundamental human skill even from a very early age. Taking a step toward understanding this human ability, we introduce EgoExoLearn, a large-scale dataset that emulates the human demonstration following process, in which individuals record egocentric videos as they execute tasks guided by demonstration videos. Focusing on the potential applications in daily assistance and professional support, EgoExoLearn contains egocentric and demonstration video data spanning 120 hours captured in daily life scenarios and specialized laboratories. Along with the videos we record high-quality gaze data and provide detailed multimodal annotations, formulating a playground for modeling the human ability to bridge asynchronous procedural actions from different viewpoints. To this end, we present benchmarks such as cross-view association, cross-view action planning, and cross-view referenced skill assessment, along with detailed analysis. We expect EgoExoLearn can serve as an important resource for bridging the actions across views, thus paving the way for creating AI agents capable of seamlessly learning by observing humans in the real world. Code and data can be found at: https://github.com/OpenGVLab/EgoExoLearn

cs.CV↗

arXiv2025

SonicSim: A customizable simulation platform for speech processing in moving sound source scenarios

Systematic evaluation of speech separation and enhancement models under moving sound source conditions requires extensive and diverse data. However, real-world datasets often lack sufficient data for training and evaluation, and synthetic datasets, while larger, lack acoustic realism. Consequently, neither effectively meets practical needs. To address this issue, we introduce SonicSim, a synthetic toolkit based on the embodied AI simulation platform Habitat-sim, designed to generate highly customizable data for moving sound sources. SonicSim supports multi-level adjustments, including scene-level, microphone-level, and source-level adjustments, enabling the creation of more diverse synthetic data. Leveraging SonicSim, we constructed a benchmark dataset called SonicSet, utilizing LibriSpeech, Freesound Dataset 50k (FSD50K), Free Music Archive (FMA), and 90 scenes from Matterport3D to evaluate speech separation and enhancement models. Additionally, to investigate the differences between synthetic and real-world data, we selected 5 hours of raw, non-reverberant data from the SonicSet validation set and recorded a real-world speech separation dataset, providing a reference for comparing SonicSet with other synthetic datasets. For speech enhancement, we utilized the real-world dataset RealMAN to validate the acoustic gap between SonicSet and existing synthetic datasets. The results indicate that models trained on SonicSet generalize better to real-world scenarios compared to other synthetic datasets. The code is publicly available at https://cslikai.cn/SonicSim/.

cs.SD↗

arXiv2025

An Egocentric Vision-Language Model based Portable Real-time Smart Assistant

We present Vinci, a vision-language system designed to provide real-time, comprehensive AI assistance on portable devices. At its core, Vinci leverages EgoVideo-VL, a novel model that integrates an egocentric vision foundation model with a large language model (LLM), enabling advanced functionalities such as scene understanding, temporal grounding, video summarization, and future planning. To enhance its utility, Vinci incorporates a memory module for processing long video streams in real time while retaining contextual history, a generation module for producing visual action demonstrations, and a retrieval module that bridges egocentric and third-person perspectives to provide relevant how-to videos for skill acquisition. Unlike existing systems that often depend on specialized hardware, Vinci is hardware-agnostic, supporting deployment across a wide range of devices, including smartphones and wearable cameras. In our experiments, we first demonstrate the superior performance of EgoVideo-VL on multiple public benchmarks, showcasing its vision-language reasoning and contextual understanding capabilities. We then conduct a series of user studies to evaluate the real-world effectiveness of Vinci, highlighting its adaptability and usability in diverse scenarios. We hope Vinci can establish a new framework for portable, real-time egocentric AI systems, empowering users with contextual and actionable insights. Including the frontend, backend, and models, all codes of Vinci are available at https://github.com/OpenGVLab/vinci.

cs.CV↗