Searcharxiv⌕ Search

arXiv subjects

Xin Wu

Publications and source records attributed to Xin Wu.

At least 73 records · Page 4Linked to original sources

Baichuan-Omni-1.5 Technical Report

We introduce Baichuan-Omni-1.5, an omni-modal model that not only has omni-modal understanding capabilities but also provides end-to-end audio generation capabilities. To achieve fluent and high-quality interaction across modalities without compromising the capabilities of any modality, we prioritized optimizing three key aspects. First, we establish a comprehensive data cleaning and synthesis pipeline for multimodal data, obtaining about 500B high-quality data (text, audio, and vision). Second, an audio-tokenizer (Baichuan-Audio-Tokenizer) has been designed to capture both semantic and acoustic information from audio, enabling seamless integration and enhanced compatibility with MLLM. Lastly, we designed a multi-stage training strategy that progressively integrates multimodal alignment and multitask fine-tuning, ensuring effective synergy across all modalities. Baichuan-Omni-1.5 leads contemporary models (including GPT4o-mini and MiniCPM-o 2.6) in terms of comprehensive omni-modal capabilities. Notably, it achieves results comparable to leading models such as Qwen2-VL-72B across various multimodal medical benchmarks.

cs.CL↗

The Influence of General Relativity on the Spins of Celestial Bodies in Inclined Orbits

Through the Rossiter-McLaughlin effect, several hot Jupiters have been found to exhibit spin-orbit misalignment, and even retrograde orbits. The high obliquity observed in these planets can be attributed to two primary formation mechanisms, as summarized in the existing literature. First, the host star's spin becomes misaligned with the planetary disk during the late stages of star formation, primarily due to chaotic accretion and magnetic interactions between the star and the planetary disk. Second, the orbital inclination of an individual planet can be excited by dynamical processes such as planet-planet scattering, the Lidov-Kozai cycle, and secular chaos within the framework of Newtonian mechanics. This study introduces a third mechanism, where, within the framework of general relativity, the post-Newtonian spin-orbit coupling term induces precession of the host star's spin around the orbital angular momentum. The orbital inclination, relative to a reference plane, can expand the range of deviation in the spatial orientation of the bodies' spins from the plane's normal. The varying amplitude and period of spin precession for both the star and the planet are derived theoretically, and the results, which can be applied without restriction, agree well with numerical simulations.

astro-ph.EP↗

Baichuan-Omni Technical Report

The salient multimodal capabilities and interactive experience of GPT-4o highlight its critical role in practical applications, yet it lacks a high-performing open-source counterpart. In this paper, we introduce Baichuan-omni, the first open-source 7B Multimodal Large Language Model (MLLM) adept at concurrently processing and analyzing modalities of image, video, audio, and text, while delivering an advanced multimodal interactive experience and strong performance. We propose an effective multimodal training schema starting with 7B model and proceeding through two stages of multimodal alignment and multitask fine-tuning across audio, image, video, and text modal. This approach equips the language model with the ability to handle visual and audio data effectively. Demonstrating strong performance across various omni-modal and multimodal benchmarks, we aim for this contribution to serve as a competitive baseline for the open-source community in advancing multimodal understanding and real-time interaction.

cs.AI↗

Explicit symplectic integrators with adaptive time steps in curved spacetimes

Recently, our group developed explicit symplectic methods for curved spacetimes that are not split into several explicitly integrable parts, but are via appropriate time transformations. Such time-transformed explicit symplectic integrators should have employed adaptive time steps in principle, but they are often difficult in practical implementations. In fact, they work well if time transformation functions cause the time-transformed Hamiltonians to have the desired splits and approach 1 or constants for sufficiently large distances. However, they do not satisfy the requirement of step-size selections in this case. Based on the step-size control technique proposed by Preto $\&$ Saha, the nonadaptive time step time-transformed explicit symplectic methods are slightly adjusted as adaptive ones. The adaptive methods have only two additional steps and a negligible increase in computational cost as compared with the nonadaptive ones. Their implementation is simple. Several dynamical simulations of particles and photons near black holes have demonstrated that the adaptive methods typically improve the efficiency of the nonadaptive methods. Because of the desirable property, the new adaptive methods are applied to investigate the chaotic dynamics of particles and photons outside the horizon in a Schwarzschild-Melvin spacetime. The new methods are widely applicable to all curved spacetimes corresponding to Hamiltonians or time-transformed Hamiltonians with the expected splits. Also application to the backwards ray-tracing method for studying the motion of photons and shadows of black holes is possible.

gr-qc↗

Gravitational Wave-Sensitive Photonic-Like Electronic Transport in Graphene for Efficient High-Frequency Gravitational Wave Detection

High-frequency gravitational waves are crucial for understanding the very early universe and distinguishing between various cosmological models, but detecting them remains a significant challenge. We investigated the effects of high-frequency gravitational waves on photonic-like electronic transport in graphene. The results show that, unlike the influence of gravitational waves on the propagation of light, the influence of gravitational waves on photonic-like electronic transport can accumulate not only in real space but also in $k$-space. This makes photonic-like electronic transport under gravitational waves similar to the propagation of light in a medium where the refractive index varies dramatically due to gravitational waves, and with shorter wavelengths. As a result, the relative intensity variation in photonic-like electronic transport under gravitational waves exceeds that of a laser interferometer with the same arm length by six orders of magnitude. At low temperatures, the influence of phonons on photon-like transport in the context of high-frequency gravitational waves can be ignored. These findings indicate a strong interaction between gravitational waves and electron transport, which helps to deepen the understanding of the interaction between gravitational waves and matter, and provides a different method for detecting high-frequency gravitational waves.

physics.ins-det↗

STROBE-X Mission Overview

We give an overview of the science objectives and mission design of the Spectroscopic Time-Resolving Observatory for Broadband Energy X-rays (STROBE-X) observatory, which has been proposed as a NASA probe-class (~$1.5B) mission in response to the Astro2020 recommendation for an X-ray probe.

astro-ph.IM↗

STROBE-X High Energy Modular Array (HEMA)

The High Energy Modular Array (HEMA) is one of three instruments that compose the STROBE-X mission concept. The HEMA is a large-area, high-throughput non-imaging pointed instrument based on the Large Area Detector developed as part of the LOFT mission concept. It is designed for spectral timing measurements of a broad range of sources and provides a transformative increase in sensitivity to X-rays in the energy range of 2--30 keV compared to previous instruments, with an effective area of 3.4 m$^{2}$ at 8.5 keV and an energy resolution of better than 300 eV at 6 keV in its nominal field of regard.

astro-ph.IM↗

Centrality Manipulation in Exclusive Photoproduction at the Electron-Ion Collider

In the context of future electron-ion collision experiments, particularly the Electron-Ion Collider (EIC) and the Electron-Ion Collider in China (EicC), investigating exclusive photoproduction processes is of paramount importance. These processes offer a unique opportunity to probe the gluon structure of nuclei across a broad range of Bjorken-$x$, facilitating measurements of nuclear shadowing and searches for gluon saturation and/or the color glass condensate. This paper explores the potential of utilizing neutron tagging from Coulomb excitation of nuclei to effectively determine centrality for exclusive photoproduction in electron-ion collisions. By developing the equivalent photon approximation for fast-moving electrons, this work incorporates a coordinate-space-dependent photon flux distribution, elucidating the relationship between the photon transverse momentum distribution and collision impact parameter. Leveraging spatial information from the photon flux, the differential cross section for Coulomb excitation of nuclei is derived. Our calculations demonstrate that neutron tagging can significantly alter impact parameter distributions, thereby providing a robust method for centrality manipulation in electron-ion collisions. This study contributes essential baseline and strategies for exploring the impact parameter dependence of exclusive photoproduction, offering novel insights for experimental design and data analysis. Ultimately, it provides additional information to better visualize the gluon distribution within the nucleus.

hep-ph↗

Phonon coherence and minimum thermal conductivity in disordered superlattice

Phonon coherence elucidates the propagation and interaction of phonon quantum states within superlattice, unveiling the wave-like nature and collective behaviors of phonons. Taking MoSe$_2$/WSe$_2$ lateral heterostructures as a model system, we demonstrate that the intricate interplay between wave-like and particle-like phonons, previously observed in perfect superlattice only, also occurs in disordered superlattice. By employing molecular dynamics simulation based on a highly accurate and efficient machine-learned potential constructed herein, we observe a non-monotonic dependence of the lattice thermal conductivity on the interface density in both perfect and disordered superlattice, with a global minimum occurring at relatively higher interface density for disordered superlattice. The counter-intuitive phonon coherence contribution can be characterized by the lagged self-similarity of the structural sequences in the disordered superlattice. Our findings extend the realm of coherent phonon transport from perfect superlattice to more general structures, which offers more flexibility in tuning thermal transport in superlattices.

cond-mat.mtrl-sci↗

V2I-Calib: A Novel Calibration Approach for Collaborative Vehicle and Infrastructure LiDAR Systems

Cooperative LiDAR systems integrating vehicles and road infrastructure, termed V2I calibration, exhibit substantial potential, yet their deployment encounters numerous challenges. A pivotal aspect of ensuring data accuracy and consistency across such systems involves the calibration of LiDAR units across heterogeneous vehicular and infrastructural endpoints. This necessitates the development of calibration methods that are both real-time and robust, particularly those that can ensure robust performance in urban canyon scenarios without relying on initial positioning values. Accordingly, this paper introduces a novel approach to V2I calibration, leveraging spatial association information among perceived objects. Central to this method is the innovative Overall Intersection over Union (oIoU) metric, which quantifies the correlation between targets identified by vehicle and infrastructure systems, thereby facilitating the real-time monitoring of calibration results. Our approach involves identifying common targets within the perception results of vehicle and infrastructure LiDAR systems through the construction of an affinity matrix. These common targets then form the basis for the calculation and optimization of extrinsic parameters. Comparative and ablation studies conducted using the DAIR-V2X dataset substantiate the superiority of our approach. For further insights and resources, our project repository is accessible at https://github.com/MassimoQu/v2i-calib.

cs.CV↗

Observational features of deformed Schwarzschild black holes illuminated by an anisotropic accretion disk

The projection effect of an anisotropic accretion disk causes its electromagnetic radiation to depend on the emission angle. Although this dependency has the potential to influence the observational characteristics of black holes, it has not received sufficient attention. In this paper, we employ a relativistic ray-tracing algorithm to numerically simulate 86 GHz and 230 GHz images of deformed Schwarzschild black holes illuminated by an equatorial anisotropic accretion disk, aiming to reveal the observational signatures of the target black hole and the impact of the projection effect on the images. The study demonstrates that while the introduction of the projection effect does not alter the profiles of the black hole's inner shadow and critical curve, it significantly suppresses the specific intensity of light rays, particularly in direct emission, thereby reducing image brightness. The extent of this reduction depends on both the observation inclination and frequency. This phenomenon aids in the extraction of geometric information from higher-order subrings in the image. Furthermore, we find that increasing the deformation parameter enhances the brightness of the deformed Schwarzschild black hole image, accompanied by a reduction in the size of the critical curve and inner shadow. This relationship establishes a connection between the intrinsic properties of deformed Schwarzschild black holes and their observational characteristics, providing a reliable tool for testing the no-hair theorem and gravitational theories. Specifically, we propose a novel method for constraining parameters based on the silhouette of the inner shadow, which holds promise for extension to any spherically symmetric black hole in other gravitational theories.

gr-qc↗

BaichuanSEED: Sharing the Potential of ExtensivE Data Collection and Deduplication by Introducing a Competitive Large Language Model Baseline

The general capabilities of Large Language Models (LLM) highly rely on the composition and selection on extensive pretraining datasets, treated as commercial secrets by several institutions. To mitigate this issue, we open-source the details of a universally applicable data processing pipeline and validate its effectiveness and potential by introducing a competitive LLM baseline. Specifically, the data processing pipeline consists of broad collection to scale up and reweighting to improve quality. We then pretrain a 7B model BaichuanSEED with 3T tokens processed by our pipeline without any deliberate downstream task-related optimization, followed by an easy but effective supervised fine-tuning stage. BaichuanSEED demonstrates consistency and predictability throughout training and achieves comparable performance on comprehensive benchmarks with several commercial advanced large language models, such as Qwen1.5 and Llama3. We also conduct several heuristic experiments to discuss the potential for further optimization of downstream tasks, such as mathematics and coding.

cs.CL↗

Multimodal generative semantic communication based on latent diffusion model

In emergencies, the ability to quickly and accurately gather environmental data and command information, and to make timely decisions, is particularly critical. Traditional semantic communication frameworks, primarily based on a single modality, are susceptible to complex environments and lighting conditions, thereby limiting decision accuracy. To this end, this paper introduces a multimodal generative semantic communication framework named mm-GESCO. The framework ingests streams of visible and infrared modal image data, generates fused semantic segmentation maps, and transmits them using a combination of one-hot encoding and zlib compression techniques to enhance data transmission efficiency. At the receiving end, the framework can reconstruct the original multimodal images based on the semantic maps. Additionally, a latent diffusion model based on contrastive learning is designed to align different modal data within the latent space, allowing mm-GESCO to reconstruct latent features of any modality presented at the input. Experimental results demonstrate that mm-GESCO achieves a compression ratio of up to 200 times, surpassing the performance of existing semantic communication frameworks and exhibiting excellent performance in downstream tasks such as object classification and detection.

cs.CV↗

Effects of Two Quantum Correction Parameters on Chaotic Dynamics of Particles Near Renormalized Group Improved Schwarzschild Black Holes

A renormalized group improved Schwarzschild black hole spacetime contains two quantum correction parameters. One parameter $γ$ represents the identification of cutoff of the distance scale, and another parameter $Ω$ stems from nonperturbative renormalization group theory. The two parameters are constrained by the data from the shadow of M87* central black hole. The dynamics of electrically charged test particles around the black hole are integrable. However, when the black hole is immersed in an external asymptotically uniform magnetic field, the dynamics are not integrable and may allow for the occurrence of chaos. % English Editor: %Please verify that the intended meaning has been retained. Employing an explicit symplectic integrator, we survey the contributions of the two parameters to the chaotic dynamical behavior. It is found that a small change of the parameter $γ$ constrained by the shadow of M87* black hole has an almost negligible effect on the dynamical transition of particles from order to chaos. However, a small decrease in the parameter $Ω$ leads to an enhancement in the strength of chaos from the global phase space structure. A theoretical interpretation is given to the different contributions. The term with the parameter $Ω$ dominates the term with the parameter $γ$, even if the two parameters have same values. % English Editor: Please verify %that the intended meaning has been retained. In particular, the parameter $Ω$ acts as a repulsive force, and its decrease means a weakening of the repulsive force or equivalently enhancing the attractive force from the black hole. On the other hand, there is a positive Lyapunov exponent that is universally given by the surface gravity of the black hole when $Ω\geq 0$ is small and the external magnetic field vanishes.

gr-qc↗

Response of the first POLAR-2 Prototype to Polarized Beams

POLAR-2 is a dedicated gamma-ray polarimeter currently foreseen to be launched towards the China Space Station around 2027. The design of the detector is based on the legacy of its predecessor mission POLAR which was launched in 2016. POLAR-2 aims to measure the polarization of the Gamma-ray Burst prompt emission within the 30-800 keV energy range. Thanks to its high sensitivity to gamma-ray polarization, as well as its large effective area, POLAR-2 will provide the most precise measurements of this type to date. Such measurements are key to improve our understanding of the astrophysical processes responsible for Gamma-Ray Bursts. The detector consists of a segmented array of plastic scintillator bars, each one of which is read out by a Silicon PhotoMultiplier channel. The flight model of POLAR-2 will contain a total of 6400 scintillators. These are divided into 100 groups of 64 bars each, in so-called polarimeter modules. In recent years, the collaboration has designed and produced the first prototypes of these polarimeter modules and subjected these to space qualification tests. In addition, in April 2023, the first of these modules were calibrated using fully polarized gamma-ray beams at the European Synchrotron Radiation Facility (ESRF) in France. In this work, we will present the results of this calibration campaign and compare these to the simulated performance of the POLAR-2 modules. Potential improvements to the design are also discussed. Finally, the measurements are used, in combination with the verified simulation framework, to estimate the scientific performance of the full POLAR-2 detector and compare it to its predecessor.

astro-ph.IM↗

Multimodal Collaboration Networks for Geospatial Vehicle Detection in Dense, Occluded, and Large-Scale Events

In large-scale disaster events, the planning of optimal rescue routes depends on the object detection ability at the disaster scene, with one of the main challenges being the presence of dense and occluded objects. Existing methods, which are typically based on the RGB modality, struggle to distinguish targets with similar colors and textures in crowded environments and are unable to identify obscured objects. To this end, we first construct two multimodal dense and occlusion vehicle detection datasets for large-scale events, utilizing RGB and height map modalities. Based on these datasets, we propose a multimodal collaboration network for dense and occluded vehicle detection, MuDet for short. MuDet hierarchically enhances the completeness of discriminable information within and across modalities and differentiates between simple and complex samples. MuDet includes three main modules: Unimodal Feature Hierarchical Enhancement (Uni-Enh), Multimodal Cross Learning (Mul-Lea), and Hard-easy Discriminative (He-Dis) Pattern. Uni-Enh and Mul-Lea enhance the features within each modality and facilitate the cross-integration of features from two heterogeneous modalities. He-Dis effectively separates densely occluded vehicle targets with significant intra-class differences and minimal inter-class differences by defining and thresholding confidence values, thereby suppressing the complex background. Experimental results on two re-labeled multimodal benchmark datasets, the 4K-SAI-LCS dataset, and the ISPRS Potsdam dataset, demonstrate the robustness and generalization of the MuDet. The codes of this work are available openly at \url{https://github.com/Shank2358/MuDet}.

cs.CV↗

Electromagnetic field and chaotic charged-particle motion around hairy black holes in Horndeski gravity

The Wald vector potential is an exact solution of the source-less Maxwell equations regarding an electromagnetic field of a vacuum uncharged black hole like the Kerr background black hole in an asymptotically uniform magnetic field. However, it is not if the black hole is a nonvacuum solution in a theory of modified gravity with extra fields or a charged Kerr-Newman spacetime. To satisfy the source-less Maxwell equations in this case, the Wald vector potential must be modified and generalized appropriately. Following this idea, we derive an expression for the vector potential of an electromagnetic field surrounding a hairy black hole in the Horndeski modified gravity theory. Explicit symplectic integrators with excellent long-term behaviour are used to simulate the motion of charged particles around the hairy black hole immersed in the external magnetic field. The recurrence plot method based on the recurrence quantification analysis uses diagonal structures parallel to the main diagonal to show regular dynamics, but adopts no diagonal structures to indicate chaotic dynamics. The method is efficient to detect chaos from order in the curved spacetime, as the Poincare map and the fast Lyapunov indicator are.

gr-qc↗

Molecular dynamics simulations of heat transport using machine-learned potentials: A mini review and tutorial on GPUMD with neuroevolution potentials

Molecular dynamics (MD) simulations play an important role in understanding and engineering heat transport properties of complex materials. An essential requirement for reliably predicting heat transport properties is the use of accurate and efficient interatomic potentials. Recently, machine-learned potentials (MLPs) have shown great promise in providing the required accuracy for a broad range of materials. In this mini review and tutorial, we delve into the fundamentals of heat transport, explore pertinent MD simulation methods, and survey the applications of MLPs in MD simulations of heat transport. Furthermore, we provide a step-by-step tutorial on developing MLPs for highly efficient and predictive heat transport simulations, utilizing the neuroevolution potentials (NEPs) as implemented in the GPUMD package. Our aim with this mini review and tutorial is to empower researchers with valuable insights into cutting-edge methodologies that can significantly enhance the accuracy and efficiency of MD simulations for heat transport studies.

cond-mat.mtrl-sci↗