Searcharxiv⌕ Search

arXiv subjects

Wei Song

Publications and source records attributed to Wei Song.

At least 109 records · Page 6Linked to original sources

Multi-Dimensional AGV Path Planning in 3D Warehouses Using Ant Colony Optimization and Advanced Neural Networks

Within modern warehouse scenarios, the rapid expansion of e-commerce and increasingly complex, multi-level storage environments have exposed the limitations of traditional AGV (Automated Guided Vehicle) path planning methods--often reliant on static 2D models and expert-tuned heuristics that struggle to handle dynamic traffic and congestion. Addressing these limitations, this paper introduces a novel AGV path planning approach for 3D warehouse environments that leverages a hybrid framework combining ACO (Ant Colony Optimization) with deep learning models, called NAHACO (Neural Adaptive Heuristic Ant Colony Optimization). NAHACO integrates three key innovations: first, an innovative heuristic algorithm for 3D warehouse cargo modeling using multidimensional tensors, which addresses the challenge of achieving superior heuristic accuracy; second, integration of a congestion-aware loss function within the ACO framework to adjust path costs based on traffic and capacity constraints, called CARL (Congestion-Aware Reinforce Loss), enabling dynamic heuristic calibration for optimizing ACO-based path planning; and third, an adaptive attention mechanism that captures multi-scale spatial features, thereby addressing dynamic heuristic calibration for further optimization of ACO-based path planning and AGV navigation. NAHACO significantly boosts path planning efficiency, yielding faster computation times and superior performance over both vanilla and state-of-the-art methods, while automatically adapting to warehouse constraints for real-time optimization. NAHACO outperforms state-of-the-art methods, lowering the total cost by up to 24.7% on TSP benchmarks. In warehouse tests, NAHACO cuts cost by up to 41.5% and congestion by up to 56.1% compared to previous methods.

cs.RO↗

A Survey on RGB, 3D, and Multimodal Approaches for Unsupervised Industrial Image Anomaly Detection

In the advancement of industrial informatization, unsupervised anomaly detection technology effectively overcomes the scarcity of abnormal samples and significantly enhances the automation and reliability of smart manufacturing. As an important branch, industrial image anomaly detection focuses on automatically identifying visual anomalies in industrial scenarios (such as product surface defects, assembly errors, and equipment appearance anomalies) through computer vision techniques. With the rapid development of Unsupervised industrial Image Anomaly Detection (UIAD), excellent detection performance has been achieved not only in RGB setting but also in 3D and multimodal (RGB and 3D) settings. However, existing surveys primarily focus on UIAD tasks in RGB setting, with little discussion in 3D and multimodal settings. To address this gap, this artical provides a comprehensive review of UIAD tasks in the three modal settings. Specifically, we first introduce the task concept and process of UIAD. We then overview the research on UIAD in three modal settings (RGB, 3D, and multimodal), including datasets and methods, and review multimodal feature fusion strategies in multimodal setting. Finally, we summarize the main challenges faced by UIAD tasks in the three modal settings, and offer insights into future development directions, aiming to provide researchers with a comprehensive reference and offer new perspectives for the advancement of industrial informatization. Corresponding resources are available at https://github.com/Sunny5250/Awesome-Multi-Setting-UIAD.

cs.CV↗

Lattice dynamics and spin-phonon coupling in the kagome spin ice HoAgGe

We employ polarization-resolved Raman spectroscopy and first-principles phonon calculations to study the lattice dynamics and spin-phonon coupling in the kagome spin ice compound HoAgGe. Upon cooling, HoAgGe shows transitions from a nonmagnetic state at 300 K to a partially magnetic-ordered phase below T2 = 11.6 K, eventually reaching a fully-magnetic ordered phase below T1 = 7 K. We detect eight of ten Raman-active phonon modes at room temperature, with frequencies consistent with first-principles phonon calculations. We find that the low-energy phonon modes harden upon cooling, soften slightly below T2, and finally harden again below T1, suggesting finite spin-phonon coupling in HoAgGe. Furthermore, one high-energy mode at 185 cm-1 with E' symmetry exhibits a Fano lineshape due to electron-phonon coupling. Our Raman results establish finite spin-phonon coupling and electron-phonon coupling in the magnetic phase of HoAgGe, providing a foundation for future studies of the novel field-induced phases at low temperatures in HoAgGe.

cond-mat.str-el↗

Asymptotic Symmetries in the TsT/$T\bar{T}$ Correspondence

Starting from holography for IIB string theory on AdS$_3\times \mathcal N$ with NS-NS flux, the TsT/$T\bar T$ correspondence is a conjecture that a TsT transformation on the string theory side is holographically dual to the single-trace version of the $T\bar T$ deformation on the field theory side. More precisely, the long string sector of string theory on the TsT-transformed background corresponds to the symmetric product theory whose seed theory is the $T\bar T$-deformed CFT$_2$. In this paper, we study the asymptotic symmetry of the string theory in the bulk. We find a state-dependent, non-local field redefinition under which the worldsheet equations of motion, stress tensor, as well as the symplectic form of string theory after the TsT transformation are mapped to those before the TsT transformation. The asymptotic symmetry in the auxiliary AdS basis is generated by two commuting Virasoro generators, while in the TsT transformed basis is non-linear and non-local. Our result from string theory analysis is compatible with that of the $T\bar T$ deformed CFT$_2$.

hep-th↗

Baichuan-Omni-1.5 Technical Report

We introduce Baichuan-Omni-1.5, an omni-modal model that not only has omni-modal understanding capabilities but also provides end-to-end audio generation capabilities. To achieve fluent and high-quality interaction across modalities without compromising the capabilities of any modality, we prioritized optimizing three key aspects. First, we establish a comprehensive data cleaning and synthesis pipeline for multimodal data, obtaining about 500B high-quality data (text, audio, and vision). Second, an audio-tokenizer (Baichuan-Audio-Tokenizer) has been designed to capture both semantic and acoustic information from audio, enabling seamless integration and enhanced compatibility with MLLM. Lastly, we designed a multi-stage training strategy that progressively integrates multimodal alignment and multitask fine-tuning, ensuring effective synergy across all modalities. Baichuan-Omni-1.5 leads contemporary models (including GPT4o-mini and MiniCPM-o 2.6) in terms of comprehensive omni-modal capabilities. Notably, it achieves results comparable to leading models such as Qwen2-VL-72B across various multimodal medical benchmarks.

cs.CL↗

M^2ConceptBase: A Fine-Grained Aligned Concept-Centric Multimodal Knowledge Base

Multimodal knowledge bases (MMKBs) provide cross-modal aligned knowledge crucial for multimodal tasks. However, the images in existing MMKBs are generally collected for entities in encyclopedia knowledge graphs. Therefore, detailed groundings of visual semantics with linguistic concepts are lacking, which are essential for the visual concept cognition ability of multimodal models. Addressing this gap, we introduce M^2ConceptBase, the first concept-centric MMKB. M^2ConceptBase models concepts as nodes with associated images and detailed textual descriptions. We propose a context-aware multimodal symbol grounding approach to align concept-image and concept-description pairs using context information from image-text datasets. Comprising 951K images and 152K concepts, M^2ConceptBase links each concept to an average of 6.27 images and a single description, ensuring comprehensive visual and textual semantics. Human studies confirm more than 95% alignment accuracy, underscoring its quality. Additionally, our experiments demonstrate that M^2ConceptBase significantly enhances VQA model performance on the OK-VQA task. M^2ConceptBase also substantially improves the fine-grained concept understanding capabilities of multimodal large language models through retrieval augmentation in two concept-related tasks, highlighting its value.

cs.AI↗

TsT, black holes, and $T\bar T + J\bar T + T\bar J$

We generate a class of string backgrounds by a sequence of TsT transformations of the NS1-NS5 system that we argue are holographically dual to states in a single-trace $T\bar T + J\bar T + T\bar J$-deformed CFT$_2$. The new string backgrounds include general rotating black hole solutions with two $U(1)$ charges as well as a smooth solution without a horizon that is interpreted as the ground state. As evidence for the correspondence we (i) derive the long string spectrum and relate it to the spectrum of the dual field theory; (ii) show that the black hole thermodynamics can be reproduced from single-trace $T\bar T + J\bar T + T\bar J$-deformed CFTs; and (iii) show that the energy of the ground state matches the energy of the vacuum in the dual theory. We also study geometric properties of these new spacetimes and find that for some choices of the parameters the three-dimensional Ricci scalar in the Einstein frame can become positive in a region outside the horizon before reaching closed timelike curves and singularities.

hep-th↗

TsT, $T\bar{T}$ and black strings

We study the relationship between TsT transformations, marginal deformations of string theory on AdS$_3$ backgrounds, and irrelevant deformations of 2d CFTs. We show that TsT transformations of NS-NS backgrounds correspond to instantaneous deformations of the worldsheet action by the antisymmetric product of two Noether currents, holographically mirroring the definition of the $T\bar{T}$, $J\bar{T}$, $T\bar{J}$, and $J\bar{J}$ deformations of 2d CFTs. Applying a TsT transformation to string theory on BTZ $\times S^3\times M^4$ we obtain a general class of rotating black string solutions, including the Horne-Horowitz and the Giveon-Itzhaki-Kutasov ones as special cases, which we show are holographically dual to thermal states in single-trace $T\bar{T}$-deformed CFTs. We also find a smooth solution interpolating between global AdS$_3$ in the IR and a linear dilaton background in the UV that is interpreted as the NS-NS ground state in the dual $T\bar{T}$-deformed CFT. This background suggests the existence of an upper bound on the deformation parameter above which the solution becomes complex. We find that the worldsheet spectrum, the thermodynamics of the black strings (in particular their Bekenstein-Hawking entropy), and the critical value of the deformation parameter match the corresponding quantities obtained from single-trace $T\bar{T}$ deformations.

hep-th↗

Baichuan-Omni Technical Report

The salient multimodal capabilities and interactive experience of GPT-4o highlight its critical role in practical applications, yet it lacks a high-performing open-source counterpart. In this paper, we introduce Baichuan-omni, the first open-source 7B Multimodal Large Language Model (MLLM) adept at concurrently processing and analyzing modalities of image, video, audio, and text, while delivering an advanced multimodal interactive experience and strong performance. We propose an effective multimodal training schema starting with 7B model and proceeding through two stages of multimodal alignment and multitask fine-tuning across audio, image, video, and text modal. This approach equips the language model with the ability to handle visual and audio data effectively. Demonstrating strong performance across various omni-modal and multimodal benchmarks, we aim for this contribution to serve as a competitive baseline for the open-source community in advancing multimodal understanding and real-time interaction.

cs.AI↗

A BMS-invariant free fermion model

We used the Cartan formalism to construct fermionic models that are compatible with Galilean or Carrollian symmetry and rigid scaling symmetry. The free Carrollian fermion model exhibits conformal Carrollian symmetry which is isomorphic to the asymptotic symmetries for flat spacetime in three dimensions, namely the BMS$_3$ symmetry. We performed canonical quantization to this free BMS fermion model, discussed both the highest weight vacuum and the induced vacuum, calculated the correlation functions and the torus partition function. Finally we constructed $\mathcal N=2$ supersymmetric theories by combining the free fermion model and the free scalar model.

hep-th↗

To Shelter or Not To Shelter: Exploring the Influence of Different Modalities in Virtual Reality on Individuals' Tornado Mitigation Behaviors

Timely and adequate risk communication before natural hazards can reduce losses from extreme weather events and provide more resilient disaster preparedness. However, existing natural hazard risk communications have been abstract, ineffective, not immersive, and sometimes counterproductive. The implementation of virtual reality (VR) for natural hazard risk communication presents a promising alternative to the existing risk communication system by offering immersive and engaging experiences. However, it is still unknown how different modalities in VR could affect individuals' mitigation behaviors related to incoming natural hazards. In addition, it is also not clear how the repetitive risk communication of different modalities in the VR system leads to the effect of risk habituation. To fill the knowledge gap, we developed a VR system with a tornado risk communication scenario and conducted a mixed-design human subject experiment (N = 24). We comprehensively investigated our research using both quantitative and qualitative results.

cs.HC↗

A Survey on Facial Expression Recognition of Static and Dynamic Emotions

Facial expression recognition (FER) aims to analyze emotional states from static images and dynamic sequences, which is pivotal in enhancing anthropomorphic communication among humans, robots, and digital avatars by leveraging AI technologies. As the FER field evolves from controlled laboratory environments to more complex in-the-wild scenarios, advanced methods have been rapidly developed and new challenges and apporaches are encounted, which are not well addressed in existing reviews of FER. This paper offers a comprehensive survey of both image-based static FER (SFER) and video-based dynamic FER (DFER) methods, analyzing from model-oriented development to challenge-focused categorization. We begin with a critical comparison of recent reviews, an introduction to common datasets and evaluation criteria, and an in-depth workflow on FER to establish a robust research foundation. We then systematically review representative approaches addressing eight main challenges in SFER (such as expression disturbance, uncertainties, compound emotions, and cross-domain inconsistency) as well as seven main challenges in DFER (such as key frame sampling, expression intensity variations, and cross-modal alignment). Additionally, we analyze recent advancements, benchmark performances, major applications, and ethical considerations. Finally, we propose five promising future directions and development trends to guide ongoing research. The project page for this paper can be found at https://github.com/wangyanckxx/SurveyFER.

cs.CV↗

Depends-Kotlin: A Cross-Language Kotlin Dependency Extractor

Since Google introduced Kotlin as an official programming language for developing Android apps in 2017, Kotlin has gained widespread adoption in Android development. However, compared to Java, there is limited support for Kotlin code dependency analysis, which is the foundation to software analysis. To bridge this gap, we develop Depends-Kotlin to extract entities and their dependencies in Kotlin source code. Not only does Depends-Kotlin support extracting entities' dependencies in Kotlin code, but it can also extract dependency relations between Kotlin and Java. Using three open-source Kotlin-Java mixing projects as our subjects, Depends-Kotlin demonstrates high accuracy and performance in resolving Kotlin-Kotlin and Kotlin-Java dependencies relations. The source code of Depends-Kotlin and the dataset used have been made available at https: //github.com/XYZboom/depends-kotlin. We also provide a screen-cast presenting Depends-Kotlin at https://youtu.be/ZPq8SRhgXzM.

cs.SE↗

Chiral kagome superconductivity modulations with residual Fermi arcs in KV3Sb5 and CsV3Sb5

Superconductivity involving finite momentum pairing can lead to spatial gap and pair density modulations, as well as Bogoliubov Fermi states within the superconducting gap. However, the experimental realization of their intertwined relations has been challenging. Here, we detect chiral kagome superconductivity modulations with residual Fermi arcs in KV3Sb5 and CsV3Sb5 by normal and Josephson scanning tunneling microscopy down to 30mK with resolved electronic energy difference at microelectronvolt level. We observe a U-shaped superconducting gap with flat residual in-gap states. This gap exhibits chiral 2 by 2 spatial modulations with magnetic field tunable chirality, which align with the chiral 2 by 2 pair density modulations observed through Josephson tunneling. These findings demonstrate a chiral pair density wave (PDW) that breaks time-reversal symmetry. Quasiparticle interference imaging of the in-gap zero-energy states reveals segmented arcs, with high-temperature data linking them to parts of the reconstructed V d-orbital states within the charge order. The detected residual Fermi arcs can be explained by the partial suppression of these d-orbital states through an interorbital 2 by 2 PDW and thus serve as candidate Bogoliubov Fermi states. Additionally, we differentiate the observed PDW order from impurity-induced gap modulations. Our observations not only uncover a chiral PDW order with orbital-selectivity, but also illuminate the fundamental space-momentum correspondence inherent in finite momentum paired superconductivity.

cond-mat.supr-con↗

Chiral pair density waves with residual Fermi arcs in RbV3Sb5

The chiral 2 by 2 charge order has been reported and confirmed in the kagome superconductor RbV3Sb5, while its interplay with superconductivity remains elusive owing to its lowest superconducting transition temperature Tc of about 0.85K among the AV3Sb5 family (A=K, Rb, Cs) that severely challenges electronic spectroscopic probes. Here, utilizing dilution-refrigerator-based scanning tunneling microscopy (STM) down to 30mK, we observe chiral 2 by 2 pair density waves with residual Fermi arcs in RbV3Sb5. We find a superconducting gap of 150μeV with substantial residual in-gap states. The spatial distribution of this gap exhibits chiral 2 by 2 modulations, signaling a chiral pair density wave (PDW). Our quasi-particle interference imaging of the zero-energy residual states further reveals arc-like patterns. We discuss the relation of the gap modulations with the residual Fermi arcs under the space-momentum correspondence between PDW and Bogoliubov Fermi states.

cond-mat.supr-con↗

Local excitation of kagome spin ice magnetism in HoAgGe seen by scanning tunneling microscopy

The kagome spin ice can host frustrated magnetic excitations by flipping its local spin. Under an inelastic tunneling condition, the tip in a scanning tunneling microscope can flip the local spin, and we apply this technique to kagome metal HoAgGe with a long-range ordered spin ice ground state. Away from defects, we discover a pair of pronounced dips in the local tunneling spectrum at symmetrical bias voltages with negative intensity values, serving as a striking inelastic tunneling signal. This signal disappears above the spin ice formation temperature and has a dependence on the magnetic fields, demonstrating its intimate relation with the spin ice magnetism. We provide a two-level spin-flip model to explain the tunneling dips considering the spin ice magnetism under spin-orbit coupling. Our results uncover a local emergent excitation of spin ice magnetism in a kagome metal, suggesting that local electrical field induced spin flip climbs over a barrier caused by spin-orbital locking.

cond-mat.str-el↗

STS MICCAI 2023 Challenge: Grand challenge on 2D and 3D semi-supervised tooth segmentation

Computer-aided design (CAD) tools are increasingly popular in modern dental practice, particularly for treatment planning or comprehensive prognosis evaluation. In particular, the 2D panoramic X-ray image efficiently detects invisible caries, impacted teeth and supernumerary teeth in children, while the 3D dental cone beam computed tomography (CBCT) is widely used in orthodontics and endodontics due to its low radiation dose. However, there is no open-access 2D public dataset for children's teeth and no open 3D dental CBCT dataset, which limits the development of automatic algorithms for segmenting teeth and analyzing diseases. The Semi-supervised Teeth Segmentation (STS) Challenge, a pioneering event in tooth segmentation, was held as a part of the MICCAI 2023 ToothFairy Workshop on the Alibaba Tianchi platform. This challenge aims to investigate effective semi-supervised tooth segmentation algorithms to advance the field of dentistry. In this challenge, we provide two modalities including the 2D panoramic X-ray images and the 3D CBCT tooth volumes. In Task 1, the goal was to segment tooth regions in panoramic X-ray images of both adult and pediatric teeth. Task 2 involved segmenting tooth sections using CBCT volumes. Limited labelled images with mostly unlabelled ones were provided in this challenge prompt using semi-supervised algorithms for training. In the preliminary round, the challenge received registration and result submission by 434 teams, with 64 advancing to the final round. This paper summarizes the diverse methods employed by the top-ranking teams in the STS MICCAI 2023 Challenge.

cs.CV↗

Adaptive Multi-modal Fusion of Spatially Variant Kernel Refinement with Diffusion Model for Blind Image Super-Resolution

Pre-trained diffusion models utilized for image generation encapsulate a substantial reservoir of a priori knowledge pertaining to intricate textures. Harnessing the potential of leveraging this a priori knowledge in the context of image super-resolution presents a compelling avenue. Nonetheless, prevailing diffusion-based methodologies presently overlook the constraints imposed by degradation information on the diffusion process. Furthermore, these methods fail to consider the spatial variability inherent in the estimated blur kernel, stemming from factors such as motion jitter and out-of-focus elements in open-environment scenarios. This oversight results in a notable deviation of the image super-resolution effect from fundamental realities. To address these concerns, we introduce a framework known as Adaptive Multi-modal Fusion of \textbf{S}patially Variant Kernel Refinement with Diffusion Model for Blind Image \textbf{S}uper-\textbf{R}esolution (SSR). Within the SSR framework, we propose a Spatially Variant Kernel Refinement (SVKR) module. SVKR estimates a Depth-Informed Kernel, which takes the depth information into account and is spatially variant. Additionally, SVKR enhance the accuracy of depth information acquired from LR images, allowing for mutual enhancement between the depth map and blur kernel estimates. Finally, we introduce the Adaptive Multi-Modal Fusion (AMF) module to align the information from three modalities: low-resolution images, depth maps, and blur kernels. This alignment can constrain the diffusion model to generate more authentic SR results.

cs.CV↗