arXiv subjects

Shangjie Xue

Publications and source records attributed to Shangjie Xue.

9 recordsLinked to original sources

arXiv2026

Uncertainty-driven 3D Gaussian Splatting Active Mapping via Anisotropic Visibility Field

We present Gaussian Splatting Anisotropic Visibility Field (GAVIS), a novel framework for uncertainty quantification and active mapping in 3DGS. Our key insight is that regions unseen from the training views yield unreliable predictions from the 3DGS. To address this, we introduce a principled and efficient method for quantifying the visibility field in 3DGS, defined as the anisotropic visibility of each particle with respect to the training views, and represented using spherical harmonics. The resulting visibility field is integrated into a Bayesian Network-based uncertainty-aware 3DGS rasterizer, enabling real-time (200 FPS) uncertainty quantification for synthesized views. Active mapping is further performed within a maximum information gain framework building on this formulation. Extensive experiments across diverse environments demonstrate that GAVIS consistently and significantly outperforms prior approaches in both accuracy and efficiency. Moreover, beyond standalone use, our method can be applied post-hoc to improve the performance of existing approaches.

cs.CV↗

arXiv2024

Neural Visibility Field for Uncertainty-Driven Active Mapping

This paper presents Neural Visibility Field (NVF), a novel uncertainty quantification method for Neural Radiance Fields (NeRF) applied to active mapping. Our key insight is that regions not visible in the training views lead to inherently unreliable color predictions by NeRF at this region, resulting in increased uncertainty in the synthesized views. To address this, we propose to use Bayesian Networks to composite position-based field uncertainty into ray-based uncertainty in camera observations. Consequently, NVF naturally assigns higher uncertainty to unobserved regions, aiding robots to select the most informative next viewpoints. Extensive evaluations show that NVF excels not only in uncertainty quantification but also in scene reconstruction for active mapping, outperforming existing methods.

cs.CV↗

arXiv2023

Neural Field Dynamics Model for Granular Object Piles Manipulation

We present a learning-based dynamics model for granular material manipulation. Inspired by the Eulerian approach commonly used in fluid dynamics, our method adopts a fully convolutional neural network that operates on a density field-based representation of object piles and pushers, allowing it to exploit the spatial locality of inter-object interactions as well as the translation equivariance through convolution operations. Furthermore, our differentiable action rendering module makes the model fully differentiable and can be directly integrated with a gradient-based trajectory optimization algorithm. We evaluate our model with a wide array of piles manipulation tasks both in simulation and real-world experiments and demonstrate that it significantly exceeds existing latent or particle-based methods in both accuracy and computation efficiency, and exhibits zero-shot generalization capabilities across various environments and tasks.

cs.RO↗

arXiv2023

Generative Skill Chaining: Long-Horizon Skill Planning with Diffusion Models

Long-horizon tasks, usually characterized by complex subtask dependencies, present a significant challenge in manipulation planning. Skill chaining is a practical approach to solving unseen tasks by combining learned skill priors. However, such methods are myopic if sequenced greedily and face scalability issues with search-based planning strategy. To address these challenges, we introduce Generative Skill Chaining~(GSC), a probabilistic framework that learns skill-centric diffusion models and composes their learned distributions to generate long-horizon plans during inference. GSC samples from all skill models in parallel to efficiently solve unseen tasks while enforcing geometric constraints. We evaluate the method on various long-horizon tasks and demonstrate its capability in reasoning about action dependencies, constraint handling, and generalization, along with its ability to replan in the face of perturbations. We show results in simulation and on real robot to validate the efficiency and scalability of GSC, highlighting its potential for advancing long-horizon task planning. More details are available at: https://generative-skill-chaining.github.io/

cs.RO↗

arXiv2023

Tetris-inspired detector with neural network for radiation mapping

In recent years, radiation mapping has attracted widespread research attention and increased public concerns on environmental monitoring. In terms of both materials and their configurations, radiation detectors have been developed to locate the directions and positions of the radiation sources. In this process, algorithm is essential in converting detector signals to radiation source information. However, due to the complex mechanisms of radiation-matter interaction and the current limitation of data collection, high-performance, low-cost radiation mapping is still challenging. Here we present a computational framework using Tetris-inspired detector pixels and machine learning for radiation mapping. Using inter-pixel padding to increase the contrast between pixels and neural network to analyze the detector readings, a detector with as few as four pixels can achieve high-resolution directional mapping. By further imposing Maximum a Posteriori (MAP) with a moving detector, further radiation position localization is achieved. Non-square, Tetris-shaped detector can further improve performance beyond the conventional grid-shaped detector. Our framework offers a new avenue for high quality radiation mapping with least number of detector pixels possible, and is anticipated to be capable to deploy for real-world radiation detection with moderate validation.

physics.ins-det↗

arXiv2021

GeoSim: Realistic Video Simulation via Geometry-Aware Composition for Self-Driving

Scalable sensor simulation is an important yet challenging open problem for safety-critical domains such as self-driving. Current works in image simulation either fail to be photorealistic or do not model the 3D environment and the dynamic objects within, losing high-level control and physical realism. In this paper, we present GeoSim, a geometry-aware image composition process which synthesizes novel urban driving scenarios by augmenting existing images with dynamic objects extracted from other scenes and rendered at novel poses. Towards this goal, we first build a diverse bank of 3D objects with both realistic geometry and appearance from sensor data. During simulation, we perform a novel geometry-aware simulation-by-composition procedure which 1) proposes plausible and realistic object placements into a given scene, 2) render novel views of dynamic objects from the asset bank, and 3) composes and blends the rendered image segments. The resulting synthetic images are realistic, traffic-aware, and geometrically consistent, allowing our approach to scale to complex use cases. We demonstrate two such important applications: long-range realistic video simulation across multiple camera sensors, and synthetic data generation for data augmentation on downstream segmentation tasks. Please check https://tmux.top/publication/geosim/ for high-resolution video results.

cs.CV↗

arXiv2020

Eightfold Fermionic Excitation in a Charge Density Wave Compound

Unconventional quasiparticle excitations in condensed matter systems have become one of the most important research frontiers. Beyond two- and fourfold degenerate Weyl and Dirac fermions, three-, six- and eightfold symmetry protected degeneracies have been predicted however remain challenging to realize in solid state materials. Here, charge density wave compound TaTe4 is proposed to hold eightfold fermionic excitation and Dirac point in energy bands. High quality TaTe4 single crystals are prepared, where the charge density wave is revealed by directly imaging the atomic structure and a pseudogap of about 45 meV on the surface. Shubnikov de-Haas oscillations of TaTe4 are consistent with band structure calculation. Scanning tunneling microscopy reveals atomic step edge states on the surface of TaTe4. This work uncovers that charge density wave is able to induce new topological phases and sheds new light on the novel excitations in condensed matter materials.

cond-mat.mtrl-sci↗

arXiv2019

Distinct fingerprints of charge density waves and electronic standing waves in ZrTe$_3$

Experimental signatures of charge density waves (CDW) in high-temperature superconductors have evoked much recent interest, yet an alternative interpretation has been theoretically raised based on electronic standing waves resulting from quasiparticles scattering off impurities or defects, also known as Friedel oscillations (FO). Indeed the two phenomena are similar and related, posing a challenge to their experimental differentiation. Here we report a resonant X-ray diffraction study of ZrTe$_3$, a model CDW material. Near the CDW transition, we observe two independent diffraction signatures that arise concomitantly, only to become clearly separated in momentum while developing very different correlation lengths in the well-ordered state. Anomalously slow dynamics of mesoscopic ordered nanoregions are further found near the transition temperature, in spite of the expected strong thermal fluctuations. These observations reveal that a spatially-modulated CDW phase emerges out of a uniform electronic fluid via a process that is promoted by self-amplifying FO, and identify a viable experimental route to distinguish CDW and FO.

cond-mat.str-el↗

arXiv2017

Topological spin excitations observed in a three-dimensional antiferromagnet

Band topology, or global wave-function structure that enforces novel properties in the bulk and on the surface of crystalline materials, is currently under intense investigations for both fundamental interest and its technological promises. While band crossing of non-trivial topological nature was first studied in three dimensions for electrons, the underlying physical idea is not restricted to fermionic excitations. In fact, experiments have confirmed the possibility to have topological band crossing of electromagnetic waves in artificial structures. Fundamental bosonic excitations in real crystals, however, have not been observed to exhibit the counterpart under ambient pressure and magnetic field, where the difficulty is in part because natural materials cannot be precisely engineered like artificial structures. Here, we use inelastic neutron scattering to reveal the presence of topological spin excitations (magnons) in a three-dimensional antiferromagnet, Cu3TeO6, which features a unique lattice of magnetic spin-1/2 Cu2+ ions. Beyond previous understanding, we find that the material's spin lattice possesses a variety of exchange interactions, with the interaction between the ninth-nearest neighbours being as strong as that between the nearest neighbours. Although theoretical analysis indicates that the presence of topological magnon band crossing is independent of model details, Cu3TeO6 turns out to be highly favourable for the experimental observation, as its optical magnons are spectrally sharp and intense due to the highly interconnected spin network and the large magnetic cell. The observed magnon band crossing generally has the form of a special type of Z2-topological nodal lines that are yet to be found in fermion systems, rendering magnon systems a fertile ground for exploring novel band topology.

cond-mat.mes-hall↗