SearcharxivSearch

arXiv subjects

Xueqi Zhao

Publications and source records attributed to Xueqi Zhao.

7 recordsLinked to original sources

4DLangVGGT: 4D Language-Visual Geometry Grounded Transformer

Constructing 4D language fields is crucial for embodied AI, augmented/virtual reality, and 4D scene understanding, as they provide enriched semantic representations of dynamic environments and enable open-vocabulary querying in complex scenarios. However, existing approaches to 4D semantic field construction primarily rely on scene-specific Gaussian splatting, which requires per-scene optimization, exhibits limited generalization, and is difficult to scale to real-world applications. To address these limitations, we propose 4DLangVGGT, the first Transformer-based feed-forward unified framework for 4D language grounding, that jointly integrates geometric perception and language alignment within a single architecture. 4DLangVGGT has two key components: the 4D Visual Geometry Transformer, StreamVGGT, which captures spatio-temporal geometric representations of dynamic scenes; and the Semantic Bridging Decoder (SBD), which projects geometry-aware features into a language-aligned semantic space, thereby enhancing semantic interpretability while preserving structural fidelity. Unlike prior methods that depend on costly per-scene optimization, 4DLangVGGT can be jointly trained across multiple dynamic scenes and directly applied during inference, achieving both deployment efficiency and strong generalization. This design significantly improves the practicality of large-scale deployment and establishes a new paradigm for open-vocabulary 4D scene understanding. Experiments on HyperNeRF and Neu3D datasets demonstrate that our approach not only generalizes effectively but also achieves state-of-the-art performance, achieving up to 2% gains under per-scene training and 1% improvements under multi-scene training. Our code released in https://github.com/hustvl/4DLangVGGT

cs.CV

Monitoring 3D Lattice Structures in Additive Manufacturing Using Topological Data Analysis

We present a new method for the statistical process control of lattice structures using tools from Topological Data Analysis. Motivated by applications in additive manufacturing, such as aerospace components and biomedical implants, where hollow lattice geometries are critical, the proposed framework is based on monitoring the persistent homology properties of parts. Specifically, we focus on homological features of dimensions zero and one, corresponding to connected components and one-dimensional loops, to characterize and detect changes in the topology of lattice structures. A nonparametric hypothesis testing procedure and a control charting scheme are introduced to monitor these features during production. Furthermore, we conduct extensive run-length analysis via various simulated but real-life lattice-structured parts. Our results demonstrate that persistent homology is well-suited for detecting topological anomalies in complex geometries and offers a robust, intrinsically geometrical alternative to other SPC methods for mesh and point data.

stat.ME

Practical Implementation of an End-to-End Methodology for SPC of 3-D Part Geometry: A Case Study

Del Castillo and Zhao (2020, 2021, 2022, 2024) have recently proposed a new methodology for the Statistical Process Control (SPC) of discrete parts whose 3-dimensional (3D) geometrical data are acquired with non-contact sensors. The approach is based on monitoring the spectrum of the Laplace-Beltrami (LB) operator of each scanned part estimated using finite element methods (FEM). The spectrum of the LB operator is an intrinsic summary of the geometry of a part, independent of the ambient space. Hence, registration of scanned parts is unnecessary when comparing them. The primary goal of this case study paper is to demonstrate the practical implementation of the spectral SPC methodology through multiple examples using real scanned parts acquired with an industrial-grade laser scanner, including 3D printed parts and commercial parts. We discuss the scanned mesh preprocessing needed in practice, including the type of remeshing found to be most beneficial for the FEM computations. For each part type, both the "phase I" and "phase II" stages of the spectral SPC methodology are showcased. In addition, we provide a new principled method to determine the number of eigenvalues of the LB operator to consider for efficient SPC of a given part geometry, and present an improved algorithm to automatically define a region of interest, particularly useful for large meshes. Computer codes that implement every method discussed in this paper, as well as all scanned part datasets used in the case studies, are made available and explained in the supplementary materials.

stat.AP

Registration-free localization of defects in 3-D parts from mesh metrology data using functional maps

Spectral Laplacian methods, widely used in computer graphics and manifold learning, have been recently proposed for the Statistical Process Control (SPC) of a sequence of manufactured parts, whose 3-dimensional metrology is acquired with non-contact sensors. These techniques provide an {\em intrinsic} solution to the SPC problem, that is, a solution exclusively based on measurements on the scanned surfaces or 2-manifolds without making reference to their ambient space. These methods, therefore, avoid the computationally expensive, non-convex registration step needed to align the parts, as required by previous methods for SPC based on 3-dimensional measurements. Once a SPC mechanism triggers and out-of-control alarm, however, an additional problem remains: that of locating where on the surface of the part that triggered the SPC alarm there is a significant shape difference with respect to either an in-control part or its nominal (CAD) design. In the past, only registration-based solutions existed for this problem. In this paper, we present a new registration-free solution to the part localization problem. Our approach uses a functional map between the manifolds to be compared, that is, a map between functions defined on each manifold based on intrinsic differential operators, in particular, the Laplace-Beltrami operator, in order to construct a point to point mapping between the two manifolds and be able to locate defects on the suspected part. A recursive partitioning algorithm is presented to define a region of interest on the surface of the part where defects are likely to occur, which results in considerable computational advantages. The functional map method involves a very large number of point-to-point comparisons based on noisy measurements, and a statistical thresholding method is presented to filter the false positives in the underlying massive multiple comparisons problem.

stat.ME

A Registration-free approach for Statistical Process Control of 3D scanned objects via FEM

Recent work in on-line Statistical Process Control (SPC) of manufactured 3-dimensional (3-D) objects has been proposed based on the estimation of the spectrum of the Laplace-Beltrami (LB) operator, a differential operator that encodes the geometrical features of a manifold and is widely used in Machine Learning (i.e., Manifold Learning). The resulting spectra are an intrinsic geometrical feature of each part, and thus can be compared between parts avoiding the part to part registration (or "part localization") pre-processing or the need for equal size meshes, characteristics which are required in previous approaches for SPC of 3D parts. The recent spectral SPC methods, however, are limited to monitoring surface data from objects such that the scanned meshes have no boundaries, holes, or missing portions. In this paper, we extend spectral methods by first considering a more accurate and general estimator of the LB spectrum that is obtained by application of Finite Element Methods (FEM) to the solution of Helmholtz's equation with boundaries. It is shown how the new spectral FEM approach, while it retains the advantages of not requiring part localization/registration or equal size datasets scanned from each part, it provides more accurate spectrum estimates, which results in faster detection of out of control conditions than earlier methods, can be applied to both mesh or volumetric (solid) scans, and furthermore, it is shown how it can be applied to partial scans that result in open meshes (surface or volumetric) with boundaries, increasing the practical applicability of the methods. The present work brings SPC methods closer to contemporary research in Computer Graphics and Manifold Learning. MATLAB code that reproduces the examples of this paper is provided in the supplementary materials.

stat.AP

An Intrinsic Geometrical Approach for Statistical Process Control of Surface and Manifold Data

We present a new method for statistical process control (SPC) of a discrete part manufacturing system based on intrinsic geometrical properties of the parts, estimated from three-dimensional sensor data. An intrinsic method has the computational advantage of avoiding the difficult part registration problem, necessary in previous SPC approaches of three-dimensional geometrical data, but inadequate if noncontact sensors are used. The approach estimates the spectrum of the Laplace-Beltrami (LB) operator of the scanned parts and uses a multivariate nonparametric control chart for online process control. Our proposal brings SPC closer to computer vision and computer graphics methods aimed to detect large differences in shape (but not in size). However, the SPC problem differs in that small changes in either shape or size of the parts need to be detected, keeping a controllable false alarm rate and without completely filtering noise. An online or "Phase II" method and a scheme for starting up in the absence of prior data ("Phase I") are presented. Comparison with earlier approaches that require registration shows the LB spectrum method to be more sensitive to rapidly detect small changes in shape and size, including the practical case when the sequence of part datasets is in the form of large, unequal size meshes. A post-alarm diagnostic method to investigate the location of defects on the surface of a part is also presented. While we focus in this article on surface (triangulation) data, the methods can also be applied to point cloud and voxel metrology data.

stat.AP

Comparing the Finite-Time Performance of Simulation-Optimization Algorithms

We empirically evaluate the finite-time performance of several simulation-optimization algorithms on a testbed of problems with the goal of motivating further development of algorithms with strong finite-time performance. We investigate if the observed performance of the algorithms can be explained by properties of the problems, e.g., the number of decision variables, the topology of the objective function, or the magnitude of the simulation error.

math.OC