arXiv subjects

Guangzhao He

Publications and source records attributed to Guangzhao He.

9 recordsLinked to original sources

arXiv2026

Thinking in Blender: Staged Executable Inverse Graphics with Vision-Language Models

Inverse graphics is a longstanding and highly underconstrained problem that seeks to reconstruct images as editable 3D scenes which can be rendered, relit, and manipulated. In this work, we investigate whether pretrained vision-language models (VLMs) can perform executable inverse graphics directly from a single image by reconstructing a scene as an editable Blender program, without relying on specialized 2D or 3D foundation models, differentiable rendering, or multi-view supervision. We introduce Staged Executable Inverse Graphics (SEIG), an agentic framework that reconstructs a 3D scene from a single image by progressively refining scene factors including geometry, materials, composition, and lighting directly in executable Blender code space. We evaluate our framework across diverse scenes using a range of reconstruction metrics spanning pixel-level, perceptual, and semantic fidelity. Our experiments show that staged reconstruction substantially improves reconstruction fidelity, highlighting the importance of task decomposition for executable inverse graphics with general-purpose VLMs. Finally, we showcase various downstream applications enabled by the reconstructed editable Blender scenes.

cs.CV↗

arXiv2026

NeuROK: Generative 4D Neural Object Kinematics

Data-driven approaches have revolutionized 3D vision, enabling transformers to effectively reconstruct and generate static 3D objects. However, generating simulative 4D dynamics -- realistic temporal deformations of static objects under various physical conditions -- remains challenging and often ad hoc, despite its importance in building comprehensive 3D world models. Most existing methods assume a predefined physical model and use system identification to estimate parameters, restricting these methods to specific categories and small-scale datasets. We propose that these restrictions can be overcome by learning a data-driven kinematic state parameterization for object-centric physical systems. Specifically, we learn both a latent space representing all possible states of the object and a decoder that maps any sampled latent to a plausibly deformed shape of the object. We refer to this parameterization as Neural Object Kinematics (NeuROK), and learn a transformer-based encoder-decoder model on a curated large-scale 4D dataset. This formulation and the learned model significantly simplify the generation of simulative dynamics since we only need to consider the dynamics within a low-dimensional latent space from the Lagrangian mechanics' perspective in classical physics. We demonstrate the effectiveness and generality of this neural simulation framework across diverse dynamic object types, showing clear advantages over prior works. Project page: https://chen-geng.com/neurok

cs.CV↗

arXiv2025

ERNet: Efficient Non-Rigid Registration Network for Point Sequences

Registering an object shape to a sequence of point clouds undergoing non-rigid deformation is a long-standing challenge. The key difficulties stem from two factors: (i) the presence of local minima due to the non-convexity of registration objectives, especially under noisy or partial inputs, which hinders accurate and robust deformation estimation, and (ii) error accumulation over long sequences, leading to tracking failures. To address these challenges, we introduce to adopt a scalable data-driven approach and propose ERNet, an efficient feed-forward model trained on large deformation datasets. It is designed to handle noisy and partial inputs while effectively leveraging temporal information for accurate and consistent sequential registration. The key to our design is predicting a sequence of deformation graphs through a two-stage pipeline, which first estimates frame-wise coarse graph nodes for robust initialization, before refining their trajectories over time in a sliding-window fashion. Extensive experiments show that our proposed approach (i) outperforms previous state-of-the-art on both the DeformingThings4D and D-FAUST datasets, and (ii) achieves more than 4x speedup compared to the previous best, offering significant efficiency improvement.

cs.CV↗

arXiv2025

Dilated coordinate method for solving nuclear lattice effective field theory

We introduce a dilated coordinate method to address computational challenges in nuclear lattice effective field theory (NLEFT) for weakly-bound few-body systems. The approach employs adaptive mesh refinement via analytic coordinate transformations, dynamically adjusting spatial resolution to resolve short-range nuclear interactions with fine grids while efficiently capturing long-range wave function tails with coarse grids. Numerical demonstrations for two- and three-body systems confirm accelerated convergence towards infinite-volume limit compared to uniform lattices, particularly beneficial for accessing highly excited states and shallow bound states near the continuum threshold. This method establishes a foundation for \textit{ab initio} studies of exotic nuclear systems near the dripline and light hypernuclei, with direct extensions to scattering and reaction processes.

nucl-th↗

arXiv2025

Category-Agnostic Neural Object Rigging

The motion of deformable 4D objects lies in a low-dimensional manifold. To better capture the low dimensionality and enable better controllability, traditional methods have devised several heuristic-based methods, i.e., rigging, for manipulating dynamic objects in an intuitive fashion. However, such representations are not scalable due to the need for expert knowledge of specific categories. Instead, we study the automatic exploration of such low-dimensional structures in a purely data-driven manner. Specifically, we design a novel representation that encodes deformable 4D objects into a sparse set of spatially grounded blobs and an instance-aware feature volume to disentangle the pose and instance information of the 3D shape. With such a representation, we can manipulate the pose of 3D objects intuitively by modifying the parameters of the blobs, while preserving rich instance-specific information. We evaluate the proposed method on a variety of object categories and demonstrate the effectiveness of the proposed framework. Project page: https://guangzhaohe.com/canor

cs.CV↗

arXiv2025

Binding of the three-hadron $DD^{*}K$ system from the lattice effective field theory

We employ the nuclear lattice effective field theory (NLEFT), an efficient tool for nuclear ab initio calculations, to solve the asymmetric multihadron systems. We take the $DD^*K$ three-body system as an illustration to demonstrate the capability of the method. Here the two-body chiral interactions between $D$, $D^*$, and $K$ are regulated with a soft lattice regulator and calibrated with the binding energies of the $T_{cc}^+$, $D^{*}_{s0}(2317)$, and $D_{s1}(2460)$ molecular states. We then calculate the three-body binding energy using the NLEFT and analyze the systematic uncertainties due to the finite volume effects, the sliding cutoff, and the leading-order three-body forces. Even when the three-body interaction is repulsive (even as large as the infinite repulsive interaction), the three-body system has a bound state unambiguously with binding energy no larger than the $D_{s1}(2460)D$ threshold. To check the renormalization group invariance of our framework, we extract the first excited state. We find that when the ground state is fixed, the first excited states with various cutoffs coincide with each other when the cubic size goes larger. In addition, the standard angular momentum and parity projection technique is implemented for the quantum numbers of the ground and excited states. We find that both of them are $S$-wave states with quantum number $J^{P}=1^-$. Because the three-body state contains two charm quarks, it is easier to be detected in the Large Hadron Collider.

hep-ph↗

arXiv2024

Two-body hadronic weak decays of bottomed hadrons

The structure of light diquarks plays a crucial role in the formation of exotic hadrons beyond the conventional quark model, especially in their line shapes of bottomed hadron decays. We study the two-body hadronic weak decays of bottomed baryons and bottomed mesons to probe the light diquark structure and pin down the quark-quark correlations in the diquark picture. We find that the light diquark does not favor a compact structure. For instance, the isoscalar diquark $[ud]$ in $Λ_{b}^{0}$ can be easily split and rearranged to form $Σ_{c}^{(*)}\bar{D}^{(*)}$ via the color-suppressed transition. This provides a hint that the hidden charm pentaquark states produced in $Λ^0_b$ decays could be the $Σ_{c}^{(*)}\bar{D}^{(*)}$ hadronic molecular candidates. This quantitative study resolves the apparent conflicts between the production mechanism and molecular nature of these $P_c$ states observed in experiment.

hep-ph↗

arXiv2023

EasyVolcap: Accelerating Neural Volumetric Video Research

Volumetric video is a technology that digitally records dynamic events such as artistic performances, sporting events, and remote conversations. When acquired, such volumography can be viewed from any viewpoint and timestamp on flat screens, 3D displays, or VR headsets, enabling immersive viewing experiences and more flexible content creation in a variety of applications such as sports broadcasting, video conferencing, gaming, and movie productions. With the recent advances and fast-growing interest in neural scene representations for volumetric video, there is an urgent need for a unified open-source library to streamline the process of volumetric video capturing, reconstruction, and rendering for both researchers and non-professional users to develop various algorithms and applications of this emerging technology. In this paper, we present EasyVolcap, a Python & Pytorch library for accelerating neural volumetric video research with the goal of unifying the process of multi-view data processing, 4D scene reconstruction, and efficient dynamic volumetric video rendering. Our source code is available at https://github.com/zju3dv/EasyVolcap.

cs.CV↗

arXiv2023

4K4D: Real-Time 4D View Synthesis at 4K Resolution

This paper targets high-fidelity and real-time view synthesis of dynamic 3D scenes at 4K resolution. Recently, some methods on dynamic view synthesis have shown impressive rendering quality. However, their speed is still limited when rendering high-resolution images. To overcome this problem, we propose 4K4D, a 4D point cloud representation that supports hardware rasterization and enables unprecedented rendering speed. Our representation is built on a 4D feature grid so that the points are naturally regularized and can be robustly optimized. In addition, we design a novel hybrid appearance model that significantly boosts the rendering quality while preserving efficiency. Moreover, we develop a differentiable depth peeling algorithm to effectively learn the proposed model from RGB videos. Experiments show that our representation can be rendered at over 400 FPS on the DNA-Rendering dataset at 1080p resolution and 80 FPS on the ENeRF-Outdoor dataset at 4K resolution using an RTX 4090 GPU, which is 30x faster than previous methods and achieves the state-of-the-art rendering quality. Our project page is available at https://zju3dv.github.io/4k4d/.

cs.CV↗