SearcharxivSearch

arXiv subjects

Dongping Li

Publications and source records attributed to Dongping Li.

10 recordsLinked to original sources

Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimation

Recent trends in sparse-view 3D reconstruction have taken two different paths: feed-forward reconstruction that predicts pixel-aligned point maps without a complete geometry, and generative 3D reconstruction that generates complete geometry but often with poor input-alignment. We present Mix3R, a novel generative 3D reconstruction method which mixes feed-forward reconstruction and 3D generation into a single framework in an aligned manner. Mix3R generates a 3D shape in two stages: a sparse voxel generation stage and a textured geometry generation stage. Unlike pure generative methods, our first-stage generation jointly produces a coarse 3D structure (sparse voxels), per-view point maps and camera parameters aligned to that 3D structure. This is made possible by introducing a Mixture-of-Transformers architecture that inserts global self-attentions to a feed-forward reconstruction model and a 3D generative model, both pretrained on large-scale data. This design effectively retains the pretrained priors but enables better 2D-3D alignment. Based on the initial aligned generations of sparse 3D voxels and point maps, we compute an overlap-based attention bias that is directly added to another pretrained textured geometry generation model, enabling it to correctly place input textures onto generated shapes in a training-free manner. Our design brings mutual benefits to both feed-forward reconstruction and 3D generation: The feed-forward branch learns to ground its predictions to a generative 3D prior, and conversely, the 3D generation branch is conditioned on geometrically informative features from the feed-forward branch. As a result, our method produces 3D shapes with better input alignment compared with pure 3D generative methods, together with camera pose estimations more accurate than previous feed-forward reconstruction methods. Our project page is at https://jsnln.github.io/mix3r/

cs.CV

Adaptive low-rank exponential integrators for large-scale differential Riccati equation

Matrix differential Riccati equation (DRE) typically exhibits transient and steady-state phases, posing challenges for fixed-step time integration methods, which may lack accuracy during transients or oversample in steady regimes. In this work, we propose adaptive low-rank matrix-valued exponential integrators for large-scale stiff DRE. The methods combine embedded exponential Rosenbrock-type schemes and adaptive step-size control, enabling an automatic adjustment to the evolving solution dynamics. This improves the accuracy during rapid transient phases while maintaining high accuracy in the steady state. Numerical experiments on benchmark problems demonstrate that the proposed adaptive integrators consistently improve accuracy and computational efficiency compared with fixed-step low-rank schemes.

math.NA

COMMET: A System for Human-Induced Conflicts in Mobile Manipulation of Everyday Tasks

Continuous advancements in robotics and AI are driving the integration of robots from industry into everyday environments. However, dynamic and unpredictable human activities in daily lives would directly or indirectly conflict with robot actions. Besides, due to the social attributes of such human-induced conflicts, solutions are not always unique and depend highly on the user's personal preferences. To address these challenges and facilitate the development of household robots, we propose COMMET, a system for human-induced COnflicts in Mobile Manipulation of Everyday Tasks. COMMET employs a hybrid detection approach, which begins with multi-modal retrieval and escalates to fine-tuned model inference for low-confidence cases. Based on collected user preferred options and settings, GPT-4o will be used to summarize user preferences from relevant cases. In preliminary studies, our detection module shows better accuracy and latency compared with GPT models. To facilitate future research, we also design a user-friendly interface for user data collection and demonstrate an effective workflow for real-world deployments.

cs.RO

EMMOE: A Comprehensive Benchmark for Embodied Mobile Manipulation in Open Environments

Developing autonomous home robots controlled by natural language has long been a pursuit of humanity. While advancements in large language models (LLMs) and embodied intelligence make this goal closer, several challenges persist: the lack of a unified benchmark for more complex robot tasks, limited evaluation methods and metrics, data incompatibility between LLMs and mobile manipulation trajectories. To address these issues, we propose Embodied Mobile Manipulation in Open Environments (EMMOE), a benchmark that requires agents to interpret user instructions and execute long-horizon everyday tasks in continuous space. EMMOE seamlessly integrates high-level and low-level embodied tasks into a unified framework, along with three new metrics for more diverse assessment. Additionally, we collect~\dataset, which features in various task attributes, detailed process annotations, re-plans after failures, and two sub-datasets for LLM training. Furthermore, we design~\model, a sophisticated agent system consists of LLM with Direct Preference Optimization (DPO), light weighted navigation and manipulation models, and multiple error detection mechanisms. Finally, we demonstrate~\model's performance and evaluations of different models and policies.

cs.RO

Efficient algorithm for the oscillatory matrix functions

This paper introduces an efficient algorithm for computing the general oscillatory matrix functions. These computations are crucial for solving second-order semi-linear initial value problems. The method is exploited using the scaling and restoring technique based on a quadruple angle formula in conjunction with a truncated Taylor series. The choice of the scaling parameter and the degree of the Taylor polynomial relies on a forward error analysis. Numerical experiments show that the new algorithm behaves in a stable fashion and performs well in both accuracy and efficiency.

math.NA

A low-rank algorithm for solving Lyapunov operator $\varphi$-functions within the matrix-valued exponential integrators

In this work we present a low-rank algorithm for computing low-rank approximations of large-scale Lyapunov operator $\varphi$-functions. These computations play a crucial role in implementing of matrix-valued exponential integrators for large-scale stiff matrix differential equations, where the (approximate) solutions are of low rank.The proposed method employs a scaling and recursive procedure, complemented by a quasi-backward error analysis to determine the optimal parameters. The computational cost is primarily determined by the multiplication of sparse matrices with block vectors. Numerical experiments validate the effectiveness of the proposed method as a foundational tool for matrix-valued exponential integrators in solving differential Lyapunov equations and Riccati equations.

math.NA

Fast GPU-Based Two-Way Continuous Collision Handling

Step-and-project is a popular way to simulate non-penetrated deformable bodies in physically-based animation. First integrating the system in time regardless of contacts and post resolving potential intersections practically strike a good balance between plausibility and efficiency. However, existing methods could be defective and unsafe when the time step is large, taking risks of failures or demands of repetitive collision testing and resolving that severely degrade performance. In this paper, we propose a novel two-way method for fast and reliable continuous collision handling. Our method launches the optimization at both ends of the intermediate time-integrated state and the previous intersection-free state, progressively generating a piecewise-linear path and finally reaching a feasible solution for the next time step. Technically, our method interleaves between a forward step and a backward step at a low cost, until the result is conditionally converged. Due to a set of unified volume-based contact constraints, our method can flexibly and reliably handle a variety of codimensional deformable bodies, including volumetric bodies, cloth, hair and sand. The experiments show that our method is safe, robust, physically faithful and numerically efficient, especially suitable for large deformations or large time steps.

cs.GR

Computing the Lyapunov operator \varphi-functions, with an application to matrix-valued exponential integrators

In this paper, we develop efficient and accurate evaluation for the Lyapunov operator function $\varphi_l(\mathcal{L}_A)[Q],$ where $\varphi_l(\cdot)$ is the function related to the exponential, $\mathcal{L}_A$ is a Lyapunov operator and $Q$ is a symmetric and full-rank matrix. An important application of the algorithm is to the matrix-valued exponential integrators for matrix differential equations such as differential Lyapunov equations and differential Riccati equations. The method is exploited by using the modified scaling and squaring procedure combined with the truncated Taylor series. A quasi-backward error analysis is presented to determine the value of the scaling parameter and the degree of the Taylor approximation. Numerical experiments show that the algorithm performs well in both accuracy and efficiency.

math.NA

Efficient and accurate computation to the $\varphi$-function and its action on a vector

In this paper, we develop efficient and accurate algorithms for evaluating $\varphi(A)$ and $\varphi(A)b$, where $A$ is an $N\times N$ matrix, $b$ is an $N$ dimensional vector and $\varphi$ is the function defined by $\varphi(x)\equiv\sum\limits^{\infty}_{k=0}\frac{z^k}{(1+k)!}$. Such matrix function (the so-called $\varphi$-function) plays a key role in a class of numerical methods well-known as exponential integrators. The algorithms use the scaling and modified squaring procedure combined with truncated Taylor series. The backward error analysis is presented to find the optimal value of the scaling and the degree of the Taylor approximation. Some useful techniques are employed for reducing the computational cost. Numerical comparisons with state-of-the-art algorithms show that the algorithms perform well in both accuracy and efficiency.

math.NA

Exponential integrators for large-scale stiff matrix Riccati differential equations

Matrix Riccati differential equations arise in many different areas and are particular important within the field of control theory. In this paper we consider numerical integration for large-scale systems of stiff matrix Riccati differential equations. We show how to apply exponential Rosenbrock-type integrators to get approximate solutions. Two typical exponential integration schemes are considered. The implementation issues are addressed and some low-rank approximations are exploited based on high quality numerical algebra codes. Numerical comparisons demonstrate that the exponential integrators can obtain high accuracy and efficiency for solving large-scale systems of stiff matrix Riccati differential equations.

math.NA