arXiv subjects

Ningtao Mao

Publications and source records attributed to Ningtao Mao.

3 recordsLinked to original sources

arXiv2026

Learnable Persistent Wrinkle Formation in Cloth Simulation

The mechanical memory of fabrics often leads to persistent wrinkles, which reflect key physical properties and habitual wear patterns. Simulating these wrinkles accurately is essential for visual plausibility in digital garments, yet no dedicated approach exists for inferring the parameters that govern their formation due to the lack of precise datasets and estimation methods. We introduce Fabric-101, an inclusive, accurate, and extendable fabric dataset comprising over 101 common fabrics following textile standards. Unlike existing datasets, it captures three physically distinct deformation components (i.e., self-recoverable (elastic), recoverable (friction-driven), and unrecoverable (plastic)), from cyclic loading-unloading measurements. Building on this data, we propose a differentiable cloth simulator combining an elasto-plastic model with friction, designed to capture recoverable and unrecoverable wrinkle formation. Our simulator is differentiable and uses adjoint method to learn fabric physical parameters from the measured hysteresis curves, learning fabric-specific wrinkle behaviors. Through extensive experiments, we demonstrate that our model reproduces persistent wrinkles that are visually and physically similar to real fabrics across diverse materials and motions. Dataset and code are available in https://github.com/GongDeshan/Fabric_101_for_Wrinkles.

cs.GR↗

arXiv2024

Bayesian Differentiable Physics for Cloth Digitalization

We propose a new method for cloth digitalization. Deviating from existing methods which learn from data captured under relatively casual settings, we propose to learn from data captured in strictly tested measuring protocols, and find plausible physical parameters of the cloths. However, such data is currently absent, so we first propose a new dataset with accurate cloth measurements. Further, the data size is considerably smaller than the ones in current deep learning, due to the nature of the data capture process. To learn from small data, we propose a new Bayesian differentiable cloth model to estimate the complex material heterogeneity of real cloths. It can provide highly accurate digitalization from very limited data samples. Through exhaustive evaluation and comparison, we show our method is accurate in cloth digitalization, efficient in learning from limited data samples, and general in capturing material variations. Code and data are available https://github.com/realcrane/Bayesian-Differentiable-Physics-for-Cloth-Digitalization

cs.CV↗

arXiv2023

Vis2Hap: Vision-based Haptic Rendering by Cross-modal Generation

To assist robots in teleoperation tasks, haptic rendering which allows human operators access a virtual touch feeling has been developed in recent years. Most previous haptic rendering methods strongly rely on data collected by tactile sensors. However, tactile data is not widely available for robots due to their limited reachable space and the restrictions of tactile sensors. To eliminate the need for tactile data, in this paper we propose a novel method named as Vis2Hap to generate haptic rendering from visual inputs that can be obtained from a distance without physical interaction. We take the surface texture of objects as key cues to be conveyed to the human operator. To this end, a generative model is designed to simulate the roughness and slipperiness of the object's surface. To embed haptic cues in Vis2Hap, we use height maps from tactile sensors and spectrograms from friction coefficients as the intermediate outputs of the generative model. Once Vis2Hap is trained, it can be used to generate height maps and spectrograms of new surface textures, from which a friction image can be obtained and displayed on a haptic display. The user study demonstrates that our proposed Vis2Hap method enables users to access a realistic haptic feeling similar to that of physical objects. The proposed vision-based haptic rendering has the potential to enhance human operators' perception of the remote environment and facilitate robotic manipulation.

cs.RO↗