SearcharxivSearch

arXiv subjects

Tixian Wang

Publications and source records attributed to Tixian Wang.

10 recordsLinked to original sources

Learning, locomotion, and navigation of soft synthetic snakes in three-dimensional, heterogeneous environments

Limbless terrestrial animals exhibit exceptional locomotor versatility and control, currently unmatched by engineered counterparts. Here, we introduce a computational framework that enables soft synthetic snakes to navigate unstructured, heterogeneous 3D terrains. Our approach is grounded in bio-inspired actuation and sensing models that reduce the control complexity inherent to high-degree-of-freedom, continuum bodies. These models are integrated into a reinforcement learning architecture to derive environment-traversing policies. Training first occurs in simplified, homogeneous terrains to learn locomotion primitives. These are then composed into adaptive strategies for complex landscapes. We demonstrate robustness by deploying a snake in high-fidelity 3D environments reconstructed from real-world imaging, achieving reliable navigation. Overall, this work provides a physically-realistic simulation platform and practical insights for the control of continuum systems in natural terrains.

cs.RO

Digital twins for the design, interactive control, and deployment of modular, fiber-reinforced soft continuum arms

Soft continuum arms (SCAs) promise versatile manipulation through mechanical compliance, for assistive devices, agriculture, search applications, or surgery. However, the strong nonlinear coupling between materials, morphology, and actuation renders design and control challenging, hindering real-world deployment. In this context, a modular fabrication strategy paired with reliable, interactive simulations would be highly beneficial, streamlining prototyping and control design. Here, we present a digital twin framework for modular SCAs realized using pneumatic Fiber-Reinforced Elastomeric Enclosures (FREEs). The approach models assemblies of FREE actuators through networks of Cosserat rods, favoring the accurate simulation of three-dimensional arm reconfigurations, while explicitly preserving internal modular architecture. This enables the quantitative analysis and scalable development of composite soft robot arms, overcoming limitations of current monolithic continuum models. To validate the framework, we introduce a three-dimensional reconstruction pipeline tailored to soft, slender, small-volume, and highly deformable structures, allowing reliable recovery of arm kinematics and strain distributions. Experimental results across multiple configurations and actuation regimes demonstrate close agreement with simulations. Finally, we embed the digital twins in a virtual environment to allow interactive control design and sim-to-real deployment, establishing a foundation for principled co-design and remote operation of modular soft continuum manipulators.

cs.RO

A Neural Network-based Framework for Fast and Smooth Posture Reconstruction of a Soft Continuum Arm

A neural network-based framework is developed and experimentally demonstrated for the problem of estimating the shape of a soft continuum arm (SCA) from noisy measurements of the pose at a finite number of locations along the length of the arm. The neural network takes as input these measurements and produces as output a finite-dimensional approximation of the strain, which is further used to reconstruct the infinite-dimensional smooth posture. This problem is important for various soft robotic applications. It is challenging due to the flexible aspects that lead to the infinite-dimensional reconstruction problem for the continuous posture and strains. Because of this, past solutions to this problem are computationally intensive. The proposed fast smooth reconstruction method is shown to be five orders of magnitude faster while having comparable accuracy. The framework is evaluated on two testbeds: a simulated octopus muscular arm and a physical BR2 pneumatic soft manipulator.

cs.RO

Modeling the Neuromuscular Control System of an Octopus Arm

The octopus arm is a neuromechanical system that involves a complex interplay between peripheral nervous system (PNS) and arm musculature. This makes the arm capable of carrying out rich maneuvers. In this paper, we build a model for the PNS and integrate it with a muscular soft octopus arm. The proposed neuromuscular architecture is used to qualitatively reproduce several biophysical observations in real octopuses, including curled rest shapes and target-directed arm reaching motions. Two control laws are proposed for target-oriented arm motions, and their performance is compared against a benchmark. Several analytical results, including rest-state characterization and stability properties of the proposed control laws, are provided.

eess.SY

A Sensory Feedback Control Law for Octopus Arm Movements

The main contribution of this paper is a novel sensory feedback control law for an octopus arm. The control law is inspired by, and helps integrate, several observations made by biologists. The proposed control law is distinct from prior work which has mainly focused on open-loop control strategies. Several analytical results are described including characterization of the equilibrium and its stability analysis. Numerical simulations demonstrate life-like motion of the soft octopus arm, qualitatively matching behavioral experiments. Quantitative comparison with bend propagation experiments helps provide the first explanation of such canonical motion using a sensory feedback control law. Several remarks are included that help draw parallels with natural pursuit strategies such as motion camouflage or classical pursuit.

eess.SY

Control-oriented Modeling of Bend Propagation in an Octopus Arm

Bend propagation in an octopus arm refers to a stereotypical maneuver whereby an octopus pushes a bend (localized region of large curvature) from the base to the tip of the arm. Bend propagation arises from the complex interplay between mechanics of the flexible arm, forces generated by internal muscles, and environmental effects (buoyancy and drag) from of the surrounding fluid. In part due to this complexity, much of prior modeling and analysis work has relied on the use of high dimensional computational models. The contribution of this paper is to present a control-oriented reduced order model based upon a novel parametrization of the curvature of the octopus arm. The parametrization is motivated by the experimental results. The reduced order model is related to and derived from a computational model which is also presented. The results from the two sets of models are compared using numerical simulations which is shown to lead to useful qualitative insights into bend propagation. A comparison between the reduced order model and experimental data is also reported.

physics.bio-ph

Optimal Control of a Soft CyberOctopus Arm

In this paper, we use the optimal control methodology to control a flexible, elastic Cosserat rod. An inspiration comes from stereotypical movement patterns in octopus arms, which are observed in a variety of manipulation tasks, such as reaching or fetching. To help uncover the mechanisms underlying these observed morphologies, we outline an optimal control-based framework. A single octopus arm is modeled as a Hamiltonian control system, where the continuum mechanics of the arm is modeled after the Cosserat rod theory, and internal, distributed muscle forces and couples are considered as controls. First order necessary optimality conditions are derived for an optimal control problem formulated for this infinite dimensional system. Solutions to this problem are obtained numerically by an iterative forward-backward algorithm. The state and adjoint equations are solved in a dynamic simulation environment, setting the stage for studying a broader class of optimal control problems. Trajectories that minimize control effort are demonstrated and qualitatively compared with observed behaviors.

math.OC

Centralized model predictive control with distributed adaptation

A centralized model predictive controller (MPC), which is unaware of local uncertainties, for an affine discrete time nonlinear system is presented. The local uncertainties are assumed to be matched, bounded and structured. In order to encounter disturbances and to improve performance, an adaptive control mechanism is employed locally. The proposed approach ensures input-to-state stability of closed-loop states and convergence to the equilibrium point. Moreover, uncertainties are learnt in terms of the given feature basis by using adaptive control mechanism. In addition, hard constraints on state and control are satisfied.

math.OC

Bio-inspired Learning of Sensorimotor Control for Locomotion

This paper presents a bio-inspired central pattern generator (CPG)-type architecture for learning optimal maneuvering control of periodic locomotory gaits. The architecture is presented here with the aid of a snake robot model problem involving planar locomotion of coupled rigid body systems. The maneuver involves clockwise or counterclockwise turning from a nominally straight path. The CPG circuit is realized as a coupled oscillator feedback particle filter. The collective dynamics of the filter are used to approximate a posterior distribution that is used to construct the optimal control input for maneuvering the robot. A Q-learning algorithm is applied to learn the approximate optimal control law. The issues surrounding the parametrization of the Q-function are discussed. The theoretical results are illustrated with numerics for a 5-link snake robot system.

eess.SY

Q-learning for POMDP: An application to learning locomotion gaits

This paper presents a Q-learning framework for learning optimal locomotion gaits in robotic systems modeled as coupled rigid bodies. Inspired by prevalence of periodic gaits in bio-locomotion, an open loop periodic input is assumed to (say) affect a nominal gait. The learning problem is to learn a new (modified) gait by using only partial noisy measurements of the state. The objective of learning is to maximize a given reward modeled as an objective function in optimal control settings. The proposed control architecture has three main components: (i) Phase modeling of dynamics by a single phase variable; (ii) A coupled oscillator feedback particle filter to represent the posterior distribution of the phase conditioned in the sensory measurements; and (iii) A Q-learning algorithm to learn the approximate optimal control law. The architecture is illustrated with the aid of a planar two-body system. The performance of the learning is demonstrated in a simulation environment.

eess.SY