arXiv subjects

Christoph Lohrmann

Publications and source records attributed to Christoph Lohrmann.

8 recordsLinked to original sources

arXiv2026

Reinforcement Learning Enables Autonomous Microrobot Navigation and Intervention in Simulated Blood Capillaries

Autonomous microrobots navigating biological vasculature could enable targeted drug delivery and thrombolysis, yet training control policies for realistic environments remains an open challenge. Prior reinforcement learning (RL) studies of microrobotic navigation have been limited to idealized geometries that omit complex hydrodynamic flow fields, confined branching structures, and dense cellular obstacles found in vivo. Here, we develop a physically grounded simulation of a blood capillary network, incorporating realistic hydrodynamic flow fields, explicit red blood cell dynamics, and anatomically derived branching geometry, and train deep RL agents to navigate it via chemotaxis. We systematically map the physical limits of navigation across robot size and swimming speed, revealing a forbidden regime where Brownian motion and flow overcome propulsion. Successful agents independently discover multiple universal strategy types, including run-and-rotate and energy-efficient search-and-sit policies, regardless of robot parameters. Without retraining, these agents perform targeted blocking and unblocking of capillary flow, restoring throughput to healthy baseline levels. These results establish RL as a viable framework for developing autonomous microrobotic intervention strategies in complex biological environments.

cs.RO↗

arXiv2025

Intermittent flow paths in biofilms grown in a microfluidic channel

Biofilms exposed to flow experience shear stress, which leads to a competitive interaction between the growth and development of a biofilm and shearing. In this study, Pseudonomas fluorescene biofilm was grown in a microfluidic channel and exposed to forced flow of an aqueous solution of variable velocity. It can be observed that under certain conditions preferential flow paths form with a dynamic, but quasi-steady state interaction of growth, detachment, and re-attachment. We find that the regimes for preferential flow path development are determined by nutrient availability and the ratio of shear stress versus the biofilm's ability to resist shear forces. The intermittent regime of flow paths is mainly driven by the supply with nutrients, which we confirm by comparison with a numerical model based on coarse-grained molecular dynamics and Lattice Boltzmann hydrodynamics.

physics.flu-dyn↗

arXiv2024

SwarmRL: Building the Future of Smart Active Systems

This work introduces SwarmRL, a Python package designed to study intelligent active particles. SwarmRL provides an easy-to-use interface for developing models to control microscopic colloids using classical control and deep reinforcement learning approaches. These models may be deployed in simulations or real-world environments under a common framework. We explain the structure of the software and its key features and demonstrate how it can be used to accelerate research. With SwarmRL, we aim to streamline research into micro-robotic control while bridging the gap between experimental and simulation-driven sciences. SwarmRL is available open-source on GitHub at https://github.com/SwarmRL/SwarmRL.

cs.RO↗

arXiv2024

Emergence of Chemotactic Strategies with Multi-Agent Reinforcement Learning

Reinforcement learning (RL) is a flexible and efficient method for programming micro-robots in complex environments. Here we investigate whether reinforcement learning can provide insights into biological systems when trained to perform chemotaxis. Namely, whether we can learn about how intelligent agents process given information in order to swim towards a target. We run simulations covering a range of agent shapes, sizes, and swim speeds to determine if the physical constraints on biological swimmers, namely Brownian motion, lead to regions where reinforcement learners' training fails. We find that the RL agents can perform chemotaxis as soon as it is physically possible and, in some cases, even before the active swimming overpowers the stochastic environment. We study the efficiency of the emergent policy and identify convergence in agent size and swim speeds. Finally, we study the strategy adopted by the reinforcement learning algorithm to explain how the agents perform their tasks. To this end, we identify three emerging dominant strategies and several rare approaches taken. These strategies, whilst producing almost identical trajectories in simulation, are distinct and give insight into the possible mechanisms behind which biological agents explore their environment and respond to changing conditions.

physics.bio-ph↗

arXiv2023

Optimal motility strategies for self-propelled agents to explore porous media

Micro-robots for, e.g., biomedical applications, need to be equipped with motility strategies that enable them to navigate through complex environments. Inspired by biological microorganisms we recreate motility patterns such as run-and-reverse, run-and-tumble or run-reverse-flick applied to active rod-like particles in silico. We investigate their capability to efficiently explore disordered porous environments with various porosities and mean pore sizes ranging down to the scale of the active particle. By calculating the effective diffusivity for the different patterns, we can predict the optimal one for each porous sample geometry. We find that providing the agent with very basic sensing and decision making capabilities yields a motility pattern outperforming the biologically inspired patterns for all investigated porous samples.

cond-mat.soft↗

arXiv2023

Environmental effects on emergent strategy in micro-scale multi-agent reinforcement learning

Multi-Agent Reinforcement Learning (MARL) is a promising candidate for realizing efficient control of microscopic particles, of which micro-robots are a subset. However, the microscopic particles' environment presents unique challenges, such as Brownian motion at sufficiently small length-scales. In this work, we explore the role of temperature in the emergence and efficacy of strategies in MARL systems using particle-based Langevin molecular dynamics simulations as a realistic representation of micro-scale environments. To this end, we perform experiments on two different multi-agent tasks in microscopic environments at different temperatures, detecting the source of a concentration gradient and rotation of a rod. We find that at higher temperatures, the RL agents identify new strategies for achieving these tasks, highlighting the importance of understanding this regime and providing insight into optimal training strategies for bridging the generalization gap between simulation and reality. We also introduce a novel Python package for studying microscopic agents using reinforcement learning (RL) to accompany our results.

physics.bio-ph↗

arXiv2020

The Influence of Motility on Bacterial Accumulation in a Microporous Channel

We study the transport of bacteria in a porous media modeled by a square channel containing one cylindrical obstacle via molecular dynamics simulations coupled to a lattice Boltzmann fluid. Our bacteria model is a rod-shaped rigid body which is propelled by a force-free mechanism. To account for the behavior of living bacteria, the model also incorporates a run-and-tumble process. The model bacteria are capable of hydrodynamically interacting with both of the channel walls and the obstacle. This enables the bacteria to get reoriented when experiencing a shear-flow. We demonstrate that this model is capable of reproducing the bacterial accumulation on the rear side of an obstacle, as has recently been experimentally observed by [G. L. Mino, et al., Advances in Microbiology 8, 451 (2018)] using E.coli bacteria. By systematically varying the external flow strength and the motility of the bacteria, we resolve the interplay between the local flow strength and the swimming characteristics that lead to the accumulation. Moreover, by changing the geometry of the channel, we also reveal the important role of the interactions between the bacteria and the confining walls for the accumulation process.

cond-mat.soft↗

arXiv2019

Autonomous engines driven by active matter: Energetics and design principles

Because of its nonequilibrium character, active matter in a steady state can drive engines that autonomously deliver work against a constant mechanical force or torque. As a generic model for such an engine, we consider systems that contain one or several active components and a single passive one that is asymmetric in its geometrical shape or its interactions. Generally, one expects that such an asymmetry leads to a persistent, directed current in the passive component, which can be used for the extraction of work. We validate this expectation for a minimal model consisting of an active and a passive particle on a one-dimensional lattice. It leads us to identify thermodynamically consistent measures for the efficiency of the conversion of isotropic activity to directed work. For systems with continuous degrees of freedom, work cannot be extracted using a one-dimensional geometry under quite general conditions. In contrast, we put forward two-dimensional shapes of a movable passive obstacle that are best suited for the extraction of work, which we compare with analytical results for an idealised work-extraction mechanism. For a setting with many noninteracting active particles, we use a mean-field approach to calculate the power and the efficiency, which we validate by simulations. Surprisingly, this approach reveals that the interaction with the passive obstacle can mediate cooperativity between otherwise noninteracting active particles, which enhances the extracted power per active particle significantly.

cond-mat.stat-mech↗