SearcharxivSearch

arXiv subjects

Leo Cazenille

Publications and source records attributed to Leo Cazenille.

14 recordsLinked to original sources

Pogobot: an Open-Source, Low-Cost Robot for Swarm Robotics and Programmable Active Matter

This paper describes the Pogobot, an open-source platform specifically designed for research at the interface of swarm robotics and active matter. Pogobot features vibration-based or wheel-based locomotion, fast infrared communication, and an array of sensors in a cost-effective package (approx. 250euros/unit). The platform's modular design, comprehensive API, and extensible architecture facilitate the implementation of swarm intelligence algorithms and collective motion. Pogobots offer an accessible alternative to existing platforms while providing advanced capabilities including directional communication between units and fast locomotion, all with a compact form factor. More than 200 Pogobots are already being used on a daily basis in several Universities to study self-organizing systems, programmable active matter, discrete reaction-diffusion-advection systems and computational models of social learning and evolution. This paper details the hardware and software architecture, communication protocols, locomotion mechanisms, and the infrastructure built around the Pogobots.

cs.RO

Pogosim -- a Simulator for Pogobot robots

Pogobots are a new type of open-source/open-hardware robots specifically designed for swarm robotics research. Their cost-effective and modular design, complemented by vibration-based and wheel-based locomotion, fast infrared communication and extensive software architecture facilitate the implementation of swarm intelligence algorithms. However, testing even simple distributed algorithms directly on robots is particularly labor-intensive. Scaling to more complex problems or calibrate user code parameters will have a prohibitively high strain on available resources. In this article we present Pogosim, a fast and scalable simulator for Pogobots, designed to reduce as much as possible algorithm development costs. The exact same code will be used in both simulation and to experimentally drive real robots. This article details the software architecture of Pogosim, explain how to write configuration files and user programs and how simulations approximate or differ from experiments. We describe how a large set of simulations can be launched in parallel, how to retrieve and analyze the simulation results, and how to optimize user code parameters using optimization algorithms.

cs.RO

Signaling and Social Learning in Swarms of Robots

This paper investigates the role of communication in improving coordination within robot swarms, focusing on a paradigm where learning and execution occur simultaneously in a decentralized manner. We highlight the role communication can play in addressing the credit assignment problem (individual contribution to the overall performance), and how it can be influenced by it. We propose a taxonomy of existing and future works on communication, focusing on information selection and physical abstraction as principal axes for classification: from low-level lossless compression with raw signal extraction and processing to high-level lossy compression with structured communication models. The paper reviews current research from evolutionary robotics, multi-agent (deep) reinforcement learning, language models, and biophysics models to outline the challenges and opportunities of communication in a collective of robots that continuously learn from one another through local message exchanges, illustrating a form of social learning.

cs.RO

Hearing the shape of an arena with spectral swarm robotics

Swarm robotics promises adaptability to unknown situations and robustness against failures. However, it still struggles with global tasks that require understanding the broader context in which the robots operate, such as identifying the shape of the arena in which the robots are embedded. Biological swarms, such as shoals of fish, flocks of birds, and colonies of insects, routinely solve global geometrical problems through the diffusion of local cues. This paradigm can be explicitly described by mathematical models that could be directly computed and exploited by a robotic swarm. Diffusion over a domain is mathematically encapsulated by the Laplacian, a linear operator that measures the local curvature of a function. Crucially the geometry of a domain can generally be reconstructed from the eigenspectrum of its Laplacian. Here we introduce spectral swarm robotics where robots diffuse information to their neighbors to emulate the Laplacian operator - enabling them to "hear" the spectrum of their arena. We reveal a universal scaling that links the optimal number of robots (a global parameter) with their optimal radius of interaction (a local parameter). We validate experimentally spectral swarm robotics under challenging conditions with the one-shot classification of arena shapes using a sparse swarm of Kilobots. Spectral methods can assist with challenging tasks where robots need to build an emergent consensus on their environment, such as adaptation to unknown terrains, division of labor, or quorum sensing. Spectral methods may extend beyond robotics to analyze and coordinate swarms of agents of various natures, such as traffic or crowds, and to better understand the long-range dynamics of natural systems emerging from short-range interactions.

cs.RO

Ensemble Feature Extraction for Multi-Container Quality-Diversity Algorithms

Quality-Diversity algorithms search for large collections of diverse and high-performing solutions, rather than just for a single solution like typical optimisation methods. They are specially adapted for multi-modal problems that can be solved in many different ways, such as complex reinforcement learning or robotics tasks. However, these approaches are highly dependent on the choice of feature descriptors (FDs) quantifying the similarity in behaviour of the solutions. While FDs usually needs to be hand-designed, recent studies have proposed ways to define them automatically by using feature extraction techniques, such as PCA or Auto-Encoders, to learn a representation of the problem from previously explored solutions. Here, we extend these approaches to more complex problems which cannot be efficiently explored by relying only on a single representation but require instead a set of diverse and complementary representations. We describe MC-AURORA, a Quality-Diversity approach that optimises simultaneously several collections of solutions, each with a different set of FDs, which are, in turn, defined automatically by an ensemble of modular auto-encoders. We show that this approach produces solutions that are more diverse than those produced by single-representation approaches.

cs.NE

Exploring Self-Assembling Behaviors in a Swarm of Bio-micro-robots using Surrogate-Assisted MAP-Elites

Swarms of molecular robots are a promising approach to create specific shapes at the microscopic scale through self-assembly. However, controlling their behavior is a challenging problem as it involves complex non-linear dynamics and high experimental variability. Hand-crafting a molecular controller will often be time-consuming and give sub-optimal results. Optimization methods, like the bioNEAT algorithm, were previously employed to partially overcome these difficulties, but they still had to cope with deceptive high-dimensional search spaces and computationally expensive simulations. Here, we describe a novel approach to solve this problem by using MAP-Elites, an algorithm that searches for both high-performing and diverse solutions. We then apply it to a molecular robotic framework we recently introduced that allows sensing, signaling and self-assembly at the micro-scale and show that MAP-Elites outperforms previous approaches. Additionally, we propose a surrogate model of micro-robots physics and chemical reaction dynamics to reduce the computational costs of simulation. We show that the resulting methodology is capable of optimizing controllers with similar accuracy as when using only a full-fledged realistic model, with half the computational budget.

cs.RO

Comparing reliability of grid-based Quality-Diversity algorithms using artificial landscapes

Quality-Diversity (QD) algorithms are a recent type of optimisation methods that search for a collection of both diverse and high performing solutions. They can be used to effectively explore a target problem according to features defined by the user. However, the field of QD still does not possess extensive methodologies and reference benchmarks to compare these algorithms. We propose a simple benchmark to compare the reliability of QD algorithms by optimising the Rastrigin function, an artificial landscape function often used to test global optimisation methods.

cs.NE

Automatic Calibration of Artificial Neural Networks for Zebrafish Collective Behaviours using a Quality Diversity Algorithm

During the last two decades, various models have been proposed for fish collective motion. These models are mainly developed to decipher the biological mechanisms of social interaction between animals. They consider very simple homogeneous unbounded environments and it is not clear that they can simulate accurately the collective trajectories. Moreover when the models are more accurate, the question of their scalability to either larger groups or more elaborate environments remains open. This study deals with learning how to simulate realistic collective motion of collective of zebrafish, using real-world tracking data. The objective is to devise an agent-based model that can be implemented on an artificial robotic fish that can blend into a collective of real fish. We present a novel approach that uses Quality Diversity algorithms, a class of algorithms that emphasise exploration over pure optimisation. In particular, we use CVT-MAP-Elites, a variant of the state-of-the-art MAP-Elites algorithm for high dimensional search space. Results show that Quality Diversity algorithms not only outperform classic evolutionary reinforcement learning methods at the macroscopic level (i.e. group behaviour), but are also able to generate more realistic biomimetic behaviours at the microscopic level (i.e. individual behaviour).

cs.NE

Modelling zebrafish collective behaviours with multilayer perceptrons optimised by evolutionary algorithms

Collective movements are pervasive behaviours among social organisms and have led to the development of many models. However, modelling animal trajectories and social interactions in simple bounded environments remains a challenge. Moreover, advances in the understanding of the sensory-motor loop and the information processing by animals are leading to revisions of the traditional assumptions made in decision-making algorithms. In this context, we develop a methodology based on artificial neural networks (ANN) to describe the collective motion of small zebrafish groups in a bounded environment. Although ANN models are commonly used in artificial systems they are still under-explored to model animal collective behaviours. Here, we present a methodology to calibrate Multilayer Perceptrons by learning from real fish experimental data. The ANNs are trained using either supervised learning or various forms of evolutionary reinforcement learning methods (using the CMA-ES and NSGA-III algorithms). We reveal that ANN models trained using evolutionary methods are capable of generating realistic collective motions for groups of 5 zebrafish including the tank wall effects, a feature that is lacking in previous models. Finally, we also discuss the benefits of optimised ANNs as candidates for driving robotic lure with biologically realistic behaviour, a method that is becoming increasingly popular to gather data and validate assumptions on collective behaviours.

q-bio.NC

Evolutionary optimisation of neural network models for fish collective behaviours in mixed groups of robots and zebrafish

Animal and robot social interactions are interesting both for ethological studies and robotics. On the one hand, the robots can be tools and models to analyse animal collective behaviours, on the other hand, the robots and their artificial intelligence are directly confronted and compared to the natural animal collective intelligence. The first step is to design robots and their behavioural controllers that are capable of socially interact with animals. Designing such behavioural bio-mimetic controllers remains an important challenge as they have to reproduce the animal behaviours and have to be calibrated on experimental data. Most animal collective behavioural models are designed by modellers based on experimental data. This process is long and costly because it is difficult to identify the relevant behavioural features that are then used as a priori knowledge in model building. Here, we want to model the fish individual and collective behaviours in order to develop robot controllers. We explore the use of optimised black-box models based on artificial neural networks (ANN) to model fish behaviours. While the ANN may not be biomimetic but rather bio-inspired, they can be used to link perception to motor responses. These models are designed to be implementable as robot controllers to form mixed-groups of fish and robots, using few a priori knowledge of the fish behaviours. We present a methodology with multilayer perceptron or echo state networks that are optimised through evolutionary algorithms to model accurately the fish individual and collective behaviours in a bounded rectangular arena. We assess the biomimetism of the generated models and compare them to the fish experimental behaviours.

q-bio.NC

How to Blend a Robot within a Group of Zebrafish: Achieving Social Acceptance through Real-time Calibration of a Multi-level Behavioural Model

We have previously shown how to socially integrate a fish robot into a group of zebrafish thanks to biomimetic behavioural models. The models have to be calibrated on experimental data to present correct behavioural features. This calibration is essential to enhance the social integration of the robot into the group. When calibrated, the behavioural model of fish behaviour is implemented to drive a robot with closed-loop control of social interactions into a group of zebrafish. This approach can be useful to form mixed-groups, and study animal individual and collective behaviour by using biomimetic autonomous robots capable of responding to the animals in long-standing experiments. Here, we show a methodology for continuous real-time calibration and refinement of multi-level behavioural model. The real-time calibration, by an evolutionary algorithm, is based on simulation of the model to correspond to the observed fish behaviour in real-time. The calibrated model is updated on the robot and tested during the experiments. This method allows to cope with changes of dynamics in fish behaviour. Moreover, each fish presents individual behavioural differences. Thus, each trial is done with naive fish groups that display behavioural variability. This real-time calibration methodology can optimise the robot behaviours during the experiments. Our implementation of this methodology runs on three different computers that perform individual tracking, data-analysis, multi-objective evolutionary algorithms, simulation of the fish robot and adaptation of the robot behavioural models, all in real-time.

cs.NE

Collective departures in zebrafish: profiling the initiators

For animals living in groups, one of the important questions is to understand what are the decision-making mechanisms that lead to choosing a motion direction or leaving an area while preserving group cohesion. Here, we analyse the initiation of collective departure in zebrafish \textit{Danio rerio}. In particular, we observed groups of 2, 3, 5, 7 and 10 zebrafish swimming in a two resting sites arena and quantify the number of collective departure initiated by each fish. While all fish initiated at least one departure, the probability to be the first one to exit a resting site is not homogeneously distributed with some individuals leading more departures than others. We show that this number of initiation is linearly proportional to the number of attempts performed and that all fish have the same success rate to lead the group out of a resting sites after an attempt. In addition, by measuring the average swimming speed of all fish, we highlight that the intra-group ranking of a fish for its proportion of initiation is correlated to its intra-group ranking in average speed. These results highlight that the initiation of collective departure in zebrafish is a heterogeneously distributed process, even if all individual have the same success rate after attempting a departure.

q-bio.PE

Loose social organisation of AB strain zebrafish groups in a two-patch environment

We explore the collective behaviours of 7 group sizes: 1, 2, 3, 5, 7, 10 and 20 AB zebrafish (Danio rerio) in a constraint environment composed of two identical squared rooms connected by a corridor. This simple set-up is similar to a natural patchy environment. We track the positions and the identities of the fish and compute the metrics at the group and at the individual levels. First, we show that the size of the population affects the behaviour of each individual in a group, the cohesion of the groups, the preferential interactions and the transition dynamics between the two rooms. Second, during collective departures, we show that the rankings of exit correspond to the topological organisations of the fish prior to their collective departure with no leadership. This spatial organisation emerge in the group a few seconds before a collective departure. These results provide new evidences on the spatial organisation of the groups and the effect of the population size on individual and collective behaviours in a patchy environment.

q-bio.PE

Automated optimisation of multi-level models of collective behaviour in a mixed society of animals and robots

Animal and robotic collective behaviours can exhibit complex dynamics that require multi-level descriptions. Here, we are interested in developing a multi-level modeling framework for the use of robots in studies about animal collective decision-making. In this context, using robots can be useful for validating models in silico, inducing calibrated repetitive stimuli to trigger animal responses or modulating and controlling animal collective behaviour. However, designing appropriate biomimetic robotic behaviour faces a major challenge: how to go from the collective decision dynamics observed with animals to an actual algorithmic implementation in robots. In previous work, this was mainly done by hand, often by taking inspiration from human-designed models. Typically, models of behaviour are either macroscopic, differential equations of the population dynamics, or microscopic,explicit spatio-temporal state of each individual. Only microscopic models can easily be implemented as robot controllers. Here, we address the problem of automating the design of lower level description models that can be implemented in robots and exhibit the same collective dynamics as a given higher level model. We apply evolutionary algorithms to simultaneously optimise the parameters of models accounting for different levels of description. This methodology is applied to an experimentally validated shelter-selection problem solved by gregarious insects and robots. We successfully design and calibrate automatically both a microscopic and a hybrid model exhibiting the same dynamics as a macroscopic one. Our framework can be used for multi-level modeling of collective behaviour in animal or robot populations and bio-hybrid systems.

nlin.AO