Searcharxiv⌕ Search

arXiv subjects

Pawel Romanczuk

Publications and source records attributed to Pawel Romanczuk.

At least 19 recordsLinked to original sources

From Optimal Policies to Individual Differences: Rethinking Reinforcement Learning for Biology

Reinforcement learning (RL) is primarily known as a computational method for optimizing control tasks, but it is increasingly used to explain biological behavior. While RL successfully captures key aspects of biology, a major gap remains: between-agent behavioral variability. Consistent individual differences naturally permeate biological populations, yet RL models typically present only the single best individual or the population average. Addressing this gap requires moving beyond current practices to generate behavioral diversity using biologically plausible mechanisms. Here, we examine approaches from various subfields of RL and outline potential paths forward to close the gap between biology and simulation.

cs.NE↗

Social-spatial dependencies for learning visual navigation

Navigation for social organisms rarely is a fully independent activity. Group structure and dynamics, as well as embodied interactions, critically influence useful behavior. Individual neural network controlled agents are trained to navigate in different social contexts, where social dependence and behavioral strategy learned is determined by relative task performance and spatial effect. Increasing high quality social information drives phase transitions from individual to following navigational strategy, and to collision avoidance in response to a crowded foraging patch. Predictable, nonstationary environmental dynamics drive behavioral hybridization between individual and social navigation, far and near the patch. Our findings challenge the approach of only inspecting individual behavior for social organisms and highlight the importance of taking a bottom-up approach in understanding how organisms behave.

cs.NE↗

Passivity-Driven Order-Disorder Transitions in Self-Aligning Active Matter

We study dense mixtures of passive and active self-aligning disks with isotropic or anisotropic mobility. We find that the passive fraction controls an order-disorder transition that is continuous in the isotropic case and discontinuous in the anisotropic one. A mean-field equation derived from the microscopic heading dynamics captures this dichotomy. Near the transition, both ordered regimes can exhibit multiple metastable oscillating or rotating states, depending on the spatial arrangement of passive particles and lattice defects, but with different transient dynamics: Systems with isotropic mobility visit multiple long-lived attractors during each simulation while systems with anisotropic mobility are trapped by a single attractor. Our results reveal the passive fraction as a physically relevant control parameter in active systems, leading to rich self-organizing dynamics.

cond-mat.soft↗

Visuospatial navigation from the bottom-up: without vestibular integration, distance prediction, or maps

Navigation is believed to be controlled by at least two partially dissociable systems in the brain. The cognitive map informs an organism of its location and bearing, updated by integrating vestibular self-motion or predicting distances to landmarks. Route-based navigation, on the other hand, directly evaluate sequential movement decisions from immediate percepts. Here we demonstrate the sufficiency of visual route-based decision-making in a classic open field navigation task often assumed to require a cognitive map. Three distinct strategies emerge to robustly navigate to a hidden goal, each conferring contextual tradeoffs analyzed at both neural and behavioral scales, as well as qualitatively aligning with behavior observed across the biological spectrum. We propose reframing navigation from the bottom-up, through an egocentric episodic perspective without assuming online access to computationally expensive top-down representations, to better explain behavior under energetic or attentional constraints.

cs.NE↗

Messengers: Breaking Echo Chambers in Collective Opinion Dynamics with Homophily

Collective estimation is a variant of collective decision-making where agents reach consensus on a continuous quantity through social interactions. Achieving precise consensus is complex due to the co-evolution of opinions and the interaction network. While homophilic networks may facilitate estimation in well-connected systems, disproportionate interactions with like-minded neighbors lead to the emergence of echo chambers and prevent consensus. Our agent-based simulations confirm that, besides limited exposure to attitude-challenging opinions, seeking reaffirming information entrap agents in echo chambers. To overcome this, agents can adopt a stubborn state (Messengers) that carry data and connect clusters by physically transporting their opinion. We propose a generic approach based on a Dichotomous Markov Process, which governs probabilistic switching between behavioral states and generates diverse collective behaviors. We study a continuum between task specialization (no switching), to generalization (slow or rapid switching). Messengers help the collective escape local minima, break echo chambers, and promote consensus.

cs.SI↗

Collective dynamics of densely confined active polar disks with self- and mutual alignment

We study the emerging collective states in a simple mechanical model of a dense group of self-propelled polar disks with off-centered rotation, confined within a circular arena. Each disk presents self-alignment towards the sum of contact forces acting on it, resulting from disk-substrate interactions, while also displaying mutual alignment with neighbors due to having its center of rotation located a distance R behind its centroid so that central contact forces can also introduce torques. The effect of both alignment mechanisms produces a variety of collective states that combine high-frequency localized circular oscillations with low-frequency milling around the center of the arena, in fluid or solid regimes. We consider cases with small/large R values, isotropic/anisotropic disk-substrate damping, smooth/rough arena boundaries, different densities, and multiple systems sizes, showing that the emergent collective states that we identify are robust, generic, and potentially observable in real-world natural or artificial systems.

cond-mat.soft↗

Collective decision-making with heterogeneous biases: Role of network topology and susceptibility

The ability of groups to make accurate collective decisions depends on a complex interplay of various factors, such as prior information, biases, social influence, and the structure of the interaction network. Here, we investigate a spin model that accounts for heterogeneous preferences and enables control over the non-linearity of social interactions. Building on previous results for complete graphs and regular 2D lattices, we investigate how the modification of network topology towards (sparse) random graphs can affect collective decision-making. We use two different measures of susceptibility to assess the responsiveness of the system to internal and external perturbations. In particular, we investigate how the maximum of susceptibility depends on network connectivity. Based on our findings, we discuss how collective systems might adapt to changes in environmental fluctuations by adjusting their network structure or the nature of their social interactions in order to remain in the region of maximal susceptibility.

physics.soc-ph↗

LARS: Light Augmented Reality System for Swarm

We present the Light Augmented Reality System LARS as an open-source and cost-effective tool. LARS leverages light-projected visual scenes for indirect robot-robot and human-robot interaction through the real environment. It operates in real-time and is compatible with a range of robotic platforms, from miniature to middle-sized robots. LARS can support researchers in conducting experiments with increased freedom, reliability, and reproducibility. This XR tool makes it possible to enrich the environment with full control by adding complex and dynamic objects while keeping the properties of robots as realistic as they are.

cs.RO↗

Escape cascades as a behavioral contagion process with adaptive network dynamics

Complex behavioral contagion in collective evasion of mobile animal groups can be predicted by reconstructing quantitative interaction networks. Based on the assumption of time-scale separation between a fast contagion process and a slower movement response, the underlying interaction networks have been previously assumed to be static, determined by the spatial structure at the onset of the collective escape response. This idealization does not account for the temporal evolution of the spatial network structure, which may have a major impact on the behavioral contagion dynamics. Here, we propose a spatially-explicit, agent-based model for the coupling between behavioral contagion and the network dynamics originating from the spreading movement response. We explore the impact of movement parameters (startle speed, initial directionality, and directional noise) on average cascade size. By conducting numerical simulations for different density levels, we show that increasing escape speed suppresses the cascade size in most cases, that the cascade size depends strongly on the movement direction of the initially startled individual, and that large variability in the direction of individual escape movements (rotational noise) will typically promote the spread of behavioral contagion through spatial groups. Our work highlights the importance of accounting for movement dynamics in behavioral contagion, and facilitates our understanding of rapid coordinated response and collective information processing in animal groups.

nlin.AO↗

Purely vision-based collective movement of robots

Collective movement inspired by animal groups promises inherited benefits for robot swarms, such as enhanced sensing and efficiency. However, while animals move in groups using only their local senses, robots often obey central control or use direct communication, introducing systemic weaknesses to the swarm. In the hope of addressing such vulnerabilities, developing bio-inspired decentralized swarms has been a major focus in recent decades. Yet, creating robots that move efficiently together using only local sensory information remains an extraordinary challenge. In this work, we present a decentralized, purely vision-based swarm of terrestrial robots. Within this novel framework robots achieve collisionless, polarized motion exclusively through minimal visual interactions, computing everything on board based on their individual camera streams, making central processing or direct communication obsolete. With agent-based simulations, we further show that using this model, even with a strictly limited field of view and within confined spaces, ordered group motion can emerge, while also highlighting key limitations. Our results offer a multitude of practical applications from hybrid societies coordinating collective movement without any common communication protocol, to advanced, decentralized vision-based robot swarms capable of diverse tasks in ever-changing environments.

cs.RO↗

Selective social interactions and speed-induced leadership in schooling fish

Animals moving together in groups are believed to interact among each other with effective social forces, such as attraction, repulsion and alignment. Such forces can be inferred using 'force maps', i.e. by analysing the dependency of the acceleration of a focal individual on relevant variables. Here we introduce a force map technique suitable for the analysis of the alignment forces experienced by individuals. After validating it using an agent-based model, we apply the force map to experimental data of schooling fish. We observe signatures of an effective alignment force with faster neighbours, and an unexpected anti-alignment with slower neighbours. Instead of an explicit anti-alignment behaviour, we suggest that the observed pattern is the result of a selective attention mechanism, where fish pay less attention to slower neighbours. This mechanism implies the existence of temporal leadership interactions based on relative speeds between neighbours. We present support for this hypothesis both from agent-based modelling, as well as from exploring leader-follower relationships in the experimental data.

physics.bio-ph↗

Leveraging Uncertainty in Collective Opinion Dynamics with Heterogeneity

Natural and artificial collectives exhibit heterogeneities across different dimensions, contributing to the complexity of their behavior. We investigate the effect of two such heterogeneities on collective opinion dynamics: heterogeneity of the quality of agents' prior information and of centrality in the network, i.e., the number of immediate neighbors. To study these heterogeneities, we not only consider them in our model, proposing a novel network generator with heterogeneous centrality, but also introduce uncertainty as an additional dimension. By quantifying the uncertainty of each agent, we provide a mechanism for agents to adaptively weigh their individual against social information. As uncertainties develop according to the interactions between agents, they capture information on heterogeneities. Therefore, uncertainty is a relevant additional observable in the study of complex collective opinion dynamics that we use to show the bidirectional relationship of heterogeneous centrality and information. Furthermore, we demonstrate that uncertainty-driven adaptive weighting leads to increased accuracy and speed of consensus, especially under heterogeneity, and provide guidelines for avoiding performance-decreasing errors in uncertainty modeling. These opportunities for improved performance and observability suggest the importance of uncertainty both for the study of natural and the design of artificial heterogeneous systems.

physics.soc-ph↗

Individuality in Swarm Robots with the Case Study of Kilobots: Noise, Bug, or Feature?

Inter-individual differences are studied in natural systems, such as fish, bees, and humans, as they contribute to the complexity of both individual and collective behaviors. However, individuality in artificial systems, such as robotic swarms, is undervalued or even overlooked. Agent-specific deviations from the norm in swarm robotics are usually understood as mere noise that can be minimized, for example, by calibration. We observe that robots have consistent deviations and argue that awareness and knowledge of these can be exploited to serve a task. We measure heterogeneity in robot swarms caused by individual differences in how robots act, sense, and oscillate. Our use case is Kilobots and we provide example behaviors where the performance of robots varies depending on individual differences. We show a non-intuitive example of phototaxis with Kilobots where the non-calibrated Kilobots show better performance than the calibrated supposedly ``ideal" one. We measure the inter-individual variations for heterogeneity in sensing and oscillation, too. We briefly discuss how these variations can enhance the complexity of collective behaviors. We suggest that by recognizing and exploring this new perspective on individuality, and hence diversity, in robotic swarms, we can gain a deeper understanding of these systems and potentially unlock new possibilities for their design and implementation of applications.

cs.RO↗

Estimation of continuous environments by robot swarms: Correlated networks and decision-making

Collective decision-making is an essential capability of large-scale multi-robot systems to establish autonomy on the swarm level. A large portion of literature on collective decision-making in swarm robotics focuses on discrete decisions selecting from a limited number of options. Here we assign a decentralized robot system with the task of exploring an unbounded environment, finding consensus on the mean of a measurable environmental feature, and aggregating at areas where that value is measured (e.g., a contour line). A unique quality of this task is a causal loop between the robots' dynamic network topology and their decision-making. For example, the network's mean node degree influences time to convergence while the currently agreed-on mean value influences the swarm's aggregation location, hence, also the network structure as well as the precision error. We propose a control algorithm and study it in real-world robot swarm experiments in different environments. We show that our approach is effective and achieves higher precision than a control experiment. We anticipate applications, for example, in containing pollution with surface vehicles.

cs.RO↗

Individual bias and fluctuations in collective decision making: from algorithms to Hamiltonians

In this paper, we reconsider the spin model suggested recently to understand some features of collective decision making among higher organisms [A.T. Hartnett et al., Phys. Rev. Lett. 116 (2016) 038701]. Within the model, the state of an agent $i$ is described by the pair of variables corresponding to its opinion $S_i=\pm 1$ and a bias $ω_i$ towards any of the opposing values of $S_i$. Collective decision making is interpreted as an approach to the equilibrium state within the non-linear voter model subject to a social pressure and a probabilistic algorithm. Here, we push such physical analogy further and give the statistical physics interpretation of the model, describing it in terms of the Hamiltonian of interaction and looking for the equilibrium state via explicit calculation of its partition function. We show that depending on the assumptions about the nature of social interactions two different Hamiltonians can be formulated, which can be solved with different methods. In such an interpretation the temperature serves as a measure of fluctuations, not considered before in the original model. We find exact solutions for the thermodynamics of the model on the complete graph. The general analytical predictions are confirmed using individual-based simulations. The simulations allow us also to study the impact of system size and initial conditions in the collective decision making in finite-sized systems, in particular with respect to convergence to metastable states.

cond-mat.stat-mech↗

Phase Transitions and Criticality in the Collective Behavior of Animals -- Self-organization and biological function

Collective behaviors exhibited by animal groups, such as fish schools, bird flocks, or insect swarms are fascinating examples of self-organization in biology. Concepts and methods from statistical physics have been used to argue theoretically about the potential consequences of collective effects in such living systems. In particular, it has been proposed that such collective systems should operate close to a phase transition, specifically a (pseudo-)critical point, in order to optimize their capability for collective computation. In this chapter, we will first review relevant phase transitions exhibited by animal collectives, pointing out the difficulties of applying concepts from statistical physics to biological systems. Then we will discuss the current state of research on the "criticality hypothesis", including methods for how to measure distance from criticality and specific functional consequences for animal groups operating near a phase transition. We will highlight the emerging view that de-emphasizes the optimality of being exactly at a critical point and instead explores the potential benefits of living systems being able to tune to an optimal distance from criticality. We will close by laying out future challenges for studying collective behavior at the interface of physics and biology.

physics.bio-ph↗

Emergent Metric-like States of Active Particles with Metric-free Polar Alignment

We study a model of self-propelled particles interacting with their $k$ nearest neighbors through polar alignment. By exploring its phase space as a function of two nondimensional parameters (alignment strength $g$ and Peclet number $\mathrm{Pe}$), we identify two distinct order-disorder transitions. One is continuous, occurs at a low critical $g$ value independent of Pe, and resembles a mean-field transition with no density-order coupling. The other is discontinuous, depends on a combined control parameter involving $g$ and Pe, and results from the formation of small, dense, highly persistent clusters of particles that follow metric-like dynamics. These dense clusters form at a critical value of the combined control parameter $\mathrm{Pe}/g^α$, with $α\approx 1.5$, which appears to be valid for different alignment-based models. Our study shows that models of active particles with metric-free interactions can produce characteristic length-scales and self-organize into metric-like collective states that undergo metric-like transitions.

cond-mat.soft↗

Social dilemmas of sociality due to beneficial and costly contagion

Levels of sociality in nature vary widely. Some species are solitary; others live in family groups; some form complex multi-family societies. Increased levels of social interaction can allow for the spread of useful innovations and beneficial information, but can also facilitate the spread of harmful contagions, such as infectious diseases. It is natural to assume that these contagion processes shape the evolution of complex social systems, but an explicit account of the dynamics of sociality under selection pressure imposed by contagion remains elusive. We consider a model for the evolution of sociality strategies in the presence of both a beneficial and costly contagion. We study the dynamics of this model at three timescales: using a susceptible-infectious-susceptible (SIS) model to describe contagion spread for given sociality strategies, a replicator equation to study the changing fractions of two different levels of sociality, and an adaptive dynamics approach to study the long-time evolution of the population level of sociality. For a wide range of assumptions about the benefits and costs of infection, we identify a social dilemma: the evolutionarily-stable sociality strategy (ESS) is distinct from the collective optimum -- the level of sociality that would be best for all individuals. In particular, the ESS level of social interaction is greater (respectively less) than the social optimum when the good contagion spreads more (respectively less) readily than the bad contagion. Our results shed light on how contagion shapes the evolution of social interaction, but reveals that evolution may not necessarily lead populations to social structures that are good for any or all.

physics.soc-ph↗