arXiv subjects

Palina Bartashevich

Publications and source records attributed to Palina Bartashevich.

3 recordsLinked to original sources

arXiv2026

From Optimal Policies to Individual Differences: Rethinking Reinforcement Learning for Biology

Reinforcement learning (RL) is primarily known as a computational method for optimizing control tasks, but it is increasingly used to explain biological behavior. While RL successfully captures key aspects of biology, a major gap remains: between-agent behavioral variability. Consistent individual differences naturally permeate biological populations, yet RL models typically present only the single best individual or the population average. Addressing this gap requires moving beyond current practices to generate behavioral diversity using biologically plausible mechanisms. Here, we examine approaches from various subfields of RL and outline potential paths forward to close the gap between biology and simulation.

cs.NE↗

arXiv2024

Selective social interactions and speed-induced leadership in schooling fish

Animals moving together in groups are believed to interact among each other with effective social forces, such as attraction, repulsion and alignment. Such forces can be inferred using 'force maps', i.e. by analysing the dependency of the acceleration of a focal individual on relevant variables. Here we introduce a force map technique suitable for the analysis of the alignment forces experienced by individuals. After validating it using an agent-based model, we apply the force map to experimental data of schooling fish. We observe signatures of an effective alignment force with faster neighbours, and an unexpected anti-alignment with slower neighbours. Instead of an explicit anti-alignment behaviour, we suggest that the observed pattern is the result of a selective attention mechanism, where fish pay less attention to slower neighbours. This mechanism implies the existence of temporal leadership interactions based on relative speeds between neighbours. We present support for this hypothesis both from agent-based modelling, as well as from exploring leader-follower relationships in the experimental data.

physics.bio-ph↗

arXiv2020

Evidence Propagation and Consensus Formation in Noisy Environments

We study the effectiveness of consensus formation in multi-agent systems where there is both belief updating based on direct evidence and also belief combination between agents. In particular, we consider the scenario in which a population of agents collaborate on the best-of-n problem where the aim is to reach a consensus about which is the best (alternatively, true) state from amongst a set of states, each with a different quality value (or level of evidence). Agents' beliefs are represented within Dempster-Shafer theory by mass functions and we investigate the macro-level properties of four well-known belief combination operators for this multi-agent consensus formation problem: Dempster's rule, Yager's rule, Dubois & Prade's operator and the averaging operator. The convergence properties of the operators are considered and simulation experiments are conducted for different evidence rates and noise levels. Results show that a combination of updating on direct evidence and belief combination between agents results in better consensus to the best state than does evidence updating alone. We also find that in this framework the operators are robust to noise. Broadly, Yager's rule is shown to be the better operator under various parameter values, i.e. convergence to the best state, robustness to noise, and scalability.

cs.MA↗