arXiv subjects

Christoph Adami

Publications and source records attributed to Christoph Adami.

At least 55 records · Page 3Linked to original sources

arXiv2016

What is Information?

Information is a precise concept that can be defined mathematically, but its relationship to what we call "knowledge" is not always made clear. Furthermore, the concepts "entropy" and "information", while deeply related, are distinct and must be used with care, something that is not always achieved in the literature. In this elementary introduction, the concepts of entropy and information are laid out one by one, explained intuitively, but defined rigorously. I argue that a proper understanding of information in terms of prediction is key to a number of disciplines beyond engineering, such as physics and biology.

nlin.AO↗

arXiv2015

Information-theoretic neuro-correlates boost evolution of cognitive systems

Genetic Algorithms (GA) are a powerful set of tools for search and optimization that mimic the process of natural selection, and have been used successfully in a wide variety of problems, including evolving neural networks to solve cognitive tasks. Despite their success, GAs sometimes fail to locate the highest peaks of the fitness landscape, in particular if the landscape is rugged and contains multiple peaks. Reaching distant and higher peaks is difficult because valleys need to be crossed, in a process that (at least temporarily) runs against the fitness maximization objective. Here we propose and test a number of information-theoretic (as well as network-based) measures that can be used in conjunction with a fitness maximization objective (so-called ``neuro-correlates") to evolve neural controllers for two widely different tasks: a behavioral task that requires information integration, and a cognitive task that requires memory and logic. We find that judiciously chosen neuro-correlates can significantly aid GAs to find the highest peaks.

q-bio.NC↗

arXiv2015

Evolution of swarming behavior is shaped by how predators attack

Animal grouping behaviors have been widely studied due to their implications for understanding social intelligence, collective cognition, and potential applications in engineering, artificial intelligence, and robotics. An important biological aspect of these studies is discerning which selection pressures favor the evolution of grouping behavior. In the past decade, researchers have begun using evolutionary computation to study the evolutionary effects of these selection pressures in predator-prey models. The selfish herd hypothesis states that concentrated groups arise because prey selfishly attempt to place their conspecifics between themselves and the predator, thus causing an endless cycle of movement toward the center of the group. Using an evolutionary model of a predator-prey system, we show that how predators attack is critical to the evolution of the selfish herd. Following this discovery, we show that density-dependent predation provides an abstraction of Hamilton's original formulation of ``domains of danger.'' Finally, we verify that density-dependent predation provides a sufficient selective advantage for prey to evolve the selfish herd in response to predation by coevolving predators. Thus, our work corroborates Hamilton's selfish herd hypothesis in a digital evolutionary model, refines the assumptions of the selfish herd hypothesis, and generalizes the domain of danger concept to density-dependent predation.

q-bio.PE↗

arXiv2015

Evolution of genome size in asexual populations

Genome sizes have evolved to vary widely, from 250 bases in viroids to 670 billion bases in amoeba. This remarkable variation in genome size is the outcome of complex interactions between various evolutionary factors such as point mutation rate, population size, insertions and deletions, and genome editing mechanisms that may be specific to certain taxonomic lineages. While comparative genomics analyses have uncovered some of the relationships between these diverse evolutionary factors, we still do not understand what drives genome size evolution. Specifically, it is not clear how primordial mutational processes of base substitutions, insertions, and deletions influence genome size evolution in asexual organisms. Here, we use digital evolution to investigate genome size evolution by tracking genome edits and their fitness effects in real time. In agreement with empirical data, we find that mutation rate is inversely correlated with genome size in asexual populations. We show that at low point mutation rate, insertions are significantly more beneficial than deletions, driving genome expansion and acquisition of phenotypic complexity. Conversely, high mutational load experienced at high mutation rates inhibits genome growth, forcing the genomes to compress genetic information. Our analyses suggest that the inverse relationship between mutation rate and genome size is a result of the tradeoff between evolving phenotypic innovation and limiting the mutational load.

q-bio.PE↗

arXiv2015

Does self-replication imply evolvability?

The most prominent property of life on Earth is its ability to evolve. It is often taken for granted that self-replication--the characteristic that makes life possible--implies evolvability, but many examples such as the lack of evolvability in computer viruses seem to challenge this view. Is evolvability itself a property that needs to evolve, or is it automatically present within any chemistry that supports sequences that can evolve in principle? Here, we study evolvability in the digital life system Avida, where self-replicating sequences written by hand are used to seed evolutionary experiments. We use 170 self-replicators that we found in a search through 3 billion randomly generated sequences (at three different sequence lengths) to study the evolvability of generic rather than hand-designed self-replicators. We find that most can evolve but some are evolutionarily sterile. From this limited data set we are led to conclude that evolvability is a likely--but not a guaranteed-- property of random replicators in a digital chemistry.

q-bio.PE↗

arXiv2015

Black holes as bosonic Gaussian channels

We identify the quantum channels corresponding to the interaction of a Gaussian quantum state with an already formed Schwarzschild black hole. Using recent advances in the classification of one-mode bosonic Gaussian channels we find that (with one exception) the black hole Gaussian channels lie in the non-entanglement breaking subset of the lossy channels C(loss), amplifying channels C(amp) and classical-noise channels B2. We show that the channel parameters depend on the black hole mass and the properties of the potential barrier surrounding it. This classification enables us to calculate the classical and quantum capacity of the black hole and to estimate the quantum capacity where no tractable quantum capacity expression exists today. We discuss these findings in the light of the black hole quantum information loss problem.

quant-ph↗

arXiv2015

Punishment in Public Goods games leads to meta-stable phase transitions and hysteresis

The evolution of cooperation has been a perennial problem in evolutionary biology because cooperation can be undermined by selfish cheaters who gain an advantage in the short run, while compromising the long-term viability of the population. Evolutionary game theory has shown that under certain conditions, cooperation nonetheless evolves stably, for example if players have the opportunity to punish cheaters that benefit from a public good yet refuse to pay into the common pool. However, punishment has remained enigmatic because it is costly, and difficult to maintain. On the other hand, cooperation emerges naturally in the Public Goods game if the synergy of the public good (the factor multiplying the public good investment) is sufficiently high. In terms of this synergy parameter, the transition from defection to cooperation can be viewed as a phase transition with the synergy as the critical parameter. We show here that punishment reduces the critical value at which cooperation occurs, but also creates the possibility of meta-stable phase transitions, where populations can "tunnel" into the cooperating phase below the critical value. At the same time, cooperating populations are unstable even above the critical value, because a group of defectors that are large enough can "nucleate" such a transition. We study the mean-field theoretical predictions via agent-based simulations of finite populations using an evolutionary approach where the decisions to cooperate or to punish are encoded genetically in terms of evolvable probabilities. We recover the theoretical predictions and demonstrate that the population shows hysteresis, as expected in systems that exhibit super-heating and super-cooling. We conclude that punishment can stabilize populations of cooperators below the critical point, but it is a two-edged sword: it can also stabilize defectors above the critical point.

q-bio.PE↗

arXiv2015

Discovery and information-theoretic characterization of transcription factor binding sites that act cooperatively

Transcription factor binding to the surface of DNA regulatory regions is one of the primary causes of regulating gene expression levels. A probabilistic approach to model protein-DNA interactions at the sequence level is through Position Weight Matrices (PWMs) that estimate the joint probability of a DNA binding site sequence by assuming positional independence within the DNA sequence. Here we construct conditional PWMs that depend on the motif signatures in the flanking DNA sequence, by conditioning known binding site loci on the presence or absence of additional binding sites in the flanking sequence of each site's locus. Pooling known sites with similar flanking sequence patterns allows for the estimation of the conditional distribution function over the binding site sequences. We apply our model to the Dorsal transcription factor binding sites active in patterning the Dorsal-Ventral axis of Drosophila development. We find that those binding sites that cooperate with nearby Twist sites on average contain about 0.5 bits of information about the presence of Twist transcription factor binding sites in the flanking sequence. We also find that Dorsal binding site detectors conditioned on flanking sequence information make better predictions about what is a Dorsal site relative to background DNA than detection without information about flanking sequence features.

physics.bio-ph↗

arXiv2014

Information-theoretic considerations concerning the origin of life

Research investigating the origins of life usually focuses on exploring possible life-bearing chemistries in the pre-biotic Earth, or else on synthetic approaches. Little work has been done exploring fundamental issues concerning the spontaneous emergence of life using only concepts (such as information and evolution) that are divorced from any particular chemistry. Here, I advocate studying the probability of spontaneous molecular self-replication as a function of the information contained in the replicator, and the environmental conditions that might enable this emergence. I show that (under certain simplifying assumptions) the probability to discover a self-replicator by chance depends exponentially on the rate of formation of the monomers. If the rate at which monomers are formed is somewhat similar to the rate at which they would occur in a self-replicating polymer, the likelihood to discover such a replicator by chance is increased by many orders of magnitude. I document such an increase in searches for a self-replicator within the digital life system avida

q-bio.PE↗

arXiv2014

Is information a selectable trait?

There is little doubt in scientific circles that--counting from the origin of life towards today--evolution has led to an increase in the amount of information stored within the genomes of the biosphere. This trend of increasing information on average likely holds for every successful line of descent, but it is not clear whether this increase is due to a general law, or whether it is a secondary effect linked to an overall increase in fitness. Here, we use "digital life" evolution experiments to study whether information is under selection if treated as an organismal trait, using the Price equation. By measuring both sides of the equation individually in an adapting population, the strength of selection on a trait appears as a "gap" between the two terms of the right-hand-side of the Price equation. We find that information is strongly selected (as it encodes all fitness-producing traits) by comparing the strength of selection on information to a weakly selected trait (sequence length), as well as to a neutral marker. We observe that while strength of selection on arbitrary traits can vary during an experiment (including reversing sign), information is a selectable trait that must increase in a fixed environment.

q-bio.PE↗

arXiv2014

Exploring the evolution of a trade-off between vigilance and foraging in group-living organisms

Despite the fact that grouping behavior has been actively studied for over a century, the relative importance of the numerous proposed fitness benefits of grouping remain unclear. We use a digital model of evolving prey under simulated predation to directly explore the evolution of gregarious foraging behavior according to one such benefit, the "many eyes" hypothesis. According to this hypothesis, collective vigilance allows prey in large groups to detect predators more efficiently by making alarm signals or behavioral cues to each other, thereby allowing individuals within the group to spend more time foraging. Here, we find that collective vigilance is sufficient to select for gregarious foraging behavior as long there is not a direct cost for grouping (e.g., competition for limited food resources), even when controlling for confounding factors such as the dilution effect. Further, we explore the role of the genetic relatedness and reproductive strategy of the prey, and find that highly related groups of prey with a semelparous reproductive strategy are the most likely to evolve gregarious foraging behavior mediated by the benefit of vigilance. These findings, combined with earlier studies with evolving digital organisms, further sharpen our understanding of the factors favoring grouping behavior.

q-bio.PE↗

arXiv2014

More Bang For Your Buck: Quorum-Sensing Capabilities Improve the Efficacy of Suicidal Altruism

Within the context of evolution, an altruistic act that benefits the receiving individual at the expense of the acting individual is a puzzling phenomenon. An extreme form of altruism can be found in colicinogenic E. coli. These suicidal altruists explode, releasing colicins that kill unrelated individuals, which are not colicin resistant. By committing suicide, the altruist makes it more likely that its kin will have less competition. The benefits of this strategy rely on the number of competitors and kin nearby. If the organism explodes at an inopportune time, the suicidal act may not harm any competitors. Communication could enable organisms to act altruistically when environmental conditions suggest that that strategy would be most beneficial. Quorum sensing is a form of communication in which bacteria produce a protein and gauge the amount of that protein around them. Quorum sensing is one means by which bacteria sense the biotic factors around them and determine when to produce products, such as antibiotics, that influence competition. Suicidal altruists could use quorum sensing to determine when exploding is most beneficial, but it is challenging to study the selective forces at work in microbes. To address these challenges, we use digital evolution (a form of experimental evolution that uses self-replicating computer programs as organisms) to investigate the effects of enabling altruistic organisms to communicate via quorum sensing. We found that quorum-sensing altruists killed a greater number of competitors per explosion, winning competitions against non-communicative altruists. These findings indicate that quorum sensing could increase the beneficial effect of altruism and the suite of conditions under which it will evolve.

cs.NE↗

arXiv2014

The capacity of black holes to transmit quantum information

We study the properties of the quantum information transmission channel that emerges from the quantum dynamics of particles interacting with a black hole horizon. We calculate the quantum channel capacity in two limiting cases where a single-letter capacity is known to exist: the limit of perfectly reflecting and perfectly absorbing black holes. We find that the perfectly reflecting black hole channel is closely related to the Unruh channel and that its capacity is non-vanishing, allowing for the perfect reconstruction of quantum information outside of the black hole horizon. We also find that the complementary channel (transmitting entanglement behind the horizon) is entanglement-breaking in this case, with vanishing capacity. We then calculate the quantum capacity of the black hole channel in the limit of a perfectly absorbing black hole and find that this capacity vanishes, while the capacity of the complementary channel is non-vanishing instead. Rather than inviting a new crisis for quantum physics, this finding instead is in accordance with the quantum no-cloning theorem, because it guarantees that there are no space-like surfaces that contain both the sender's quantum state and the receiver's reconstructed quantum state.

quant-ph↗

arXiv2014

Leveraging Evolutionary Search to Discover Self-Adaptive and Self-Organizing Cellular Automata

Building self-adaptive and self-organizing (SASO) systems is a challenging problem, in part because SASO principles are not yet well understood and few platforms exist for exploring them. Cellular automata (CA) are a well-studied approach to exploring the principles underlying self-organization. A CA comprises a lattice of cells whose states change over time based on a discrete update function. One challenge to developing CA is that the relationship of an update function, which describes the local behavior of each cell, to the global behavior of the entire CA is often unclear. As a result, many researchers have used stochastic search techniques, such as evolutionary algorithms, to automatically discover update functions that produce a desired global behavior. However, these update functions are typically defined in a way that does not provide for self-adaptation. Here we describe an approach to discovering CA update functions that are both self-adaptive and self-organizing. Specifically, we use a novel evolutionary algorithm-based approach to discover finite state machines (FSMs) that implement update functions for CA. We show how this approach is able to evolve FSM-based update functions that perform well on the density classification task for 1-, 2-, and 3-dimensional CA. Moreover, we show that these FSMs are self-adaptive, self-organizing, and highly scalable, often performing well on CA that are orders of magnitude larger than those used to evaluate performance during the evolutionary search. These results demonstrate that CA are a viable platform for studying the integration of self-adaptation and self-organization, and strengthen the case for using evolutionary algorithms as a component of SASO systems.

cs.NE↗

arXiv2014

Trade-offs drive resource specialization and the gradual establishment of ecotypes

Speciation is driven by many different factors. Among those are trade-offs between different ways an organism utilizes resources, and these trade-offs can constrain the manner in which selection can optimize traits. Limited migration among allopatric populations and species interactions can also drive speciation, but here we ask if trade-offs alone are sufficient to drive speciation in the absence of other factors. We present a model to study the effects of trade-offs on specialization and adaptive radiation in asexual organisms based solely on competition for limiting resources, where trade-offs are stronger the greater an organism's ability to utilize resources. In this model resources are perfectly substitutable, and fitness is derived from the consumption of these resources. The model contains no spatial parameters, and is therefore strictly sympatric. We quantify the degree of specialization by the number of ecotypes formed and the niche breadth of the population, and observe that these are sensitive to resource influx and trade-offs. Resource influx has a strong effect on the degree of specialization, with a clear transition between minimal diversification at high influx and multiple species evolving at low resource influx. At low resource influx the degree of specialization further depends on the strength of the trade-offs, with more ecotypes evolving the stronger trade-offs are. The specialized organisms persist through negative frequency-dependent selection. In addition, by analyzing one of the evolutionary radiations in greater detail we demonstrate that a single mutation alone is not enough to establish a new ecotype, even though phylogenetic reconstruction identifies that mutation as the branching point. Instead, it takes a series of additional mutations to ensure the stable coexistence of the new ecotype in the background of the existing ones, reminiscent of a recent observa

q-bio.PE↗

arXiv2014

Classical information transmission capacity of quantum black holes

The fate of classical information incident on a quantum black hole has been the subject of an ongoing controversy in theoretical physics, because a calculation within the framework of semi-classical curved-space quantum field theory appears to show that the incident information is irretrievably lost, in contradiction to time-honored principles such as time-reversibility and unitarity. Here, we show within this framework embedded in quantum communication theory that signaling from past to future infinity in the presence of a Schwarzschild black hole can occur with arbitrary accuracy, and thus that classical information is not lost in black hole dynamics. The calculation relies on a treatment that is manifestly unitary from the outset, where probability conservation is guaranteed because black holes stimulate the emission of radiation in response to infalling matter. This stimulated radiation is non-thermal, and contains all of the information about the infalling matter, while Hawking radiation contains none of it.

gr-qc↗

arXiv2013

Risk aversion as an evolutionary adaptation

Risk aversion is a common behavior universal to humans and animals alike. Economists have traditionally defined risk preferences by the curvature of the utility function. Psychologists and behavioral economists also make use of concepts such as loss aversion and probability weighting to model risk aversion. Neurophysiological evidence suggests that loss aversion has its origins in relatively ancient neural circuitries (e.g., ventral striatum). Could there thus be an evolutionary origin to risk avoidance? We study this question by evolving strategies that adapt to play the equivalent mean payoff gamble. We hypothesize that risk aversion in the equivalent mean payoff gamble is beneficial as an adaptation to living in small groups, and find that a preference for risk averse strategies only evolves in small populations of less than 1,000 individuals, while agents exhibit no such strategy preference in larger populations. Further, we discover that risk aversion can also evolve in larger populations, but only when the population is segmented into small groups of around 150 individuals. Finally, we observe that risk aversion only evolves when the gamble is a rare event that has a large impact on the individual's fitness. These findings align with earlier reports that humans lived in small groups for a large portion of their evolutionary history. As such, we suggest that rare, high-risk, high-payoff events such as mating and mate competition could have driven the evolution of risk averse behavior in humans living in small groups.

q-bio.PE↗

arXiv2013

The evolution of representation in simple cognitive networks

Representations are internal models of the environment that can provide guidance to a behaving agent, even in the absence of sensory information. It is not clear how representations are developed and whether or not they are necessary or even essential for intelligent behavior. We argue here that the ability to represent relevant features of the environment is the expected consequence of an adaptive process, give a formal definition of representation based on information theory, and quantify it with a measure R. To measure how R changes over time, we evolve two types of networks---an artificial neural network and a network of hidden Markov gates---to solve a categorization task using a genetic algorithm. We find that the capacity to represent increases during evolutionary adaptation, and that agents form representations of their environment during their lifetime. This ability allows the agents to act on sensorial inputs in the context of their acquired representations and enables complex and context-dependent behavior. We examine which concepts (features of the environment) our networks are representing, how the representations are logically encoded in the networks, and how they form as an agent behaves to solve a task. We conclude that R should be able to quantify the representations within any cognitive system, and should be predictive of an agent's long-term adaptive success.

q-bio.NC↗