SearcharxivSearch

arXiv · chao-dyn/9903009

Chaotic Dynamics in Iterated Map Neural Networks with Piecewise Linear Activation Function

Abstract

The paper examines the discrete-time dynamics of neuron models (of excitatory and inhibitory types) with piecewise linear activation functions, which are connected in a network. The properties of a pair of neurons (one excitatory and the other inhibitory) connected with each other, is studied in detail. Even such a simple system shows a rich variety of behavior, including high-period oscillations and chaos. Border-collision bifurcations and multifractal fragmentation of the phase space is also observed for a range of parameter values. Extension of the model to a larger number of neurons is suggested under certain restrictive assumptions, which makes the resultant network dynamics effectively one-dimensional. Possible applications of the network for information processing are outlined. These include using the network for auto-association, pattern classification, nonlinear function approximation and periodic sequence generation.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Sitabhra Sinha. 1999-03-06. Chaotic Dynamics in Iterated Map Neural Networks with Piecewise Linear Activation Function. https://arxiv.org/abs/chao-dyn/9903009

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

The Bogdanov Map: Bifurcations, Mode Locking, and Chaos in a Dissipative System

We investigate the bifurcations and basins of attraction in the Bogdanov map, a planar quadratic map which is conjugate to the Hénon area-preserving map in its conservative limit. It undergoes a Hopf bifurcation as dissipation is added, and exhibits the panoply of mode locking, Arnold tongues, and chaos as an invariant circle grows out, finally to be destroyed in the homoclinic tangency of the manifolds of a remote saddle point. The Bogdanov map is the Euler map of a two-dimensional system of ordinary differential equations first considered by Bogdanov and Arnold in their study of the versal unfolding of the double-zero-eigenvalue singularity, and equivalently of a vector field invariant under rotation of the plane by an angle $2π$. It is a useful system in which to observe the effect of dissipative perturbations on Hamiltonian structure. In addition, we argue that the Bogdanov map provides a good approximation to the dynamics of the Poincaré maps of periodically forced oscillators.

chao-dyn

Passive Scalars and Three-Dimensional Liouvillian Maps

Global aspects of the motion of passive scalars in time-dependent incompressible fluid flows are well described by volume-preserving (Liouvillian) three-dimensional maps. In this paper the possible invariant structures in Liouvillian maps and the two most interesting nearly-integrable cases are investigated. In addition, the fundamental role of invariant lines in organizing the dynamics of this type of system is exposed. Bifurcations involving the destruction of some invariant lines and tubes and the creation of new ones are described in detail.

chao-dyn