SearcharxivSearch

arXiv subjects

Mario Stepanik

Publications and source records attributed to Mario Stepanik.

2 recordsLinked to original sources

Unsupervised learning architecture based on neural Darwinism and Hopfield networks recognizes symbols with high accuracy

This paper introduces a novel unsupervised learning paradigm inspired by Gerald Edelman's theory of neuronal group selection ("Neural Darwinism"). The presented automaton learns to recognize arbitrary symbols (e.g., letters of an alphabet) when they are presented repeatedly, as they are when children learn to read. On a second hierarchical level, the model creates abstract categories representing the learnt symbols. The fundamental computational unit are simple McCulloch-Pitts neurons arranged into fully-connected groups (Hopfield networks with randomly initialized weights), which are "selected", in an evolutionary sense, through symbol presentation. The learning process is fully tractable and easily interpretable for humans, in contrast to most neural network architectures. Computational properties of Hopfield networks enabling pattern recognition are discussed. In simulations, the model achieves high accuracy in learning the letters of the Latin alphabet, presented as binary patterns on a grid. This paper is a proof of concept with no claims to state-of-the-art performance in letter recognition, but hopefully inspires new thinking in bio-inspired machine learning.

cs.NE

LSTM model predicting outcome of strategic thinking task exhibits representations of level-k thinking

Which neural mechanisms underlie strategic thinking in the human brain? Neuroeconomic research has not yet bridged the gap between theoretical models of higher-order reasoning and the precise mechanisms implemented in neural networks in the human brain. In this paper, I demonstrate that a recurrent neural network model can learn to perform strongly in the simple strategic game Rock-Paper-Scissors. In doing so, it develops implicit representations of strategically important variables (the levels $k$ of reasoning) which economists have postulated in theoretical models. These representations can be extracted from the hidden activations of the neural network. These findings hint at a connection between the mechanisms implicit in recurrent neural networks and models of strategic thinking in economic theory. Future empirical brain research can investigate whether these mechanisms correspond to mechanisms implicit in biological neural networks.

cs.GT