SearcharxivSearch

arXiv subjects

Tobias Reichenbach

Publications and source records attributed to Tobias Reichenbach.

At least 19 recordsLinked to original sources

A Resource-Efficient CNN-Based EEG Auditory Attention Decoding ASIC

Following a target speaker in a noisy environment, commonly known as the cocktail party problem, remains particularly challenging for cochlear implant (CI) users. Recent studies have explored EEG-based auditory attention decoding (AAD) using neural networks to enhance hearing assistance. This paper presents a resource-efficient ASIC for real-time EEG-based auditory attention decoding by integrating a quantized CNN inference engine and a Pearson-correlation classifier. The proposed architecture employs streaming execution, on-chip buffering, and memory-efficient dataflow to reduce hardware cost while maintaining real-time performance. The proposed ASIC has been fully implemented in GF22FDX 22-nm CMOS technology, occupying a total silicon area of 2.09 mm$^2$(1264$\mu$m x 1654$\mu$m), with the CNN inference engine and streaming classification engine requiring only 0.076 mm$^2$. Operating at a core voltage of 0.55 V, the design achieves a power consumption of 0.4941 mW and an inference latency of 7.34 ms, providing an energy-efficient hardware platform for EEG-based auditory attention decoding in hearing-assistance applications.

cs.AR

Detecting gamma-band responses to the speech envelope for the ICASSP 2024 Auditory EEG Decoding Signal Processing Grand Challenge

The 2024 ICASSP Auditory EEG Signal Processing Grand Challenge concerns the decoding of electroencephalography (EEG) measurements taken from participants who listened to speech material. This work details our solution to the match-mismatch sub-task: given a short temporal segment of EEG recordings and several candidate speech segments, the task is to classify which of the speech segments was time-aligned with the EEG signals. We show that high-frequency gamma-band responses to the speech envelope can be detected with a high accuracy. By jointly assessing gamma-band responses and low-frequency envelope tracking, we develop a match-mismatch decoder which placed first in this task.

eess.AS

Comparison of linear and nonlinear methods for decoding selective attention to speech from ear-EEG recordings

Many people with hearing loss struggle to comprehend speech in crowded auditory scenes, even when they are using hearing aids. It has recently been demonstrated that the focus of a listener's selective attention to speech can be decoded from their electroencephalography (EEG) recordings, raising the prospect of smart EEG-steered hearing aids which restore speech comprehension in adverse acoustic environments (such as the cocktail party). To this end, we here assess the feasibility of using a novel, ultra-wearable ear-EEG device to classify the selective attention of normal-hearing listeners who participated in a two-talker competing-speakers experiment. Eighteen participants took part in a diotic listening task, whereby they were asked to attend to one narrator whilst ignoring the other. Encoding models were estimated from the recorded signals, and these confirmed that the device has the ability to capture auditory responses that are consistent with those reported in high-density EEG studies. Several state-of-the-art auditory attention decoding algorithms were next compared, including stimulus-reconstruction algorithms based on linear regression as well as non-linear deep neural networks, and canonical correlation analysis (CCA). Meaningful markers of selective auditory attention could be extracted from the ear-EEG signals of all 18 participants, even when those markers were derived from relatively short EEG segments of just five seconds in duration. Algorithms which related the EEG signals to the rising edges of the speech temporal envelope (onset envelope) were more successful than those which made use of the temporal envelope itself. The CCA algorithm achieved the highest mean attention decoding accuracy, although differences between the performances of the three algorithms were both small and not statistically significant when EEG segments of short durations were employed.

eess.AS

Decoding Envelope and Frequency-Following EEG Responses to Continuous Speech Using Deep Neural Networks

The electroencephalogram (EEG) offers a non-invasive means by which a listener's auditory system may be monitored during continuous speech perception. Reliable auditory-EEG decoders could facilitate the objective diagnosis of hearing disorders, or find applications in cognitively-steered hearing aids. Previously, we developed decoders for the ICASSP Auditory EEG Signal Processing Grand Challenge (SPGC). These decoders aimed to solve the match-mismatch task: given a short temporal segment of EEG recordings, and two candidate speech segments, the task is to identify which of the two speech segments is temporally aligned, or matched, with the EEG segment. The decoders made use of cortical responses to the speech envelope, as well as speech-related frequency-following responses, to relate the EEG recordings to the speech stimuli. Here we comprehensively document the methods by which the decoders were developed. We extend our previous analysis by exploring the association between speaker characteristics (pitch and sex) and classification accuracy, and provide a full statistical analysis of the final performance of the decoders as evaluated on a heldout portion of the dataset. Finally, the generalisation capabilities of the decoders are characterised, by evaluating them using an entirely different dataset which contains EEG recorded under a variety of speech-listening conditions. The results show that the match-mismatch decoders achieve accurate and robust classification accuracies, and they can even serve as auditory attention decoders without additional training.

eess.AS

Relating EEG recordings to speech using envelope tracking and the speech-FFR

During speech perception, a listener's electroencephalogram (EEG) reflects acoustic-level processing as well as higher-level cognitive factors such as speech comprehension and attention. However, decoding speech from EEG recordings is challenging due to the low signal-to-noise ratios of EEG signals. We report on an approach developed for the ICASSP 2023 'Auditory EEG Decoding' Signal Processing Grand Challenge. A simple ensembling method is shown to considerably improve upon the baseline decoder performance. Even higher classification rates are achieved by jointly decoding the speech-evoked frequency-following response and responses to the temporal envelope of speech, as well as by fine-tuning the decoders to individual subjects. Our results could have applications in the diagnosis of hearing disorders or in cognitively steered hearing aids.

eess.AS

Emotive Response to a Hybrid-Face Robot and Translation to Consumer Social Robots

We introduce the conceptual formulation, design, fabrication, control and commercial translation with IoT connection of a hybrid-face social robot and validation of human emotional response to its affective interactions. The hybrid-face robot integrates a 3D printed faceplate and a digital display to simplify conveyance of complex facial movements while providing the impression of three-dimensional depth for natural interaction. We map the space of potential emotions of the robot to specific facial feature parameters and characterise the recognisability of the humanoid hybrid-face robot's archetypal facial expressions. We introduce pupil dilation as an additional degree of freedom for conveyance of emotive states. Human interaction experiments demonstrate the ability to effectively convey emotion from the hybrid-robot face to human observers by mapping their neurophysiological electroencephalography (EEG) response to perceived emotional information and through interviews. Results show main hybrid-face robotic expressions can be discriminated with recognition rates above 80% and invoke human emotive response similar to that of actual human faces as measured by the face-specific N170 event-related potentials in EEG. The hybrid-face robot concept has been modified, implemented, and released in the commercial IoT robotic platform Miko (My Companion), an affective robot with facial and conversational features currently in use for human-robot interaction in children by Emotix Inc. We demonstrate that human EEG responses to Miko emotions are comparative to neurophysiological responses for actual human facial recognition. Finally, interviews show above 90% expression recognition rates in our commercial robot. We conclude that simplified hybrid-face abstraction conveys emotions effectively and enhances human-robot interaction.

cs.RO

Mobility-Dependent Selection of Competing Strategy Associations

Standard models of population dynamics focus on the the interaction, survival, and extinction of the competing species individually. Real ecological systems, however, are characterized by an abundance of species (or strategies, in the terminology of evolutionary-game theory) that form intricate, complex interaction networks. The description of the ensuing dynamics may be aided by studying associations of certain strategies rather than individual ones. Here we show how such a higher-level description can bear fruitful insight. Motivated from different strains of colicinogenic Escherichia coli bacteria, we investigate a four-strategy system which contains a three-strategy cycle and a neutral alliance of two strategies. We find that the stochastic, spatial model exhibits a mobility-dependent selection of either the three-strategy cycle or of the neutral pair. We analyze this intriguing phenomenon numerically and analytically.

q-bio.PE

Waves on Reissner's membrane: a mechanism for the propagation of otoacoustic emissions from the cochlea

Sound is detected and converted into electrical signals within the ear. The cochlea not only acts as a passive detector of sound, however, but can also produce tones itself. These otoacoustic emissions are a striking manifestation of the cochlea's mechanical active process. A controversy remains of how these mechanical signals propagate back to the middle ear, from which they are emitted as sound. Here we combine theoretical and experimental studies to show that mechanical signals can be transmitted by waves on Reissner's membrane, an elastic structure within the cochea. We develop a theory for wave propagation on Reissner's membrane and its role in otoacoustic emissions. Employing a scanning laser interferometer, we measure traveling waves on Reissner's membrane in the gerbil, guinea pig, and chinchilla. The results accord with the theory and thus support a role for Reissner's membrane in otoacoustic emissions.

q-bio.TO

Frequency decoding of periodically timed action potentials through distinct activity patterns in a random neural network

Frequency discrimination is a fundamental task of the auditory system. The mammalian inner ear, or cochlea, provides a place code in which different frequencies are detected at different spatial locations. However, a temporal code based on spike timing is also available: action potentials evoked in an auditory-nerve fiber by a low-frequency tone occur at a preferred phase of the stimulus-they exhibit phase locking-and thus provide temporal information about the tone's frequency. In an accompanying psychoacoustic study, and in agreement with previous experiments, we show that humans employ this temporal information for discrimination of low frequencies. How might such temporal information be read out in the brain? Here we demonstrate that recurrent random neural networks in which connections between neurons introduce characteristic time delays, and in which neurons require temporally coinciding inputs for spike initiation, can perform sharp frequency discrimination when stimulated with phase-locked inputs. Although the frequency resolution achieved by such networks is limited by the noise in phase locking, the resolution for realistic values reaches the tiny frequency difference of 0.2% that has been measured in humans.

q-bio.NC

Discrimination of low-frequency tones employs temporal fine structure

An auditory neuron can preserve the temporal fine structure of a low-frequency tone by phase-locking its response to the stimulus. Apart from sound localization, however, little is known about the role of this temporal information for signal processing in the brain. Through psychoacoustic studies we provide direct evidence that humans employ temporal fine structure to discriminate between frequencies. To this end we construct tones that are based on a single frequency but in which, through the concatenation of wavelets, the phase changes randomly every few cycles. We then test the frequency discrimination of these phase-changing tones, of control tones without phase changes, and of short tones that consist of a single wavelets. For carrier frequencies below a few kilohertz we find that phase changes systematically worsen frequency discrimination. No such effect appears for higher carrier frequencies at which temporal information is not available in the central auditory system.

q-bio.NC

Unidirectional mechanical amplification as a design principle for an active microphone

Amplification underlies the operation of many biological and engineering systems. Simple electrical, optical, and mechanical amplifiers are reciprocal: the backward coupling of the output to the input equals the forward coupling of the input to the output. Unidirectional amplifiers that occur often in electrical and optical systems are special non-reciprocal devices in which the output does not couple back to the input even though the forward coupling persists. Here we propose a scheme for unidirectional mechanical amplification that we utilize to construct an active microphone. We show that amplification improves the microphone's threshold for detecting weak signals and that unidirectionality prevents distortion.

physics.ins-det

Driven Transport on Parallel Lanes with Particle Exclusion and Obstruction

We investigate a driven two-channel system where particles on different lanes mutually obstruct each others motion extending an earlier model by Popkov and Peschel [1]. This obstruction may occur in biological contexts due to steric hinderance where motor proteins carry cargos by `walking' on microtubules. Similarly, the model serves as a description for classical spin transport where charged particles with internal states move unidirectionally on a lattice. Three regimes of qualitatively different behavior are identified depending on the strength of coupling between the lanes. For small and large coupling strengths the model can be mapped to a one-channel problem, whereas a new and rich phase behavior emerges for intermediate ones. We derive an approximate but quantitatively accurate theoretical description in terms of a one-site cluster approximation, and obtain insight into the phase behavior through the current-density relations combined with an extremal-current principle. Our results are confirmed by stochastic simulations. [1] V. Popkov and I. Peschel, Phys. Rev. E 64, 026126 (2001).

physics.bio-ph

Dual contribution to amplification in the mammalian inner ear

The inner ear achieves a wide dynamic range of responsiveness by mechanically amplifying weak sounds. The enormous mechanical gain reported for the mammalian cochlea, which exceeds a factor of 4,000, poses a challenge for theory. Here we show how such a large gain can result from an interaction between amplification by low-gain hair bundles and a pressure wave: hair bundles can amplify both their displacement per locally applied pressure and the pressure wave itself. A recently proposed ratchet mechanism, in which hair-bundle forces do not feed back on the pressure wave, delineates the two effects. Our analytical calculations with a WKB approximation agree with numerical solutions.

q-bio.TO

Coexistence in a One-Dimensional Cyclic Dominance Process

Cyclic (rock-paper-scissors-type) population models serve to mimic complex species interactions. Focusing on a paradigmatic three-species model with mutations in one dimension, we observe an interplay between equilibrium and non-equilibrium processes in the stationary state. We exploit these insights to obtain asymptotically exact descriptions of the emerging reactive steady state in the regimes of high and low mutation rates. The results are compared to stochastic lattice simulations. Our methods and findings are potentially relevant for the spatio-temporal evolution of other non-equilibrium stochastic processes.

cond-mat.stat-mech

Entropy production of cyclic population dynamics

Entropy serves as a central observable in equilibrium thermodynamics. However, many biological and ecological systems operate far from thermal equilibrium. Here we show that entropy production can characterize the behavior of such nonequilibrium systems. To this end we calculate the entropy production for a population model that displays nonequilibrium behavior resulting from cyclic competition. At a critical point the dynamics exhibits a transition from large, limit-cycle like oscillations to small, erratic oscillations. We show that the entropy production peaks very close to the critical point and tends to zero upon deviating from it. We further provide analytical methods for computing the entropy production which agree excellently with numerical simulations.

cond-mat.stat-mech

A ratchet mechanism for amplification in low-frequency mammalian hearing

The sensitivity and frequency selectivity of hearing result from tuned amplification by an active process in the mechanoreceptive hair cells. In most vertebrates the active process stems from the active motility of hair bundles. The mammalian cochlea exhibits an additional form of mechanical activity termed electromotility: its outer hair cells (OHCs) change length upon electrical stimulation. The relative contributions of these two mechanisms to the active process in the mammalian inner ear is the subject of intense current debate. Here we show that active hair-bundle motility and electromotility can together implement an efficient mechanism for amplification that functions like a ratchet: sound-evoked forces acting on the basilar membrane are transmitted to the hair bundles whereas electromotility decouples active hair-bundle forces from the basilar membrane. This unidirectional coupling can extend the hearing range well below the resonant frequency of the basilar membrane. It thereby provides a concept for low-frequency hearing that accounts for a variety of unexplained experimental observations from the cochlear apex, including the shape and phase behavior of apical tuning curves, their lack of significant nonlinearities, and the shape changes of threshold tuning curves of auditory nerve fibers along the cochlea. The ratchet mechanism constitutes a general design principle for implementing mechanical amplification in engineering applications.

q-bio.NC

The edge of neutral evolution in social dilemmas

The functioning of animal as well as human societies fundamentally relies on cooperation. Yet, defection is often favorable for the selfish individual, and social dilemmas arise. Selection by individuals' fitness, usually the basic driving force of evolution, quickly eliminates cooperators. However, evolution is also governed by fluctuations that can be of greater importance than fitness differences, and can render evolution effectively neutral. Here, we investigate the effects of selection versus fluctuations in social dilemmas. By studying the mean extinction times of cooperators and defectors, a variable sensitive to fluctuations, we are able to identify and quantify an emerging 'edge of neutral evolution' that delineates regimes of neutral and Darwinian evolution. Our results reveal that cooperation is significantly maintained in the neutral regimes. In contrast, the classical predictions of evolutionary game theory, where defectors beat cooperators, are recovered in the Darwinian regimes. Our studies demonstrate that fluctuations can provide a surprisingly simple way to partly resolve social dilemmas. Our methods are generally applicable to estimate the role of random drift in evolutionary dynamics.

q-bio.PE

Zero-one survival behavior of cyclically competing species

Coexistence of competing species is, due to unavoidable fluctuations, always transient. In this Letter, we investigate the ultimate survival probabilities characterizing different species in cyclic competition. We show that they often obey a surprisingly simple, though non-trivial behavior. Within a model where coexistence is neutrally stable, we demonstrate a robust zero-one law: When the interactions between the three species are (generically) asymmetric, the `weakest' species survives at a probability that tends to one for large population sizes, while the other two are guaranteed to extinct. We rationalize our findings from stochastic simulations by an analytic approach.

q-bio.PE