arXiv subjects

Patrik Vuilleumier

Publications and source records attributed to Patrik Vuilleumier.

4 recordsLinked to original sources

arXiv2025

Deep Neural Encoder-Decoder Model to Relate fMRI Brain Activity with Naturalistic Stimuli

We propose an end-to-end deep neural encoder-decoder model to encode and decode brain activity in response to naturalistic stimuli using functional magnetic resonance imaging (fMRI) data. Leveraging temporally correlated input from consecutive film frames, we employ temporal convolutional layers in our architecture, which effectively allows to bridge the temporal resolution gap between natural movie stimuli and fMRI acquisitions. Our model predicts activity of voxels in and around the visual cortex and performs reconstruction of corresponding visual inputs from neural activity. Finally, we investigate brain regions contributing to visual decoding through saliency maps. We find that the most contributing regions are the middle occipital area, the fusiform area, and the calcarine, respectively employed in shape perception, complex recognition (in particular face perception), and basic visual features such as edges and contrasts. These functions being strongly solicited are in line with the decoder's capability to reconstruct edges, faces, and contrasts. All in all, this suggests the possibility to probe our understanding of visual processing in films using as a proxy the behaviour of deep learning models such as the one proposed in this paper.

cs.CV↗

arXiv2023

EmoStim: A Database of Emotional Film Clips with Discrete and Componential Assessment

Emotion elicitation using emotional film clips is one of the most common and ecologically valid methods in Affective Computing. However, selecting and validating appropriate materials that evoke a range of emotions is challenging. Here we present EmoStim: A Database of Emotional Film Clips as a film library with a rich and varied content. EmoStim is designed for researchers interested in studying emotions in relation to either discrete or componential models of emotion. To create the database, 139 film clips were selected from literature and then annotated by 638 participants through the CrowdFlower platform. We selected 99 film clips based on the distribution of subjective ratings that effectively distinguished between emotions defined by the discrete model. We show that the selected film clips reliably induce a range of specific emotions according to the discrete model. Further, we describe relationships between emotions, emotion organization in the componential space, and underlying dimensions representing emotional experience. The EmoStim database and participant annotations are freely available for research purposes. The database can be used to enrich our understanding of emotions further and serve as a guide to select or create additional materials.

cs.HC↗

arXiv2020

A Multi-Componential Approach to Emotion Recognition and the Effect of Personality

Emotions are an inseparable part of human nature affecting our behavior in response to the outside world. Although most empirical studies have been dominated by two theoretical models including discrete categories of emotion and dichotomous dimensions, results from neuroscience approaches suggest a multi-processes mechanism underpinning emotional experience with a large overlap across different emotions. While these findings are consistent with the influential theories of emotion in psychology that emphasize a role for multiple component processes to generate emotion episodes, few studies have systematically investigated the relationship between discrete emotions and a full componential view. This paper applies a componential framework with a data-driven approach to characterize emotional experiences evoked during movie watching. The results suggest that differences between various emotions can be captured by a few (at least 6) latent dimensions, each defined by features associated with component processes, including appraisal, expression, physiology, motivation, and feeling. In addition, the link between discrete emotions and component model is explored and results show that a componential model with a limited number of descriptors is still able to predict the level of experienced discrete emotion(s) to a satisfactory level. Finally, as appraisals may vary according to individual dispositions and biases, we also study the relationship between personality traits and emotions in our computational framework and show that the role of personality on discrete emotion differences can be better justified using the component model.

q-bio.NC↗

arXiv2018

Neurofeedback Tunes Scale-Free Dynamics in Spontaneous Brain Activity

Brain oscillations exhibit long-range temporal correlations (LRTCs), which reflect the regularity of their fluctuations: low values representing more random (decorrelated) while high values more persistent (correlated) dynamics. LRTCs constitute supporting evidence that the brain operates near criticality, a state where neuronal activities are balanced between order and randomness. Here, healthy adults used closed-loop brain training (neurofeedback, NFB) to reduce the amplitude of alpha oscillations, producing a significant increase in spontaneous LRTCs post-training. This effect was reproduced in patients with post-traumatic stress disorder, where abnormally random dynamics were reversed by NFB, correlating with significant improvements in hyperarousal. Notably, regions manifesting abnormally low LRTCs (i.e., excessive randomness) normalized toward healthy population levels, consistent with theoretical predictions about self-organized criticality. Hence, when exposed to appropriate training, spontaneous cortical activity reveals a residual capacity for "self-tuning" its own temporal complexity, despite manifesting the abnormal dynamics seen in individuals with psychiatric disorder. Lastly, we observed an inverse-U relationship between strength of LRTC and oscillation amplitude, suggesting a breakdown of long-range dependence at high/low synchronization extremes, in line with recent computational models. Together, our findings offer a broader mechanistic framework for motivating research and clinical applications of NFB, encompassing disorders with perturbed LRTCs.

q-bio.NC↗