SearcharxivSearch

arXiv subjects

Eli Kinney-Lang

Publications and source records attributed to Eli Kinney-Lang.

7 recordsLinked to original sources

Leveraging Foundation Models for Calibration-Free c-VEP BCIs

Foundation Models (FMs) have surged in popularity over the past five years, with applications spanning fields from computer vision to natural language processing. Brain-Computer Interfaces (BCIs) have also gained momentum due to their potential to support individuals with complex disabilities. Among BCI paradigms, code-modulated Visual Evoked Potentials (c-VEPs) remain relatively understudied, despite offering high information transfer rates and large selection target capacities. However, c-VEP systems require lengthy calibration sessions, limiting their practicality outside of laboratory settings. In this study, we use a FM for the first time to eliminate the need for lengthy calibration in c-VEP BCI systems. We evaluated two approaches: (1) a truly calibration-free approach requiring no subject-specific data, and (2) a limited calibration approach, where we assessed the benefit of incorporating incremental amounts of calibration data. In both cases, a classification head is trained on data from other subjects. For a new subject, no calibration data is required in the calibration-free setup, making the c-VEP system effectively plug-and-play. The proposed method was tested on two c-VEP datasets. For the calibration-free approach, the average accuracy on the first dataset (n = 17) was 68.8% +/- 17.6%, comparable to the full-calibration performance reported in the original study (66.2% +/- 13.8%), which required approximately 11 minutes of calibration. On the second dataset (n = 12), the calibration-free accuracy was 71.8% +/- 20.2%, versus 93.7% +/- 5.5% from the original study, which required around 3.5 minutes. A limited-calibration approach using only 20% of the subject's data (approximately 43 seconds) yielded 92% +/- 5.2% accuracy. These results indicate that our FM-based approach can effectively eliminate or significantly reduce the need for lengthy calibration in c-VEP BCIs.

cs.HC

Narrative-Guided Reinforcement Learning: A Platform for Studying Language Model Influence on Decision Making

We present a preliminary experimental platform that explores how narrative elements might shape AI decision-making by combining reinforcement learning (RL) with language model reasoning. While AI systems can now both make decisions and engage in narrative reasoning, these capabilities have mostly been studied separately. Our platform attempts to bridge this gap using a dual-system architecture to examine how narrative frameworks could influence reward-based learning. The system comprises a reinforcement learning policy that suggests actions based on past experience, and a language model that processes these suggestions through different narrative frameworks to guide decisions. This setup enables initial experimentation with narrative elements while maintaining consistent environment and reward structures. We implement this architecture in a configurable gridworld environment, where agents receive both policy suggestions and information about their surroundings. The platform's modular design facilitates controlled testing of environmental complexity, narrative parameters, and the interaction between reinforcement learning and narrative-based decisions. Our logging system captures basic decision metrics, from RL policy values to language model reasoning to action selection patterns. While preliminary, this implementation provides a foundation for studying how different narrative frameworks might affect reward-based decisions and exploring potential interactions between optimization-based learning and symbolic reasoning in AI systems.

cs.AI

Higher order tensor decomposition for proportional myoelectric control based on muscle synergies

Muscle synergies have recently been utilised in myoelectric control systems. Thus far, all proposed synergy-based systems rely on matrix factorisation methods. However, this is limited in terms of task-dimensionality. Here, the potential application of higher-order tensor decomposition as a framework for proportional myoelectric control is demonstrated. A novel constrained Tucker decomposition (consTD) technique of synergy extraction is proposed for synergy-based myoelectric control model and compared with state-of-the-art matrix factorisation models. The extracted synergies were used to estimate control signals for the wrist's Degree of Freedom (DoF) through direct projection. The consTD model was able to estimate the control signals for each DoF by utilising all data in one 3rd-order tensor. This is contrast with matrix factorisation models where data are segmented for each DoF and then the synergies often have to be realigned. Moreover, the consTD method offers more information by providing additional shared synergies, unlike matrix factorisation methods. The extracted control signals were fed to a ridge regression to estimate the wrist's kinematics based on real glove data. The Coefficient of Determination (R2) for the reconstructed wrist position showed that the proposed consTD was higher than matrix factorisation methods. In sum, this study provides the first proof of concept for the use of higher-order tensor decomposition in proportional myoelectric control and it highlights the potential of tensors to provide an objective and direct approach to identify synergies.

eess.SP

On the use of higher-order tensors to model muscle synergies

The muscle synergy concept provides the best framework to understand motor control and it has been recently utilised in many applications such as prosthesis control. The current muscle synergy model relies on decomposing multi-channel surface Electromyography (EMG) signals into a synergy matrix (spatial mode) and its weighting function (temporal mode). This is done using several matrix factorisation techniques, with Non-negative matrix factorisation (NMF) being the most prominent method. Here, we introduce a 4th-order tensor muscle synergy model that extends the current state of the art by taking spectral information and repetitions (movements) into account. This adds more depth to the model and provides more synergistic information. In particular, we illustrate a proof-of-concept study where the Tucker3 tensor decomposition model was applied to a subset of wrist movements from the Ninapro database. The results showed the potential of Tucker3 tensor factorisation in finding patterns of muscle synergies with information about the movements and highlights the differences between the current and proposed model.

eess.SP

Consistency of Muscle Synergies Extracted via Higher-Order Tensor Decomposition Towards Myoelectric Control

In recent years, muscle synergies have been pro-posed for proportional myoelectric control. Synergies were extracted using matrix factorisation techniques (mainly non-negative matrix factorisation, NMF), which requires identification of synergies to tasks or movements. In addition, NMF methods were viable only with a task dimension of 2 degrees of freedoms(DoFs). Here, the potential use of a higher-order tensor model for myoelectric control is explored. We assess the ability of a constrained Tucker tensor decomposition to estimate consistent synergies when the task dimensionality is increased up to 3-DoFs. Synergies extracted from 3rd-order tensor of 1 and 3 DoFs were compared. Results showed that muscle synergies extracted via constrained Tucker decomposition were consistent with the increase of task-dimension. Hence, these results support the consideration of proportional 3-DoF myoelectric control based on tensor decompositions.

eess.SP

Evaluation of matrix factorisation approaches for muscle synergy extraction

The muscle synergy concept provides a widely-accepted paradigm to break down the complexity of motor control. In order to identify the synergies, different matrix factorisation techniques have been used in a repertoire of fields such as prosthesis control and biomechanical and clinical studies. However, the relevance of these matrix factorisation techniques is still open for discussion since there is no ground truth for the underlying synergies. Here, we evaluate factorisation techniques and investigate the factors that affect the quality of estimated synergies. We compared commonly used matrix factorisation methods: Principal component analysis (PCA), Independent component analysis (ICA), Non-negative matrix factorization (NMF) and second-order blind identification (SOBI). Publicly available real data were used to assess the synergies extracted by each factorisation method in the classification of wrist movements. Synthetic datasets were utilised to explore the effect of muscle synergy sparsity, level of noise and number of channels on the extracted synergies. Results suggest that the sparse synergy model and a higher number of channels would result in better-estimated synergies. Without dimensionality reduction, SOBI showed better results than other factorisation methods. This suggests that SOBI would be an alternative when a limited number of electrodes is available but its performance was still poor in that case. Otherwise, NMF had the best performance when the number of channels was higher than the number of synergies. Therefore, NMF would be the best method for muscle synergy extraction.

eess.SP

Tensor-driven extraction of developmental features from varying paediatric EEG datasets

Objective. Consistently changing physiological properties in developing children's brains challenges new data heavy technologies, like brain-computer interfaces (BCI). Advancing signal processing methods in such technologies to be more sensitive to developmental changes could help improve their function and usability in paediatric populations. Taking advantage of the multi-dimensional structure of EEG data through tensor analysis offers a framework to extract relevant developmental features present in paediatric resting-state EEG datasets. Methods. Three paediatric datasets from varying developmental states and populations were analyzed using a developed two-step constrained Parallel Factor (PARAFAC) tensor decomposition. The datasets included the Muir Maxwell Epilepsy Centre, Children's Hospital Boston-MIT and the Child Mind Institute, outlining two impaired and one healthy population, respectively. Within dataset cross-validation used support vector machines (SVM) for classification of out-of-fold data predicting subject age as a proxy measure of development. t-distributed Stochastic Neighbour Embedding (t-SNE) maps complemented classification analysis through visualization of the high-dimensional feature structures. Main Results. Development-sensitive features were successfully identified for the developmental conditions of each dataset. SVM classification accuracy and misclassification costs were improved significantly for both healthy and impaired paediatric populations. t-SNE maps revealed suitable tensor factorization was key in extracting developmental features. Significance. The described methods are a promising tool for incorporating the unique developmental features present throughout childhood EEG into new technologies like BCI and its applications.

q-bio.NC