Objective. Electroencephalography (EEG) analysis has been an important tool in neuroscience with applications in neuroscience, neural engineering (e.g. Brain–computer interfaces, BCI's), and even commercial applications. Many of the analytical tools used in EEG studies have used machine learning to uncover relevant information for neural classification and neuroimaging. Recently, the availability of large EEG data sets and advances in machine learning have both led to the deployment of deep learning architectures, especially in the analysis of EEG signals and in understanding the information it may contain for brain functionality. The robust automatic classification of these signals is an important step towards making the use of EEG more practical in many applications and less reliant on trained professionals. Towards this goal, a systematic review of the literature on deep learning applications to EEG classification was performed to address the following critical questions: (1) Which EEG classification tasks have been explored with deep learning? (2) What input formulations have been used for training the deep networks? (3) Are there specific deep learning network structures suitable for specific types of tasks? Approach. A systematic literature review of EEG classification using deep learning was performed on Web of Science and PubMed databases, resulting in 90 identified studies. Those studies were analyzed based on type of task, EEG preprocessing methods, input type, and deep learning architecture. Main results. For EEG classification tasks, convolutional neural networks, recurrent neural networks, deep belief networks outperform stacked auto-encoders and multi-layer perceptron neural networks in classification accuracy. The tasks that used deep learning fell into five general groups: emotion recognition, motor imagery, mental workload, seizure detection, event related potential detection, and sleep scoring. For each type of task, we describe the specific input formulation, major characteristics, and end classifier recommendations found through this review. Significance. This review summarizes the current practices and performance outcomes in the use of deep learning for EEG classification. Practical suggestions on the selection of many hyperparameters are provided in the hope that they will promote or guide the deployment of deep learning to EEG datasets in future research.
Purpose-led Publishing is a coalition of three not-for-profit publishers in the field of physical sciences: AIP Publishing, the American Physical Society and IOP Publishing.
Together, as publishers that will always put purpose above profit, we have defined a set of industry standards that underpin high-quality, ethical scholarly communications.
We are proudly declaring that science is our only shareholder.
ISSN: 1741-2552
Journal of Neural Engineering was created to help scientists, clinicians and engineers to understand, replace, repair and enhance the nervous system.
Open all abstracts, in this tab
Alexander Craik et al 2019 J. Neural Eng. 16 031001
Yannick Roy et al 2019 J. Neural Eng. 16 051001
Context. Electroencephalography (EEG) is a complex signal and can require several years of training, as well as advanced signal processing and feature extraction methodologies to be correctly interpreted. Recently, deep learning (DL) has shown great promise in helping make sense of EEG signals due to its capacity to learn good feature representations from raw data. Whether DL truly presents advantages as compared to more traditional EEG processing approaches, however, remains an open question. Objective. In this work, we review 154 papers that apply DL to EEG, published between January 2010 and July 2018, and spanning different application domains such as epilepsy, sleep, brain–computer interfacing, and cognitive and affective monitoring. We extract trends and highlight interesting approaches from this large body of literature in order to inform future research and formulate recommendations. Methods. Major databases spanning the fields of science and engineering were queried to identify relevant studies published in scientific journals, conferences, and electronic preprint repositories. Various data items were extracted for each study pertaining to (1) the data, (2) the preprocessing methodology, (3) the DL design choices, (4) the results, and (5) the reproducibility of the experiments. These items were then analyzed one by one to uncover trends. Results. Our analysis reveals that the amount of EEG data used across studies varies from less than ten minutes to thousands of hours, while the number of samples seen during training by a network varies from a few dozens to several millions, depending on how epochs are extracted. Interestingly, we saw that more than half the studies used publicly available data and that there has also been a clear shift from intra-subject to inter-subject approaches over the last few years. About of the studies used convolutional neural networks (CNNs), while used recurrent neural networks (RNNs), most often with a total of 3–10 layers. Moreover, almost one-half of the studies trained their models on raw or preprocessed EEG time series. Finally, the median gain in accuracy of DL approaches over traditional baselines was across all relevant studies. More importantly, however, we noticed studies often suffer from poor reproducibility: a majority of papers would be hard or impossible to reproduce given the unavailability of their data and code. Significance. To help the community progress and share work more effectively, we provide a list of recommendations for future studies and emphasize the need for more reproducible research. We also make our summary table of DL and EEG papers available and invite authors of published work to contribute to it directly. A planned follow-up to this work will be an online public benchmarking portal listing reproducible results.
F Lotte et al 2018 J. Neural Eng. 15 031005
Objective. Most current electroencephalography (EEG)-based brain–computer interfaces (BCIs) are based on machine learning algorithms. There is a large diversity of classifier types that are used in this field, as described in our 2007 review paper. Now, approximately ten years after this review publication, many new algorithms have been developed and tested to classify EEG signals in BCIs. The time is therefore ripe for an updated review of EEG classification algorithms for BCIs. Approach. We surveyed the BCI and machine learning literature from 2007 to 2017 to identify the new classification approaches that have been investigated to design BCIs. We synthesize these studies in order to present such algorithms, to report how they were used for BCIs, what were the outcomes, and to identify their pros and cons. Main results. We found that the recently designed classification algorithms for EEG-based BCIs can be divided into four main categories: adaptive classifiers, matrix and tensor classifiers, transfer learning and deep learning, plus a few other miscellaneous classifiers. Among these, adaptive classifiers were demonstrated to be generally superior to static ones, even with unsupervised adaptation. Transfer learning can also prove useful although the benefits of transfer learning remain unpredictable. Riemannian geometry-based methods have reached state-of-the-art performances on multiple BCI problems and deserve to be explored more thoroughly, along with tensor-based methods. Shrinkage linear discriminant analysis and random forests also appear particularly useful for small training samples settings. On the other hand, deep learning methods have not yet shown convincing improvement over state-of-the-art BCI methods. Significance. This paper provides a comprehensive overview of the modern classification algorithms used in EEG-based BCIs, presents the principles of these methods and guidelines on when and how to use them. It also identifies a number of challenges to further advance EEG classification in BCI.
Ravikiran Mane et al 2020 J. Neural Eng. 17 041001
Stroke is one of the leading causes of long-term disability among adults and contributes to major socio-economic burden globally. Stroke frequently results in multifaceted impairments including motor, cognitive and emotion deficits. In recent years, brain–computer interface (BCI)-based therapy has shown promising results for post-stroke motor rehabilitation. In spite of the success received by BCI-based interventions in the motor domain, non-motor impairments are yet to receive similar attention in research and clinical settings. Some preliminary encouraging results in post-stroke cognitive rehabilitation using BCI seem to suggest that it may also hold potential for treating non-motor deficits such as cognitive and emotion impairments. Moreover, past studies have shown an intricate relationship between motor, cognitive and emotion functions which might influence the overall post-stroke rehabilitation outcome. A number of studies highlight the inability of current treatment protocols to account for the implicit interplay between motor, cognitive and emotion functions. This indicates the necessity to explore an all-inclusive treatment plan targeting the synergistic influence of these standalone interventions. This approach may lead to better overall recovery than treating the individual deficits in isolation. In this paper, we review the recent advances in BCI-based post-stroke motor rehabilitation and highlight the potential for the use of BCI systems beyond the motor domain, in particular, in improving cognition and emotion of stroke patients. Building on the current results and findings of studies in individual domains, we next discuss the possibility of a holistic BCI system for motor, cognitive and affect rehabilitation which may synergistically promote restorative neuroplasticity. Such a system would provide an all-encompassing rehabilitation platform, leading to overarching clinical outcomes and transfer of these outcomes to a better quality of living. This is one of the first works to analyse the possibility of targeting cross-domain influence of post-stroke functional recovery enabled by BCI-based rehabilitation.
Vernon J Lawhern et al 2018 J. Neural Eng. 15 056013
Objective. Brain–computer interfaces (BCI) enable direct communication with a computer, using neural activity as the control signal. This neural signal is generally chosen from a variety of well-studied electroencephalogram (EEG) signals. For a given BCI paradigm, feature extractors and classifiers are tailored to the distinct characteristics of its expected EEG control signal, limiting its application to that specific signal. Convolutional neural networks (CNNs), which have been used in computer vision and speech recognition to perform automatic feature extraction and classification, have successfully been applied to EEG-based BCIs; however, they have mainly been applied to single BCI paradigms and thus it remains unclear how these architectures generalize to other paradigms. Here, we ask if we can design a single CNN architecture to accurately classify EEG signals from different BCI paradigms, while simultaneously being as compact as possible. Approach. In this work we introduce EEGNet, a compact convolutional neural network for EEG-based BCIs. We introduce the use of depthwise and separable convolutions to construct an EEG-specific model which encapsulates well-known EEG feature extraction concepts for BCI. We compare EEGNet, both for within-subject and cross-subject classification, to current state-of-the-art approaches across four BCI paradigms: P300 visual-evoked potentials, error-related negativity responses (ERN), movement-related cortical potentials (MRCP), and sensory motor rhythms (SMR). Main results. We show that EEGNet generalizes across paradigms better than, and achieves comparably high performance to, the reference algorithms when only limited training data is available across all tested paradigms. In addition, we demonstrate three different approaches to visualize the contents of a trained EEGNet model to enable interpretation of the learned features. Significance. Our results suggest that EEGNet is robust enough to learn a wide variety of interpretable features over a range of BCI tasks. Our models can be found at: https://github.com/vlawhern/arl-eegmodels.
Steve Furber 2016 J. Neural Eng. 13 051001
Neuromorphic computing covers a diverse range of approaches to information processing all of which demonstrate some degree of neurobiological inspiration that differentiates them from mainstream conventional computing systems. The philosophy behind neuromorphic computing has its origins in the seminal work carried out by Carver Mead at Caltech in the late 1980s. This early work influenced others to carry developments forward, and advances in VLSI technology supported steady growth in the scale and capability of neuromorphic devices. Recently, a number of large-scale neuromorphic projects have emerged, taking the approach to unprecedented scales and capabilities. These large-scale projects are associated with major new funding initiatives for brain-related research, creating a sense that the time and circumstances are right for progress in our understanding of information processing in the brain. In this review we present a brief history of neuromorphic engineering then focus on some of the principal current large-scale projects, their main features, how their approaches are complementary and distinct, their advantages and drawbacks, and highlight the sorts of capabilities that each can deliver to neural modellers.
Haoming Zhang et al 2021 J. Neural Eng. 18 056057
Objective. Deep learning (DL) networks are increasingly attracting attention across various fields, including electroencephalography (EEG) signal processing. These models provide comparable performance to that of traditional techniques. At present, however, there is a lack of well-structured and standardized datasets with specific benchmark limit the development of DL solutions for EEG denoising. Approach. Here, we present EEGdenoiseNet, a benchmark EEG dataset that is suited for training and testing DL-based denoising models, as well as for performance comparisons across models. EEGdenoiseNet contains 4514 clean EEG segments, 3400 ocular artifact segments and 5598 muscular artifact segments, allowing users to synthesize contaminated EEG segments with the ground-truth clean EEG. Main results. We used EEGdenoiseNet to evaluate denoising performance of four classical networks (a fully-connected network, a simple and a complex convolution network, and a recurrent neural network). Our results suggested that DL methods have great potential for EEG denoising even under high noise contamination. Significance. Through EEGdenoiseNet, we hope to accelerate the development of the emerging field of DL-based EEG denoising. The dataset and code are available at https://github.com/ncclabsustech/EEGdenoiseNet.
M Asjid Tanveer et al 2024 J. Neural Eng. 21 036022
Objective. This study develops a deep learning (DL) method for fast auditory attention decoding (AAD) using electroencephalography (EEG) from listeners with hearing impairment (HI). It addresses three classification tasks: differentiating noise from speech-in-noise, classifying the direction of attended speech (left vs. right) and identifying the activation status of hearing aid noise reduction algorithms (OFF vs. ON). These tasks contribute to our understanding of how hearing technology influences auditory processing in the hearing-impaired population. Approach. Deep convolutional neural network (DCNN) models were designed for each task. Two training strategies were employed to clarify the impact of data splitting on AAD tasks: inter-trial, where the testing set used classification windows from trials that the training set had not seen, and intra-trial, where the testing set used unseen classification windows from trials where other segments were seen during training. The models were evaluated on EEG data from 31 participants with HI, listening to competing talkers amidst background noise. Main results. Using 1 s classification windows, DCNN models achieve accuracy (ACC) of 69.8%, 73.3% and 82.9% and area-under-curve (AUC) of 77.2%, 80.6% and 92.1% for the three tasks respectively on inter-trial strategy. In the intra-trial strategy, they achieved ACC of 87.9%, 80.1% and 97.5%, along with AUC of 94.6%, 89.1%, and 99.8%. Our DCNN models show good performance on short 1 s EEG samples, making them suitable for real-world applications. Conclusion: Our DCNN models successfully addressed three tasks with short 1 s EEG windows from participants with HI, showcasing their potential. While the inter-trial strategy demonstrated promise for assessing AAD, the intra-trial approach yielded inflated results, underscoring the important role of proper data splitting in EEG-based AAD tasks. Significance. Our findings showcase the promising potential of EEG-based tools for assessing auditory attention in clinical contexts and advancing hearing technology, while also promoting further exploration of alternative DL architectures and their potential constraints.
Siegfried Ludwig et al 2024 J. Neural Eng. 21 036010
Objective. The patterns of brain activity associated with different brain processes can be used to identify different brain states and make behavioural predictions. However, the relevant features are not readily apparent and accessible. Our aim is to design a system for learning informative latent representations from multichannel recordings of ongoing EEG activity. Approach: We propose a novel differentiable decoding pipeline consisting of learnable filters and a pre-determined feature extraction module. Specifically, we introduce filters parameterized by generalized Gaussian functions that offer a smooth derivative for stable end-to-end model training and allow for learning interpretable features. For the feature module, we use signal magnitude and functional connectivity estimates. Main results. We demonstrate the utility of our model on a new EEG dataset of unprecedented size (i.e. 721 subjects), where we identify consistent trends of music perception and related individual differences. Furthermore, we train and apply our model in two additional datasets, specifically for emotion recognition on SEED and workload classification on simultaneous task EEG workload. The discovered features align well with previous neuroscience studies and offer new insights, such as marked differences in the functional connectivity profile between left and right temporal areas during music listening. This agrees with the specialisation of the temporal lobes regarding music perception proposed in the literature. Significance. The proposed method offers strong interpretability of learned features while reaching similar levels of accuracy achieved by black box deep learning models. This improved trustworthiness may promote the use of deep learning models in real world applications. The model code is available at https://github.com/SMLudwig/EEGminer/.
Yuya Ikegawa et al 2024 J. Neural Eng. 21 036019
Objective. Invasive brain–computer interfaces (BCIs) are promising communication devices for severely paralyzed patients. Recent advances in intracranial electroencephalography (iEEG) coupled with natural language processing have enhanced communication speed and accuracy. It should be noted that such a speech BCI uses signals from the motor cortex. However, BCIs based on motor cortical activities may experience signal deterioration in users with motor cortical degenerative diseases such as amyotrophic lateral sclerosis. An alternative approach to using iEEG of the motor cortex is necessary to support patients with such conditions. Approach. In this study, a multimodal embedding of text and images was used to decode visual semantic information from iEEG signals of the visual cortex to generate text and images. We used contrastive language-image pretraining (CLIP) embedding to represent images presented to 17 patients implanted with electrodes in the occipital and temporal cortices. A CLIP image vector was inferred from the high-γ power of the iEEG signals recorded while viewing the images. Main results. Text was generated by CLIPCAP from the inferred CLIP vector with better-than-chance accuracy. Then, an image was created from the generated text using StableDiffusion with significant accuracy. Significance. The text and images generated from iEEG through the CLIP embedding vector can be used for improved communication.
Open all abstracts, in this tab
Wenhao Wu et al 2024 J. Neural Eng. 21 036026
Objective. In the specific use of electromyogram (EMG) driven prosthetics, the user's disability reduces the space available for the electrode array. We propose a framework for EMG decomposition adapted to the condition of a few channels (less than 30 observations), which can elevate the potential of prosthetics in terms of cost and applicability. Approach. The new framework contains a peel-off approach, a refining strategy for motor unit (MU) spike train and MU action potential and a re-subtracting strategy to adapt the framework to few channels environments. Simulated EMG signals were generated to test the framework. In addition, we quantify and analyze the effect of strategies used in the framework. Main results. The results show that the new algorithm has an average improvement of 19.97% in the number of MUs identified compared to the control algorithm. Quantitative analysis of the usage strategies shows that the re-subtracting and refining strategies can effectively improve the performance of the framework under the condition of few channels. Significance. These prove that the new framework can be applied to few channel conditions, providing a optimization space for neural interface design in cost and user adaptation.
Dengpei Ji et al 2024 J. Neural Eng. 21 036024
Objective. Magnetoencephalography (MEG) shares a comparable time resolution with electroencephalography. However, MEG excels in spatial resolution, enabling it to capture even the subtlest and weakest brain signals for brain-computer interfaces (BCIs). Leveraging MEG's capabilities, specifically with optically pumped magnetometers (OPM-MEG), proves to be a promising avenue for advancing MEG-BCIs, owing to its exceptional sensitivity and portability. This study harnesses the power of high-frequency steady-state visual evoked fields (SSVEFs) to build an MEG-BCI system that is flickering-imperceptible, user-friendly, and highly accurate. Approach. We have constructed a nine-command BCI that operates on high-frequency SSVEF (58–62 Hz with a 0.5 Hz interval) stimulation. We achieved this by placing the light source inside and outside the magnetic shielding room, ensuring compliance with non-magnetic and visual stimulus presentation requirements. Five participants took part in offline experiments, during which we collected six-channel multi-dimensional MEG signals along both the vertical (Z-axis) and tangential (Y-axis) components. Our approach leveraged the ensemble task-related component analysis algorithm for SSVEF identification and system performance evaluation. Main Results. The offline average accuracy of our proposed system reached an impressive 92.98% when considering multi-dimensional conjoint analysis using data from both the Z and Y axes. Our method achieved a theoretical average information transfer rate (ITR) of 58.36 bits min−1 with a data length of 0.7 s, and the highest individual ITR reached an impressive 63.75 bits min−1. Significance. This study marks the first exploration of high-frequency SSVEF-BCI based on OPM-MEG. These results underscore the potential and feasibility of MEG in detecting subtle brain signals, offering both theoretical insights and practical value in advancing the development and application of MEG in BCI systems.
Xianzhang Zeng et al 2024 J. Neural Eng. 21 036025
Objective: Decoding auditory attention from brain signals is essential for the development of neuro-steered hearing aids. This study aims to overcome the challenges of extracting discriminative feature representations from electroencephalography (EEG) signals for auditory attention detection (AAD) tasks, particularly focusing on the intrinsic relationships between different EEG channels. Approach: We propose a novel attention-guided graph structure learning network, AGSLnet, which leverages potential relationships between EEG channels to improve AAD performance. Specifically, AGSLnet is designed to dynamically capture latent relationships between channels and construct a graph structure of EEG signals. Main result: We evaluated AGSLnet on two publicly available AAD datasets and demonstrated its superiority and robustness over state-of-the-art models. Visualization of the graph structure trained by AGSLnet supports previous neuroscience findings, enhancing our understanding of the underlying neural mechanisms. Significance: This study presents a novel approach for examining brain functional connections, improving AAD performance in low-latency settings, and supporting the development of neuro-steered hearing aids.
Yipeng Zhang et al 2024 J. Neural Eng. 21 036023
Objective. This study aims to develop and validate an end-to-end software platform, PyHFO, that streamlines the application of deep learning (DL) methodologies in detecting neurophysiological biomarkers for epileptogenic zones from EEG recordings. Approach. We introduced PyHFO, which enables time-efficient high-frequency oscillation (HFO) detection algorithms like short-term energy and Montreal Neurological Institute and Hospital detectors. It incorporates DL models for artifact and HFO with spike classification, designed to operate efficiently on standard computer hardware. Main results. The validation of PyHFO was conducted on three separate datasets: the first comprised solely of grid/strip electrodes, the second a combination of grid/strip and depth electrodes, and the third derived from rodent studies, which sampled the neocortex and hippocampus using depth electrodes. PyHFO demonstrated an ability to handle datasets efficiently, with optimization techniques enabling it to achieve speeds up to 50 times faster than traditional HFO detection applications. Users have the flexibility to employ our pre-trained DL model or use their EEG data for custom model training. Significance. PyHFO successfully bridges the computational challenge faced in applying DL techniques to EEG data analysis in epilepsy studies, presenting a feasible solution for both clinical and research settings. By offering a user-friendly and computationally efficient platform, PyHFO paves the way for broader adoption of advanced EEG data analysis tools in clinical practice and fosters potential for large-scale research collaborations.
M Asjid Tanveer et al 2024 J. Neural Eng. 21 036022
Objective. This study develops a deep learning (DL) method for fast auditory attention decoding (AAD) using electroencephalography (EEG) from listeners with hearing impairment (HI). It addresses three classification tasks: differentiating noise from speech-in-noise, classifying the direction of attended speech (left vs. right) and identifying the activation status of hearing aid noise reduction algorithms (OFF vs. ON). These tasks contribute to our understanding of how hearing technology influences auditory processing in the hearing-impaired population. Approach. Deep convolutional neural network (DCNN) models were designed for each task. Two training strategies were employed to clarify the impact of data splitting on AAD tasks: inter-trial, where the testing set used classification windows from trials that the training set had not seen, and intra-trial, where the testing set used unseen classification windows from trials where other segments were seen during training. The models were evaluated on EEG data from 31 participants with HI, listening to competing talkers amidst background noise. Main results. Using 1 s classification windows, DCNN models achieve accuracy (ACC) of 69.8%, 73.3% and 82.9% and area-under-curve (AUC) of 77.2%, 80.6% and 92.1% for the three tasks respectively on inter-trial strategy. In the intra-trial strategy, they achieved ACC of 87.9%, 80.1% and 97.5%, along with AUC of 94.6%, 89.1%, and 99.8%. Our DCNN models show good performance on short 1 s EEG samples, making them suitable for real-world applications. Conclusion: Our DCNN models successfully addressed three tasks with short 1 s EEG windows from participants with HI, showcasing their potential. While the inter-trial strategy demonstrated promise for assessing AAD, the intra-trial approach yielded inflated results, underscoring the important role of proper data splitting in EEG-based AAD tasks. Significance. Our findings showcase the promising potential of EEG-based tools for assessing auditory attention in clinical contexts and advancing hearing technology, while also promoting further exploration of alternative DL architectures and their potential constraints.
Open all abstracts, in this tab
Rongqi Hong et al 2024 J. Neural Eng. 21 021002
Objective: Epilepsy is a complex disease spanning across multiple scales, from ion channels in neurons to neuronal circuits across the entire brain. Over the past decades, computational models have been used to describe the pathophysiological activity of the epileptic brain from different aspects. Traditionally, each computational model can aid in optimizing therapeutic interventions, therefore, providing a particular view to design strategies for treating epilepsy. As a result, most studies are concerned with generating specific models of the epileptic brain that can help us understand the certain machinery of the pathological state. Those specific models vary in complexity and biological accuracy, with system-level models often lacking biological details. Approach: Here, we review various types of computational model of epilepsy and discuss their potential for different therapeutic approaches and scenarios, including drug discovery, surgical strategies, brain stimulation, and seizure prediction. We propose that we need to consider an integrated approach with a unified modelling framework across multiple scales to understand the epileptic brain. Our proposal is based on the recent increase in computational power, which has opened up the possibility of unifying those specific epileptic models into simulations with an unprecedented level of detail. Main results: A multi-scale epilepsy model can bridge the gap between biologically detailed models, used to address molecular and cellular questions, and brain-wide models based on abstract models which can account for complex neurological and behavioural observations. Significance: With these efforts, we move toward the next generation of epileptic brain models capable of connecting cellular features, such as ion channel properties, with standard clinical measures such as seizure severity.
Joana Soldado-Magraner et al 2024 J. Neural Eng. 21 022001
Objective. Brain-computer interfaces (BCIs) are neuroprosthetic devices that allow for direct interaction between brains and machines. These types of neurotechnologies have recently experienced a strong drive in research and development, given, in part, that they promise to restore motor and communication abilities in individuals experiencing severe paralysis. While a rich literature analyzes the ethical, legal, and sociocultural implications (ELSCI) of these novel neurotechnologies, engineers, clinicians and BCI practitioners often do not have enough exposure to these topics. Approach. Here, we present the IEEE Neuroethics Framework, an international, multiyear, iterative initiative aimed at developing a robust, accessible set of considerations for diverse stakeholders. Main results. Using the framework, we provide practical examples of ELSCI considerations for BCI neurotechnologies. We focus on invasive technologies, and in particular, devices that are implanted intra-cortically for medical research applications. Significance. We demonstrate the utility of our framework in exposing a wide range of implications across different intra-cortical BCI technology modalities and conclude with recommendations on how to utilize this knowledge in the development and application of ethical guidelines for BCI neurotechnologies.
C J H Rikhof et al 2024 J. Neural Eng. 21 021001
Objective. The incidence of stroke rising, leading to an increased demand for rehabilitation services. Literature has consistently shown that early and intensive rehabilitation is beneficial for stroke patients. Robot-assisted devices have been extensively studied in this context, as they have the potential to increase the frequency of therapy sessions and thereby the intensity. Robot-assisted systems can be combined with electrical stimulation (ES) to further enhance muscle activation and patient compliance. The objective of this study was to review the effectiveness of ES combined with all types of robot-assisted technology for lower extremity rehabilitation in stroke patients. Approach. A thorough search of peer-reviewed articles was conducted. The quality of the included studies was assessed using a modified version of the Downs and Black checklist. Relevant information regarding the interventions, devices, study populations, and more was extracted from the selected articles. Main results. A total of 26 articles were included in the review, with 23 of them scoring at least fair on the methodological quality. The analyzed devices could be categorized into two main groups: cycling combined with ES and robots combined with ES. Overall, all the studies demonstrated improvements in body function and structure, as well as activity level, as per the International Classification of Functioning, Disability, and Health model. Half of the studies in this review showed superiority of training with the combination of robot and ES over robot training alone or over conventional treatment. Significance. The combination of robot-assisted technology with ES is gaining increasing interest in stroke rehabilitation. However, the studies identified in this review present challenges in terms of comparability due to variations in outcome measures and intervention protocols. Future research should focus on actively involving and engaging patients in executing movements and strive for standardization in outcome values and intervention protocols.
Zachary T Sanger et al 2024 J. Neural Eng. 21 012001
Deep brain stimulation (DBS) using Medtronic's Percept™ PC implantable pulse generator is FDA-approved for treating Parkinson's disease (PD), essential tremor, dystonia, obsessive compulsive disorder, and epilepsy. Percept™ PC enables simultaneous recording of neural signals from the same lead used for stimulation. Many Percept™ PC sensing features were built with PD patients in mind, but these features are potentially useful to refine therapies for many different disease processes. When starting our ongoing epilepsy research study, we found it difficult to find detailed descriptions about these features and have compiled information from multiple sources to understand it as a tool, particularly for use in patients other than those with PD. Here we provide a tutorial for scientists and physicians interested in using Percept™ PC's features and provide examples of how neural time series data is often represented and saved. We address characteristics of the recorded signals and discuss Percept™ PC hardware and software capabilities in data pre-processing, signal filtering, and DBS lead performance. We explain the power spectrum of the data and how it is shaped by the filter response of Percept™ PC as well as the aliasing of the stimulation due to digitally sampling the data. We present Percept™ PC's ability to extract biomarkers that may be used to optimize stimulation therapy. We show how differences in lead type affects noise characteristics of the implanted leads from seven epilepsy patients enrolled in our clinical trial. Percept™ PC has sufficient signal-to-noise ratio, sampling capabilities, and stimulus artifact rejection for neural activity recording. Limitations in sampling rate, potential artifacts during stimulation, and shortening of battery life when monitoring neural activity at home were observed. Despite these limitations, Percept™ PC demonstrates potential as a useful tool for recording neural activity in order to optimize stimulation therapies to personalize treatment.
Khaled M Taghlabi et al 2024 J. Neural Eng. 21 011001
Peripheral nerve interfaces (PNIs) are electrical systems designed to integrate with peripheral nerves in patients, such as following central nervous system (CNS) injuries to augment or replace CNS control and restore function. We review the literature for clinical trials and studies containing clinical outcome measures to explore the utility of human applications of PNIs. We discuss the various types of electrodes currently used for PNI systems and their functionalities and limitations. We discuss important design characteristics of PNI systems, including biocompatibility, resolution and specificity, efficacy, and longevity, to highlight their importance in the current and future development of PNIs. The clinical outcomes of PNI systems are also discussed. Finally, we review relevant PNI clinical trials that were conducted, up to the present date, to restore the sensory and motor function of upper or lower limbs in amputees, spinal cord injury patients, or intact individuals and describe their significant findings. This review highlights the current progress in the field of PNIs and serves as a foundation for future development and application of PNI systems.
Open all abstracts, in this tab
Ilya Kolb et al 2019 J. Neural Eng. 16 046003
Objective. Intracellular patch-clamp electrophysiology, one of the most ubiquitous, high-fidelity techniques in biophysics, remains laborious and low-throughput. While previous efforts have succeeded at automating some steps of the technique, here we demonstrate a robotic 'PatcherBot' system that can perform many patch-clamp recordings sequentially, fully unattended. Approach. Comprehensive automation is accomplished by outfitting the robot with machine vision, and cleaning pipettes instead of manually exchanging them. Main results. the PatcherBot can obtain data at a rate of 16 cells per hour and work with no human intervention for up to 3 h. We demonstrate the broad applicability and scalability of this system by performing hundreds of recordings in tissue culture cells and mouse brain slices with no human supervision. Using the PatcherBot, we also discovered that pipette cleaning can be improved by a factor of three. Significance. The system is potentially transformative for applications that depend on many high-quality measurements of single cells, such as drug screening, protein functional characterization, and multimodal cell type investigations.
Alborz Rezazadeh Sereshkeh et al 2019 J. Neural Eng. 16 016005
Objective. Most brain–computer interfaces (BCIs) based on functional near-infrared spectroscopy (fNIRS) require that users perform mental tasks such as motor imagery, mental arithmetic, or music imagery to convey a message or to answer simple yes or no questions. These cognitive tasks usually have no direct association with the communicative intent, which makes them difficult for users to perform. Approach. In this paper, a 3-class intuitive BCI is presented which enables users to directly answer yes or no questions by covertly rehearsing the word 'yes' or 'no' for 15 s. The BCI also admits an equivalent duration of unconstrained rest which constitutes the third discernable task. Twelve participants each completed one offline block and six online blocks over the course of two sessions. The mean value of the change in oxygenated hemoglobin concentration during a trial was calculated for each channel and used to train a regularized linear discriminant analysis (RLDA) classifier. Main results. By the final online block, nine out of 12 participants were performing above chance (p < 0.001 using the binomial cumulative distribution), with a 3-class accuracy of 83.8% ± 9.4%. Even when considering all participants, the average online 3-class accuracy over the last three blocks was 64.1 % ± 20.6%, with only three participants scoring below chance (p < 0.001). For most participants, channels in the left temporal and temporoparietal cortex provided the most discriminative information. Significance. To our knowledge, this is the first report of an online 3-class imagined speech BCI. Our findings suggest that imagined speech can be used as a reliable activation task for selected users for development of more intuitive BCIs for communication.
L Nathan Perkins et al 2018 J. Neural Eng. 15 066002
Objective. Optical techniques for recording and manipulating neural activity have traditionally been constrained to superficial brain regions due to light scattering. New techniques are needed to extend optical access to large 3D volumes in deep brain areas, while retaining local connectivity. Approach. We have developed a method to implant bundles of hundreds or thousands of optical microfibers, each with a diameter of 8 μm. During insertion, each fiber moves independently, following a path of least resistance. The fibers achieve near total internal reflection, enabling optically interfacing with the tissue near each fiber aperture. Main results. At a depth of 3 mm, histology shows fibers consistently splay over 1 mm in diameter throughout the target region. Immunohistochemical staining after chronic implants reveals neurons in close proximity to the fiber tips. Models of photon fluence indicate that fibers can be used as a stimulation light source to precisely activate distinct patterns of neurons by illuminating a subset of fibers in the bundle. By recording fluorescent beads diffusing in water, we demonstrate the recording capability of the fibers. Significance. Our histology, modeling and fluorescent bead recordings suggest that the optical microfibers may provide a minimally invasive, stable, bidirectional interface for recording or stimulating genetic probes in deep brain regions—a hyper-localized form of fiber photometry.
Christine A Edwards et al 2018 J. Neural Eng. 15 066003
Objective. Stereotactic frame systems are the gold-standard for stereotactic surgeries, such as implantation of deep brain stimulation (DBS) devices for treatment of medically resistant neurologic and psychiatric disorders. However, frame-based systems require that the patient is awake with a stereotactic frame affixed to their head for the duration of the surgical planning and implantation of the DBS electrodes. While frameless systems are increasingly available, a reusable re-attachable frame system provides unique benefits. As such, we created a novel reusable MRI-compatible stereotactic frame system that maintains clinical accuracy through the detachment and reattachment of its stereotactic devices used for MRI-guided neuronavigation. Approach. We designed a reusable arc-centered frame system that includes MRI-compatible anchoring skull screws for detachment and re-attachment of its stereotactic devices. We validated the stability and accuracy of our system through phantom, in vivo mock-human porcine DBS-model and human cadaver testing. Main results. Phantom testing achieved a root mean square error (RMSE) of 0.94 ± 0.23 mm between the ground truth and the frame-targeted coordinates; and achieved an RMSE of 1.11 ± 0.40 mm and 1.33 ± 0.38 mm between the ground truth and the CT- and MRI-targeted coordinates, respectively. In vivo and cadaver testing achieved a combined 3D Euclidean localization error of 1.85 ± 0.36 mm (p < 0.03) between the pre-operative MRI-guided placement and the post-operative CT-guided confirmation of the DBS electrode. Significance. Our system demonstrated consistent clinical accuracy that is comparable to conventional frame and frameless stereotactic systems. Our frame system is the first to demonstrate accurate relocation of stereotactic frame devices during in vivo MRI-guided DBS surgical procedures. As such, this reusable and re-attachable MRI-compatible system is expected to enable more complex, chronic neuromodulation experiments, and lead to a clinically available re-attachable frame that is expected to decrease patient discomfort and costs of DBS surgery.
P Senn et al 2018 J. Neural Eng. 15 056018
Objective. Cochlear implants, while providing significant benefits to recipients, remain limited due to broad neural activation. Focussed multipolar stimulation (FMP) is an advanced stimulation strategy that uses multiple current sources to produce highly focussed patterns of neural excitation in order to overcome these shortcomings. Approach. This report presents single-source multipolar stimulation (SSMPS), a novel form of stimulation based on a single current source and a passive current divider. Compared to conventional FMP with multiple current sources, SSMPS can be implemented as a modular addition to conventional (i.e. single) current source stimulation systems facilitating charge balance within the cochlea. As with FMP, SSMPS requires the determination of a transimpedance matrix to allow for focusing of the stimulation. The first part of this study therefore investigated the effects of varying the probe stimulus (e.g. current level and pulse width) on the measurement of the transimpedance matrix. SSMPS was then studied using in vitro based measurements of voltages at non-stimulated electrodes along an electrode array in normal saline. The voltage reduction with reference to monopolar stimulation was compared to tripolar and common ground stimulation, two clinically established stimulation modes. Finally, a proof of principle in vivo test of SSMPS in a feline model was performed. Main results. A probe stimulus of at least 40 nC is required to reliably measure the transimpedance matrix. In vitro stimulation using SSMPS resulted in a significantly greater voltage reduction compared to monopolar, tripolar and common ground stimulation. Interestingly, matching measurement and stimulation parameters did not lead to an improved focussing performance. Compared to monopolar stimulation, SSMPS resulted in reduced spread of neural activity in the inferior colliculus, albeit with increased thresholds. Significance. The present study demonstrates that SSMPS successfully limits the broadening of the excitatory field along the electrode array and a subsequent reduction in the spread of neural excitation.
Open all abstracts, in this tab
Gowda et al
Decoding gestures from the upper limb using noninvasive surface electromyogram (sEMG) signals is of keen interest for the rehabilitation of amputees, artificial supernumerary limb augmentation, gestural control of computers, and virtual/augmented realities. We show that sEMG signals recorded across an array of sensor electrodes in multiple spatial locations around the forearm evince a rich geometric pattern of global motor unit (MU) activity that can be leveraged to distinguish different hand gestures. We demonstrate a simple technique to analyze spatial patterns of muscle MU activity within a temporal window and show that distinct gestures can be classified in both supervised and unsupervised manners. Specifically, we construct symmetric positive definite (SPD) covariance matrices to represent the spatial distribution of MU activity in a time window of interest, calculated as pairwise covariance of electrical signals measured across different electrodes. This allows us to understand and manipulate multivariate sEMG timeseries on a more natural subspace - the Riemannian manifold. Furthermore, it directly addresses signal variability across individuals and sessions, which remains a major challenge in the field. sEMG signals measured at a single electrode lack contextual information such as how various anatomical and physiological factors influence the signals and how their combined effect alters the evident interaction among neighboring muscles. As we show here, analyzing spatial patterns using covariance matrices on Riemannian manifolds allows us to robustly model complex interactions across spatially distributed MUs and provides a flexible and transparent framework to quantify differences in sEMG signals across individuals. The proposed method is novel in the study of sEMG signals and its performance exceeds the current benchmarks while maintaining exceptional computational efficiency.
Gonsalves et al
Objective. Severe traumatic brain injury (sTBI) induced neuronal loss and brain atrophy contribute significantly to long-term disabilities. Brain extracellular matrix (ECM) associated chondroitin sulfate (CS) glycosaminoglycans promote neural stem cell (NSC) maintenance, and CS hydrogel implants have demonstrated the ability to enhance neuroprotection, in preclinical sTBI studies. However, the ability of neuritogenic chimeric peptide (CP) functionalized CS hydrogels in promoting functional recovery, after controlled cortical impact (CCI) and suction ablation (SA) induced sTBI, has not been previously demonstrated. We hypothesized that neuritogenic (CS)CP hydrogels will promote neuritogenesis of human NSCs, and accelerate brain tissue repair and functional recovery in sTBI rats. Approach. We synthesized chondroitin 4-O sulfate (CS-A)CP, and 4,6-O-sulfate (CS-E)CP hydrogels, using strain promoted azide-alkyne cycloaddition (SPAAC), to promote cell adhesion and neuritogenesis of human NSCs, in vitro; and assessed the ability of (CS-A)CP hydrogels in promoting tissue and functional repair, in a novel CCI-SA sTBI model, in vivo. Main Results. Results indicated that (CS-E)CP hydrogels significantly enhanced human NSC aggregation and migration via focal adhesion kinase complexes, when compared to NSCs in (CS-A)CP hydrogels, in vitro. In contrast, NSCs encapsulated in (CS-A)CP hydrogels differentiated into neurons bearing longer neurites and showed greater spontaneous activity, when compared to those in (CS-E)CP hydrogels. The intracavitary implantation of (CS-A)CP hydrogels, acutely after CCI-SA-sTBI, prevented neuronal and axonal loss, as determined by immunohistochemical analyses. (CS-A)CP hydrogel implanted animals also demonstrated the significantly accelerated recovery of 'reach-to-grasp' function when compared to sTBI controls, over a period of 5-weeks. Significance. These findings demonstrate the neuritogenic and neuroprotective attributes of (CS)CP "click" hydrogels, and open new avenues for using modified CS biorthogonal handles to develop tissue engineered implants for sTBI repair.
Zhang et al
Objective. 
Motor-related brain-computer interface (BCI) have a broad range of applications, with the detection of premovement intentions being a prominent use case. However, the electroencephalography (EEG) features during the premovement phase are not distinctly evident and are susceptible to attentional influences. These limitations impede the enhancement of performance in motor-based BCI. The objective of this study is to establish a premovement BCI encoding paradigm that integrates the preparatory movement state and validates its feasibility in improving the detection of movement intentions. 
Methods. 
Two button tasks were designed to induce subjects into a preparation state for two movement intentions (left and right) based on visual guidance, in contrast to spontaneous premovement. The low frequency movement-related cortical potentials (MRCPs) and high frequency event-related desynchronization (ERD) EEG data of 14 subjects were recorded. Extracted features were fused and classified using task‑related common spatial patterns (TR-CSP) and common spatial patterns (CSP) algorithms. Differences between prepared premovement and spontaneous premovement were compared in terms of time domain, frequency domain, and classification accuracy. Results. 
In the time domain, MRCPs features reveal that prepared premovement induce lower amplitude and earlier latency on both contralateral and ipsilateral motor cortex compared to spontaneous premovement, with susceptibility to the dominant hand's influence. Frequency domain ERD features indicate that prepared premovement induce lower ERD values bilaterally, and the ERD recovery speed after button press is the fastest. By using the fusion approach, the classification accuracy increased from 78.92% for spontaneous premovement to 83.59% for prepared premovement (p<0.05). Along with the 4.67% improvement in classification accuracy, the standard deviation decreased by 0.95. 
Significance. 
The research findings confirm that incorporating a preparatory state into premovement enhances neural representations related to movement. This encoding enhancement paradigm effectively improves the performance of motor-based BCI. Additionally, this concept has the potential to broaden the range of decodable movement intentions and related information in motor-related BCI.
Ferris et al
Objective: Rapid switching of Magnetic Resonance Imaging (MRI) gradient fields induces electric fields that can cause peripheral nerve stimulation (PNS) and so accurate characterization of PNS is required to maintain patient safety and comfort while maximizing MRI performance. The minimum magnetic gradient amplitude that causes stimulation, the PNS threshold, depends on intrinsic axon properties and the spatial and temporal properties of the induced electric field. The PNS strength-duration curve is widely used to characterize simulation thresholds for periodic waveforms and is parameterized by the chronaxie and rheobase. Safety limits to avoid unwanted PNS in MRI rely on a single chronaxie value to characterize the response of all nerves. However, experimental magnetostimulation peripheral nerve chronaxie values vary by an order of magnitude. Given the diverse range of chronaxies observed and the importance of this number in MRI safety models, we seek a deeper understanding of the mechanisms contributing to chronaxie variability. Approach: We use a coupled electromagnetic-neurodynamic peripheral nerve stimulation model to assess geometric sources of chronaxie variability. We study the impact of the position of the stimulating magnetic field coil relative to the body, along with the effect of local anatomical features and nerve trajectories on the driving function and the resulting chronaxie. Main results: We find realistic variation of local axon and tissue geometry can modulate a given axon's chronaxie by up to 2-fold. Our results identify the temporal rate of charge redistribution as the underlying determinant of the chronaxie. Significance: This charge distribution is a function of both intrinsic axon properties and the spatial stimulus along the nerve; thus, examination of the local tissue topology, which shapes the electric fields, as well as the nerve trajectory, are critical for better understanding chronaxie variations and defining more biologically informed MRI safety guidelines.
Wang et al
Objective. Identifying major depressive disorder (MDD) using objective physiological signals has become a pressing challenge. Approach. Hence, this paper proposes a graph convolutional transformer network (GCTNet) for accurate and reliable MDD detection using electroencephalogram (EEG) signals. The developed framework integrates a residual graph convolutional network (ResGCN) block to capture spatial information and a Transformer block to extract global temporal dynamics. Additionally, we introduce the contrastive cross-entropy (CCE) loss that combines contrastive learning to enhance the stability and discriminability of the extracted features, thereby improving classification performance. Main results. The effectiveness of the GCTNet model and CCE loss was assessed using EEG data from 41 MDD patients and 44 normal controls (NC), in addition to a publicly available dataset. Utilizing a subject-independent data partitioning method and 10-fold cross-validation, the proposed method demonstrated significant performance, achieving an average Area Under the Curve (AUC) of 0.7693 and 0.9755 across both datasets, respectively. Comparative analyses demonstrated the superiority of the GCTNet framework with CCE loss over state-of-the-art algorithms in MDD detection tasks. Significance. The proposed method offers an objective and effective approach to MDD detection, providing valuable support for clinical-assisted diagnosis.
Open all abstracts, in this tab
Yipeng Zhang et al 2024 J. Neural Eng. 21 036023
Objective. This study aims to develop and validate an end-to-end software platform, PyHFO, that streamlines the application of deep learning (DL) methodologies in detecting neurophysiological biomarkers for epileptogenic zones from EEG recordings. Approach. We introduced PyHFO, which enables time-efficient high-frequency oscillation (HFO) detection algorithms like short-term energy and Montreal Neurological Institute and Hospital detectors. It incorporates DL models for artifact and HFO with spike classification, designed to operate efficiently on standard computer hardware. Main results. The validation of PyHFO was conducted on three separate datasets: the first comprised solely of grid/strip electrodes, the second a combination of grid/strip and depth electrodes, and the third derived from rodent studies, which sampled the neocortex and hippocampus using depth electrodes. PyHFO demonstrated an ability to handle datasets efficiently, with optimization techniques enabling it to achieve speeds up to 50 times faster than traditional HFO detection applications. Users have the flexibility to employ our pre-trained DL model or use their EEG data for custom model training. Significance. PyHFO successfully bridges the computational challenge faced in applying DL techniques to EEG data analysis in epilepsy studies, presenting a feasible solution for both clinical and research settings. By offering a user-friendly and computationally efficient platform, PyHFO paves the way for broader adoption of advanced EEG data analysis tools in clinical practice and fosters potential for large-scale research collaborations.
Harshavardhana T Gowda and Lee M Miller 2024 J. Neural Eng.
Decoding gestures from the upper limb using noninvasive surface electromyogram (sEMG) signals is of keen interest for the rehabilitation of amputees, artificial supernumerary limb augmentation, gestural control of computers, and virtual/augmented realities. We show that sEMG signals recorded across an array of sensor electrodes in multiple spatial locations around the forearm evince a rich geometric pattern of global motor unit (MU) activity that can be leveraged to distinguish different hand gestures. We demonstrate a simple technique to analyze spatial patterns of muscle MU activity within a temporal window and show that distinct gestures can be classified in both supervised and unsupervised manners. Specifically, we construct symmetric positive definite (SPD) covariance matrices to represent the spatial distribution of MU activity in a time window of interest, calculated as pairwise covariance of electrical signals measured across different electrodes. This allows us to understand and manipulate multivariate sEMG timeseries on a more natural subspace - the Riemannian manifold. Furthermore, it directly addresses signal variability across individuals and sessions, which remains a major challenge in the field. sEMG signals measured at a single electrode lack contextual information such as how various anatomical and physiological factors influence the signals and how their combined effect alters the evident interaction among neighboring muscles. As we show here, analyzing spatial patterns using covariance matrices on Riemannian manifolds allows us to robustly model complex interactions across spatially distributed MUs and provides a flexible and transparent framework to quantify differences in sEMG signals across individuals. The proposed method is novel in the study of sEMG signals and its performance exceeds the current benchmarks while maintaining exceptional computational efficiency.
Nathan Gonsalves et al 2024 J. Neural Eng.
Objective. Severe traumatic brain injury (sTBI) induced neuronal loss and brain atrophy contribute significantly to long-term disabilities. Brain extracellular matrix (ECM) associated chondroitin sulfate (CS) glycosaminoglycans promote neural stem cell (NSC) maintenance, and CS hydrogel implants have demonstrated the ability to enhance neuroprotection, in preclinical sTBI studies. However, the ability of neuritogenic chimeric peptide (CP) functionalized CS hydrogels in promoting functional recovery, after controlled cortical impact (CCI) and suction ablation (SA) induced sTBI, has not been previously demonstrated. We hypothesized that neuritogenic (CS)CP hydrogels will promote neuritogenesis of human NSCs, and accelerate brain tissue repair and functional recovery in sTBI rats. Approach. We synthesized chondroitin 4-O sulfate (CS-A)CP, and 4,6-O-sulfate (CS-E)CP hydrogels, using strain promoted azide-alkyne cycloaddition (SPAAC), to promote cell adhesion and neuritogenesis of human NSCs, in vitro; and assessed the ability of (CS-A)CP hydrogels in promoting tissue and functional repair, in a novel CCI-SA sTBI model, in vivo. Main Results. Results indicated that (CS-E)CP hydrogels significantly enhanced human NSC aggregation and migration via focal adhesion kinase complexes, when compared to NSCs in (CS-A)CP hydrogels, in vitro. In contrast, NSCs encapsulated in (CS-A)CP hydrogels differentiated into neurons bearing longer neurites and showed greater spontaneous activity, when compared to those in (CS-E)CP hydrogels. The intracavitary implantation of (CS-A)CP hydrogels, acutely after CCI-SA-sTBI, prevented neuronal and axonal loss, as determined by immunohistochemical analyses. (CS-A)CP hydrogel implanted animals also demonstrated the significantly accelerated recovery of 'reach-to-grasp' function when compared to sTBI controls, over a period of 5-weeks. Significance. These findings demonstrate the neuritogenic and neuroprotective attributes of (CS)CP "click" hydrogels, and open new avenues for using modified CS biorthogonal handles to develop tissue engineered implants for sTBI repair.
Keying Chen et al 2024 J. Neural Eng.
Objective: This study aims to reveal longitudinal changes in functional network connectivity within and across different brain structures near chronically implanted microelectrodes. While it is well established that the foreign-body response (FBR) contributes to the gradual decline of the signals recorded from brain implants over time, how the FBR affects the functional stability of neural circuits near implanted Brain-Computer Interfaces (BCIs) remains unknown. This research aims to illuminate how the chronic FBR can alter local neural circuit function and the implications for BCI decoders. Approach: This study utilized single-shank, 16-channel,100 µm site-spacing Michigan-style microelectrodes (3mm length, 703 µm2 site area) that span all cortical layers and the hippocampal CA1 region. Sex balanced C57BL6 wildtype mice (11-13 weeks old) received perpendicularly implanted microelectrode in left primary visual cortex. Electrophysiological recordings were performed during both spontaneous activity and visual sensory stimulation. Alterations in neuronal activity near the microelectrode were tested assessing cross-frequency synchronization of LFP and spike entrainment to LFP oscillatory activity throughout 16 weeks after microelectrode implantation. Main Results: The study found that cortical layer 4, the input-receiving layer, maintained activity over the implantation time. However, layers 2/3 rapidly experienced severe impairment, leading to a loss of proper intralaminar connectivity in the downstream output layers 5/6. Furthermore, the impairment of interlaminar connectivity near the microelectrode was unidirectional, showing decreased connectivity from Layers 2/3 to Layers 5/6 but not the reverse direction. In the hippocampus, CA1 neurons gradually became unable to properly entrain to the surrounding LFP oscillations. Significance: This study provides a detailed characterization of network connectivity dysfunction over long-term microelectrode implantation periods. This new knowledge could contribute to the development of targeted therapeutic strategies aimed at improving the health of the tissue surrounding brain implants and potentially inform engineering of adaptive decoders as the FBR progresses. Our study's understanding of the dynamic changes in the functional network over time opens the door to developing interventions for improving the long-term stability and performance of intracortical microelectrodes.
M Asjid Tanveer et al 2024 J. Neural Eng. 21 036022
Objective. This study develops a deep learning (DL) method for fast auditory attention decoding (AAD) using electroencephalography (EEG) from listeners with hearing impairment (HI). It addresses three classification tasks: differentiating noise from speech-in-noise, classifying the direction of attended speech (left vs. right) and identifying the activation status of hearing aid noise reduction algorithms (OFF vs. ON). These tasks contribute to our understanding of how hearing technology influences auditory processing in the hearing-impaired population. Approach. Deep convolutional neural network (DCNN) models were designed for each task. Two training strategies were employed to clarify the impact of data splitting on AAD tasks: inter-trial, where the testing set used classification windows from trials that the training set had not seen, and intra-trial, where the testing set used unseen classification windows from trials where other segments were seen during training. The models were evaluated on EEG data from 31 participants with HI, listening to competing talkers amidst background noise. Main results. Using 1 s classification windows, DCNN models achieve accuracy (ACC) of 69.8%, 73.3% and 82.9% and area-under-curve (AUC) of 77.2%, 80.6% and 92.1% for the three tasks respectively on inter-trial strategy. In the intra-trial strategy, they achieved ACC of 87.9%, 80.1% and 97.5%, along with AUC of 94.6%, 89.1%, and 99.8%. Our DCNN models show good performance on short 1 s EEG samples, making them suitable for real-world applications. Conclusion: Our DCNN models successfully addressed three tasks with short 1 s EEG windows from participants with HI, showcasing their potential. While the inter-trial strategy demonstrated promise for assessing AAD, the intra-trial approach yielded inflated results, underscoring the important role of proper data splitting in EEG-based AAD tasks. Significance. Our findings showcase the promising potential of EEG-based tools for assessing auditory attention in clinical contexts and advancing hearing technology, while also promoting further exploration of alternative DL architectures and their potential constraints.
JingYang Liu et al 2024 J. Neural Eng.
Objective: Electrical stimulation of peripheral nerves has long been a treatment option to restore impaired neural functions that cannot be restored by conventional pharmacological therapies. Endovascular neurostimulation with stent-mounted electrode arrays is a promising and less invasive alternative to traditional implanted electrodes, which typically require invasive implantation surgery. In this study, we investigated the feasibility of endovascular stimulation of the femoral nerve using a stent-mounted electrode array and compared its performance to that of a commercially available pacing catheter.
Approach: In acute animal experiments, a quadripolar pacing catheter was implanted unilaterally in the femoral artery to stimulate the femoral nerve in a bipolar configuration. Electromyogram (EMG) of the quadriceps and electroneurogram (ENG) of a distal branch of the femoral nerve were recorded. After retrieval of the pacing catheter, a bipolar stent-mounted electrode array was implanted in the same artery and the recording sessions were repeated.
Main Results: Stimulation of the femoral nerve was feasible with the stent-electrode array. Although the threshold stimulus intensities required with the stent-mounted electrode array (at 100-500µs increasing pulse width, 2.17 ± 0.87 mA - 1.00 ± 0.11 mA) were more than two times higher than the pacing catheter electrodes (1.05 ± 0.48 mA - 0.57 ± 0.28mA), we demonstrated that, by reducing the stimulus pulse width to 100 µs, the threshold charge per phase and charge density can be reduced to 0.22 ± 0.09 µC and 24.62 ± 9.81 µC/cm2, which were below the tissue-damaging limit, as defined by the Shannon criteria.
Significance: The present study is the first to report in vivo feasibility and efficiency of peripheral nerve stimulation using an endovascular stent-mounted electrode array. 
Alessandra Calcagno et al 2024 J. Neural Eng.
Objective: This study explores the changes in the organization of functional brain networks induced by performing a visuomotor integration task, as revealed by noninvasive spontaneous electroencephalographic traces (EEG). Approach: EEG data were acquired during the execution of the Nine Hole Peg Test (NHPT) with the dominant and non-dominant hands in a group of 44 right-handed volunteers. Both spectral analysis and phase-based connectivity analysis were performed in the Theta (ϑ), Mu (μ) and Beta (ß) bands. Graph Theoretical Analysis (GTA) was also performed to investigate the topological reorganization induced by motor task execution. Main results: Spectral analysis revealed an increase of frontoparietal ϑ power and a spatially diffused reduction of µ and ß contribution, regardless of the hand used. GTA showed a significant increase in network integration induced by movement with the dominant limb compared to baseline in the ϑ band. The µ and ß bands were associated with a reduction in network integration during the NHPT. In the µ rhythm, this result was more evident for the right-hand movement, while in the ß band, results did not show dependence on the laterality. Finally, correlation analysis highlighted an association between frequency-specific topology measures and task performance for both hands. Significance: Our results show that functional brain networks reorganize during visually guided movements in a frequency-dependent manner, differently depending on the hand used (dominant/non dominant).
Jan Zbinden et al 2024 J. Neural Eng. 21 036021
Objective. The advent of surgical reconstruction techniques has enabled the recreation of myoelectric controls sites that were previously lost due to amputation. This advancement is particularly beneficial for individuals with higher-level arm amputations, who were previously constrained to using a single degree of freedom (DoF) myoelectric prostheses due to the limited number of available muscles from which control signals could be extracted. In this study, we explore the use of surgically created electro-neuromuscular constructs to intuitively control multiple bionic joints during daily life with a participant who was implanted with a neuromusculoskeletal prosthetic interface. Approach. We sequentially increased the number of controlled joints, starting at a single DoF allowing to open and close the hand, subsequently adding control of the wrist (2 DoF) and elbow (3 DoF). Main results. We found that the surgically created electro-neuromuscular constructs allow for intuitive simultaneous and proportional control of up to three degrees of freedom using direct control. Extended home-use and the additional bionic joints resulted in improved prosthesis functionality and disability outcomes. Significance. Our findings indicate that electro-neuromuscular constructs can aid in restoring lost functionality and thereby support a person who lost their arm in daily-life tasks.
Alessandro Fasse et al 2024 J. Neural Eng.
Spinal cord stimulation (SCS) is a well-established treatment for the management of certain chronic pain conditions. More recently, it has also garnered attention as a means of modulating neural activity with the goal of restoring lost autonomic or sensory-motor function. Personalized modeling and treatment planning are critical aspects of safe and effective SCS [46, 60]. However, the generation of spine models at the required level of detail and accuracy requires time and labor intensive manual image segmentation by human experts. Hence, there is a need for maximally automated segmentation routines capable of producing high-quality anatomical models that can be used even in cases where available data is limited. To this end, we developed an automated image segmentation and model generation pipeline based on a novel Convolutional Neural Network (CNN) architecture trained on feline spinal cord magnetic resonance imaging (MRI) data. The pipeline includes steps for image preprocessing, data augmentation, transfer learning and cleanup. To assess the relative importance of each step in the pipeline and of our choice of CNN architecture, we systematically dropped steps or substituted architectures, quantifying the downstream effects in terms of tissue segmentation quality (Jaccard index and Hausdorff distance) and predicted nerve recruitment (estimated axonal depolarization). This leaveone-out analysis demonstrated that each pipeline step contributed a small but measurable increment to mean segmentation quality. Surprisingly, minor differences in segmentation accuracy translated to significant deviations (ranging between 4% and 13% for each pipeline step) in predicted nerve recruitment, highlighting the importance of careful workflow design. To our knowledge, this is the first analysis to also assess the downstream impact of segmentation quality differences on neurostimulation predictions. Furthermore, transfer learning techniques enhanced segmentation metric consistency and allowed generalization to a completely different spine region with minimal additional training data. This work helps pave the way towards fully automated, personalized SCS treatment planning in clinical settings.
Yuya Ikegawa et al 2024 J. Neural Eng. 21 036019
Objective. Invasive brain–computer interfaces (BCIs) are promising communication devices for severely paralyzed patients. Recent advances in intracranial electroencephalography (iEEG) coupled with natural language processing have enhanced communication speed and accuracy. It should be noted that such a speech BCI uses signals from the motor cortex. However, BCIs based on motor cortical activities may experience signal deterioration in users with motor cortical degenerative diseases such as amyotrophic lateral sclerosis. An alternative approach to using iEEG of the motor cortex is necessary to support patients with such conditions. Approach. In this study, a multimodal embedding of text and images was used to decode visual semantic information from iEEG signals of the visual cortex to generate text and images. We used contrastive language-image pretraining (CLIP) embedding to represent images presented to 17 patients implanted with electrodes in the occipital and temporal cortices. A CLIP image vector was inferred from the high-γ power of the iEEG signals recorded while viewing the images. Main results. Text was generated by CLIPCAP from the inferred CLIP vector with better-than-chance accuracy. Then, an image was created from the generated text using StableDiffusion with significant accuracy. Significance. The text and images generated from iEEG through the CLIP embedding vector can be used for improved communication.