Effect of power feature covariance shift on BCI spatial-filtering techniques: A comparative study
•This study investigates the performance of several spatial-filtering approaches on calibration and test set acquired 30 min after the calibration, mimicking the real BCI scenarios.•EEG extracted feature covariance shifts lead to the BCI model accuracy deterioration, even after 30 min of a break.•FB...
Gespeichert in:
Veröffentlicht in: | Computer methods and programs in biomedicine 2021-01, Vol.198, p.105808-105808, Article 105808 |
---|---|
Hauptverfasser: | , , , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 105808 |
---|---|
container_issue | |
container_start_page | 105808 |
container_title | Computer methods and programs in biomedicine |
container_volume | 198 |
creator | Miladinović, Aleksandar Ajčević, Miloš Jarmolowska, Joanna Marusic, Uros Colussi, Marco Silveri, Giulia Battaglini, Piero Paolo Accardo, Agostino |
description | •This study investigates the performance of several spatial-filtering approaches on calibration and test set acquired 30 min after the calibration, mimicking the real BCI scenarios.•EEG extracted feature covariance shifts lead to the BCI model accuracy deterioration, even after 30 min of a break.•FBCSP and FBSCPT showed to be more robust to feature covariance shift largely maintaining the original performance characterized by moderately high accuracy (>70%).•Stationary Subspace Analysis preprocessing improved the models’ performance and also reduced the gap between calibration and test set observed BCI model accuracies.
The input data distributions of EEG-based BCI systems can change during intra-session transitions due to nonstationarity caused by features covariate shifts, thus compromising BCI performance.
We aimed to identify the most robust spatial filtering approach, among most used methods, testing them on calibration dataset, and test dataset recorded 30 min afterwards. In addition, we also investigated if their performance improved after application of Stationary Subspace Analysis (SSA).
We have recorded, in 17 healthy subjects, the calibration set at the beginning of the upper limb motor imagery BCI experiment and testing set separately 30 min afterwards. Both the calibration and test data were pre-processed and the BCI models were produced by using several spatial filtering approaches on the calibration set. Those models were subsequently evaluated on a test set. The differences between the accuracy estimated by cross-validation on the calibration dataset and the accuracy on the test dataset were investigated. The same procedure was performed with, and without SSA pre-processing step.
A significant reduction in accuracy on the test dataset was observed for CSP, SPoC and SpecRCSP approaches. For SLap and SpecCSP only a slight decreasing trend was observed, while FBCSP and FBCSPT largely maintained moderately high median accuracy >70%. In the case of application of SSA pre-processing, the differences between accuracy observed on calibration and test dataset were reduced. In addition, accuracy values both on calibration and test set were slightly higher in case of SSA pre-processing and also in this case FBCSP and FBCSPT presented slightly better performance compared to other methods.
The intrinsic signal nonstationarity characteristics, caused by covariance shifts of power features, reduced the accuracy of BCI model, therefore, suggesting that thi |
doi_str_mv | 10.1016/j.cmpb.2020.105808 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2458728884</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0169260720316412</els_id><sourcerecordid>2458728884</sourcerecordid><originalsourceid>FETCH-LOGICAL-c400t-fd32ed857eb1f1af66c38b9f05134a77582514eaab41c9be110bf0e52ee1c9db3</originalsourceid><addsrcrecordid>eNp9kL1OwzAURi0EoqXwAgzII0uK7cSJi1igKlCpEgvMluNcU1f5w06K-vY4SmFksq51vk_3HoSuKZlTQtO73VxXbT5nhA0fXBBxgqZUZCzKeMpP0TRAi4ilJJugC-93hBDGeXqOJnFMeZZkZIrUyhjQHW4MbptvcNiA6noHWDd75ayqNWC_tSYQNX5arrFvVWdVGRlbduBs_Yk70NvafvXg7_FjyFWtcoHZh2DXF4dLdGZU6eHq-M7Qx_Pqffkabd5e1svHTaQTQrrIFDGDQvAMcmqoMmmqY5EvDOE0TlSWccE4TUCpPKF6kQOlJDcEOAMIc5HHM3Q79rauGZbpZGW9hrJUNTS9lyzhQY0QIgkoG1HtGu8dGNk6Wyl3kJTIQa3cyUGtHNTKUW0I3Rz7-7yC4i_y6zIADyMA4cq9BSe9thAEFtYFxbJo7H_9PzkkiyE</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2458728884</pqid></control><display><type>article</type><title>Effect of power feature covariance shift on BCI spatial-filtering techniques: A comparative study</title><source>MEDLINE</source><source>Access via ScienceDirect (Elsevier)</source><creator>Miladinović, Aleksandar ; Ajčević, Miloš ; Jarmolowska, Joanna ; Marusic, Uros ; Colussi, Marco ; Silveri, Giulia ; Battaglini, Piero Paolo ; Accardo, Agostino</creator><creatorcontrib>Miladinović, Aleksandar ; Ajčević, Miloš ; Jarmolowska, Joanna ; Marusic, Uros ; Colussi, Marco ; Silveri, Giulia ; Battaglini, Piero Paolo ; Accardo, Agostino</creatorcontrib><description>•This study investigates the performance of several spatial-filtering approaches on calibration and test set acquired 30 min after the calibration, mimicking the real BCI scenarios.•EEG extracted feature covariance shifts lead to the BCI model accuracy deterioration, even after 30 min of a break.•FBCSP and FBSCPT showed to be more robust to feature covariance shift largely maintaining the original performance characterized by moderately high accuracy (>70%).•Stationary Subspace Analysis preprocessing improved the models’ performance and also reduced the gap between calibration and test set observed BCI model accuracies.
The input data distributions of EEG-based BCI systems can change during intra-session transitions due to nonstationarity caused by features covariate shifts, thus compromising BCI performance.
We aimed to identify the most robust spatial filtering approach, among most used methods, testing them on calibration dataset, and test dataset recorded 30 min afterwards. In addition, we also investigated if their performance improved after application of Stationary Subspace Analysis (SSA).
We have recorded, in 17 healthy subjects, the calibration set at the beginning of the upper limb motor imagery BCI experiment and testing set separately 30 min afterwards. Both the calibration and test data were pre-processed and the BCI models were produced by using several spatial filtering approaches on the calibration set. Those models were subsequently evaluated on a test set. The differences between the accuracy estimated by cross-validation on the calibration dataset and the accuracy on the test dataset were investigated. The same procedure was performed with, and without SSA pre-processing step.
A significant reduction in accuracy on the test dataset was observed for CSP, SPoC and SpecRCSP approaches. For SLap and SpecCSP only a slight decreasing trend was observed, while FBCSP and FBCSPT largely maintained moderately high median accuracy >70%. In the case of application of SSA pre-processing, the differences between accuracy observed on calibration and test dataset were reduced. In addition, accuracy values both on calibration and test set were slightly higher in case of SSA pre-processing and also in this case FBCSP and FBCSPT presented slightly better performance compared to other methods.
The intrinsic signal nonstationarity characteristics, caused by covariance shifts of power features, reduced the accuracy of BCI model, therefore, suggesting that this evaluation framework should be considered for testing and simulating real life performance. FBCSP and FBSCPT approaches showed to be more robust to feature covariance shift. SSA can improve the models performance and reduce accuracy decline from calibration to test set.</description><identifier>ISSN: 0169-2607</identifier><identifier>EISSN: 1872-7565</identifier><identifier>DOI: 10.1016/j.cmpb.2020.105808</identifier><identifier>PMID: 33157470</identifier><language>eng</language><publisher>Ireland: Elsevier B.V</publisher><subject>Algorithms ; BCI ; Brain-Computer Interfaces ; Covariance shift ; EEG ; Electroencephalography ; Humans ; Imagination ; Motor-imagery ; Signal Processing, Computer-Assisted ; Spatial filtering</subject><ispartof>Computer methods and programs in biomedicine, 2021-01, Vol.198, p.105808-105808, Article 105808</ispartof><rights>2020</rights><rights>Copyright © 2020. Published by Elsevier B.V.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c400t-fd32ed857eb1f1af66c38b9f05134a77582514eaab41c9be110bf0e52ee1c9db3</citedby><cites>FETCH-LOGICAL-c400t-fd32ed857eb1f1af66c38b9f05134a77582514eaab41c9be110bf0e52ee1c9db3</cites><orcidid>0000-0003-3761-1983</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.cmpb.2020.105808$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/33157470$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Miladinović, Aleksandar</creatorcontrib><creatorcontrib>Ajčević, Miloš</creatorcontrib><creatorcontrib>Jarmolowska, Joanna</creatorcontrib><creatorcontrib>Marusic, Uros</creatorcontrib><creatorcontrib>Colussi, Marco</creatorcontrib><creatorcontrib>Silveri, Giulia</creatorcontrib><creatorcontrib>Battaglini, Piero Paolo</creatorcontrib><creatorcontrib>Accardo, Agostino</creatorcontrib><title>Effect of power feature covariance shift on BCI spatial-filtering techniques: A comparative study</title><title>Computer methods and programs in biomedicine</title><addtitle>Comput Methods Programs Biomed</addtitle><description>•This study investigates the performance of several spatial-filtering approaches on calibration and test set acquired 30 min after the calibration, mimicking the real BCI scenarios.•EEG extracted feature covariance shifts lead to the BCI model accuracy deterioration, even after 30 min of a break.•FBCSP and FBSCPT showed to be more robust to feature covariance shift largely maintaining the original performance characterized by moderately high accuracy (>70%).•Stationary Subspace Analysis preprocessing improved the models’ performance and also reduced the gap between calibration and test set observed BCI model accuracies.
The input data distributions of EEG-based BCI systems can change during intra-session transitions due to nonstationarity caused by features covariate shifts, thus compromising BCI performance.
We aimed to identify the most robust spatial filtering approach, among most used methods, testing them on calibration dataset, and test dataset recorded 30 min afterwards. In addition, we also investigated if their performance improved after application of Stationary Subspace Analysis (SSA).
We have recorded, in 17 healthy subjects, the calibration set at the beginning of the upper limb motor imagery BCI experiment and testing set separately 30 min afterwards. Both the calibration and test data were pre-processed and the BCI models were produced by using several spatial filtering approaches on the calibration set. Those models were subsequently evaluated on a test set. The differences between the accuracy estimated by cross-validation on the calibration dataset and the accuracy on the test dataset were investigated. The same procedure was performed with, and without SSA pre-processing step.
A significant reduction in accuracy on the test dataset was observed for CSP, SPoC and SpecRCSP approaches. For SLap and SpecCSP only a slight decreasing trend was observed, while FBCSP and FBCSPT largely maintained moderately high median accuracy >70%. In the case of application of SSA pre-processing, the differences between accuracy observed on calibration and test dataset were reduced. In addition, accuracy values both on calibration and test set were slightly higher in case of SSA pre-processing and also in this case FBCSP and FBCSPT presented slightly better performance compared to other methods.
The intrinsic signal nonstationarity characteristics, caused by covariance shifts of power features, reduced the accuracy of BCI model, therefore, suggesting that this evaluation framework should be considered for testing and simulating real life performance. FBCSP and FBSCPT approaches showed to be more robust to feature covariance shift. SSA can improve the models performance and reduce accuracy decline from calibration to test set.</description><subject>Algorithms</subject><subject>BCI</subject><subject>Brain-Computer Interfaces</subject><subject>Covariance shift</subject><subject>EEG</subject><subject>Electroencephalography</subject><subject>Humans</subject><subject>Imagination</subject><subject>Motor-imagery</subject><subject>Signal Processing, Computer-Assisted</subject><subject>Spatial filtering</subject><issn>0169-2607</issn><issn>1872-7565</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNp9kL1OwzAURi0EoqXwAgzII0uK7cSJi1igKlCpEgvMluNcU1f5w06K-vY4SmFksq51vk_3HoSuKZlTQtO73VxXbT5nhA0fXBBxgqZUZCzKeMpP0TRAi4ilJJugC-93hBDGeXqOJnFMeZZkZIrUyhjQHW4MbptvcNiA6noHWDd75ayqNWC_tSYQNX5arrFvVWdVGRlbduBs_Yk70NvafvXg7_FjyFWtcoHZh2DXF4dLdGZU6eHq-M7Qx_Pqffkabd5e1svHTaQTQrrIFDGDQvAMcmqoMmmqY5EvDOE0TlSWccE4TUCpPKF6kQOlJDcEOAMIc5HHM3Q79rauGZbpZGW9hrJUNTS9lyzhQY0QIgkoG1HtGu8dGNk6Wyl3kJTIQa3cyUGtHNTKUW0I3Rz7-7yC4i_y6zIADyMA4cq9BSe9thAEFtYFxbJo7H_9PzkkiyE</recordid><startdate>202101</startdate><enddate>202101</enddate><creator>Miladinović, Aleksandar</creator><creator>Ajčević, Miloš</creator><creator>Jarmolowska, Joanna</creator><creator>Marusic, Uros</creator><creator>Colussi, Marco</creator><creator>Silveri, Giulia</creator><creator>Battaglini, Piero Paolo</creator><creator>Accardo, Agostino</creator><general>Elsevier B.V</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0003-3761-1983</orcidid></search><sort><creationdate>202101</creationdate><title>Effect of power feature covariance shift on BCI spatial-filtering techniques: A comparative study</title><author>Miladinović, Aleksandar ; Ajčević, Miloš ; Jarmolowska, Joanna ; Marusic, Uros ; Colussi, Marco ; Silveri, Giulia ; Battaglini, Piero Paolo ; Accardo, Agostino</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c400t-fd32ed857eb1f1af66c38b9f05134a77582514eaab41c9be110bf0e52ee1c9db3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Algorithms</topic><topic>BCI</topic><topic>Brain-Computer Interfaces</topic><topic>Covariance shift</topic><topic>EEG</topic><topic>Electroencephalography</topic><topic>Humans</topic><topic>Imagination</topic><topic>Motor-imagery</topic><topic>Signal Processing, Computer-Assisted</topic><topic>Spatial filtering</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Miladinović, Aleksandar</creatorcontrib><creatorcontrib>Ajčević, Miloš</creatorcontrib><creatorcontrib>Jarmolowska, Joanna</creatorcontrib><creatorcontrib>Marusic, Uros</creatorcontrib><creatorcontrib>Colussi, Marco</creatorcontrib><creatorcontrib>Silveri, Giulia</creatorcontrib><creatorcontrib>Battaglini, Piero Paolo</creatorcontrib><creatorcontrib>Accardo, Agostino</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Computer methods and programs in biomedicine</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Miladinović, Aleksandar</au><au>Ajčević, Miloš</au><au>Jarmolowska, Joanna</au><au>Marusic, Uros</au><au>Colussi, Marco</au><au>Silveri, Giulia</au><au>Battaglini, Piero Paolo</au><au>Accardo, Agostino</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Effect of power feature covariance shift on BCI spatial-filtering techniques: A comparative study</atitle><jtitle>Computer methods and programs in biomedicine</jtitle><addtitle>Comput Methods Programs Biomed</addtitle><date>2021-01</date><risdate>2021</risdate><volume>198</volume><spage>105808</spage><epage>105808</epage><pages>105808-105808</pages><artnum>105808</artnum><issn>0169-2607</issn><eissn>1872-7565</eissn><abstract>•This study investigates the performance of several spatial-filtering approaches on calibration and test set acquired 30 min after the calibration, mimicking the real BCI scenarios.•EEG extracted feature covariance shifts lead to the BCI model accuracy deterioration, even after 30 min of a break.•FBCSP and FBSCPT showed to be more robust to feature covariance shift largely maintaining the original performance characterized by moderately high accuracy (>70%).•Stationary Subspace Analysis preprocessing improved the models’ performance and also reduced the gap between calibration and test set observed BCI model accuracies.
The input data distributions of EEG-based BCI systems can change during intra-session transitions due to nonstationarity caused by features covariate shifts, thus compromising BCI performance.
We aimed to identify the most robust spatial filtering approach, among most used methods, testing them on calibration dataset, and test dataset recorded 30 min afterwards. In addition, we also investigated if their performance improved after application of Stationary Subspace Analysis (SSA).
We have recorded, in 17 healthy subjects, the calibration set at the beginning of the upper limb motor imagery BCI experiment and testing set separately 30 min afterwards. Both the calibration and test data were pre-processed and the BCI models were produced by using several spatial filtering approaches on the calibration set. Those models were subsequently evaluated on a test set. The differences between the accuracy estimated by cross-validation on the calibration dataset and the accuracy on the test dataset were investigated. The same procedure was performed with, and without SSA pre-processing step.
A significant reduction in accuracy on the test dataset was observed for CSP, SPoC and SpecRCSP approaches. For SLap and SpecCSP only a slight decreasing trend was observed, while FBCSP and FBCSPT largely maintained moderately high median accuracy >70%. In the case of application of SSA pre-processing, the differences between accuracy observed on calibration and test dataset were reduced. In addition, accuracy values both on calibration and test set were slightly higher in case of SSA pre-processing and also in this case FBCSP and FBCSPT presented slightly better performance compared to other methods.
The intrinsic signal nonstationarity characteristics, caused by covariance shifts of power features, reduced the accuracy of BCI model, therefore, suggesting that this evaluation framework should be considered for testing and simulating real life performance. FBCSP and FBSCPT approaches showed to be more robust to feature covariance shift. SSA can improve the models performance and reduce accuracy decline from calibration to test set.</abstract><cop>Ireland</cop><pub>Elsevier B.V</pub><pmid>33157470</pmid><doi>10.1016/j.cmpb.2020.105808</doi><tpages>1</tpages><orcidid>https://orcid.org/0000-0003-3761-1983</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0169-2607 |
ispartof | Computer methods and programs in biomedicine, 2021-01, Vol.198, p.105808-105808, Article 105808 |
issn | 0169-2607 1872-7565 |
language | eng |
recordid | cdi_proquest_miscellaneous_2458728884 |
source | MEDLINE; Access via ScienceDirect (Elsevier) |
subjects | Algorithms BCI Brain-Computer Interfaces Covariance shift EEG Electroencephalography Humans Imagination Motor-imagery Signal Processing, Computer-Assisted Spatial filtering |
title | Effect of power feature covariance shift on BCI spatial-filtering techniques: A comparative study |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-22T10%3A57%3A50IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Effect%20of%20power%20feature%20covariance%20shift%20on%20BCI%20spatial-filtering%20techniques:%20A%20comparative%20study&rft.jtitle=Computer%20methods%20and%20programs%20in%20biomedicine&rft.au=Miladinovi%C4%87,%20Aleksandar&rft.date=2021-01&rft.volume=198&rft.spage=105808&rft.epage=105808&rft.pages=105808-105808&rft.artnum=105808&rft.issn=0169-2607&rft.eissn=1872-7565&rft_id=info:doi/10.1016/j.cmpb.2020.105808&rft_dat=%3Cproquest_cross%3E2458728884%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2458728884&rft_id=info:pmid/33157470&rft_els_id=S0169260720316412&rfr_iscdi=true |