Effect of power feature covariance shift on BCI spatial-filtering techniques: A comparative study

•This study investigates the performance of several spatial-filtering approaches on calibration and test set acquired 30 min after the calibration, mimicking the real BCI scenarios.•EEG extracted feature covariance shifts lead to the BCI model accuracy deterioration, even after 30 min of a break.•FB...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Computer methods and programs in biomedicine 2021-01, Vol.198, p.105808-105808, Article 105808
Hauptverfasser: Miladinović, Aleksandar, Ajčević, Miloš, Jarmolowska, Joanna, Marusic, Uros, Colussi, Marco, Silveri, Giulia, Battaglini, Piero Paolo, Accardo, Agostino
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 105808
container_issue
container_start_page 105808
container_title Computer methods and programs in biomedicine
container_volume 198
creator Miladinović, Aleksandar
Ajčević, Miloš
Jarmolowska, Joanna
Marusic, Uros
Colussi, Marco
Silveri, Giulia
Battaglini, Piero Paolo
Accardo, Agostino
description •This study investigates the performance of several spatial-filtering approaches on calibration and test set acquired 30 min after the calibration, mimicking the real BCI scenarios.•EEG extracted feature covariance shifts lead to the BCI model accuracy deterioration, even after 30 min of a break.•FBCSP and FBSCPT showed to be more robust to feature covariance shift largely maintaining the original performance characterized by moderately high accuracy (>70%).•Stationary Subspace Analysis preprocessing improved the models’ performance and also reduced the gap between calibration and test set observed BCI model accuracies. The input data distributions of EEG-based BCI systems can change during intra-session transitions due to nonstationarity caused by features covariate shifts, thus compromising BCI performance. We aimed to identify the most robust spatial filtering approach, among most used methods, testing them on calibration dataset, and test dataset recorded 30 min afterwards. In addition, we also investigated if their performance improved after application of Stationary Subspace Analysis (SSA). We have recorded, in 17 healthy subjects, the calibration set at the beginning of the upper limb motor imagery BCI experiment and testing set separately 30 min afterwards. Both the calibration and test data were pre-processed and the BCI models were produced by using several spatial filtering approaches on the calibration set. Those models were subsequently evaluated on a test set. The differences between the accuracy estimated by cross-validation on the calibration dataset and the accuracy on the test dataset were investigated. The same procedure was performed with, and without SSA pre-processing step. A significant reduction in accuracy on the test dataset was observed for CSP, SPoC and SpecRCSP approaches. For SLap and SpecCSP only a slight decreasing trend was observed, while FBCSP and FBCSPT largely maintained moderately high median accuracy >70%. In the case of application of SSA pre-processing, the differences between accuracy observed on calibration and test dataset were reduced. In addition, accuracy values both on calibration and test set were slightly higher in case of SSA pre-processing and also in this case FBCSP and FBCSPT presented slightly better performance compared to other methods. The intrinsic signal nonstationarity characteristics, caused by covariance shifts of power features, reduced the accuracy of BCI model, therefore, suggesting that thi
doi_str_mv 10.1016/j.cmpb.2020.105808
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2458728884</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0169260720316412</els_id><sourcerecordid>2458728884</sourcerecordid><originalsourceid>FETCH-LOGICAL-c400t-fd32ed857eb1f1af66c38b9f05134a77582514eaab41c9be110bf0e52ee1c9db3</originalsourceid><addsrcrecordid>eNp9kL1OwzAURi0EoqXwAgzII0uK7cSJi1igKlCpEgvMluNcU1f5w06K-vY4SmFksq51vk_3HoSuKZlTQtO73VxXbT5nhA0fXBBxgqZUZCzKeMpP0TRAi4ilJJugC-93hBDGeXqOJnFMeZZkZIrUyhjQHW4MbptvcNiA6noHWDd75ayqNWC_tSYQNX5arrFvVWdVGRlbduBs_Yk70NvafvXg7_FjyFWtcoHZh2DXF4dLdGZU6eHq-M7Qx_Pqffkabd5e1svHTaQTQrrIFDGDQvAMcmqoMmmqY5EvDOE0TlSWccE4TUCpPKF6kQOlJDcEOAMIc5HHM3Q79rauGZbpZGW9hrJUNTS9lyzhQY0QIgkoG1HtGu8dGNk6Wyl3kJTIQa3cyUGtHNTKUW0I3Rz7-7yC4i_y6zIADyMA4cq9BSe9thAEFtYFxbJo7H_9PzkkiyE</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2458728884</pqid></control><display><type>article</type><title>Effect of power feature covariance shift on BCI spatial-filtering techniques: A comparative study</title><source>MEDLINE</source><source>Access via ScienceDirect (Elsevier)</source><creator>Miladinović, Aleksandar ; Ajčević, Miloš ; Jarmolowska, Joanna ; Marusic, Uros ; Colussi, Marco ; Silveri, Giulia ; Battaglini, Piero Paolo ; Accardo, Agostino</creator><creatorcontrib>Miladinović, Aleksandar ; Ajčević, Miloš ; Jarmolowska, Joanna ; Marusic, Uros ; Colussi, Marco ; Silveri, Giulia ; Battaglini, Piero Paolo ; Accardo, Agostino</creatorcontrib><description>•This study investigates the performance of several spatial-filtering approaches on calibration and test set acquired 30 min after the calibration, mimicking the real BCI scenarios.•EEG extracted feature covariance shifts lead to the BCI model accuracy deterioration, even after 30 min of a break.•FBCSP and FBSCPT showed to be more robust to feature covariance shift largely maintaining the original performance characterized by moderately high accuracy (&gt;70%).•Stationary Subspace Analysis preprocessing improved the models’ performance and also reduced the gap between calibration and test set observed BCI model accuracies. The input data distributions of EEG-based BCI systems can change during intra-session transitions due to nonstationarity caused by features covariate shifts, thus compromising BCI performance. We aimed to identify the most robust spatial filtering approach, among most used methods, testing them on calibration dataset, and test dataset recorded 30 min afterwards. In addition, we also investigated if their performance improved after application of Stationary Subspace Analysis (SSA). We have recorded, in 17 healthy subjects, the calibration set at the beginning of the upper limb motor imagery BCI experiment and testing set separately 30 min afterwards. Both the calibration and test data were pre-processed and the BCI models were produced by using several spatial filtering approaches on the calibration set. Those models were subsequently evaluated on a test set. The differences between the accuracy estimated by cross-validation on the calibration dataset and the accuracy on the test dataset were investigated. The same procedure was performed with, and without SSA pre-processing step. A significant reduction in accuracy on the test dataset was observed for CSP, SPoC and SpecRCSP approaches. For SLap and SpecCSP only a slight decreasing trend was observed, while FBCSP and FBCSPT largely maintained moderately high median accuracy &gt;70%. In the case of application of SSA pre-processing, the differences between accuracy observed on calibration and test dataset were reduced. In addition, accuracy values both on calibration and test set were slightly higher in case of SSA pre-processing and also in this case FBCSP and FBCSPT presented slightly better performance compared to other methods. The intrinsic signal nonstationarity characteristics, caused by covariance shifts of power features, reduced the accuracy of BCI model, therefore, suggesting that this evaluation framework should be considered for testing and simulating real life performance. FBCSP and FBSCPT approaches showed to be more robust to feature covariance shift. SSA can improve the models performance and reduce accuracy decline from calibration to test set.</description><identifier>ISSN: 0169-2607</identifier><identifier>EISSN: 1872-7565</identifier><identifier>DOI: 10.1016/j.cmpb.2020.105808</identifier><identifier>PMID: 33157470</identifier><language>eng</language><publisher>Ireland: Elsevier B.V</publisher><subject>Algorithms ; BCI ; Brain-Computer Interfaces ; Covariance shift ; EEG ; Electroencephalography ; Humans ; Imagination ; Motor-imagery ; Signal Processing, Computer-Assisted ; Spatial filtering</subject><ispartof>Computer methods and programs in biomedicine, 2021-01, Vol.198, p.105808-105808, Article 105808</ispartof><rights>2020</rights><rights>Copyright © 2020. Published by Elsevier B.V.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c400t-fd32ed857eb1f1af66c38b9f05134a77582514eaab41c9be110bf0e52ee1c9db3</citedby><cites>FETCH-LOGICAL-c400t-fd32ed857eb1f1af66c38b9f05134a77582514eaab41c9be110bf0e52ee1c9db3</cites><orcidid>0000-0003-3761-1983</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.cmpb.2020.105808$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/33157470$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Miladinović, Aleksandar</creatorcontrib><creatorcontrib>Ajčević, Miloš</creatorcontrib><creatorcontrib>Jarmolowska, Joanna</creatorcontrib><creatorcontrib>Marusic, Uros</creatorcontrib><creatorcontrib>Colussi, Marco</creatorcontrib><creatorcontrib>Silveri, Giulia</creatorcontrib><creatorcontrib>Battaglini, Piero Paolo</creatorcontrib><creatorcontrib>Accardo, Agostino</creatorcontrib><title>Effect of power feature covariance shift on BCI spatial-filtering techniques: A comparative study</title><title>Computer methods and programs in biomedicine</title><addtitle>Comput Methods Programs Biomed</addtitle><description>•This study investigates the performance of several spatial-filtering approaches on calibration and test set acquired 30 min after the calibration, mimicking the real BCI scenarios.•EEG extracted feature covariance shifts lead to the BCI model accuracy deterioration, even after 30 min of a break.•FBCSP and FBSCPT showed to be more robust to feature covariance shift largely maintaining the original performance characterized by moderately high accuracy (&gt;70%).•Stationary Subspace Analysis preprocessing improved the models’ performance and also reduced the gap between calibration and test set observed BCI model accuracies. The input data distributions of EEG-based BCI systems can change during intra-session transitions due to nonstationarity caused by features covariate shifts, thus compromising BCI performance. We aimed to identify the most robust spatial filtering approach, among most used methods, testing them on calibration dataset, and test dataset recorded 30 min afterwards. In addition, we also investigated if their performance improved after application of Stationary Subspace Analysis (SSA). We have recorded, in 17 healthy subjects, the calibration set at the beginning of the upper limb motor imagery BCI experiment and testing set separately 30 min afterwards. Both the calibration and test data were pre-processed and the BCI models were produced by using several spatial filtering approaches on the calibration set. Those models were subsequently evaluated on a test set. The differences between the accuracy estimated by cross-validation on the calibration dataset and the accuracy on the test dataset were investigated. The same procedure was performed with, and without SSA pre-processing step. A significant reduction in accuracy on the test dataset was observed for CSP, SPoC and SpecRCSP approaches. For SLap and SpecCSP only a slight decreasing trend was observed, while FBCSP and FBCSPT largely maintained moderately high median accuracy &gt;70%. In the case of application of SSA pre-processing, the differences between accuracy observed on calibration and test dataset were reduced. In addition, accuracy values both on calibration and test set were slightly higher in case of SSA pre-processing and also in this case FBCSP and FBCSPT presented slightly better performance compared to other methods. The intrinsic signal nonstationarity characteristics, caused by covariance shifts of power features, reduced the accuracy of BCI model, therefore, suggesting that this evaluation framework should be considered for testing and simulating real life performance. FBCSP and FBSCPT approaches showed to be more robust to feature covariance shift. SSA can improve the models performance and reduce accuracy decline from calibration to test set.</description><subject>Algorithms</subject><subject>BCI</subject><subject>Brain-Computer Interfaces</subject><subject>Covariance shift</subject><subject>EEG</subject><subject>Electroencephalography</subject><subject>Humans</subject><subject>Imagination</subject><subject>Motor-imagery</subject><subject>Signal Processing, Computer-Assisted</subject><subject>Spatial filtering</subject><issn>0169-2607</issn><issn>1872-7565</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNp9kL1OwzAURi0EoqXwAgzII0uK7cSJi1igKlCpEgvMluNcU1f5w06K-vY4SmFksq51vk_3HoSuKZlTQtO73VxXbT5nhA0fXBBxgqZUZCzKeMpP0TRAi4ilJJugC-93hBDGeXqOJnFMeZZkZIrUyhjQHW4MbptvcNiA6noHWDd75ayqNWC_tSYQNX5arrFvVWdVGRlbduBs_Yk70NvafvXg7_FjyFWtcoHZh2DXF4dLdGZU6eHq-M7Qx_Pqffkabd5e1svHTaQTQrrIFDGDQvAMcmqoMmmqY5EvDOE0TlSWccE4TUCpPKF6kQOlJDcEOAMIc5HHM3Q79rauGZbpZGW9hrJUNTS9lyzhQY0QIgkoG1HtGu8dGNk6Wyl3kJTIQa3cyUGtHNTKUW0I3Rz7-7yC4i_y6zIADyMA4cq9BSe9thAEFtYFxbJo7H_9PzkkiyE</recordid><startdate>202101</startdate><enddate>202101</enddate><creator>Miladinović, Aleksandar</creator><creator>Ajčević, Miloš</creator><creator>Jarmolowska, Joanna</creator><creator>Marusic, Uros</creator><creator>Colussi, Marco</creator><creator>Silveri, Giulia</creator><creator>Battaglini, Piero Paolo</creator><creator>Accardo, Agostino</creator><general>Elsevier B.V</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0003-3761-1983</orcidid></search><sort><creationdate>202101</creationdate><title>Effect of power feature covariance shift on BCI spatial-filtering techniques: A comparative study</title><author>Miladinović, Aleksandar ; Ajčević, Miloš ; Jarmolowska, Joanna ; Marusic, Uros ; Colussi, Marco ; Silveri, Giulia ; Battaglini, Piero Paolo ; Accardo, Agostino</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c400t-fd32ed857eb1f1af66c38b9f05134a77582514eaab41c9be110bf0e52ee1c9db3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Algorithms</topic><topic>BCI</topic><topic>Brain-Computer Interfaces</topic><topic>Covariance shift</topic><topic>EEG</topic><topic>Electroencephalography</topic><topic>Humans</topic><topic>Imagination</topic><topic>Motor-imagery</topic><topic>Signal Processing, Computer-Assisted</topic><topic>Spatial filtering</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Miladinović, Aleksandar</creatorcontrib><creatorcontrib>Ajčević, Miloš</creatorcontrib><creatorcontrib>Jarmolowska, Joanna</creatorcontrib><creatorcontrib>Marusic, Uros</creatorcontrib><creatorcontrib>Colussi, Marco</creatorcontrib><creatorcontrib>Silveri, Giulia</creatorcontrib><creatorcontrib>Battaglini, Piero Paolo</creatorcontrib><creatorcontrib>Accardo, Agostino</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Computer methods and programs in biomedicine</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Miladinović, Aleksandar</au><au>Ajčević, Miloš</au><au>Jarmolowska, Joanna</au><au>Marusic, Uros</au><au>Colussi, Marco</au><au>Silveri, Giulia</au><au>Battaglini, Piero Paolo</au><au>Accardo, Agostino</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Effect of power feature covariance shift on BCI spatial-filtering techniques: A comparative study</atitle><jtitle>Computer methods and programs in biomedicine</jtitle><addtitle>Comput Methods Programs Biomed</addtitle><date>2021-01</date><risdate>2021</risdate><volume>198</volume><spage>105808</spage><epage>105808</epage><pages>105808-105808</pages><artnum>105808</artnum><issn>0169-2607</issn><eissn>1872-7565</eissn><abstract>•This study investigates the performance of several spatial-filtering approaches on calibration and test set acquired 30 min after the calibration, mimicking the real BCI scenarios.•EEG extracted feature covariance shifts lead to the BCI model accuracy deterioration, even after 30 min of a break.•FBCSP and FBSCPT showed to be more robust to feature covariance shift largely maintaining the original performance characterized by moderately high accuracy (&gt;70%).•Stationary Subspace Analysis preprocessing improved the models’ performance and also reduced the gap between calibration and test set observed BCI model accuracies. The input data distributions of EEG-based BCI systems can change during intra-session transitions due to nonstationarity caused by features covariate shifts, thus compromising BCI performance. We aimed to identify the most robust spatial filtering approach, among most used methods, testing them on calibration dataset, and test dataset recorded 30 min afterwards. In addition, we also investigated if their performance improved after application of Stationary Subspace Analysis (SSA). We have recorded, in 17 healthy subjects, the calibration set at the beginning of the upper limb motor imagery BCI experiment and testing set separately 30 min afterwards. Both the calibration and test data were pre-processed and the BCI models were produced by using several spatial filtering approaches on the calibration set. Those models were subsequently evaluated on a test set. The differences between the accuracy estimated by cross-validation on the calibration dataset and the accuracy on the test dataset were investigated. The same procedure was performed with, and without SSA pre-processing step. A significant reduction in accuracy on the test dataset was observed for CSP, SPoC and SpecRCSP approaches. For SLap and SpecCSP only a slight decreasing trend was observed, while FBCSP and FBCSPT largely maintained moderately high median accuracy &gt;70%. In the case of application of SSA pre-processing, the differences between accuracy observed on calibration and test dataset were reduced. In addition, accuracy values both on calibration and test set were slightly higher in case of SSA pre-processing and also in this case FBCSP and FBCSPT presented slightly better performance compared to other methods. The intrinsic signal nonstationarity characteristics, caused by covariance shifts of power features, reduced the accuracy of BCI model, therefore, suggesting that this evaluation framework should be considered for testing and simulating real life performance. FBCSP and FBSCPT approaches showed to be more robust to feature covariance shift. SSA can improve the models performance and reduce accuracy decline from calibration to test set.</abstract><cop>Ireland</cop><pub>Elsevier B.V</pub><pmid>33157470</pmid><doi>10.1016/j.cmpb.2020.105808</doi><tpages>1</tpages><orcidid>https://orcid.org/0000-0003-3761-1983</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0169-2607
ispartof Computer methods and programs in biomedicine, 2021-01, Vol.198, p.105808-105808, Article 105808
issn 0169-2607
1872-7565
language eng
recordid cdi_proquest_miscellaneous_2458728884
source MEDLINE; Access via ScienceDirect (Elsevier)
subjects Algorithms
BCI
Brain-Computer Interfaces
Covariance shift
EEG
Electroencephalography
Humans
Imagination
Motor-imagery
Signal Processing, Computer-Assisted
Spatial filtering
title Effect of power feature covariance shift on BCI spatial-filtering techniques: A comparative study
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-22T10%3A57%3A50IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Effect%20of%20power%20feature%20covariance%20shift%20on%20BCI%20spatial-filtering%20techniques:%20A%20comparative%20study&rft.jtitle=Computer%20methods%20and%20programs%20in%20biomedicine&rft.au=Miladinovi%C4%87,%20Aleksandar&rft.date=2021-01&rft.volume=198&rft.spage=105808&rft.epage=105808&rft.pages=105808-105808&rft.artnum=105808&rft.issn=0169-2607&rft.eissn=1872-7565&rft_id=info:doi/10.1016/j.cmpb.2020.105808&rft_dat=%3Cproquest_cross%3E2458728884%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2458728884&rft_id=info:pmid/33157470&rft_els_id=S0169260720316412&rfr_iscdi=true