Automated Motor Tic Detection: A Machine Learning Approach

Background Video‐based tic detection and scoring is useful to independently and objectively assess tic frequency and severity in patients with Tourette syndrome. In trained raters, interrater reliability is good. However, video ratings are time‐consuming and cumbersome, particularly in large‐scale s...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Movement disorders 2023-07, Vol.38 (7), p.1327-1335
Hauptverfasser: Brügge, Nele Sophie, Sallandt, Gesine Marie, Schappert, Ronja, Li, Frédéric, Siekmann, Alina, Grzegorzek, Marcin, Bäumer, Tobias, Frings, Christian, Beste, Christian, Stenger, Roland, Roessner, Veit, Fudickar, Sebastian, Handels, Heinz, Münchau, Alexander
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 1335
container_issue 7
container_start_page 1327
container_title Movement disorders
container_volume 38
creator Brügge, Nele Sophie
Sallandt, Gesine Marie
Schappert, Ronja
Li, Frédéric
Siekmann, Alina
Grzegorzek, Marcin
Bäumer, Tobias
Frings, Christian
Beste, Christian
Stenger, Roland
Roessner, Veit
Fudickar, Sebastian
Handels, Heinz
Münchau, Alexander
description Background Video‐based tic detection and scoring is useful to independently and objectively assess tic frequency and severity in patients with Tourette syndrome. In trained raters, interrater reliability is good. However, video ratings are time‐consuming and cumbersome, particularly in large‐scale studies. Therefore, we developed two machine learning (ML) algorithms for automatic tic detection. Objective The aim of this study was to evaluate the performances of state‐of‐the‐art ML approaches for automatic video‐based tic detection in patients with Tourette syndrome. Methods We used 64 videos of n = 35 patients with Tourette syndrome. The data of six subjects (15 videos with ratings) were used as a validation set for hyperparameter optimization. For the binary classification task to distinguish between tic and no‐tic segments, we established two different supervised learning approaches. First, we manually extracted features based on landmarks, which served as input for a Random Forest classifier (Random Forest). Second, a fully automated deep learning approach was used, where regions of interest in video snippets were input to a convolutional neural network (deep neural network). Results Tic detection F1 scores (and accuracy) were 82.0% (88.4%) in the Random Forest and 79.5% (88.5%) in the deep neural network approach. Conclusions ML algorithms for automatic tic detection based on video recordings are feasible and reliable and could thus become a valuable assessment tool, for example, for objective tic measurements in clinical trials. ML algorithms might also be useful for the differential diagnosis of tics. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society. Our article confirms that video‐based motor tic detection using machine learning is possible and feasible. We have developed two separate classifiers, a Random Forest classifier and a deep neural network. We found comparable high F1 scores (up to 82%) in both approaches.
doi_str_mv 10.1002/mds.29439
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2812506131</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2812506131</sourcerecordid><originalsourceid>FETCH-LOGICAL-c3889-5d7de1ad903f28825e09d67da86fcce5e051685d010a363641b0df5e2f51f7e53</originalsourceid><addsrcrecordid>eNp10E9LwzAYBvAgipvTg19ACl70UJc3adJ0t7L5DzY8OM8lS95qx9rOpkX27Y12ehA8hYQfTx4eQs6B3gClbFxad8OSiCcHZAiCQ6iYiA_JkColQg5KDMiJc2tKAQTIYzLgMUjJYjUkk7Rr61K3aINF3dZNsCxMMMMWTVvU1SRIg4U2b0WFwRx1UxXVa5But03tH0_JUa43Ds_254i83N0upw_h_On-cZrOQ8OVSkJhY4ugbUJ5zpRvhjSxMrZaydwY9FffSQlLgWouuYxgRW0ukOUC8hgFH5GrPtd_-96ha7OycAY3G11h3bmMKWCCSuDg6eUfuq67pvLtvIo4jUBJ6dV1r0xTO9dgnm2botTNLgOafQ2a-UGz70G9vdgndqsS7a_8WdCDcQ8-ig3u_k_KFrPnPvITECN8og</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2843041866</pqid></control><display><type>article</type><title>Automated Motor Tic Detection: A Machine Learning Approach</title><source>MEDLINE</source><source>Wiley Online Library Journals Frontfile Complete</source><creator>Brügge, Nele Sophie ; Sallandt, Gesine Marie ; Schappert, Ronja ; Li, Frédéric ; Siekmann, Alina ; Grzegorzek, Marcin ; Bäumer, Tobias ; Frings, Christian ; Beste, Christian ; Stenger, Roland ; Roessner, Veit ; Fudickar, Sebastian ; Handels, Heinz ; Münchau, Alexander</creator><creatorcontrib>Brügge, Nele Sophie ; Sallandt, Gesine Marie ; Schappert, Ronja ; Li, Frédéric ; Siekmann, Alina ; Grzegorzek, Marcin ; Bäumer, Tobias ; Frings, Christian ; Beste, Christian ; Stenger, Roland ; Roessner, Veit ; Fudickar, Sebastian ; Handels, Heinz ; Münchau, Alexander</creatorcontrib><description>Background Video‐based tic detection and scoring is useful to independently and objectively assess tic frequency and severity in patients with Tourette syndrome. In trained raters, interrater reliability is good. However, video ratings are time‐consuming and cumbersome, particularly in large‐scale studies. Therefore, we developed two machine learning (ML) algorithms for automatic tic detection. Objective The aim of this study was to evaluate the performances of state‐of‐the‐art ML approaches for automatic video‐based tic detection in patients with Tourette syndrome. Methods We used 64 videos of n = 35 patients with Tourette syndrome. The data of six subjects (15 videos with ratings) were used as a validation set for hyperparameter optimization. For the binary classification task to distinguish between tic and no‐tic segments, we established two different supervised learning approaches. First, we manually extracted features based on landmarks, which served as input for a Random Forest classifier (Random Forest). Second, a fully automated deep learning approach was used, where regions of interest in video snippets were input to a convolutional neural network (deep neural network). Results Tic detection F1 scores (and accuracy) were 82.0% (88.4%) in the Random Forest and 79.5% (88.5%) in the deep neural network approach. Conclusions ML algorithms for automatic tic detection based on video recordings are feasible and reliable and could thus become a valuable assessment tool, for example, for objective tic measurements in clinical trials. ML algorithms might also be useful for the differential diagnosis of tics. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society. Our article confirms that video‐based motor tic detection using machine learning is possible and feasible. We have developed two separate classifiers, a Random Forest classifier and a deep neural network. We found comparable high F1 scores (up to 82%) in both approaches.</description><identifier>ISSN: 0885-3185</identifier><identifier>EISSN: 1531-8257</identifier><identifier>DOI: 10.1002/mds.29439</identifier><identifier>PMID: 37166278</identifier><language>eng</language><publisher>Hoboken, USA: John Wiley &amp; Sons, Inc</publisher><subject>Algorithms ; Automation ; Clinical trials ; Deep learning ; deep neural networks ; Differential diagnosis ; Face Mesh ; Gilles de la Tourette syndrome ; Humans ; Learning algorithms ; Machine Learning ; Movement disorders ; Neural networks ; Random Forest ; Reproducibility of Results ; tic detection ; Tic Disorders - diagnosis ; Tics - diagnosis ; Tourette syndrome ; Tourette Syndrome - diagnosis</subject><ispartof>Movement disorders, 2023-07, Vol.38 (7), p.1327-1335</ispartof><rights>2023 The Authors. published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.</rights><rights>2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.</rights><rights>2023. This article is published under http://creativecommons.org/licenses/by-nc-nd/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c3889-5d7de1ad903f28825e09d67da86fcce5e051685d010a363641b0df5e2f51f7e53</citedby><cites>FETCH-LOGICAL-c3889-5d7de1ad903f28825e09d67da86fcce5e051685d010a363641b0df5e2f51f7e53</cites><orcidid>0000-0002-3219-2284</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1002%2Fmds.29439$$EPDF$$P50$$Gwiley$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1002%2Fmds.29439$$EHTML$$P50$$Gwiley$$Hfree_for_read</linktohtml><link.rule.ids>314,776,780,1411,27903,27904,45553,45554</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/37166278$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Brügge, Nele Sophie</creatorcontrib><creatorcontrib>Sallandt, Gesine Marie</creatorcontrib><creatorcontrib>Schappert, Ronja</creatorcontrib><creatorcontrib>Li, Frédéric</creatorcontrib><creatorcontrib>Siekmann, Alina</creatorcontrib><creatorcontrib>Grzegorzek, Marcin</creatorcontrib><creatorcontrib>Bäumer, Tobias</creatorcontrib><creatorcontrib>Frings, Christian</creatorcontrib><creatorcontrib>Beste, Christian</creatorcontrib><creatorcontrib>Stenger, Roland</creatorcontrib><creatorcontrib>Roessner, Veit</creatorcontrib><creatorcontrib>Fudickar, Sebastian</creatorcontrib><creatorcontrib>Handels, Heinz</creatorcontrib><creatorcontrib>Münchau, Alexander</creatorcontrib><title>Automated Motor Tic Detection: A Machine Learning Approach</title><title>Movement disorders</title><addtitle>Mov Disord</addtitle><description>Background Video‐based tic detection and scoring is useful to independently and objectively assess tic frequency and severity in patients with Tourette syndrome. In trained raters, interrater reliability is good. However, video ratings are time‐consuming and cumbersome, particularly in large‐scale studies. Therefore, we developed two machine learning (ML) algorithms for automatic tic detection. Objective The aim of this study was to evaluate the performances of state‐of‐the‐art ML approaches for automatic video‐based tic detection in patients with Tourette syndrome. Methods We used 64 videos of n = 35 patients with Tourette syndrome. The data of six subjects (15 videos with ratings) were used as a validation set for hyperparameter optimization. For the binary classification task to distinguish between tic and no‐tic segments, we established two different supervised learning approaches. First, we manually extracted features based on landmarks, which served as input for a Random Forest classifier (Random Forest). Second, a fully automated deep learning approach was used, where regions of interest in video snippets were input to a convolutional neural network (deep neural network). Results Tic detection F1 scores (and accuracy) were 82.0% (88.4%) in the Random Forest and 79.5% (88.5%) in the deep neural network approach. Conclusions ML algorithms for automatic tic detection based on video recordings are feasible and reliable and could thus become a valuable assessment tool, for example, for objective tic measurements in clinical trials. ML algorithms might also be useful for the differential diagnosis of tics. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society. Our article confirms that video‐based motor tic detection using machine learning is possible and feasible. We have developed two separate classifiers, a Random Forest classifier and a deep neural network. We found comparable high F1 scores (up to 82%) in both approaches.</description><subject>Algorithms</subject><subject>Automation</subject><subject>Clinical trials</subject><subject>Deep learning</subject><subject>deep neural networks</subject><subject>Differential diagnosis</subject><subject>Face Mesh</subject><subject>Gilles de la Tourette syndrome</subject><subject>Humans</subject><subject>Learning algorithms</subject><subject>Machine Learning</subject><subject>Movement disorders</subject><subject>Neural networks</subject><subject>Random Forest</subject><subject>Reproducibility of Results</subject><subject>tic detection</subject><subject>Tic Disorders - diagnosis</subject><subject>Tics - diagnosis</subject><subject>Tourette syndrome</subject><subject>Tourette Syndrome - diagnosis</subject><issn>0885-3185</issn><issn>1531-8257</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>24P</sourceid><sourceid>WIN</sourceid><sourceid>EIF</sourceid><recordid>eNp10E9LwzAYBvAgipvTg19ACl70UJc3adJ0t7L5DzY8OM8lS95qx9rOpkX27Y12ehA8hYQfTx4eQs6B3gClbFxad8OSiCcHZAiCQ6iYiA_JkColQg5KDMiJc2tKAQTIYzLgMUjJYjUkk7Rr61K3aINF3dZNsCxMMMMWTVvU1SRIg4U2b0WFwRx1UxXVa5But03tH0_JUa43Ds_254i83N0upw_h_On-cZrOQ8OVSkJhY4ugbUJ5zpRvhjSxMrZaydwY9FffSQlLgWouuYxgRW0ukOUC8hgFH5GrPtd_-96ha7OycAY3G11h3bmMKWCCSuDg6eUfuq67pvLtvIo4jUBJ6dV1r0xTO9dgnm2botTNLgOafQ2a-UGz70G9vdgndqsS7a_8WdCDcQ8-ig3u_k_KFrPnPvITECN8og</recordid><startdate>202307</startdate><enddate>202307</enddate><creator>Brügge, Nele Sophie</creator><creator>Sallandt, Gesine Marie</creator><creator>Schappert, Ronja</creator><creator>Li, Frédéric</creator><creator>Siekmann, Alina</creator><creator>Grzegorzek, Marcin</creator><creator>Bäumer, Tobias</creator><creator>Frings, Christian</creator><creator>Beste, Christian</creator><creator>Stenger, Roland</creator><creator>Roessner, Veit</creator><creator>Fudickar, Sebastian</creator><creator>Handels, Heinz</creator><creator>Münchau, Alexander</creator><general>John Wiley &amp; Sons, Inc</general><general>Wiley Subscription Services, Inc</general><scope>24P</scope><scope>WIN</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7TK</scope><scope>8FD</scope><scope>FR3</scope><scope>K9.</scope><scope>NAPCQ</scope><scope>P64</scope><scope>RC3</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-3219-2284</orcidid></search><sort><creationdate>202307</creationdate><title>Automated Motor Tic Detection: A Machine Learning Approach</title><author>Brügge, Nele Sophie ; Sallandt, Gesine Marie ; Schappert, Ronja ; Li, Frédéric ; Siekmann, Alina ; Grzegorzek, Marcin ; Bäumer, Tobias ; Frings, Christian ; Beste, Christian ; Stenger, Roland ; Roessner, Veit ; Fudickar, Sebastian ; Handels, Heinz ; Münchau, Alexander</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c3889-5d7de1ad903f28825e09d67da86fcce5e051685d010a363641b0df5e2f51f7e53</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Algorithms</topic><topic>Automation</topic><topic>Clinical trials</topic><topic>Deep learning</topic><topic>deep neural networks</topic><topic>Differential diagnosis</topic><topic>Face Mesh</topic><topic>Gilles de la Tourette syndrome</topic><topic>Humans</topic><topic>Learning algorithms</topic><topic>Machine Learning</topic><topic>Movement disorders</topic><topic>Neural networks</topic><topic>Random Forest</topic><topic>Reproducibility of Results</topic><topic>tic detection</topic><topic>Tic Disorders - diagnosis</topic><topic>Tics - diagnosis</topic><topic>Tourette syndrome</topic><topic>Tourette Syndrome - diagnosis</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Brügge, Nele Sophie</creatorcontrib><creatorcontrib>Sallandt, Gesine Marie</creatorcontrib><creatorcontrib>Schappert, Ronja</creatorcontrib><creatorcontrib>Li, Frédéric</creatorcontrib><creatorcontrib>Siekmann, Alina</creatorcontrib><creatorcontrib>Grzegorzek, Marcin</creatorcontrib><creatorcontrib>Bäumer, Tobias</creatorcontrib><creatorcontrib>Frings, Christian</creatorcontrib><creatorcontrib>Beste, Christian</creatorcontrib><creatorcontrib>Stenger, Roland</creatorcontrib><creatorcontrib>Roessner, Veit</creatorcontrib><creatorcontrib>Fudickar, Sebastian</creatorcontrib><creatorcontrib>Handels, Heinz</creatorcontrib><creatorcontrib>Münchau, Alexander</creatorcontrib><collection>Wiley Online Library Open Access</collection><collection>Wiley Free Content</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Neurosciences Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>Nursing &amp; Allied Health Premium</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>Genetics Abstracts</collection><collection>MEDLINE - Academic</collection><jtitle>Movement disorders</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Brügge, Nele Sophie</au><au>Sallandt, Gesine Marie</au><au>Schappert, Ronja</au><au>Li, Frédéric</au><au>Siekmann, Alina</au><au>Grzegorzek, Marcin</au><au>Bäumer, Tobias</au><au>Frings, Christian</au><au>Beste, Christian</au><au>Stenger, Roland</au><au>Roessner, Veit</au><au>Fudickar, Sebastian</au><au>Handels, Heinz</au><au>Münchau, Alexander</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Automated Motor Tic Detection: A Machine Learning Approach</atitle><jtitle>Movement disorders</jtitle><addtitle>Mov Disord</addtitle><date>2023-07</date><risdate>2023</risdate><volume>38</volume><issue>7</issue><spage>1327</spage><epage>1335</epage><pages>1327-1335</pages><issn>0885-3185</issn><eissn>1531-8257</eissn><abstract>Background Video‐based tic detection and scoring is useful to independently and objectively assess tic frequency and severity in patients with Tourette syndrome. In trained raters, interrater reliability is good. However, video ratings are time‐consuming and cumbersome, particularly in large‐scale studies. Therefore, we developed two machine learning (ML) algorithms for automatic tic detection. Objective The aim of this study was to evaluate the performances of state‐of‐the‐art ML approaches for automatic video‐based tic detection in patients with Tourette syndrome. Methods We used 64 videos of n = 35 patients with Tourette syndrome. The data of six subjects (15 videos with ratings) were used as a validation set for hyperparameter optimization. For the binary classification task to distinguish between tic and no‐tic segments, we established two different supervised learning approaches. First, we manually extracted features based on landmarks, which served as input for a Random Forest classifier (Random Forest). Second, a fully automated deep learning approach was used, where regions of interest in video snippets were input to a convolutional neural network (deep neural network). Results Tic detection F1 scores (and accuracy) were 82.0% (88.4%) in the Random Forest and 79.5% (88.5%) in the deep neural network approach. Conclusions ML algorithms for automatic tic detection based on video recordings are feasible and reliable and could thus become a valuable assessment tool, for example, for objective tic measurements in clinical trials. ML algorithms might also be useful for the differential diagnosis of tics. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society. Our article confirms that video‐based motor tic detection using machine learning is possible and feasible. We have developed two separate classifiers, a Random Forest classifier and a deep neural network. We found comparable high F1 scores (up to 82%) in both approaches.</abstract><cop>Hoboken, USA</cop><pub>John Wiley &amp; Sons, Inc</pub><pmid>37166278</pmid><doi>10.1002/mds.29439</doi><tpages>9</tpages><orcidid>https://orcid.org/0000-0002-3219-2284</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0885-3185
ispartof Movement disorders, 2023-07, Vol.38 (7), p.1327-1335
issn 0885-3185
1531-8257
language eng
recordid cdi_proquest_miscellaneous_2812506131
source MEDLINE; Wiley Online Library Journals Frontfile Complete
subjects Algorithms
Automation
Clinical trials
Deep learning
deep neural networks
Differential diagnosis
Face Mesh
Gilles de la Tourette syndrome
Humans
Learning algorithms
Machine Learning
Movement disorders
Neural networks
Random Forest
Reproducibility of Results
tic detection
Tic Disorders - diagnosis
Tics - diagnosis
Tourette syndrome
Tourette Syndrome - diagnosis
title Automated Motor Tic Detection: A Machine Learning Approach
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-22T01%3A31%3A32IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Automated%20Motor%20Tic%20Detection:%20A%20Machine%20Learning%20Approach&rft.jtitle=Movement%20disorders&rft.au=Br%C3%BCgge,%20Nele%20Sophie&rft.date=2023-07&rft.volume=38&rft.issue=7&rft.spage=1327&rft.epage=1335&rft.pages=1327-1335&rft.issn=0885-3185&rft.eissn=1531-8257&rft_id=info:doi/10.1002/mds.29439&rft_dat=%3Cproquest_cross%3E2812506131%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2843041866&rft_id=info:pmid/37166278&rfr_iscdi=true