Automated Motor Tic Detection: A Machine Learning Approach
Background Video‐based tic detection and scoring is useful to independently and objectively assess tic frequency and severity in patients with Tourette syndrome. In trained raters, interrater reliability is good. However, video ratings are time‐consuming and cumbersome, particularly in large‐scale s...
Gespeichert in:
Veröffentlicht in: | Movement disorders 2023-07, Vol.38 (7), p.1327-1335 |
---|---|
Hauptverfasser: | , , , , , , , , , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 1335 |
---|---|
container_issue | 7 |
container_start_page | 1327 |
container_title | Movement disorders |
container_volume | 38 |
creator | Brügge, Nele Sophie Sallandt, Gesine Marie Schappert, Ronja Li, Frédéric Siekmann, Alina Grzegorzek, Marcin Bäumer, Tobias Frings, Christian Beste, Christian Stenger, Roland Roessner, Veit Fudickar, Sebastian Handels, Heinz Münchau, Alexander |
description | Background
Video‐based tic detection and scoring is useful to independently and objectively assess tic frequency and severity in patients with Tourette syndrome. In trained raters, interrater reliability is good. However, video ratings are time‐consuming and cumbersome, particularly in large‐scale studies. Therefore, we developed two machine learning (ML) algorithms for automatic tic detection.
Objective
The aim of this study was to evaluate the performances of state‐of‐the‐art ML approaches for automatic video‐based tic detection in patients with Tourette syndrome.
Methods
We used 64 videos of n = 35 patients with Tourette syndrome. The data of six subjects (15 videos with ratings) were used as a validation set for hyperparameter optimization. For the binary classification task to distinguish between tic and no‐tic segments, we established two different supervised learning approaches. First, we manually extracted features based on landmarks, which served as input for a Random Forest classifier (Random Forest). Second, a fully automated deep learning approach was used, where regions of interest in video snippets were input to a convolutional neural network (deep neural network).
Results
Tic detection F1 scores (and accuracy) were 82.0% (88.4%) in the Random Forest and 79.5% (88.5%) in the deep neural network approach.
Conclusions
ML algorithms for automatic tic detection based on video recordings are feasible and reliable and could thus become a valuable assessment tool, for example, for objective tic measurements in clinical trials. ML algorithms might also be useful for the differential diagnosis of tics. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.
Our article confirms that video‐based motor tic detection using machine learning is possible and feasible. We have developed two separate classifiers, a Random Forest classifier and a deep neural network. We found comparable high F1 scores (up to 82%) in both approaches. |
doi_str_mv | 10.1002/mds.29439 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2812506131</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2812506131</sourcerecordid><originalsourceid>FETCH-LOGICAL-c3889-5d7de1ad903f28825e09d67da86fcce5e051685d010a363641b0df5e2f51f7e53</originalsourceid><addsrcrecordid>eNp10E9LwzAYBvAgipvTg19ACl70UJc3adJ0t7L5DzY8OM8lS95qx9rOpkX27Y12ehA8hYQfTx4eQs6B3gClbFxad8OSiCcHZAiCQ6iYiA_JkColQg5KDMiJc2tKAQTIYzLgMUjJYjUkk7Rr61K3aINF3dZNsCxMMMMWTVvU1SRIg4U2b0WFwRx1UxXVa5But03tH0_JUa43Ds_254i83N0upw_h_On-cZrOQ8OVSkJhY4ugbUJ5zpRvhjSxMrZaydwY9FffSQlLgWouuYxgRW0ukOUC8hgFH5GrPtd_-96ha7OycAY3G11h3bmMKWCCSuDg6eUfuq67pvLtvIo4jUBJ6dV1r0xTO9dgnm2botTNLgOafQ2a-UGz70G9vdgndqsS7a_8WdCDcQ8-ig3u_k_KFrPnPvITECN8og</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2843041866</pqid></control><display><type>article</type><title>Automated Motor Tic Detection: A Machine Learning Approach</title><source>MEDLINE</source><source>Wiley Online Library Journals Frontfile Complete</source><creator>Brügge, Nele Sophie ; Sallandt, Gesine Marie ; Schappert, Ronja ; Li, Frédéric ; Siekmann, Alina ; Grzegorzek, Marcin ; Bäumer, Tobias ; Frings, Christian ; Beste, Christian ; Stenger, Roland ; Roessner, Veit ; Fudickar, Sebastian ; Handels, Heinz ; Münchau, Alexander</creator><creatorcontrib>Brügge, Nele Sophie ; Sallandt, Gesine Marie ; Schappert, Ronja ; Li, Frédéric ; Siekmann, Alina ; Grzegorzek, Marcin ; Bäumer, Tobias ; Frings, Christian ; Beste, Christian ; Stenger, Roland ; Roessner, Veit ; Fudickar, Sebastian ; Handels, Heinz ; Münchau, Alexander</creatorcontrib><description>Background
Video‐based tic detection and scoring is useful to independently and objectively assess tic frequency and severity in patients with Tourette syndrome. In trained raters, interrater reliability is good. However, video ratings are time‐consuming and cumbersome, particularly in large‐scale studies. Therefore, we developed two machine learning (ML) algorithms for automatic tic detection.
Objective
The aim of this study was to evaluate the performances of state‐of‐the‐art ML approaches for automatic video‐based tic detection in patients with Tourette syndrome.
Methods
We used 64 videos of n = 35 patients with Tourette syndrome. The data of six subjects (15 videos with ratings) were used as a validation set for hyperparameter optimization. For the binary classification task to distinguish between tic and no‐tic segments, we established two different supervised learning approaches. First, we manually extracted features based on landmarks, which served as input for a Random Forest classifier (Random Forest). Second, a fully automated deep learning approach was used, where regions of interest in video snippets were input to a convolutional neural network (deep neural network).
Results
Tic detection F1 scores (and accuracy) were 82.0% (88.4%) in the Random Forest and 79.5% (88.5%) in the deep neural network approach.
Conclusions
ML algorithms for automatic tic detection based on video recordings are feasible and reliable and could thus become a valuable assessment tool, for example, for objective tic measurements in clinical trials. ML algorithms might also be useful for the differential diagnosis of tics. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.
Our article confirms that video‐based motor tic detection using machine learning is possible and feasible. We have developed two separate classifiers, a Random Forest classifier and a deep neural network. We found comparable high F1 scores (up to 82%) in both approaches.</description><identifier>ISSN: 0885-3185</identifier><identifier>EISSN: 1531-8257</identifier><identifier>DOI: 10.1002/mds.29439</identifier><identifier>PMID: 37166278</identifier><language>eng</language><publisher>Hoboken, USA: John Wiley & Sons, Inc</publisher><subject>Algorithms ; Automation ; Clinical trials ; Deep learning ; deep neural networks ; Differential diagnosis ; Face Mesh ; Gilles de la Tourette syndrome ; Humans ; Learning algorithms ; Machine Learning ; Movement disorders ; Neural networks ; Random Forest ; Reproducibility of Results ; tic detection ; Tic Disorders - diagnosis ; Tics - diagnosis ; Tourette syndrome ; Tourette Syndrome - diagnosis</subject><ispartof>Movement disorders, 2023-07, Vol.38 (7), p.1327-1335</ispartof><rights>2023 The Authors. published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.</rights><rights>2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.</rights><rights>2023. This article is published under http://creativecommons.org/licenses/by-nc-nd/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c3889-5d7de1ad903f28825e09d67da86fcce5e051685d010a363641b0df5e2f51f7e53</citedby><cites>FETCH-LOGICAL-c3889-5d7de1ad903f28825e09d67da86fcce5e051685d010a363641b0df5e2f51f7e53</cites><orcidid>0000-0002-3219-2284</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1002%2Fmds.29439$$EPDF$$P50$$Gwiley$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1002%2Fmds.29439$$EHTML$$P50$$Gwiley$$Hfree_for_read</linktohtml><link.rule.ids>314,776,780,1411,27903,27904,45553,45554</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/37166278$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Brügge, Nele Sophie</creatorcontrib><creatorcontrib>Sallandt, Gesine Marie</creatorcontrib><creatorcontrib>Schappert, Ronja</creatorcontrib><creatorcontrib>Li, Frédéric</creatorcontrib><creatorcontrib>Siekmann, Alina</creatorcontrib><creatorcontrib>Grzegorzek, Marcin</creatorcontrib><creatorcontrib>Bäumer, Tobias</creatorcontrib><creatorcontrib>Frings, Christian</creatorcontrib><creatorcontrib>Beste, Christian</creatorcontrib><creatorcontrib>Stenger, Roland</creatorcontrib><creatorcontrib>Roessner, Veit</creatorcontrib><creatorcontrib>Fudickar, Sebastian</creatorcontrib><creatorcontrib>Handels, Heinz</creatorcontrib><creatorcontrib>Münchau, Alexander</creatorcontrib><title>Automated Motor Tic Detection: A Machine Learning Approach</title><title>Movement disorders</title><addtitle>Mov Disord</addtitle><description>Background
Video‐based tic detection and scoring is useful to independently and objectively assess tic frequency and severity in patients with Tourette syndrome. In trained raters, interrater reliability is good. However, video ratings are time‐consuming and cumbersome, particularly in large‐scale studies. Therefore, we developed two machine learning (ML) algorithms for automatic tic detection.
Objective
The aim of this study was to evaluate the performances of state‐of‐the‐art ML approaches for automatic video‐based tic detection in patients with Tourette syndrome.
Methods
We used 64 videos of n = 35 patients with Tourette syndrome. The data of six subjects (15 videos with ratings) were used as a validation set for hyperparameter optimization. For the binary classification task to distinguish between tic and no‐tic segments, we established two different supervised learning approaches. First, we manually extracted features based on landmarks, which served as input for a Random Forest classifier (Random Forest). Second, a fully automated deep learning approach was used, where regions of interest in video snippets were input to a convolutional neural network (deep neural network).
Results
Tic detection F1 scores (and accuracy) were 82.0% (88.4%) in the Random Forest and 79.5% (88.5%) in the deep neural network approach.
Conclusions
ML algorithms for automatic tic detection based on video recordings are feasible and reliable and could thus become a valuable assessment tool, for example, for objective tic measurements in clinical trials. ML algorithms might also be useful for the differential diagnosis of tics. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.
Our article confirms that video‐based motor tic detection using machine learning is possible and feasible. We have developed two separate classifiers, a Random Forest classifier and a deep neural network. We found comparable high F1 scores (up to 82%) in both approaches.</description><subject>Algorithms</subject><subject>Automation</subject><subject>Clinical trials</subject><subject>Deep learning</subject><subject>deep neural networks</subject><subject>Differential diagnosis</subject><subject>Face Mesh</subject><subject>Gilles de la Tourette syndrome</subject><subject>Humans</subject><subject>Learning algorithms</subject><subject>Machine Learning</subject><subject>Movement disorders</subject><subject>Neural networks</subject><subject>Random Forest</subject><subject>Reproducibility of Results</subject><subject>tic detection</subject><subject>Tic Disorders - diagnosis</subject><subject>Tics - diagnosis</subject><subject>Tourette syndrome</subject><subject>Tourette Syndrome - diagnosis</subject><issn>0885-3185</issn><issn>1531-8257</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>24P</sourceid><sourceid>WIN</sourceid><sourceid>EIF</sourceid><recordid>eNp10E9LwzAYBvAgipvTg19ACl70UJc3adJ0t7L5DzY8OM8lS95qx9rOpkX27Y12ehA8hYQfTx4eQs6B3gClbFxad8OSiCcHZAiCQ6iYiA_JkColQg5KDMiJc2tKAQTIYzLgMUjJYjUkk7Rr61K3aINF3dZNsCxMMMMWTVvU1SRIg4U2b0WFwRx1UxXVa5But03tH0_JUa43Ds_254i83N0upw_h_On-cZrOQ8OVSkJhY4ugbUJ5zpRvhjSxMrZaydwY9FffSQlLgWouuYxgRW0ukOUC8hgFH5GrPtd_-96ha7OycAY3G11h3bmMKWCCSuDg6eUfuq67pvLtvIo4jUBJ6dV1r0xTO9dgnm2botTNLgOafQ2a-UGz70G9vdgndqsS7a_8WdCDcQ8-ig3u_k_KFrPnPvITECN8og</recordid><startdate>202307</startdate><enddate>202307</enddate><creator>Brügge, Nele Sophie</creator><creator>Sallandt, Gesine Marie</creator><creator>Schappert, Ronja</creator><creator>Li, Frédéric</creator><creator>Siekmann, Alina</creator><creator>Grzegorzek, Marcin</creator><creator>Bäumer, Tobias</creator><creator>Frings, Christian</creator><creator>Beste, Christian</creator><creator>Stenger, Roland</creator><creator>Roessner, Veit</creator><creator>Fudickar, Sebastian</creator><creator>Handels, Heinz</creator><creator>Münchau, Alexander</creator><general>John Wiley & Sons, Inc</general><general>Wiley Subscription Services, Inc</general><scope>24P</scope><scope>WIN</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7TK</scope><scope>8FD</scope><scope>FR3</scope><scope>K9.</scope><scope>NAPCQ</scope><scope>P64</scope><scope>RC3</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-3219-2284</orcidid></search><sort><creationdate>202307</creationdate><title>Automated Motor Tic Detection: A Machine Learning Approach</title><author>Brügge, Nele Sophie ; Sallandt, Gesine Marie ; Schappert, Ronja ; Li, Frédéric ; Siekmann, Alina ; Grzegorzek, Marcin ; Bäumer, Tobias ; Frings, Christian ; Beste, Christian ; Stenger, Roland ; Roessner, Veit ; Fudickar, Sebastian ; Handels, Heinz ; Münchau, Alexander</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c3889-5d7de1ad903f28825e09d67da86fcce5e051685d010a363641b0df5e2f51f7e53</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Algorithms</topic><topic>Automation</topic><topic>Clinical trials</topic><topic>Deep learning</topic><topic>deep neural networks</topic><topic>Differential diagnosis</topic><topic>Face Mesh</topic><topic>Gilles de la Tourette syndrome</topic><topic>Humans</topic><topic>Learning algorithms</topic><topic>Machine Learning</topic><topic>Movement disorders</topic><topic>Neural networks</topic><topic>Random Forest</topic><topic>Reproducibility of Results</topic><topic>tic detection</topic><topic>Tic Disorders - diagnosis</topic><topic>Tics - diagnosis</topic><topic>Tourette syndrome</topic><topic>Tourette Syndrome - diagnosis</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Brügge, Nele Sophie</creatorcontrib><creatorcontrib>Sallandt, Gesine Marie</creatorcontrib><creatorcontrib>Schappert, Ronja</creatorcontrib><creatorcontrib>Li, Frédéric</creatorcontrib><creatorcontrib>Siekmann, Alina</creatorcontrib><creatorcontrib>Grzegorzek, Marcin</creatorcontrib><creatorcontrib>Bäumer, Tobias</creatorcontrib><creatorcontrib>Frings, Christian</creatorcontrib><creatorcontrib>Beste, Christian</creatorcontrib><creatorcontrib>Stenger, Roland</creatorcontrib><creatorcontrib>Roessner, Veit</creatorcontrib><creatorcontrib>Fudickar, Sebastian</creatorcontrib><creatorcontrib>Handels, Heinz</creatorcontrib><creatorcontrib>Münchau, Alexander</creatorcontrib><collection>Wiley Online Library Open Access</collection><collection>Wiley Free Content</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Neurosciences Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Nursing & Allied Health Premium</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>Genetics Abstracts</collection><collection>MEDLINE - Academic</collection><jtitle>Movement disorders</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Brügge, Nele Sophie</au><au>Sallandt, Gesine Marie</au><au>Schappert, Ronja</au><au>Li, Frédéric</au><au>Siekmann, Alina</au><au>Grzegorzek, Marcin</au><au>Bäumer, Tobias</au><au>Frings, Christian</au><au>Beste, Christian</au><au>Stenger, Roland</au><au>Roessner, Veit</au><au>Fudickar, Sebastian</au><au>Handels, Heinz</au><au>Münchau, Alexander</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Automated Motor Tic Detection: A Machine Learning Approach</atitle><jtitle>Movement disorders</jtitle><addtitle>Mov Disord</addtitle><date>2023-07</date><risdate>2023</risdate><volume>38</volume><issue>7</issue><spage>1327</spage><epage>1335</epage><pages>1327-1335</pages><issn>0885-3185</issn><eissn>1531-8257</eissn><abstract>Background
Video‐based tic detection and scoring is useful to independently and objectively assess tic frequency and severity in patients with Tourette syndrome. In trained raters, interrater reliability is good. However, video ratings are time‐consuming and cumbersome, particularly in large‐scale studies. Therefore, we developed two machine learning (ML) algorithms for automatic tic detection.
Objective
The aim of this study was to evaluate the performances of state‐of‐the‐art ML approaches for automatic video‐based tic detection in patients with Tourette syndrome.
Methods
We used 64 videos of n = 35 patients with Tourette syndrome. The data of six subjects (15 videos with ratings) were used as a validation set for hyperparameter optimization. For the binary classification task to distinguish between tic and no‐tic segments, we established two different supervised learning approaches. First, we manually extracted features based on landmarks, which served as input for a Random Forest classifier (Random Forest). Second, a fully automated deep learning approach was used, where regions of interest in video snippets were input to a convolutional neural network (deep neural network).
Results
Tic detection F1 scores (and accuracy) were 82.0% (88.4%) in the Random Forest and 79.5% (88.5%) in the deep neural network approach.
Conclusions
ML algorithms for automatic tic detection based on video recordings are feasible and reliable and could thus become a valuable assessment tool, for example, for objective tic measurements in clinical trials. ML algorithms might also be useful for the differential diagnosis of tics. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.
Our article confirms that video‐based motor tic detection using machine learning is possible and feasible. We have developed two separate classifiers, a Random Forest classifier and a deep neural network. We found comparable high F1 scores (up to 82%) in both approaches.</abstract><cop>Hoboken, USA</cop><pub>John Wiley & Sons, Inc</pub><pmid>37166278</pmid><doi>10.1002/mds.29439</doi><tpages>9</tpages><orcidid>https://orcid.org/0000-0002-3219-2284</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0885-3185 |
ispartof | Movement disorders, 2023-07, Vol.38 (7), p.1327-1335 |
issn | 0885-3185 1531-8257 |
language | eng |
recordid | cdi_proquest_miscellaneous_2812506131 |
source | MEDLINE; Wiley Online Library Journals Frontfile Complete |
subjects | Algorithms Automation Clinical trials Deep learning deep neural networks Differential diagnosis Face Mesh Gilles de la Tourette syndrome Humans Learning algorithms Machine Learning Movement disorders Neural networks Random Forest Reproducibility of Results tic detection Tic Disorders - diagnosis Tics - diagnosis Tourette syndrome Tourette Syndrome - diagnosis |
title | Automated Motor Tic Detection: A Machine Learning Approach |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-22T01%3A31%3A32IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Automated%20Motor%20Tic%20Detection:%20A%20Machine%20Learning%20Approach&rft.jtitle=Movement%20disorders&rft.au=Br%C3%BCgge,%20Nele%20Sophie&rft.date=2023-07&rft.volume=38&rft.issue=7&rft.spage=1327&rft.epage=1335&rft.pages=1327-1335&rft.issn=0885-3185&rft.eissn=1531-8257&rft_id=info:doi/10.1002/mds.29439&rft_dat=%3Cproquest_cross%3E2812506131%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2843041866&rft_id=info:pmid/37166278&rfr_iscdi=true |