Inter- and Intra-Rater Reliability of Laryngeal Sensation Testing with the Touch Method During Flexible Endoscopic Evaluations of Swallowing
Objectives: Sensation is an integral component of laryngeal control for breathing, swallowing, and vocalization. Laryngeal sensation is assessed by elicitation of the laryngeal adductor reflex (LAR), a brainstem-mediated adduction of the true vocal folds. During Flexible Endoscopic Evaluations of Sw...
Gespeichert in:
| Veröffentlicht in: | Annals of otology, rhinology & laryngology rhinology & laryngology, 2020-06, Vol.129 (6), p.565-571 |
|---|---|
| Hauptverfasser: | , , , , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 571 |
|---|---|
| container_issue | 6 |
| container_start_page | 565 |
| container_title | Annals of otology, rhinology & laryngology |
| container_volume | 129 |
| creator | Borders, James C. O’Dea, Meredith B. McNally, Edel Norberg, Elizabeth Kitila, Merertu Walsh, Michael Liu, Rui Pisegna, Jessica M. |
| description | Objectives:
Sensation is an integral component of laryngeal control for breathing, swallowing, and vocalization. Laryngeal sensation is assessed by elicitation of the laryngeal adductor reflex (LAR), a brainstem-mediated adduction of the true vocal folds. During Flexible Endoscopic Evaluations of Swallowing (FEES), the touch method can be used to elicit the LAR to judge laryngeal sensation. Despite the prevalence of this method in clinical practice and research, prior studies have yet to examine inter- and intra-rater reliability.
Methods:
Four speech-language pathologists rated 125 randomized video clips for the presence, absence, or inability to rate the LAR. Fifty percent of video clips were re-randomized and re-rated 1 week later. Raters then created guidelines and participated in formal consensus training sessions on a separate set of videos. Ratings were repeated post-training.
Results:
Overall inter-rater reliability was fair (κ = 0.22) prior to training. Pre-training intra-rater reliability ranged from fair (κ = 0.35) to almost perfect (κ = 0.89). Inter-rater reliability significantly improved after training (κ = 0.42, P |
| doi_str_mv | 10.1177/0003489419901145 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2343038505</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sage_id>10.1177_0003489419901145</sage_id><sourcerecordid>2343038505</sourcerecordid><originalsourceid>FETCH-LOGICAL-c337t-c6b1618fa12f458f243241c443d993c383a07bf503a07eec402cf4338f9fb5c23</originalsourceid><addsrcrecordid>eNp1kU1PGzEQhi1EBSlw76nykcu29tpm18eKhhYpCCkJEreV1ztOjBw7tXcJ_Ad-NN6GckDqaT7edx5pZhD6Qsk3SqvqOyGE8VpyKiWhlIsDNKGSs0JU5f0hmoxyMerH6HNKD7nkgpRH6JhRKWpZiwl6ufY9xAIr3-GcRlXMVW7gOTirWuts_4yDwTMVn_0KlMML8En1Nni8hNRbv8I7269xvwa8DINe4xvo16HDP4c4ilcOnmzrAE99F5IOW6vx9FG54S8jjezFTjkXdtl9ij4Z5RKcvcUTdHc1XV7-Lma3v64vf8wKzVjVF_qipRe0NoqWhovalJyVnGrOWScl06xmilStEWSMAJqTUhvOWG2kaYUu2Qk633O3MfwZ8hrNxiYNzikPYUhNyTgjrBZEZCvZW3UMKUUwzTbaTb5GQ0kz_qD5-IM88vWNPrQb6N4H_h09G4q9IakVNA9hiD5v-3_gK0ijj50</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2343038505</pqid></control><display><type>article</type><title>Inter- and Intra-Rater Reliability of Laryngeal Sensation Testing with the Touch Method During Flexible Endoscopic Evaluations of Swallowing</title><source>MEDLINE</source><source>SAGE Complete A-Z List</source><creator>Borders, James C. ; O’Dea, Meredith B. ; McNally, Edel ; Norberg, Elizabeth ; Kitila, Merertu ; Walsh, Michael ; Liu, Rui ; Pisegna, Jessica M.</creator><creatorcontrib>Borders, James C. ; O’Dea, Meredith B. ; McNally, Edel ; Norberg, Elizabeth ; Kitila, Merertu ; Walsh, Michael ; Liu, Rui ; Pisegna, Jessica M.</creatorcontrib><description>Objectives:
Sensation is an integral component of laryngeal control for breathing, swallowing, and vocalization. Laryngeal sensation is assessed by elicitation of the laryngeal adductor reflex (LAR), a brainstem-mediated adduction of the true vocal folds. During Flexible Endoscopic Evaluations of Swallowing (FEES), the touch method can be used to elicit the LAR to judge laryngeal sensation. Despite the prevalence of this method in clinical practice and research, prior studies have yet to examine inter- and intra-rater reliability.
Methods:
Four speech-language pathologists rated 125 randomized video clips for the presence, absence, or inability to rate the LAR. Fifty percent of video clips were re-randomized and re-rated 1 week later. Raters then created guidelines and participated in formal consensus training sessions on a separate set of videos. Ratings were repeated post-training.
Results:
Overall inter-rater reliability was fair (κ = 0.22) prior to training. Pre-training intra-rater reliability ranged from fair (κ = 0.35) to almost perfect (κ = 0.89). Inter-rater reliability significantly improved after training (κ = 0.42, P < .001), though agreement did not reach prespecified acceptable levels (κ ≥ 0.80). Post-training intra-rater reliability ranged from moderate (κ = 0.49) to almost perfect (κ = 0.85).
Conclusion:
Adequate inter-rater reliability was not achieved when rating isolated attempts to elicit the LAR. Acceptable within-rater reliability was observed in some raters 1 week after initial ratings, suggesting that ratings may remain consistent within raters over a short period of time. Limitations and considerations for future research using the touch method are discussed.</description><identifier>ISSN: 0003-4894</identifier><identifier>EISSN: 1943-572X</identifier><identifier>DOI: 10.1177/0003489419901145</identifier><identifier>PMID: 31958985</identifier><language>eng</language><publisher>Los Angeles, CA: SAGE Publications</publisher><subject>Adult ; Aged ; Deglutition Disorders - diagnosis ; Deglutition Disorders - physiopathology ; Health Personnel ; Humans ; Laryngoscopy ; Middle Aged ; Observer Variation ; Prospective Studies ; Reflex, Abnormal - physiology ; Reproducibility of Results ; Speech-Language Pathology ; Touch - physiology ; Vocal Cords - physiopathology</subject><ispartof>Annals of otology, rhinology & laryngology, 2020-06, Vol.129 (6), p.565-571</ispartof><rights>The Author(s) 2020</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c337t-c6b1618fa12f458f243241c443d993c383a07bf503a07eec402cf4338f9fb5c23</citedby><cites>FETCH-LOGICAL-c337t-c6b1618fa12f458f243241c443d993c383a07bf503a07eec402cf4338f9fb5c23</cites><orcidid>0000-0002-0291-4266</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://journals.sagepub.com/doi/pdf/10.1177/0003489419901145$$EPDF$$P50$$Gsage$$H</linktopdf><linktohtml>$$Uhttps://journals.sagepub.com/doi/10.1177/0003489419901145$$EHTML$$P50$$Gsage$$H</linktohtml><link.rule.ids>314,778,782,21808,27913,27914,43610,43611</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/31958985$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Borders, James C.</creatorcontrib><creatorcontrib>O’Dea, Meredith B.</creatorcontrib><creatorcontrib>McNally, Edel</creatorcontrib><creatorcontrib>Norberg, Elizabeth</creatorcontrib><creatorcontrib>Kitila, Merertu</creatorcontrib><creatorcontrib>Walsh, Michael</creatorcontrib><creatorcontrib>Liu, Rui</creatorcontrib><creatorcontrib>Pisegna, Jessica M.</creatorcontrib><title>Inter- and Intra-Rater Reliability of Laryngeal Sensation Testing with the Touch Method During Flexible Endoscopic Evaluations of Swallowing</title><title>Annals of otology, rhinology & laryngology</title><addtitle>Ann Otol Rhinol Laryngol</addtitle><description>Objectives:
Sensation is an integral component of laryngeal control for breathing, swallowing, and vocalization. Laryngeal sensation is assessed by elicitation of the laryngeal adductor reflex (LAR), a brainstem-mediated adduction of the true vocal folds. During Flexible Endoscopic Evaluations of Swallowing (FEES), the touch method can be used to elicit the LAR to judge laryngeal sensation. Despite the prevalence of this method in clinical practice and research, prior studies have yet to examine inter- and intra-rater reliability.
Methods:
Four speech-language pathologists rated 125 randomized video clips for the presence, absence, or inability to rate the LAR. Fifty percent of video clips were re-randomized and re-rated 1 week later. Raters then created guidelines and participated in formal consensus training sessions on a separate set of videos. Ratings were repeated post-training.
Results:
Overall inter-rater reliability was fair (κ = 0.22) prior to training. Pre-training intra-rater reliability ranged from fair (κ = 0.35) to almost perfect (κ = 0.89). Inter-rater reliability significantly improved after training (κ = 0.42, P < .001), though agreement did not reach prespecified acceptable levels (κ ≥ 0.80). Post-training intra-rater reliability ranged from moderate (κ = 0.49) to almost perfect (κ = 0.85).
Conclusion:
Adequate inter-rater reliability was not achieved when rating isolated attempts to elicit the LAR. Acceptable within-rater reliability was observed in some raters 1 week after initial ratings, suggesting that ratings may remain consistent within raters over a short period of time. Limitations and considerations for future research using the touch method are discussed.</description><subject>Adult</subject><subject>Aged</subject><subject>Deglutition Disorders - diagnosis</subject><subject>Deglutition Disorders - physiopathology</subject><subject>Health Personnel</subject><subject>Humans</subject><subject>Laryngoscopy</subject><subject>Middle Aged</subject><subject>Observer Variation</subject><subject>Prospective Studies</subject><subject>Reflex, Abnormal - physiology</subject><subject>Reproducibility of Results</subject><subject>Speech-Language Pathology</subject><subject>Touch - physiology</subject><subject>Vocal Cords - physiopathology</subject><issn>0003-4894</issn><issn>1943-572X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNp1kU1PGzEQhi1EBSlw76nykcu29tpm18eKhhYpCCkJEreV1ztOjBw7tXcJ_Ad-NN6GckDqaT7edx5pZhD6Qsk3SqvqOyGE8VpyKiWhlIsDNKGSs0JU5f0hmoxyMerH6HNKD7nkgpRH6JhRKWpZiwl6ufY9xAIr3-GcRlXMVW7gOTirWuts_4yDwTMVn_0KlMML8En1Nni8hNRbv8I7269xvwa8DINe4xvo16HDP4c4ilcOnmzrAE99F5IOW6vx9FG54S8jjezFTjkXdtl9ij4Z5RKcvcUTdHc1XV7-Lma3v64vf8wKzVjVF_qipRe0NoqWhovalJyVnGrOWScl06xmilStEWSMAJqTUhvOWG2kaYUu2Qk633O3MfwZ8hrNxiYNzikPYUhNyTgjrBZEZCvZW3UMKUUwzTbaTb5GQ0kz_qD5-IM88vWNPrQb6N4H_h09G4q9IakVNA9hiD5v-3_gK0ijj50</recordid><startdate>202006</startdate><enddate>202006</enddate><creator>Borders, James C.</creator><creator>O’Dea, Meredith B.</creator><creator>McNally, Edel</creator><creator>Norberg, Elizabeth</creator><creator>Kitila, Merertu</creator><creator>Walsh, Michael</creator><creator>Liu, Rui</creator><creator>Pisegna, Jessica M.</creator><general>SAGE Publications</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-0291-4266</orcidid></search><sort><creationdate>202006</creationdate><title>Inter- and Intra-Rater Reliability of Laryngeal Sensation Testing with the Touch Method During Flexible Endoscopic Evaluations of Swallowing</title><author>Borders, James C. ; O’Dea, Meredith B. ; McNally, Edel ; Norberg, Elizabeth ; Kitila, Merertu ; Walsh, Michael ; Liu, Rui ; Pisegna, Jessica M.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c337t-c6b1618fa12f458f243241c443d993c383a07bf503a07eec402cf4338f9fb5c23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Adult</topic><topic>Aged</topic><topic>Deglutition Disorders - diagnosis</topic><topic>Deglutition Disorders - physiopathology</topic><topic>Health Personnel</topic><topic>Humans</topic><topic>Laryngoscopy</topic><topic>Middle Aged</topic><topic>Observer Variation</topic><topic>Prospective Studies</topic><topic>Reflex, Abnormal - physiology</topic><topic>Reproducibility of Results</topic><topic>Speech-Language Pathology</topic><topic>Touch - physiology</topic><topic>Vocal Cords - physiopathology</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Borders, James C.</creatorcontrib><creatorcontrib>O’Dea, Meredith B.</creatorcontrib><creatorcontrib>McNally, Edel</creatorcontrib><creatorcontrib>Norberg, Elizabeth</creatorcontrib><creatorcontrib>Kitila, Merertu</creatorcontrib><creatorcontrib>Walsh, Michael</creatorcontrib><creatorcontrib>Liu, Rui</creatorcontrib><creatorcontrib>Pisegna, Jessica M.</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Annals of otology, rhinology & laryngology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Borders, James C.</au><au>O’Dea, Meredith B.</au><au>McNally, Edel</au><au>Norberg, Elizabeth</au><au>Kitila, Merertu</au><au>Walsh, Michael</au><au>Liu, Rui</au><au>Pisegna, Jessica M.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Inter- and Intra-Rater Reliability of Laryngeal Sensation Testing with the Touch Method During Flexible Endoscopic Evaluations of Swallowing</atitle><jtitle>Annals of otology, rhinology & laryngology</jtitle><addtitle>Ann Otol Rhinol Laryngol</addtitle><date>2020-06</date><risdate>2020</risdate><volume>129</volume><issue>6</issue><spage>565</spage><epage>571</epage><pages>565-571</pages><issn>0003-4894</issn><eissn>1943-572X</eissn><abstract>Objectives:
Sensation is an integral component of laryngeal control for breathing, swallowing, and vocalization. Laryngeal sensation is assessed by elicitation of the laryngeal adductor reflex (LAR), a brainstem-mediated adduction of the true vocal folds. During Flexible Endoscopic Evaluations of Swallowing (FEES), the touch method can be used to elicit the LAR to judge laryngeal sensation. Despite the prevalence of this method in clinical practice and research, prior studies have yet to examine inter- and intra-rater reliability.
Methods:
Four speech-language pathologists rated 125 randomized video clips for the presence, absence, or inability to rate the LAR. Fifty percent of video clips were re-randomized and re-rated 1 week later. Raters then created guidelines and participated in formal consensus training sessions on a separate set of videos. Ratings were repeated post-training.
Results:
Overall inter-rater reliability was fair (κ = 0.22) prior to training. Pre-training intra-rater reliability ranged from fair (κ = 0.35) to almost perfect (κ = 0.89). Inter-rater reliability significantly improved after training (κ = 0.42, P < .001), though agreement did not reach prespecified acceptable levels (κ ≥ 0.80). Post-training intra-rater reliability ranged from moderate (κ = 0.49) to almost perfect (κ = 0.85).
Conclusion:
Adequate inter-rater reliability was not achieved when rating isolated attempts to elicit the LAR. Acceptable within-rater reliability was observed in some raters 1 week after initial ratings, suggesting that ratings may remain consistent within raters over a short period of time. Limitations and considerations for future research using the touch method are discussed.</abstract><cop>Los Angeles, CA</cop><pub>SAGE Publications</pub><pmid>31958985</pmid><doi>10.1177/0003489419901145</doi><tpages>7</tpages><orcidid>https://orcid.org/0000-0002-0291-4266</orcidid></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 0003-4894 |
| ispartof | Annals of otology, rhinology & laryngology, 2020-06, Vol.129 (6), p.565-571 |
| issn | 0003-4894 1943-572X |
| language | eng |
| recordid | cdi_proquest_miscellaneous_2343038505 |
| source | MEDLINE; SAGE Complete A-Z List |
| subjects | Adult Aged Deglutition Disorders - diagnosis Deglutition Disorders - physiopathology Health Personnel Humans Laryngoscopy Middle Aged Observer Variation Prospective Studies Reflex, Abnormal - physiology Reproducibility of Results Speech-Language Pathology Touch - physiology Vocal Cords - physiopathology |
| title | Inter- and Intra-Rater Reliability of Laryngeal Sensation Testing with the Touch Method During Flexible Endoscopic Evaluations of Swallowing |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-15T07%3A59%3A31IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Inter-%20and%20Intra-Rater%20Reliability%20of%20Laryngeal%20Sensation%20Testing%20with%20the%20Touch%20Method%20During%20Flexible%20Endoscopic%20Evaluations%20of%20Swallowing&rft.jtitle=Annals%20of%20otology,%20rhinology%20&%20laryngology&rft.au=Borders,%20James%20C.&rft.date=2020-06&rft.volume=129&rft.issue=6&rft.spage=565&rft.epage=571&rft.pages=565-571&rft.issn=0003-4894&rft.eissn=1943-572X&rft_id=info:doi/10.1177/0003489419901145&rft_dat=%3Cproquest_cross%3E2343038505%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2343038505&rft_id=info:pmid/31958985&rft_sage_id=10.1177_0003489419901145&rfr_iscdi=true |