Event- and interval-based measurement of stuttering: a review

Background Event‐ and interval‐based measurements are two different ways of computing frequency of stuttering. Interval‐based methodology emerged as an alternative measure to overcome problems associated with reproducibility in the event‐based methodology. No review has been made to study the effect...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:International journal of language & communication disorders 2015-01, Vol.50 (1), p.14-30
Hauptverfasser: Valente, Ana Rita S., Jesus, Luis M. T., Hall, Andreia, Leahy, Margaret
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 30
container_issue 1
container_start_page 14
container_title International journal of language & communication disorders
container_volume 50
creator Valente, Ana Rita S.
Jesus, Luis M. T.
Hall, Andreia
Leahy, Margaret
description Background Event‐ and interval‐based measurements are two different ways of computing frequency of stuttering. Interval‐based methodology emerged as an alternative measure to overcome problems associated with reproducibility in the event‐based methodology. No review has been made to study the effect of methodological factors in interval‐based absolute reliability data or to compute the agreement between the two methodologies in terms of inter‐judge, intra‐judge and accuracy (i.e., correspondence between raters’ scores and an established criterion). Aims To provide a review related to reproducibility of event‐based and time‐interval measurement, and to verify the effect of methodological factors (training, experience, interval duration, sample presentation order and judgment conditions) on agreement of time‐interval measurement; in addition, to determine if it is possible to quantify the agreement between the two methodologies Methods & Procedures The first two authors searched for articles on ERIC, MEDLINE, PubMed, B‐on, CENTRAL and Dissertation s during January–February 2013 and retrieved 495 articles. Forty‐eight articles were selected for review. Content tables were constructed with the main findings. Main Contribution Articles related to event‐based measurements revealed values of inter‐ and intra‐judge greater than 0.70 and agreement percentages beyond 80%. The articles related to time‐interval measures revealed that, in general, judges with more experience with stuttering presented significantly higher levels of intra‐ and inter‐judge agreement. Inter‐ and intra‐judge values were beyond the references for high reproducibility values for both methodologies. Accuracy (regarding the closeness of raters’ judgements with an established criterion), intra‐ and inter‐judge agreement were higher for trained groups when compared with non‐trained groups. Sample presentation order and audio/video conditions did not result in differences in inter‐ or intra‐judge results. A duration of 5 s for an interval appears to be an acceptable agreement. Explanation for high reproducibility values as well as parameter choice to report those data are discussed. Conclusions & Implications Both interval‐ and event‐based methodologies used trained or experienced judges for inter‐ and intra‐judge determination and data were beyond the references for good reproducibility values. Inter‐ and intra‐judge values were reported in different metric scales among event‐ and interval‐based
doi_str_mv 10.1111/1460-6984.12113
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1700660587</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3563869671</sourcerecordid><originalsourceid>FETCH-LOGICAL-c4763-57a0995b5135ea9640dcf6116b3c1bfabc54b709aebcfb80d27ba448169430053</originalsourceid><addsrcrecordid>eNqFkbtPHDEQxq0oUXilpkMrpaFZ8Pi5RqJAxzO6QEMUKY1l785GS_Zx2LsH_Pfx5eCKNEzjkef3fdJ8Q8g-0CNIdQxC0VyZQhwBA-AfyPbm52PquSpyVjC2RXZifKCUMpDwmWwxYcAYUWyT04sl9mOeub7Kmn7EsHRt7l3EKuvQxSlgl-bZUGdxnMY0b_rfJ5nLAi4bfNojn2rXRvzy-u6SH5cX97PrfH53dTM7m-el0IrnUjtqjPQSuERnlKBVWSsA5XkJvna-lMJrahz6svYFrZj2TogClBGcUsl3yeHadxGGxwnjaLsmlti2rsdhihY0pUpRWej3USUZNykJmtCv_6EPwxT6tEiihE75chCJOl5TZRhiDFjbRWg6F14sULs6gl1FbleR239HSIqDV9_Jd1ht-LfUE6DWwFPT4st7fvbbfHb-5pyvhU0c8XkjdOGPVZpraX_eXll-KRT_xb7bOf8LkSCdHQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1647111314</pqid></control><display><type>article</type><title>Event- and interval-based measurement of stuttering: a review</title><source>MEDLINE</source><source>Access via Wiley Online Library</source><creator>Valente, Ana Rita S. ; Jesus, Luis M. T. ; Hall, Andreia ; Leahy, Margaret</creator><creatorcontrib>Valente, Ana Rita S. ; Jesus, Luis M. T. ; Hall, Andreia ; Leahy, Margaret</creatorcontrib><description>Background Event‐ and interval‐based measurements are two different ways of computing frequency of stuttering. Interval‐based methodology emerged as an alternative measure to overcome problems associated with reproducibility in the event‐based methodology. No review has been made to study the effect of methodological factors in interval‐based absolute reliability data or to compute the agreement between the two methodologies in terms of inter‐judge, intra‐judge and accuracy (i.e., correspondence between raters’ scores and an established criterion). Aims To provide a review related to reproducibility of event‐based and time‐interval measurement, and to verify the effect of methodological factors (training, experience, interval duration, sample presentation order and judgment conditions) on agreement of time‐interval measurement; in addition, to determine if it is possible to quantify the agreement between the two methodologies Methods &amp; Procedures The first two authors searched for articles on ERIC, MEDLINE, PubMed, B‐on, CENTRAL and Dissertation s during January–February 2013 and retrieved 495 articles. Forty‐eight articles were selected for review. Content tables were constructed with the main findings. Main Contribution Articles related to event‐based measurements revealed values of inter‐ and intra‐judge greater than 0.70 and agreement percentages beyond 80%. The articles related to time‐interval measures revealed that, in general, judges with more experience with stuttering presented significantly higher levels of intra‐ and inter‐judge agreement. Inter‐ and intra‐judge values were beyond the references for high reproducibility values for both methodologies. Accuracy (regarding the closeness of raters’ judgements with an established criterion), intra‐ and inter‐judge agreement were higher for trained groups when compared with non‐trained groups. Sample presentation order and audio/video conditions did not result in differences in inter‐ or intra‐judge results. A duration of 5 s for an interval appears to be an acceptable agreement. Explanation for high reproducibility values as well as parameter choice to report those data are discussed. Conclusions &amp; Implications Both interval‐ and event‐based methodologies used trained or experienced judges for inter‐ and intra‐judge determination and data were beyond the references for good reproducibility values. Inter‐ and intra‐judge values were reported in different metric scales among event‐ and interval‐based methods studies, making it unfeasible to quantify the agreement between the two methods.</description><identifier>ISSN: 1368-2822</identifier><identifier>EISSN: 1460-6984</identifier><identifier>DOI: 10.1111/1460-6984.12113</identifier><identifier>PMID: 24919948</identifier><identifier>CODEN: IJLDFI</identifier><language>eng</language><publisher>United States: Blackwell Publishing Ltd</publisher><subject>accuracy ; Agreements ; Behavior Therapy - methods ; Child ; event-based measurement ; Humans ; inter-judge ; interval-based measurement ; intra-judge ; Observer Variation ; Reproducibility of Results ; Speech Production Measurement - methods ; Speech Production Measurement - statistics &amp; numerical data ; Speech Therapy - methods ; Stuttering ; Stuttering - classification ; Stuttering - diagnosis ; Stuttering - therapy</subject><ispartof>International journal of language &amp; communication disorders, 2015-01, Vol.50 (1), p.14-30</ispartof><rights>2014 Royal College of Speech and Language Therapists</rights><rights>2014 Royal College of Speech and Language Therapists.</rights><rights>2015 Royal College of Speech and Language Therapists</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c4763-57a0995b5135ea9640dcf6116b3c1bfabc54b709aebcfb80d27ba448169430053</citedby><cites>FETCH-LOGICAL-c4763-57a0995b5135ea9640dcf6116b3c1bfabc54b709aebcfb80d27ba448169430053</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1111%2F1460-6984.12113$$EPDF$$P50$$Gwiley$$H</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1111%2F1460-6984.12113$$EHTML$$P50$$Gwiley$$H</linktohtml><link.rule.ids>314,780,784,1417,27924,27925,45574,45575</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/24919948$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Valente, Ana Rita S.</creatorcontrib><creatorcontrib>Jesus, Luis M. T.</creatorcontrib><creatorcontrib>Hall, Andreia</creatorcontrib><creatorcontrib>Leahy, Margaret</creatorcontrib><title>Event- and interval-based measurement of stuttering: a review</title><title>International journal of language &amp; communication disorders</title><addtitle>INT J LANG COMMUN DISORD</addtitle><description>Background Event‐ and interval‐based measurements are two different ways of computing frequency of stuttering. Interval‐based methodology emerged as an alternative measure to overcome problems associated with reproducibility in the event‐based methodology. No review has been made to study the effect of methodological factors in interval‐based absolute reliability data or to compute the agreement between the two methodologies in terms of inter‐judge, intra‐judge and accuracy (i.e., correspondence between raters’ scores and an established criterion). Aims To provide a review related to reproducibility of event‐based and time‐interval measurement, and to verify the effect of methodological factors (training, experience, interval duration, sample presentation order and judgment conditions) on agreement of time‐interval measurement; in addition, to determine if it is possible to quantify the agreement between the two methodologies Methods &amp; Procedures The first two authors searched for articles on ERIC, MEDLINE, PubMed, B‐on, CENTRAL and Dissertation s during January–February 2013 and retrieved 495 articles. Forty‐eight articles were selected for review. Content tables were constructed with the main findings. Main Contribution Articles related to event‐based measurements revealed values of inter‐ and intra‐judge greater than 0.70 and agreement percentages beyond 80%. The articles related to time‐interval measures revealed that, in general, judges with more experience with stuttering presented significantly higher levels of intra‐ and inter‐judge agreement. Inter‐ and intra‐judge values were beyond the references for high reproducibility values for both methodologies. Accuracy (regarding the closeness of raters’ judgements with an established criterion), intra‐ and inter‐judge agreement were higher for trained groups when compared with non‐trained groups. Sample presentation order and audio/video conditions did not result in differences in inter‐ or intra‐judge results. A duration of 5 s for an interval appears to be an acceptable agreement. Explanation for high reproducibility values as well as parameter choice to report those data are discussed. Conclusions &amp; Implications Both interval‐ and event‐based methodologies used trained or experienced judges for inter‐ and intra‐judge determination and data were beyond the references for good reproducibility values. Inter‐ and intra‐judge values were reported in different metric scales among event‐ and interval‐based methods studies, making it unfeasible to quantify the agreement between the two methods.</description><subject>accuracy</subject><subject>Agreements</subject><subject>Behavior Therapy - methods</subject><subject>Child</subject><subject>event-based measurement</subject><subject>Humans</subject><subject>inter-judge</subject><subject>interval-based measurement</subject><subject>intra-judge</subject><subject>Observer Variation</subject><subject>Reproducibility of Results</subject><subject>Speech Production Measurement - methods</subject><subject>Speech Production Measurement - statistics &amp; numerical data</subject><subject>Speech Therapy - methods</subject><subject>Stuttering</subject><subject>Stuttering - classification</subject><subject>Stuttering - diagnosis</subject><subject>Stuttering - therapy</subject><issn>1368-2822</issn><issn>1460-6984</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2015</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNqFkbtPHDEQxq0oUXilpkMrpaFZ8Pi5RqJAxzO6QEMUKY1l785GS_Zx2LsH_Pfx5eCKNEzjkef3fdJ8Q8g-0CNIdQxC0VyZQhwBA-AfyPbm52PquSpyVjC2RXZifKCUMpDwmWwxYcAYUWyT04sl9mOeub7Kmn7EsHRt7l3EKuvQxSlgl-bZUGdxnMY0b_rfJ5nLAi4bfNojn2rXRvzy-u6SH5cX97PrfH53dTM7m-el0IrnUjtqjPQSuERnlKBVWSsA5XkJvna-lMJrahz6svYFrZj2TogClBGcUsl3yeHadxGGxwnjaLsmlti2rsdhihY0pUpRWej3USUZNykJmtCv_6EPwxT6tEiihE75chCJOl5TZRhiDFjbRWg6F14sULs6gl1FbleR239HSIqDV9_Jd1ht-LfUE6DWwFPT4st7fvbbfHb-5pyvhU0c8XkjdOGPVZpraX_eXll-KRT_xb7bOf8LkSCdHQ</recordid><startdate>201501</startdate><enddate>201501</enddate><creator>Valente, Ana Rita S.</creator><creator>Jesus, Luis M. T.</creator><creator>Hall, Andreia</creator><creator>Leahy, Margaret</creator><general>Blackwell Publishing Ltd</general><general>Wiley Subscription Services, Inc</general><scope>BSCLL</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7T9</scope><scope>8BM</scope><scope>K9.</scope><scope>NAPCQ</scope><scope>7X8</scope></search><sort><creationdate>201501</creationdate><title>Event- and interval-based measurement of stuttering: a review</title><author>Valente, Ana Rita S. ; Jesus, Luis M. T. ; Hall, Andreia ; Leahy, Margaret</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c4763-57a0995b5135ea9640dcf6116b3c1bfabc54b709aebcfb80d27ba448169430053</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2015</creationdate><topic>accuracy</topic><topic>Agreements</topic><topic>Behavior Therapy - methods</topic><topic>Child</topic><topic>event-based measurement</topic><topic>Humans</topic><topic>inter-judge</topic><topic>interval-based measurement</topic><topic>intra-judge</topic><topic>Observer Variation</topic><topic>Reproducibility of Results</topic><topic>Speech Production Measurement - methods</topic><topic>Speech Production Measurement - statistics &amp; numerical data</topic><topic>Speech Therapy - methods</topic><topic>Stuttering</topic><topic>Stuttering - classification</topic><topic>Stuttering - diagnosis</topic><topic>Stuttering - therapy</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Valente, Ana Rita S.</creatorcontrib><creatorcontrib>Jesus, Luis M. T.</creatorcontrib><creatorcontrib>Hall, Andreia</creatorcontrib><creatorcontrib>Leahy, Margaret</creatorcontrib><collection>Istex</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Linguistics and Language Behavior Abstracts (LLBA)</collection><collection>ComDisDome</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>Nursing &amp; Allied Health Premium</collection><collection>MEDLINE - Academic</collection><jtitle>International journal of language &amp; communication disorders</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Valente, Ana Rita S.</au><au>Jesus, Luis M. T.</au><au>Hall, Andreia</au><au>Leahy, Margaret</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Event- and interval-based measurement of stuttering: a review</atitle><jtitle>International journal of language &amp; communication disorders</jtitle><addtitle>INT J LANG COMMUN DISORD</addtitle><date>2015-01</date><risdate>2015</risdate><volume>50</volume><issue>1</issue><spage>14</spage><epage>30</epage><pages>14-30</pages><issn>1368-2822</issn><eissn>1460-6984</eissn><coden>IJLDFI</coden><abstract>Background Event‐ and interval‐based measurements are two different ways of computing frequency of stuttering. Interval‐based methodology emerged as an alternative measure to overcome problems associated with reproducibility in the event‐based methodology. No review has been made to study the effect of methodological factors in interval‐based absolute reliability data or to compute the agreement between the two methodologies in terms of inter‐judge, intra‐judge and accuracy (i.e., correspondence between raters’ scores and an established criterion). Aims To provide a review related to reproducibility of event‐based and time‐interval measurement, and to verify the effect of methodological factors (training, experience, interval duration, sample presentation order and judgment conditions) on agreement of time‐interval measurement; in addition, to determine if it is possible to quantify the agreement between the two methodologies Methods &amp; Procedures The first two authors searched for articles on ERIC, MEDLINE, PubMed, B‐on, CENTRAL and Dissertation s during January–February 2013 and retrieved 495 articles. Forty‐eight articles were selected for review. Content tables were constructed with the main findings. Main Contribution Articles related to event‐based measurements revealed values of inter‐ and intra‐judge greater than 0.70 and agreement percentages beyond 80%. The articles related to time‐interval measures revealed that, in general, judges with more experience with stuttering presented significantly higher levels of intra‐ and inter‐judge agreement. Inter‐ and intra‐judge values were beyond the references for high reproducibility values for both methodologies. Accuracy (regarding the closeness of raters’ judgements with an established criterion), intra‐ and inter‐judge agreement were higher for trained groups when compared with non‐trained groups. Sample presentation order and audio/video conditions did not result in differences in inter‐ or intra‐judge results. A duration of 5 s for an interval appears to be an acceptable agreement. Explanation for high reproducibility values as well as parameter choice to report those data are discussed. Conclusions &amp; Implications Both interval‐ and event‐based methodologies used trained or experienced judges for inter‐ and intra‐judge determination and data were beyond the references for good reproducibility values. Inter‐ and intra‐judge values were reported in different metric scales among event‐ and interval‐based methods studies, making it unfeasible to quantify the agreement between the two methods.</abstract><cop>United States</cop><pub>Blackwell Publishing Ltd</pub><pmid>24919948</pmid><doi>10.1111/1460-6984.12113</doi><tpages>17</tpages></addata></record>
fulltext fulltext
identifier ISSN: 1368-2822
ispartof International journal of language & communication disorders, 2015-01, Vol.50 (1), p.14-30
issn 1368-2822
1460-6984
language eng
recordid cdi_proquest_miscellaneous_1700660587
source MEDLINE; Access via Wiley Online Library
subjects accuracy
Agreements
Behavior Therapy - methods
Child
event-based measurement
Humans
inter-judge
interval-based measurement
intra-judge
Observer Variation
Reproducibility of Results
Speech Production Measurement - methods
Speech Production Measurement - statistics & numerical data
Speech Therapy - methods
Stuttering
Stuttering - classification
Stuttering - diagnosis
Stuttering - therapy
title Event- and interval-based measurement of stuttering: a review
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-19T15%3A52%3A24IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Event-%20and%20interval-based%20measurement%20of%20stuttering:%20a%20review&rft.jtitle=International%20journal%20of%20language%20&%20communication%20disorders&rft.au=Valente,%20Ana%20Rita%20S.&rft.date=2015-01&rft.volume=50&rft.issue=1&rft.spage=14&rft.epage=30&rft.pages=14-30&rft.issn=1368-2822&rft.eissn=1460-6984&rft.coden=IJLDFI&rft_id=info:doi/10.1111/1460-6984.12113&rft_dat=%3Cproquest_cross%3E3563869671%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1647111314&rft_id=info:pmid/24919948&rfr_iscdi=true