Event- and interval-based measurement of stuttering: a review
Background Event‐ and interval‐based measurements are two different ways of computing frequency of stuttering. Interval‐based methodology emerged as an alternative measure to overcome problems associated with reproducibility in the event‐based methodology. No review has been made to study the effect...
Gespeichert in:
Veröffentlicht in: | International journal of language & communication disorders 2015-01, Vol.50 (1), p.14-30 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 30 |
---|---|
container_issue | 1 |
container_start_page | 14 |
container_title | International journal of language & communication disorders |
container_volume | 50 |
creator | Valente, Ana Rita S. Jesus, Luis M. T. Hall, Andreia Leahy, Margaret |
description | Background
Event‐ and interval‐based measurements are two different ways of computing frequency of stuttering. Interval‐based methodology emerged as an alternative measure to overcome problems associated with reproducibility in the event‐based methodology. No review has been made to study the effect of methodological factors in interval‐based absolute reliability data or to compute the agreement between the two methodologies in terms of inter‐judge, intra‐judge and accuracy (i.e., correspondence between raters’ scores and an established criterion).
Aims
To provide a review related to reproducibility of event‐based and time‐interval measurement, and to verify the effect of methodological factors (training, experience, interval duration, sample presentation order and judgment conditions) on agreement of time‐interval measurement; in addition, to determine if it is possible to quantify the agreement between the two methodologies
Methods & Procedures
The first two authors searched for articles on ERIC, MEDLINE, PubMed, B‐on, CENTRAL and Dissertation s during January–February 2013 and retrieved 495 articles. Forty‐eight articles were selected for review. Content tables were constructed with the main findings.
Main Contribution
Articles related to event‐based measurements revealed values of inter‐ and intra‐judge greater than 0.70 and agreement percentages beyond 80%. The articles related to time‐interval measures revealed that, in general, judges with more experience with stuttering presented significantly higher levels of intra‐ and inter‐judge agreement. Inter‐ and intra‐judge values were beyond the references for high reproducibility values for both methodologies. Accuracy (regarding the closeness of raters’ judgements with an established criterion), intra‐ and inter‐judge agreement were higher for trained groups when compared with non‐trained groups. Sample presentation order and audio/video conditions did not result in differences in inter‐ or intra‐judge results. A duration of 5 s for an interval appears to be an acceptable agreement. Explanation for high reproducibility values as well as parameter choice to report those data are discussed.
Conclusions & Implications
Both interval‐ and event‐based methodologies used trained or experienced judges for inter‐ and intra‐judge determination and data were beyond the references for good reproducibility values. Inter‐ and intra‐judge values were reported in different metric scales among event‐ and interval‐based |
doi_str_mv | 10.1111/1460-6984.12113 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1700660587</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3563869671</sourcerecordid><originalsourceid>FETCH-LOGICAL-c4763-57a0995b5135ea9640dcf6116b3c1bfabc54b709aebcfb80d27ba448169430053</originalsourceid><addsrcrecordid>eNqFkbtPHDEQxq0oUXilpkMrpaFZ8Pi5RqJAxzO6QEMUKY1l785GS_Zx2LsH_Pfx5eCKNEzjkef3fdJ8Q8g-0CNIdQxC0VyZQhwBA-AfyPbm52PquSpyVjC2RXZifKCUMpDwmWwxYcAYUWyT04sl9mOeub7Kmn7EsHRt7l3EKuvQxSlgl-bZUGdxnMY0b_rfJ5nLAi4bfNojn2rXRvzy-u6SH5cX97PrfH53dTM7m-el0IrnUjtqjPQSuERnlKBVWSsA5XkJvna-lMJrahz6svYFrZj2TogClBGcUsl3yeHadxGGxwnjaLsmlti2rsdhihY0pUpRWej3USUZNykJmtCv_6EPwxT6tEiihE75chCJOl5TZRhiDFjbRWg6F14sULs6gl1FbleR239HSIqDV9_Jd1ht-LfUE6DWwFPT4st7fvbbfHb-5pyvhU0c8XkjdOGPVZpraX_eXll-KRT_xb7bOf8LkSCdHQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1647111314</pqid></control><display><type>article</type><title>Event- and interval-based measurement of stuttering: a review</title><source>MEDLINE</source><source>Access via Wiley Online Library</source><creator>Valente, Ana Rita S. ; Jesus, Luis M. T. ; Hall, Andreia ; Leahy, Margaret</creator><creatorcontrib>Valente, Ana Rita S. ; Jesus, Luis M. T. ; Hall, Andreia ; Leahy, Margaret</creatorcontrib><description>Background
Event‐ and interval‐based measurements are two different ways of computing frequency of stuttering. Interval‐based methodology emerged as an alternative measure to overcome problems associated with reproducibility in the event‐based methodology. No review has been made to study the effect of methodological factors in interval‐based absolute reliability data or to compute the agreement between the two methodologies in terms of inter‐judge, intra‐judge and accuracy (i.e., correspondence between raters’ scores and an established criterion).
Aims
To provide a review related to reproducibility of event‐based and time‐interval measurement, and to verify the effect of methodological factors (training, experience, interval duration, sample presentation order and judgment conditions) on agreement of time‐interval measurement; in addition, to determine if it is possible to quantify the agreement between the two methodologies
Methods & Procedures
The first two authors searched for articles on ERIC, MEDLINE, PubMed, B‐on, CENTRAL and Dissertation s during January–February 2013 and retrieved 495 articles. Forty‐eight articles were selected for review. Content tables were constructed with the main findings.
Main Contribution
Articles related to event‐based measurements revealed values of inter‐ and intra‐judge greater than 0.70 and agreement percentages beyond 80%. The articles related to time‐interval measures revealed that, in general, judges with more experience with stuttering presented significantly higher levels of intra‐ and inter‐judge agreement. Inter‐ and intra‐judge values were beyond the references for high reproducibility values for both methodologies. Accuracy (regarding the closeness of raters’ judgements with an established criterion), intra‐ and inter‐judge agreement were higher for trained groups when compared with non‐trained groups. Sample presentation order and audio/video conditions did not result in differences in inter‐ or intra‐judge results. A duration of 5 s for an interval appears to be an acceptable agreement. Explanation for high reproducibility values as well as parameter choice to report those data are discussed.
Conclusions & Implications
Both interval‐ and event‐based methodologies used trained or experienced judges for inter‐ and intra‐judge determination and data were beyond the references for good reproducibility values. Inter‐ and intra‐judge values were reported in different metric scales among event‐ and interval‐based methods studies, making it unfeasible to quantify the agreement between the two methods.</description><identifier>ISSN: 1368-2822</identifier><identifier>EISSN: 1460-6984</identifier><identifier>DOI: 10.1111/1460-6984.12113</identifier><identifier>PMID: 24919948</identifier><identifier>CODEN: IJLDFI</identifier><language>eng</language><publisher>United States: Blackwell Publishing Ltd</publisher><subject>accuracy ; Agreements ; Behavior Therapy - methods ; Child ; event-based measurement ; Humans ; inter-judge ; interval-based measurement ; intra-judge ; Observer Variation ; Reproducibility of Results ; Speech Production Measurement - methods ; Speech Production Measurement - statistics & numerical data ; Speech Therapy - methods ; Stuttering ; Stuttering - classification ; Stuttering - diagnosis ; Stuttering - therapy</subject><ispartof>International journal of language & communication disorders, 2015-01, Vol.50 (1), p.14-30</ispartof><rights>2014 Royal College of Speech and Language Therapists</rights><rights>2014 Royal College of Speech and Language Therapists.</rights><rights>2015 Royal College of Speech and Language Therapists</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c4763-57a0995b5135ea9640dcf6116b3c1bfabc54b709aebcfb80d27ba448169430053</citedby><cites>FETCH-LOGICAL-c4763-57a0995b5135ea9640dcf6116b3c1bfabc54b709aebcfb80d27ba448169430053</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1111%2F1460-6984.12113$$EPDF$$P50$$Gwiley$$H</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1111%2F1460-6984.12113$$EHTML$$P50$$Gwiley$$H</linktohtml><link.rule.ids>314,780,784,1417,27924,27925,45574,45575</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/24919948$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Valente, Ana Rita S.</creatorcontrib><creatorcontrib>Jesus, Luis M. T.</creatorcontrib><creatorcontrib>Hall, Andreia</creatorcontrib><creatorcontrib>Leahy, Margaret</creatorcontrib><title>Event- and interval-based measurement of stuttering: a review</title><title>International journal of language & communication disorders</title><addtitle>INT J LANG COMMUN DISORD</addtitle><description>Background
Event‐ and interval‐based measurements are two different ways of computing frequency of stuttering. Interval‐based methodology emerged as an alternative measure to overcome problems associated with reproducibility in the event‐based methodology. No review has been made to study the effect of methodological factors in interval‐based absolute reliability data or to compute the agreement between the two methodologies in terms of inter‐judge, intra‐judge and accuracy (i.e., correspondence between raters’ scores and an established criterion).
Aims
To provide a review related to reproducibility of event‐based and time‐interval measurement, and to verify the effect of methodological factors (training, experience, interval duration, sample presentation order and judgment conditions) on agreement of time‐interval measurement; in addition, to determine if it is possible to quantify the agreement between the two methodologies
Methods & Procedures
The first two authors searched for articles on ERIC, MEDLINE, PubMed, B‐on, CENTRAL and Dissertation s during January–February 2013 and retrieved 495 articles. Forty‐eight articles were selected for review. Content tables were constructed with the main findings.
Main Contribution
Articles related to event‐based measurements revealed values of inter‐ and intra‐judge greater than 0.70 and agreement percentages beyond 80%. The articles related to time‐interval measures revealed that, in general, judges with more experience with stuttering presented significantly higher levels of intra‐ and inter‐judge agreement. Inter‐ and intra‐judge values were beyond the references for high reproducibility values for both methodologies. Accuracy (regarding the closeness of raters’ judgements with an established criterion), intra‐ and inter‐judge agreement were higher for trained groups when compared with non‐trained groups. Sample presentation order and audio/video conditions did not result in differences in inter‐ or intra‐judge results. A duration of 5 s for an interval appears to be an acceptable agreement. Explanation for high reproducibility values as well as parameter choice to report those data are discussed.
Conclusions & Implications
Both interval‐ and event‐based methodologies used trained or experienced judges for inter‐ and intra‐judge determination and data were beyond the references for good reproducibility values. Inter‐ and intra‐judge values were reported in different metric scales among event‐ and interval‐based methods studies, making it unfeasible to quantify the agreement between the two methods.</description><subject>accuracy</subject><subject>Agreements</subject><subject>Behavior Therapy - methods</subject><subject>Child</subject><subject>event-based measurement</subject><subject>Humans</subject><subject>inter-judge</subject><subject>interval-based measurement</subject><subject>intra-judge</subject><subject>Observer Variation</subject><subject>Reproducibility of Results</subject><subject>Speech Production Measurement - methods</subject><subject>Speech Production Measurement - statistics & numerical data</subject><subject>Speech Therapy - methods</subject><subject>Stuttering</subject><subject>Stuttering - classification</subject><subject>Stuttering - diagnosis</subject><subject>Stuttering - therapy</subject><issn>1368-2822</issn><issn>1460-6984</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2015</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNqFkbtPHDEQxq0oUXilpkMrpaFZ8Pi5RqJAxzO6QEMUKY1l785GS_Zx2LsH_Pfx5eCKNEzjkef3fdJ8Q8g-0CNIdQxC0VyZQhwBA-AfyPbm52PquSpyVjC2RXZifKCUMpDwmWwxYcAYUWyT04sl9mOeub7Kmn7EsHRt7l3EKuvQxSlgl-bZUGdxnMY0b_rfJ5nLAi4bfNojn2rXRvzy-u6SH5cX97PrfH53dTM7m-el0IrnUjtqjPQSuERnlKBVWSsA5XkJvna-lMJrahz6svYFrZj2TogClBGcUsl3yeHadxGGxwnjaLsmlti2rsdhihY0pUpRWej3USUZNykJmtCv_6EPwxT6tEiihE75chCJOl5TZRhiDFjbRWg6F14sULs6gl1FbleR239HSIqDV9_Jd1ht-LfUE6DWwFPT4st7fvbbfHb-5pyvhU0c8XkjdOGPVZpraX_eXll-KRT_xb7bOf8LkSCdHQ</recordid><startdate>201501</startdate><enddate>201501</enddate><creator>Valente, Ana Rita S.</creator><creator>Jesus, Luis M. T.</creator><creator>Hall, Andreia</creator><creator>Leahy, Margaret</creator><general>Blackwell Publishing Ltd</general><general>Wiley Subscription Services, Inc</general><scope>BSCLL</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7T9</scope><scope>8BM</scope><scope>K9.</scope><scope>NAPCQ</scope><scope>7X8</scope></search><sort><creationdate>201501</creationdate><title>Event- and interval-based measurement of stuttering: a review</title><author>Valente, Ana Rita S. ; Jesus, Luis M. T. ; Hall, Andreia ; Leahy, Margaret</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c4763-57a0995b5135ea9640dcf6116b3c1bfabc54b709aebcfb80d27ba448169430053</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2015</creationdate><topic>accuracy</topic><topic>Agreements</topic><topic>Behavior Therapy - methods</topic><topic>Child</topic><topic>event-based measurement</topic><topic>Humans</topic><topic>inter-judge</topic><topic>interval-based measurement</topic><topic>intra-judge</topic><topic>Observer Variation</topic><topic>Reproducibility of Results</topic><topic>Speech Production Measurement - methods</topic><topic>Speech Production Measurement - statistics & numerical data</topic><topic>Speech Therapy - methods</topic><topic>Stuttering</topic><topic>Stuttering - classification</topic><topic>Stuttering - diagnosis</topic><topic>Stuttering - therapy</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Valente, Ana Rita S.</creatorcontrib><creatorcontrib>Jesus, Luis M. T.</creatorcontrib><creatorcontrib>Hall, Andreia</creatorcontrib><creatorcontrib>Leahy, Margaret</creatorcontrib><collection>Istex</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Linguistics and Language Behavior Abstracts (LLBA)</collection><collection>ComDisDome</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Nursing & Allied Health Premium</collection><collection>MEDLINE - Academic</collection><jtitle>International journal of language & communication disorders</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Valente, Ana Rita S.</au><au>Jesus, Luis M. T.</au><au>Hall, Andreia</au><au>Leahy, Margaret</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Event- and interval-based measurement of stuttering: a review</atitle><jtitle>International journal of language & communication disorders</jtitle><addtitle>INT J LANG COMMUN DISORD</addtitle><date>2015-01</date><risdate>2015</risdate><volume>50</volume><issue>1</issue><spage>14</spage><epage>30</epage><pages>14-30</pages><issn>1368-2822</issn><eissn>1460-6984</eissn><coden>IJLDFI</coden><abstract>Background
Event‐ and interval‐based measurements are two different ways of computing frequency of stuttering. Interval‐based methodology emerged as an alternative measure to overcome problems associated with reproducibility in the event‐based methodology. No review has been made to study the effect of methodological factors in interval‐based absolute reliability data or to compute the agreement between the two methodologies in terms of inter‐judge, intra‐judge and accuracy (i.e., correspondence between raters’ scores and an established criterion).
Aims
To provide a review related to reproducibility of event‐based and time‐interval measurement, and to verify the effect of methodological factors (training, experience, interval duration, sample presentation order and judgment conditions) on agreement of time‐interval measurement; in addition, to determine if it is possible to quantify the agreement between the two methodologies
Methods & Procedures
The first two authors searched for articles on ERIC, MEDLINE, PubMed, B‐on, CENTRAL and Dissertation s during January–February 2013 and retrieved 495 articles. Forty‐eight articles were selected for review. Content tables were constructed with the main findings.
Main Contribution
Articles related to event‐based measurements revealed values of inter‐ and intra‐judge greater than 0.70 and agreement percentages beyond 80%. The articles related to time‐interval measures revealed that, in general, judges with more experience with stuttering presented significantly higher levels of intra‐ and inter‐judge agreement. Inter‐ and intra‐judge values were beyond the references for high reproducibility values for both methodologies. Accuracy (regarding the closeness of raters’ judgements with an established criterion), intra‐ and inter‐judge agreement were higher for trained groups when compared with non‐trained groups. Sample presentation order and audio/video conditions did not result in differences in inter‐ or intra‐judge results. A duration of 5 s for an interval appears to be an acceptable agreement. Explanation for high reproducibility values as well as parameter choice to report those data are discussed.
Conclusions & Implications
Both interval‐ and event‐based methodologies used trained or experienced judges for inter‐ and intra‐judge determination and data were beyond the references for good reproducibility values. Inter‐ and intra‐judge values were reported in different metric scales among event‐ and interval‐based methods studies, making it unfeasible to quantify the agreement between the two methods.</abstract><cop>United States</cop><pub>Blackwell Publishing Ltd</pub><pmid>24919948</pmid><doi>10.1111/1460-6984.12113</doi><tpages>17</tpages></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1368-2822 |
ispartof | International journal of language & communication disorders, 2015-01, Vol.50 (1), p.14-30 |
issn | 1368-2822 1460-6984 |
language | eng |
recordid | cdi_proquest_miscellaneous_1700660587 |
source | MEDLINE; Access via Wiley Online Library |
subjects | accuracy Agreements Behavior Therapy - methods Child event-based measurement Humans inter-judge interval-based measurement intra-judge Observer Variation Reproducibility of Results Speech Production Measurement - methods Speech Production Measurement - statistics & numerical data Speech Therapy - methods Stuttering Stuttering - classification Stuttering - diagnosis Stuttering - therapy |
title | Event- and interval-based measurement of stuttering: a review |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-19T15%3A52%3A24IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Event-%20and%20interval-based%20measurement%20of%20stuttering:%20a%20review&rft.jtitle=International%20journal%20of%20language%20&%20communication%20disorders&rft.au=Valente,%20Ana%20Rita%20S.&rft.date=2015-01&rft.volume=50&rft.issue=1&rft.spage=14&rft.epage=30&rft.pages=14-30&rft.issn=1368-2822&rft.eissn=1460-6984&rft.coden=IJLDFI&rft_id=info:doi/10.1111/1460-6984.12113&rft_dat=%3Cproquest_cross%3E3563869671%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1647111314&rft_id=info:pmid/24919948&rfr_iscdi=true |