Interrater Reliability of Posture Observations
Objective: The aims of this research were (a) to study the interrater reliability of a posture observation method, (b) to test the impact of different posture categorization systems on interrater reliability, and (c) to provide guidelines for improving interrater reliability. Background: Estimation...
Gespeichert in:
| Veröffentlicht in: | Human factors 2009-06, Vol.51 (3), p.292-309 |
|---|---|
| Hauptverfasser: | , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 309 |
|---|---|
| container_issue | 3 |
| container_start_page | 292 |
| container_title | Human factors |
| container_volume | 51 |
| creator | Bao, Stephen Howard, Ninica Spielholz, Peregrin Silverstein, Barbara Polissar, Nayak |
| description | Objective: The aims of this research were (a) to study the interrater reliability of a posture observation method, (b) to test the impact of different posture categorization systems on interrater reliability, and (c) to provide guidelines for improving interrater reliability. Background: Estimation of posture through observation is challenging. Previous studies have shown varying degrees of validity and reliability, providing little information about conditions necessary to achieve acceptable reliability. Method: Seven raters estimated posture angles from video recordings. Different measures of interrater reliability, including percentage agreement, precision, expression as interrater standard deviation, and intraclass correlation coefficients (ICC), were computed. Results: Some posture parameters, such as the upper arm flexion and extension, had ICCs ≥ 0.50. Most posture parameters had a precision around the 10° range. The predefined categorization and 30° posture categorization strategies showed substantially better agreement among the raters than did the 10° strategy. Conclusions: Different interrater reliability measures described different aspects of agreement for the posture observation tool. The level of agreement differed substantially between the agreement measures used. Observation of large body parts generally resulted in better reliability. Wider width angle intervals resulted in better percentage agreement compared with narrower intervals. For most postures, 30°angle intervals are appropriate. Training aimed at using a properly designed data entry system, and clear posture definitions with relevant examples, including definitions of the neutral positions of the various body parts, will help improve interrater reliability. Application: The results provide ergonomics practitioners with information about the interrater reliability of a postural observation method and guidelines for improving interrater reliability for video-recorded field data. |
| doi_str_mv | 10.1177/0018720809340273 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_67646871</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sage_id>10.1177_0018720809340273</sage_id><sourcerecordid>21178031</sourcerecordid><originalsourceid>FETCH-LOGICAL-c521t-a091ebbe3e95c07668df623d3b2e373b2c9f0fb536842cfb18489b8e55d67c853</originalsourceid><addsrcrecordid>eNqF0c1LwzAUAPAgipvTuycpiN4685Lm6yjDj8FgInouSZpKR9fOpBX239ttRWUgu7wc3u-9vOQhdAl4DCDEHcYgBcESK5pgIugRGgJLRCxBwjEabtLxJj9AZyEsMMZcUXaKBqAEw0LRIRpPq8Z5r7sQvbqy0KYoi2Yd1Xn0Uoem9S6am-D8l26Kugrn6CTXZXAX_TlC748Pb5PneDZ_mk7uZ7FlBJpYYwXOGEedYhYLzmWWc0IzaoijootW5Tg3jHKZEJsbkIlURjrGMi6sZHSEbnd9V77-bF1o0mURrCtLXbm6DSkXPOFSwEFIOSOM08OQdB8q8RZe78FF3fqqe20KikjgnG4V3inr6xC8y9OVL5bar1PA6WY36f5uupKrvnFrli77LeiX0YGbHuhgdZl7Xdki_DgCUlLRwRGKdy7oD_dnuv8u_gY-wKBt</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1928166331</pqid></control><display><type>article</type><title>Interrater Reliability of Posture Observations</title><source>MEDLINE</source><source>SAGE Complete A-Z List</source><creator>Bao, Stephen ; Howard, Ninica ; Spielholz, Peregrin ; Silverstein, Barbara ; Polissar, Nayak</creator><creatorcontrib>Bao, Stephen ; Howard, Ninica ; Spielholz, Peregrin ; Silverstein, Barbara ; Polissar, Nayak</creatorcontrib><description>Objective: The aims of this research were (a) to study the interrater reliability of a posture observation method, (b) to test the impact of different posture categorization systems on interrater reliability, and (c) to provide guidelines for improving interrater reliability. Background: Estimation of posture through observation is challenging. Previous studies have shown varying degrees of validity and reliability, providing little information about conditions necessary to achieve acceptable reliability. Method: Seven raters estimated posture angles from video recordings. Different measures of interrater reliability, including percentage agreement, precision, expression as interrater standard deviation, and intraclass correlation coefficients (ICC), were computed. Results: Some posture parameters, such as the upper arm flexion and extension, had ICCs ≥ 0.50. Most posture parameters had a precision around the 10° range. The predefined categorization and 30° posture categorization strategies showed substantially better agreement among the raters than did the 10° strategy. Conclusions: Different interrater reliability measures described different aspects of agreement for the posture observation tool. The level of agreement differed substantially between the agreement measures used. Observation of large body parts generally resulted in better reliability. Wider width angle intervals resulted in better percentage agreement compared with narrower intervals. For most postures, 30°angle intervals are appropriate. Training aimed at using a properly designed data entry system, and clear posture definitions with relevant examples, including definitions of the neutral positions of the various body parts, will help improve interrater reliability. Application: The results provide ergonomics practitioners with information about the interrater reliability of a postural observation method and guidelines for improving interrater reliability for video-recorded field data.</description><identifier>ISSN: 0018-7208</identifier><identifier>EISSN: 1547-8181</identifier><identifier>DOI: 10.1177/0018720809340273</identifier><identifier>PMID: 19750793</identifier><identifier>CODEN: HUFAA6</identifier><language>eng</language><publisher>Los Angeles, CA: SAGE Publications</publisher><subject>Activity levels. Psychomotricity ; Arm ; Biological and medical sciences ; Body parts ; Classification ; Component reliability ; Correlation coefficient ; Correlation coefficients ; Data processing ; Ergonomics ; Ergonomics - methods ; Fundamental and applied biological sciences. Psychology ; Guidelines ; Humans ; Intervals ; Observation - methods ; Observational studies ; Observer Variation ; Posture ; Psychology. Psychoanalysis. Psychiatry ; Psychology. Psychophysiology ; Psychomotor activities ; Reliability aspects ; Reproducibility ; Reproducibility of Results ; Space life sciences ; System reliability ; Test procedures ; Video data ; Work - physiology</subject><ispartof>Human factors, 2009-06, Vol.51 (3), p.292-309</ispartof><rights>2009 INIST-CNRS</rights><rights>Copyright Human Factors and Ergonomics Society Jun 2009</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c521t-a091ebbe3e95c07668df623d3b2e373b2c9f0fb536842cfb18489b8e55d67c853</citedby><cites>FETCH-LOGICAL-c521t-a091ebbe3e95c07668df623d3b2e373b2c9f0fb536842cfb18489b8e55d67c853</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://journals.sagepub.com/doi/pdf/10.1177/0018720809340273$$EPDF$$P50$$Gsage$$H</linktopdf><linktohtml>$$Uhttps://journals.sagepub.com/doi/10.1177/0018720809340273$$EHTML$$P50$$Gsage$$H</linktohtml><link.rule.ids>314,780,784,21819,27924,27925,43621,43622</link.rule.ids><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=21883779$$DView record in Pascal Francis$$Hfree_for_read</backlink><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/19750793$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Bao, Stephen</creatorcontrib><creatorcontrib>Howard, Ninica</creatorcontrib><creatorcontrib>Spielholz, Peregrin</creatorcontrib><creatorcontrib>Silverstein, Barbara</creatorcontrib><creatorcontrib>Polissar, Nayak</creatorcontrib><title>Interrater Reliability of Posture Observations</title><title>Human factors</title><addtitle>Hum Factors</addtitle><description>Objective: The aims of this research were (a) to study the interrater reliability of a posture observation method, (b) to test the impact of different posture categorization systems on interrater reliability, and (c) to provide guidelines for improving interrater reliability. Background: Estimation of posture through observation is challenging. Previous studies have shown varying degrees of validity and reliability, providing little information about conditions necessary to achieve acceptable reliability. Method: Seven raters estimated posture angles from video recordings. Different measures of interrater reliability, including percentage agreement, precision, expression as interrater standard deviation, and intraclass correlation coefficients (ICC), were computed. Results: Some posture parameters, such as the upper arm flexion and extension, had ICCs ≥ 0.50. Most posture parameters had a precision around the 10° range. The predefined categorization and 30° posture categorization strategies showed substantially better agreement among the raters than did the 10° strategy. Conclusions: Different interrater reliability measures described different aspects of agreement for the posture observation tool. The level of agreement differed substantially between the agreement measures used. Observation of large body parts generally resulted in better reliability. Wider width angle intervals resulted in better percentage agreement compared with narrower intervals. For most postures, 30°angle intervals are appropriate. Training aimed at using a properly designed data entry system, and clear posture definitions with relevant examples, including definitions of the neutral positions of the various body parts, will help improve interrater reliability. Application: The results provide ergonomics practitioners with information about the interrater reliability of a postural observation method and guidelines for improving interrater reliability for video-recorded field data.</description><subject>Activity levels. Psychomotricity</subject><subject>Arm</subject><subject>Biological and medical sciences</subject><subject>Body parts</subject><subject>Classification</subject><subject>Component reliability</subject><subject>Correlation coefficient</subject><subject>Correlation coefficients</subject><subject>Data processing</subject><subject>Ergonomics</subject><subject>Ergonomics - methods</subject><subject>Fundamental and applied biological sciences. Psychology</subject><subject>Guidelines</subject><subject>Humans</subject><subject>Intervals</subject><subject>Observation - methods</subject><subject>Observational studies</subject><subject>Observer Variation</subject><subject>Posture</subject><subject>Psychology. Psychoanalysis. Psychiatry</subject><subject>Psychology. Psychophysiology</subject><subject>Psychomotor activities</subject><subject>Reliability aspects</subject><subject>Reproducibility</subject><subject>Reproducibility of Results</subject><subject>Space life sciences</subject><subject>System reliability</subject><subject>Test procedures</subject><subject>Video data</subject><subject>Work - physiology</subject><issn>0018-7208</issn><issn>1547-8181</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2009</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNqF0c1LwzAUAPAgipvTuycpiN4685Lm6yjDj8FgInouSZpKR9fOpBX239ttRWUgu7wc3u-9vOQhdAl4DCDEHcYgBcESK5pgIugRGgJLRCxBwjEabtLxJj9AZyEsMMZcUXaKBqAEw0LRIRpPq8Z5r7sQvbqy0KYoi2Yd1Xn0Uoem9S6am-D8l26Kugrn6CTXZXAX_TlC748Pb5PneDZ_mk7uZ7FlBJpYYwXOGEedYhYLzmWWc0IzaoijootW5Tg3jHKZEJsbkIlURjrGMi6sZHSEbnd9V77-bF1o0mURrCtLXbm6DSkXPOFSwEFIOSOM08OQdB8q8RZe78FF3fqqe20KikjgnG4V3inr6xC8y9OVL5bar1PA6WY36f5uupKrvnFrli77LeiX0YGbHuhgdZl7Xdki_DgCUlLRwRGKdy7oD_dnuv8u_gY-wKBt</recordid><startdate>20090601</startdate><enddate>20090601</enddate><creator>Bao, Stephen</creator><creator>Howard, Ninica</creator><creator>Spielholz, Peregrin</creator><creator>Silverstein, Barbara</creator><creator>Polissar, Nayak</creator><general>SAGE Publications</general><general>Human Factors and Ergonomics Society</general><scope>IQODW</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QF</scope><scope>7QQ</scope><scope>7SC</scope><scope>7SE</scope><scope>7SP</scope><scope>7SR</scope><scope>7T2</scope><scope>7TA</scope><scope>7TB</scope><scope>7TK</scope><scope>7U5</scope><scope>8BQ</scope><scope>8FD</scope><scope>C1K</scope><scope>F28</scope><scope>FR3</scope><scope>H8D</scope><scope>H8G</scope><scope>JG9</scope><scope>JQ2</scope><scope>K9.</scope><scope>KR7</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>7U2</scope><scope>7X8</scope></search><sort><creationdate>20090601</creationdate><title>Interrater Reliability of Posture Observations</title><author>Bao, Stephen ; Howard, Ninica ; Spielholz, Peregrin ; Silverstein, Barbara ; Polissar, Nayak</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c521t-a091ebbe3e95c07668df623d3b2e373b2c9f0fb536842cfb18489b8e55d67c853</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2009</creationdate><topic>Activity levels. Psychomotricity</topic><topic>Arm</topic><topic>Biological and medical sciences</topic><topic>Body parts</topic><topic>Classification</topic><topic>Component reliability</topic><topic>Correlation coefficient</topic><topic>Correlation coefficients</topic><topic>Data processing</topic><topic>Ergonomics</topic><topic>Ergonomics - methods</topic><topic>Fundamental and applied biological sciences. Psychology</topic><topic>Guidelines</topic><topic>Humans</topic><topic>Intervals</topic><topic>Observation - methods</topic><topic>Observational studies</topic><topic>Observer Variation</topic><topic>Posture</topic><topic>Psychology. Psychoanalysis. Psychiatry</topic><topic>Psychology. Psychophysiology</topic><topic>Psychomotor activities</topic><topic>Reliability aspects</topic><topic>Reproducibility</topic><topic>Reproducibility of Results</topic><topic>Space life sciences</topic><topic>System reliability</topic><topic>Test procedures</topic><topic>Video data</topic><topic>Work - physiology</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Bao, Stephen</creatorcontrib><creatorcontrib>Howard, Ninica</creatorcontrib><creatorcontrib>Spielholz, Peregrin</creatorcontrib><creatorcontrib>Silverstein, Barbara</creatorcontrib><creatorcontrib>Polissar, Nayak</creatorcontrib><collection>Pascal-Francis</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Aluminium Industry Abstracts</collection><collection>Ceramic Abstracts</collection><collection>Computer and Information Systems Abstracts</collection><collection>Corrosion Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>Health and Safety Science Abstracts (Full archive)</collection><collection>Materials Business File</collection><collection>Mechanical & Transportation Engineering Abstracts</collection><collection>Neurosciences Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ANTE: Abstracts in New Technology & Engineering</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>Copper Technical Reference Library</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>Safety Science and Risk</collection><collection>MEDLINE - Academic</collection><jtitle>Human factors</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Bao, Stephen</au><au>Howard, Ninica</au><au>Spielholz, Peregrin</au><au>Silverstein, Barbara</au><au>Polissar, Nayak</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Interrater Reliability of Posture Observations</atitle><jtitle>Human factors</jtitle><addtitle>Hum Factors</addtitle><date>2009-06-01</date><risdate>2009</risdate><volume>51</volume><issue>3</issue><spage>292</spage><epage>309</epage><pages>292-309</pages><issn>0018-7208</issn><eissn>1547-8181</eissn><coden>HUFAA6</coden><abstract>Objective: The aims of this research were (a) to study the interrater reliability of a posture observation method, (b) to test the impact of different posture categorization systems on interrater reliability, and (c) to provide guidelines for improving interrater reliability. Background: Estimation of posture through observation is challenging. Previous studies have shown varying degrees of validity and reliability, providing little information about conditions necessary to achieve acceptable reliability. Method: Seven raters estimated posture angles from video recordings. Different measures of interrater reliability, including percentage agreement, precision, expression as interrater standard deviation, and intraclass correlation coefficients (ICC), were computed. Results: Some posture parameters, such as the upper arm flexion and extension, had ICCs ≥ 0.50. Most posture parameters had a precision around the 10° range. The predefined categorization and 30° posture categorization strategies showed substantially better agreement among the raters than did the 10° strategy. Conclusions: Different interrater reliability measures described different aspects of agreement for the posture observation tool. The level of agreement differed substantially between the agreement measures used. Observation of large body parts generally resulted in better reliability. Wider width angle intervals resulted in better percentage agreement compared with narrower intervals. For most postures, 30°angle intervals are appropriate. Training aimed at using a properly designed data entry system, and clear posture definitions with relevant examples, including definitions of the neutral positions of the various body parts, will help improve interrater reliability. Application: The results provide ergonomics practitioners with information about the interrater reliability of a postural observation method and guidelines for improving interrater reliability for video-recorded field data.</abstract><cop>Los Angeles, CA</cop><pub>SAGE Publications</pub><pmid>19750793</pmid><doi>10.1177/0018720809340273</doi><tpages>18</tpages></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 0018-7208 |
| ispartof | Human factors, 2009-06, Vol.51 (3), p.292-309 |
| issn | 0018-7208 1547-8181 |
| language | eng |
| recordid | cdi_proquest_miscellaneous_67646871 |
| source | MEDLINE; SAGE Complete A-Z List |
| subjects | Activity levels. Psychomotricity Arm Biological and medical sciences Body parts Classification Component reliability Correlation coefficient Correlation coefficients Data processing Ergonomics Ergonomics - methods Fundamental and applied biological sciences. Psychology Guidelines Humans Intervals Observation - methods Observational studies Observer Variation Posture Psychology. Psychoanalysis. Psychiatry Psychology. Psychophysiology Psychomotor activities Reliability aspects Reproducibility Reproducibility of Results Space life sciences System reliability Test procedures Video data Work - physiology |
| title | Interrater Reliability of Posture Observations |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-06T01%3A18%3A44IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Interrater%20Reliability%20of%20Posture%20Observations&rft.jtitle=Human%20factors&rft.au=Bao,%20Stephen&rft.date=2009-06-01&rft.volume=51&rft.issue=3&rft.spage=292&rft.epage=309&rft.pages=292-309&rft.issn=0018-7208&rft.eissn=1547-8181&rft.coden=HUFAA6&rft_id=info:doi/10.1177/0018720809340273&rft_dat=%3Cproquest_cross%3E21178031%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1928166331&rft_id=info:pmid/19750793&rft_sage_id=10.1177_0018720809340273&rfr_iscdi=true |