Insufficient Effort Survey Responding: An Under-Appreciated Problem in Work and Organisational Health Psychology Research
Insufficient effort responding (IER) is problematic in that it can add a systematic source of variance for variables with average responses that depart from the scale midpoints. We present a rationale for why IER is of particular importance to Work and Organisational Health Psychology (WOHP) researc...
Gespeichert in:
Veröffentlicht in: | Applied psychology 2016-04, Vol.65 (2), p.287-321 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 321 |
---|---|
container_issue | 2 |
container_start_page | 287 |
container_title | Applied psychology |
container_volume | 65 |
creator | McGonagle, Alyssa K. Huang, Jason L. Walsh, Benjamin M. |
description | Insufficient effort responding (IER) is problematic in that it can add a systematic source of variance for variables with average responses that depart from the scale midpoints. We present a rationale for why IER is of particular importance to Work and Organisational Health Psychology (WOHP) researchers. We also demonstrate its biasing effects using several variables of interest to WOHP researchers (perceived work ability, negative affectivity, perceived disability, work–safety tension, accident/injury frequencies, and experienced and instigated incivility) in two datasets. As expected, IER was significantly correlated with the focal study variables. We also found some evidence that hypothesised bivariate correlations between these variables were inflated when IER respondents were included. Corroborating IER's potential confounding role, we further found significant declines in the magnitude of the hypothesised bivariate correlations after partialling out IER. In addition, we found evidence for biasing (under‐estimation) effects for predictors not contaminated by IER in multiple regression models where some predictors and the outcome were both contaminated by IER. We call for WOHP researchers to routinely discourage IER from occurring in their surveys, screen for IER prior to analyzing survey data, and establish a standard practice for handling IER cases. |
doi_str_mv | 10.1111/apps.12058 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_1774388690</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3990883511</sourcerecordid><originalsourceid>FETCH-LOGICAL-c3398-1dab0710efa7b85eaac2c94ce842e82494209a4cb8227a00c1fd227c4327f8673</originalsourceid><addsrcrecordid>eNp9kE9PGzEUxC0EEoH20k9gqTekBdvrrO3eoggSJFQi_ihVL5bjfU4Mi73YG9r99iyk5chc3jv8ZjQahL5RckoHnZm2zaeUkbHcQyPKK16QsRL7aERYpQql-K9DdJTzAxlUldUI9Zchb53z1kPo8LlzMXX4dpteoMc3kNsYah_WP_Ak4PtQQyombZvAetNBjRcprhp4wj7gZUyP2IQaX6e1CT6bzsdgGjwH03QbvMi93cQmrt9TwSS7-YIOnGkyfP13j9H9xfnddF5cXc8up5OrwpalkgWtzYoISsAZsZJjMMYyq7gFyRlIxhVnRBluV5IxYQix1NXDZ3nJhJOVKI_R911um-LzFnKnH-I2Dd2ypkLwUspKkYE62VE2xZwTON0m_2RSrynRb9Pqt2n1-7QDTHfwH99A_wmpJ4vF7X9PsfP43MHfD49Jj3ooKcZ6-XOmufo9v5iVU70sXwGGC4xd</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1774388690</pqid></control><display><type>article</type><title>Insufficient Effort Survey Responding: An Under-Appreciated Problem in Work and Organisational Health Psychology Research</title><source>Wiley Online Library - AutoHoldings Journals</source><source>EBSCOhost Business Source Complete</source><source>Applied Social Sciences Index & Abstracts (ASSIA)</source><creator>McGonagle, Alyssa K. ; Huang, Jason L. ; Walsh, Benjamin M.</creator><creatorcontrib>McGonagle, Alyssa K. ; Huang, Jason L. ; Walsh, Benjamin M.</creatorcontrib><description>Insufficient effort responding (IER) is problematic in that it can add a systematic source of variance for variables with average responses that depart from the scale midpoints. We present a rationale for why IER is of particular importance to Work and Organisational Health Psychology (WOHP) researchers. We also demonstrate its biasing effects using several variables of interest to WOHP researchers (perceived work ability, negative affectivity, perceived disability, work–safety tension, accident/injury frequencies, and experienced and instigated incivility) in two datasets. As expected, IER was significantly correlated with the focal study variables. We also found some evidence that hypothesised bivariate correlations between these variables were inflated when IER respondents were included. Corroborating IER's potential confounding role, we further found significant declines in the magnitude of the hypothesised bivariate correlations after partialling out IER. In addition, we found evidence for biasing (under‐estimation) effects for predictors not contaminated by IER in multiple regression models where some predictors and the outcome were both contaminated by IER. We call for WOHP researchers to routinely discourage IER from occurring in their surveys, screen for IER prior to analyzing survey data, and establish a standard practice for handling IER cases.</description><identifier>ISSN: 0269-994X</identifier><identifier>EISSN: 1464-0597</identifier><identifier>DOI: 10.1111/apps.12058</identifier><language>eng</language><publisher>Oxford: Blackwell Publishing Ltd</publisher><subject>Accidents ; Clinical assessment ; Disability ; Health psychology ; Injuries ; Medical research ; Negative emotions ; Occupational health ; Occupational health and safety ; Occupational psychology ; Occupational safety ; Psychological aspects ; Psychology ; Safety ; Studies ; Variables</subject><ispartof>Applied psychology, 2016-04, Vol.65 (2), p.287-321</ispartof><rights>2015 International Association of Applied Psychology.</rights><rights>2016 International Association of Applied Psychology.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c3398-1dab0710efa7b85eaac2c94ce842e82494209a4cb8227a00c1fd227c4327f8673</citedby><cites>FETCH-LOGICAL-c3398-1dab0710efa7b85eaac2c94ce842e82494209a4cb8227a00c1fd227c4327f8673</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1111%2Fapps.12058$$EPDF$$P50$$Gwiley$$H</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1111%2Fapps.12058$$EHTML$$P50$$Gwiley$$H</linktohtml><link.rule.ids>314,780,784,1417,27924,27925,30999,45574,45575</link.rule.ids></links><search><creatorcontrib>McGonagle, Alyssa K.</creatorcontrib><creatorcontrib>Huang, Jason L.</creatorcontrib><creatorcontrib>Walsh, Benjamin M.</creatorcontrib><title>Insufficient Effort Survey Responding: An Under-Appreciated Problem in Work and Organisational Health Psychology Research</title><title>Applied psychology</title><addtitle>Applied Psychology</addtitle><description>Insufficient effort responding (IER) is problematic in that it can add a systematic source of variance for variables with average responses that depart from the scale midpoints. We present a rationale for why IER is of particular importance to Work and Organisational Health Psychology (WOHP) researchers. We also demonstrate its biasing effects using several variables of interest to WOHP researchers (perceived work ability, negative affectivity, perceived disability, work–safety tension, accident/injury frequencies, and experienced and instigated incivility) in two datasets. As expected, IER was significantly correlated with the focal study variables. We also found some evidence that hypothesised bivariate correlations between these variables were inflated when IER respondents were included. Corroborating IER's potential confounding role, we further found significant declines in the magnitude of the hypothesised bivariate correlations after partialling out IER. In addition, we found evidence for biasing (under‐estimation) effects for predictors not contaminated by IER in multiple regression models where some predictors and the outcome were both contaminated by IER. We call for WOHP researchers to routinely discourage IER from occurring in their surveys, screen for IER prior to analyzing survey data, and establish a standard practice for handling IER cases.</description><subject>Accidents</subject><subject>Clinical assessment</subject><subject>Disability</subject><subject>Health psychology</subject><subject>Injuries</subject><subject>Medical research</subject><subject>Negative emotions</subject><subject>Occupational health</subject><subject>Occupational health and safety</subject><subject>Occupational psychology</subject><subject>Occupational safety</subject><subject>Psychological aspects</subject><subject>Psychology</subject><subject>Safety</subject><subject>Studies</subject><subject>Variables</subject><issn>0269-994X</issn><issn>1464-0597</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2016</creationdate><recordtype>article</recordtype><sourceid>7QJ</sourceid><recordid>eNp9kE9PGzEUxC0EEoH20k9gqTekBdvrrO3eoggSJFQi_ihVL5bjfU4Mi73YG9r99iyk5chc3jv8ZjQahL5RckoHnZm2zaeUkbHcQyPKK16QsRL7aERYpQql-K9DdJTzAxlUldUI9Zchb53z1kPo8LlzMXX4dpteoMc3kNsYah_WP_Ak4PtQQyombZvAetNBjRcprhp4wj7gZUyP2IQaX6e1CT6bzsdgGjwH03QbvMi93cQmrt9TwSS7-YIOnGkyfP13j9H9xfnddF5cXc8up5OrwpalkgWtzYoISsAZsZJjMMYyq7gFyRlIxhVnRBluV5IxYQix1NXDZ3nJhJOVKI_R911um-LzFnKnH-I2Dd2ypkLwUspKkYE62VE2xZwTON0m_2RSrynRb9Pqt2n1-7QDTHfwH99A_wmpJ4vF7X9PsfP43MHfD49Jj3ooKcZ6-XOmufo9v5iVU70sXwGGC4xd</recordid><startdate>201604</startdate><enddate>201604</enddate><creator>McGonagle, Alyssa K.</creator><creator>Huang, Jason L.</creator><creator>Walsh, Benjamin M.</creator><general>Blackwell Publishing Ltd</general><scope>BSCLL</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QJ</scope><scope>K9.</scope></search><sort><creationdate>201604</creationdate><title>Insufficient Effort Survey Responding: An Under-Appreciated Problem in Work and Organisational Health Psychology Research</title><author>McGonagle, Alyssa K. ; Huang, Jason L. ; Walsh, Benjamin M.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c3398-1dab0710efa7b85eaac2c94ce842e82494209a4cb8227a00c1fd227c4327f8673</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2016</creationdate><topic>Accidents</topic><topic>Clinical assessment</topic><topic>Disability</topic><topic>Health psychology</topic><topic>Injuries</topic><topic>Medical research</topic><topic>Negative emotions</topic><topic>Occupational health</topic><topic>Occupational health and safety</topic><topic>Occupational psychology</topic><topic>Occupational safety</topic><topic>Psychological aspects</topic><topic>Psychology</topic><topic>Safety</topic><topic>Studies</topic><topic>Variables</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>McGonagle, Alyssa K.</creatorcontrib><creatorcontrib>Huang, Jason L.</creatorcontrib><creatorcontrib>Walsh, Benjamin M.</creatorcontrib><collection>Istex</collection><collection>CrossRef</collection><collection>Applied Social Sciences Index & Abstracts (ASSIA)</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><jtitle>Applied psychology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>McGonagle, Alyssa K.</au><au>Huang, Jason L.</au><au>Walsh, Benjamin M.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Insufficient Effort Survey Responding: An Under-Appreciated Problem in Work and Organisational Health Psychology Research</atitle><jtitle>Applied psychology</jtitle><addtitle>Applied Psychology</addtitle><date>2016-04</date><risdate>2016</risdate><volume>65</volume><issue>2</issue><spage>287</spage><epage>321</epage><pages>287-321</pages><issn>0269-994X</issn><eissn>1464-0597</eissn><abstract>Insufficient effort responding (IER) is problematic in that it can add a systematic source of variance for variables with average responses that depart from the scale midpoints. We present a rationale for why IER is of particular importance to Work and Organisational Health Psychology (WOHP) researchers. We also demonstrate its biasing effects using several variables of interest to WOHP researchers (perceived work ability, negative affectivity, perceived disability, work–safety tension, accident/injury frequencies, and experienced and instigated incivility) in two datasets. As expected, IER was significantly correlated with the focal study variables. We also found some evidence that hypothesised bivariate correlations between these variables were inflated when IER respondents were included. Corroborating IER's potential confounding role, we further found significant declines in the magnitude of the hypothesised bivariate correlations after partialling out IER. In addition, we found evidence for biasing (under‐estimation) effects for predictors not contaminated by IER in multiple regression models where some predictors and the outcome were both contaminated by IER. We call for WOHP researchers to routinely discourage IER from occurring in their surveys, screen for IER prior to analyzing survey data, and establish a standard practice for handling IER cases.</abstract><cop>Oxford</cop><pub>Blackwell Publishing Ltd</pub><doi>10.1111/apps.12058</doi><tpages>35</tpages></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0269-994X |
ispartof | Applied psychology, 2016-04, Vol.65 (2), p.287-321 |
issn | 0269-994X 1464-0597 |
language | eng |
recordid | cdi_proquest_journals_1774388690 |
source | Wiley Online Library - AutoHoldings Journals; EBSCOhost Business Source Complete; Applied Social Sciences Index & Abstracts (ASSIA) |
subjects | Accidents Clinical assessment Disability Health psychology Injuries Medical research Negative emotions Occupational health Occupational health and safety Occupational psychology Occupational safety Psychological aspects Psychology Safety Studies Variables |
title | Insufficient Effort Survey Responding: An Under-Appreciated Problem in Work and Organisational Health Psychology Research |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T13%3A20%3A13IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Insufficient%20Effort%20Survey%20Responding:%20An%20Under-Appreciated%20Problem%20in%20Work%20and%20Organisational%20Health%20Psychology%20Research&rft.jtitle=Applied%20psychology&rft.au=McGonagle,%20Alyssa%20K.&rft.date=2016-04&rft.volume=65&rft.issue=2&rft.spage=287&rft.epage=321&rft.pages=287-321&rft.issn=0269-994X&rft.eissn=1464-0597&rft_id=info:doi/10.1111/apps.12058&rft_dat=%3Cproquest_cross%3E3990883511%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1774388690&rft_id=info:pmid/&rfr_iscdi=true |