Insufficient Effort Survey Responding: An Under-Appreciated Problem in Work and Organisational Health Psychology Research

Insufficient effort responding (IER) is problematic in that it can add a systematic source of variance for variables with average responses that depart from the scale midpoints. We present a rationale for why IER is of particular importance to Work and Organisational Health Psychology (WOHP) researc...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Applied psychology 2016-04, Vol.65 (2), p.287-321
Hauptverfasser: McGonagle, Alyssa K., Huang, Jason L., Walsh, Benjamin M.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 321
container_issue 2
container_start_page 287
container_title Applied psychology
container_volume 65
creator McGonagle, Alyssa K.
Huang, Jason L.
Walsh, Benjamin M.
description Insufficient effort responding (IER) is problematic in that it can add a systematic source of variance for variables with average responses that depart from the scale midpoints. We present a rationale for why IER is of particular importance to Work and Organisational Health Psychology (WOHP) researchers. We also demonstrate its biasing effects using several variables of interest to WOHP researchers (perceived work ability, negative affectivity, perceived disability, work–safety tension, accident/injury frequencies, and experienced and instigated incivility) in two datasets. As expected, IER was significantly correlated with the focal study variables. We also found some evidence that hypothesised bivariate correlations between these variables were inflated when IER respondents were included. Corroborating IER's potential confounding role, we further found significant declines in the magnitude of the hypothesised bivariate correlations after partialling out IER. In addition, we found evidence for biasing (under‐estimation) effects for predictors not contaminated by IER in multiple regression models where some predictors and the outcome were both contaminated by IER. We call for WOHP researchers to routinely discourage IER from occurring in their surveys, screen for IER prior to analyzing survey data, and establish a standard practice for handling IER cases.
doi_str_mv 10.1111/apps.12058
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_1774388690</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3990883511</sourcerecordid><originalsourceid>FETCH-LOGICAL-c3398-1dab0710efa7b85eaac2c94ce842e82494209a4cb8227a00c1fd227c4327f8673</originalsourceid><addsrcrecordid>eNp9kE9PGzEUxC0EEoH20k9gqTekBdvrrO3eoggSJFQi_ihVL5bjfU4Mi73YG9r99iyk5chc3jv8ZjQahL5RckoHnZm2zaeUkbHcQyPKK16QsRL7aERYpQql-K9DdJTzAxlUldUI9Zchb53z1kPo8LlzMXX4dpteoMc3kNsYah_WP_Ak4PtQQyombZvAetNBjRcprhp4wj7gZUyP2IQaX6e1CT6bzsdgGjwH03QbvMi93cQmrt9TwSS7-YIOnGkyfP13j9H9xfnddF5cXc8up5OrwpalkgWtzYoISsAZsZJjMMYyq7gFyRlIxhVnRBluV5IxYQix1NXDZ3nJhJOVKI_R911um-LzFnKnH-I2Dd2ypkLwUspKkYE62VE2xZwTON0m_2RSrynRb9Pqt2n1-7QDTHfwH99A_wmpJ4vF7X9PsfP43MHfD49Jj3ooKcZ6-XOmufo9v5iVU70sXwGGC4xd</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1774388690</pqid></control><display><type>article</type><title>Insufficient Effort Survey Responding: An Under-Appreciated Problem in Work and Organisational Health Psychology Research</title><source>Wiley Online Library - AutoHoldings Journals</source><source>EBSCOhost Business Source Complete</source><source>Applied Social Sciences Index &amp; Abstracts (ASSIA)</source><creator>McGonagle, Alyssa K. ; Huang, Jason L. ; Walsh, Benjamin M.</creator><creatorcontrib>McGonagle, Alyssa K. ; Huang, Jason L. ; Walsh, Benjamin M.</creatorcontrib><description>Insufficient effort responding (IER) is problematic in that it can add a systematic source of variance for variables with average responses that depart from the scale midpoints. We present a rationale for why IER is of particular importance to Work and Organisational Health Psychology (WOHP) researchers. We also demonstrate its biasing effects using several variables of interest to WOHP researchers (perceived work ability, negative affectivity, perceived disability, work–safety tension, accident/injury frequencies, and experienced and instigated incivility) in two datasets. As expected, IER was significantly correlated with the focal study variables. We also found some evidence that hypothesised bivariate correlations between these variables were inflated when IER respondents were included. Corroborating IER's potential confounding role, we further found significant declines in the magnitude of the hypothesised bivariate correlations after partialling out IER. In addition, we found evidence for biasing (under‐estimation) effects for predictors not contaminated by IER in multiple regression models where some predictors and the outcome were both contaminated by IER. We call for WOHP researchers to routinely discourage IER from occurring in their surveys, screen for IER prior to analyzing survey data, and establish a standard practice for handling IER cases.</description><identifier>ISSN: 0269-994X</identifier><identifier>EISSN: 1464-0597</identifier><identifier>DOI: 10.1111/apps.12058</identifier><language>eng</language><publisher>Oxford: Blackwell Publishing Ltd</publisher><subject>Accidents ; Clinical assessment ; Disability ; Health psychology ; Injuries ; Medical research ; Negative emotions ; Occupational health ; Occupational health and safety ; Occupational psychology ; Occupational safety ; Psychological aspects ; Psychology ; Safety ; Studies ; Variables</subject><ispartof>Applied psychology, 2016-04, Vol.65 (2), p.287-321</ispartof><rights>2015 International Association of Applied Psychology.</rights><rights>2016 International Association of Applied Psychology.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c3398-1dab0710efa7b85eaac2c94ce842e82494209a4cb8227a00c1fd227c4327f8673</citedby><cites>FETCH-LOGICAL-c3398-1dab0710efa7b85eaac2c94ce842e82494209a4cb8227a00c1fd227c4327f8673</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1111%2Fapps.12058$$EPDF$$P50$$Gwiley$$H</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1111%2Fapps.12058$$EHTML$$P50$$Gwiley$$H</linktohtml><link.rule.ids>314,780,784,1417,27924,27925,30999,45574,45575</link.rule.ids></links><search><creatorcontrib>McGonagle, Alyssa K.</creatorcontrib><creatorcontrib>Huang, Jason L.</creatorcontrib><creatorcontrib>Walsh, Benjamin M.</creatorcontrib><title>Insufficient Effort Survey Responding: An Under-Appreciated Problem in Work and Organisational Health Psychology Research</title><title>Applied psychology</title><addtitle>Applied Psychology</addtitle><description>Insufficient effort responding (IER) is problematic in that it can add a systematic source of variance for variables with average responses that depart from the scale midpoints. We present a rationale for why IER is of particular importance to Work and Organisational Health Psychology (WOHP) researchers. We also demonstrate its biasing effects using several variables of interest to WOHP researchers (perceived work ability, negative affectivity, perceived disability, work–safety tension, accident/injury frequencies, and experienced and instigated incivility) in two datasets. As expected, IER was significantly correlated with the focal study variables. We also found some evidence that hypothesised bivariate correlations between these variables were inflated when IER respondents were included. Corroborating IER's potential confounding role, we further found significant declines in the magnitude of the hypothesised bivariate correlations after partialling out IER. In addition, we found evidence for biasing (under‐estimation) effects for predictors not contaminated by IER in multiple regression models where some predictors and the outcome were both contaminated by IER. We call for WOHP researchers to routinely discourage IER from occurring in their surveys, screen for IER prior to analyzing survey data, and establish a standard practice for handling IER cases.</description><subject>Accidents</subject><subject>Clinical assessment</subject><subject>Disability</subject><subject>Health psychology</subject><subject>Injuries</subject><subject>Medical research</subject><subject>Negative emotions</subject><subject>Occupational health</subject><subject>Occupational health and safety</subject><subject>Occupational psychology</subject><subject>Occupational safety</subject><subject>Psychological aspects</subject><subject>Psychology</subject><subject>Safety</subject><subject>Studies</subject><subject>Variables</subject><issn>0269-994X</issn><issn>1464-0597</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2016</creationdate><recordtype>article</recordtype><sourceid>7QJ</sourceid><recordid>eNp9kE9PGzEUxC0EEoH20k9gqTekBdvrrO3eoggSJFQi_ihVL5bjfU4Mi73YG9r99iyk5chc3jv8ZjQahL5RckoHnZm2zaeUkbHcQyPKK16QsRL7aERYpQql-K9DdJTzAxlUldUI9Zchb53z1kPo8LlzMXX4dpteoMc3kNsYah_WP_Ak4PtQQyombZvAetNBjRcprhp4wj7gZUyP2IQaX6e1CT6bzsdgGjwH03QbvMi93cQmrt9TwSS7-YIOnGkyfP13j9H9xfnddF5cXc8up5OrwpalkgWtzYoISsAZsZJjMMYyq7gFyRlIxhVnRBluV5IxYQix1NXDZ3nJhJOVKI_R911um-LzFnKnH-I2Dd2ypkLwUspKkYE62VE2xZwTON0m_2RSrynRb9Pqt2n1-7QDTHfwH99A_wmpJ4vF7X9PsfP43MHfD49Jj3ooKcZ6-XOmufo9v5iVU70sXwGGC4xd</recordid><startdate>201604</startdate><enddate>201604</enddate><creator>McGonagle, Alyssa K.</creator><creator>Huang, Jason L.</creator><creator>Walsh, Benjamin M.</creator><general>Blackwell Publishing Ltd</general><scope>BSCLL</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QJ</scope><scope>K9.</scope></search><sort><creationdate>201604</creationdate><title>Insufficient Effort Survey Responding: An Under-Appreciated Problem in Work and Organisational Health Psychology Research</title><author>McGonagle, Alyssa K. ; Huang, Jason L. ; Walsh, Benjamin M.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c3398-1dab0710efa7b85eaac2c94ce842e82494209a4cb8227a00c1fd227c4327f8673</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2016</creationdate><topic>Accidents</topic><topic>Clinical assessment</topic><topic>Disability</topic><topic>Health psychology</topic><topic>Injuries</topic><topic>Medical research</topic><topic>Negative emotions</topic><topic>Occupational health</topic><topic>Occupational health and safety</topic><topic>Occupational psychology</topic><topic>Occupational safety</topic><topic>Psychological aspects</topic><topic>Psychology</topic><topic>Safety</topic><topic>Studies</topic><topic>Variables</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>McGonagle, Alyssa K.</creatorcontrib><creatorcontrib>Huang, Jason L.</creatorcontrib><creatorcontrib>Walsh, Benjamin M.</creatorcontrib><collection>Istex</collection><collection>CrossRef</collection><collection>Applied Social Sciences Index &amp; Abstracts (ASSIA)</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><jtitle>Applied psychology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>McGonagle, Alyssa K.</au><au>Huang, Jason L.</au><au>Walsh, Benjamin M.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Insufficient Effort Survey Responding: An Under-Appreciated Problem in Work and Organisational Health Psychology Research</atitle><jtitle>Applied psychology</jtitle><addtitle>Applied Psychology</addtitle><date>2016-04</date><risdate>2016</risdate><volume>65</volume><issue>2</issue><spage>287</spage><epage>321</epage><pages>287-321</pages><issn>0269-994X</issn><eissn>1464-0597</eissn><abstract>Insufficient effort responding (IER) is problematic in that it can add a systematic source of variance for variables with average responses that depart from the scale midpoints. We present a rationale for why IER is of particular importance to Work and Organisational Health Psychology (WOHP) researchers. We also demonstrate its biasing effects using several variables of interest to WOHP researchers (perceived work ability, negative affectivity, perceived disability, work–safety tension, accident/injury frequencies, and experienced and instigated incivility) in two datasets. As expected, IER was significantly correlated with the focal study variables. We also found some evidence that hypothesised bivariate correlations between these variables were inflated when IER respondents were included. Corroborating IER's potential confounding role, we further found significant declines in the magnitude of the hypothesised bivariate correlations after partialling out IER. In addition, we found evidence for biasing (under‐estimation) effects for predictors not contaminated by IER in multiple regression models where some predictors and the outcome were both contaminated by IER. We call for WOHP researchers to routinely discourage IER from occurring in their surveys, screen for IER prior to analyzing survey data, and establish a standard practice for handling IER cases.</abstract><cop>Oxford</cop><pub>Blackwell Publishing Ltd</pub><doi>10.1111/apps.12058</doi><tpages>35</tpages></addata></record>
fulltext fulltext
identifier ISSN: 0269-994X
ispartof Applied psychology, 2016-04, Vol.65 (2), p.287-321
issn 0269-994X
1464-0597
language eng
recordid cdi_proquest_journals_1774388690
source Wiley Online Library - AutoHoldings Journals; EBSCOhost Business Source Complete; Applied Social Sciences Index & Abstracts (ASSIA)
subjects Accidents
Clinical assessment
Disability
Health psychology
Injuries
Medical research
Negative emotions
Occupational health
Occupational health and safety
Occupational psychology
Occupational safety
Psychological aspects
Psychology
Safety
Studies
Variables
title Insufficient Effort Survey Responding: An Under-Appreciated Problem in Work and Organisational Health Psychology Research
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T13%3A20%3A13IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Insufficient%20Effort%20Survey%20Responding:%20An%20Under-Appreciated%20Problem%20in%20Work%20and%20Organisational%20Health%20Psychology%20Research&rft.jtitle=Applied%20psychology&rft.au=McGonagle,%20Alyssa%20K.&rft.date=2016-04&rft.volume=65&rft.issue=2&rft.spage=287&rft.epage=321&rft.pages=287-321&rft.issn=0269-994X&rft.eissn=1464-0597&rft_id=info:doi/10.1111/apps.12058&rft_dat=%3Cproquest_cross%3E3990883511%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1774388690&rft_id=info:pmid/&rfr_iscdi=true