Racing the Clock: Using Response Time as a Proxy for Attentiveness on Self-Administered Surveys

Internet-based surveys have expanded public opinion data collection at the expense of monitoring respondent attentiveness, potentially compromising data quality. Researchers now have to evaluate attentiveness ex-post. We propose a new proxy for attentiveness—response-time attentiveness clustering (R...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Political analysis 2022-10, Vol.30 (4), p.550-569
Hauptverfasser: Read, Blair, Wolters, Lukas, Berinsky, Adam J.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 569
container_issue 4
container_start_page 550
container_title Political analysis
container_volume 30
creator Read, Blair
Wolters, Lukas
Berinsky, Adam J.
description Internet-based surveys have expanded public opinion data collection at the expense of monitoring respondent attentiveness, potentially compromising data quality. Researchers now have to evaluate attentiveness ex-post. We propose a new proxy for attentiveness—response-time attentiveness clustering (RTAC)—that uses dimension reduction and an unsupervised clustering algorithm to leverage variation in response time between respondents and across questions. We advance the literature theoretically arguing that the existing dichotomous classification of respondents as fast or attentive is insufficient and neglects slow and inattentive respondents. We validate our theoretical classification and empirical strategy against commonly used proxies for survey attentiveness. In contrast to other methods for capturing attentiveness, RTAC allows researchers to collect attentiveness data unobtrusively without sacrificing space on the survey instrument.
doi_str_mv 10.1017/pan.2021.32
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2711749592</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><cupid>10_1017_pan_2021_32</cupid><sourcerecordid>2711749592</sourcerecordid><originalsourceid>FETCH-LOGICAL-c266t-c303f8c77124a6cc3d3e705f52e70b9abc33ea3e11a97bb0515d703419435dbd3</originalsourceid><addsrcrecordid>eNptkEtLAzEUhYMoWKsr_0DApUzNY2bSuCvFFxSUPtYhk7lTp3aSMUmL_ffO0IIbV-dw-TgXPoRuKRlRQsVDq-2IEUZHnJ2hAU1FnqRyLM-7TlKRUDkWl-gqhA3paCHlAKm5NrVd4_gJeLp15usRr0J_mENonQ2Al3UDWAes8Yd3PwdcOY8nMYKN9R4shICdxQvYVsmkbGpbhwgeSrzY-T0cwjW6qPQ2wM0ph2j1_LScviaz95e36WSWGJbnMTGc8GpshKAs1bkxvOQgSFZlrItC6sJwDpoDpVqKoiAZzUpBeEplyrOyKPkQ3R13W---dxCi2ridt91LxQSlIpWZZB11f6SMdyF4qFTr60b7g6JE9QZVZ1D1BhXv6eRE66bwdbmGv9H_-F_f93J5</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2711749592</pqid></control><display><type>article</type><title>Racing the Clock: Using Response Time as a Proxy for Attentiveness on Self-Administered Surveys</title><source>Worldwide Political Science Abstracts</source><source>Cambridge Journals</source><source>Political Science Complete</source><creator>Read, Blair ; Wolters, Lukas ; Berinsky, Adam J.</creator><creatorcontrib>Read, Blair ; Wolters, Lukas ; Berinsky, Adam J.</creatorcontrib><description>Internet-based surveys have expanded public opinion data collection at the expense of monitoring respondent attentiveness, potentially compromising data quality. Researchers now have to evaluate attentiveness ex-post. We propose a new proxy for attentiveness—response-time attentiveness clustering (RTAC)—that uses dimension reduction and an unsupervised clustering algorithm to leverage variation in response time between respondents and across questions. We advance the literature theoretically arguing that the existing dichotomous classification of respondents as fast or attentive is insufficient and neglects slow and inattentive respondents. We validate our theoretical classification and empirical strategy against commonly used proxies for survey attentiveness. In contrast to other methods for capturing attentiveness, RTAC allows researchers to collect attentiveness data unobtrusively without sacrificing space on the survey instrument.</description><identifier>ISSN: 1047-1987</identifier><identifier>EISSN: 1476-4989</identifier><identifier>DOI: 10.1017/pan.2021.32</identifier><language>eng</language><publisher>New York, USA: Cambridge University Press</publisher><subject>Classification ; Data collection ; Data quality ; Internet ; Polls &amp; surveys ; Public opinion ; Questionnaires ; Researchers ; Respondents ; Response time ; Time</subject><ispartof>Political analysis, 2022-10, Vol.30 (4), p.550-569</ispartof><rights>The Author(s) 2021. Published by Cambridge University Press on behalf of the Society for Political Methodology</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c266t-c303f8c77124a6cc3d3e705f52e70b9abc33ea3e11a97bb0515d703419435dbd3</citedby><cites>FETCH-LOGICAL-c266t-c303f8c77124a6cc3d3e705f52e70b9abc33ea3e11a97bb0515d703419435dbd3</cites><orcidid>0000-0003-1284-9952 ; 0000-0001-7264-0785 ; 0000-0001-7827-9396</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.cambridge.org/core/product/identifier/S1047198721000322/type/journal_article$$EHTML$$P50$$Gcambridge$$H</linktohtml><link.rule.ids>164,314,780,784,12845,27924,27925,55628</link.rule.ids></links><search><creatorcontrib>Read, Blair</creatorcontrib><creatorcontrib>Wolters, Lukas</creatorcontrib><creatorcontrib>Berinsky, Adam J.</creatorcontrib><title>Racing the Clock: Using Response Time as a Proxy for Attentiveness on Self-Administered Surveys</title><title>Political analysis</title><addtitle>Polit. Anal</addtitle><description>Internet-based surveys have expanded public opinion data collection at the expense of monitoring respondent attentiveness, potentially compromising data quality. Researchers now have to evaluate attentiveness ex-post. We propose a new proxy for attentiveness—response-time attentiveness clustering (RTAC)—that uses dimension reduction and an unsupervised clustering algorithm to leverage variation in response time between respondents and across questions. We advance the literature theoretically arguing that the existing dichotomous classification of respondents as fast or attentive is insufficient and neglects slow and inattentive respondents. We validate our theoretical classification and empirical strategy against commonly used proxies for survey attentiveness. In contrast to other methods for capturing attentiveness, RTAC allows researchers to collect attentiveness data unobtrusively without sacrificing space on the survey instrument.</description><subject>Classification</subject><subject>Data collection</subject><subject>Data quality</subject><subject>Internet</subject><subject>Polls &amp; surveys</subject><subject>Public opinion</subject><subject>Questionnaires</subject><subject>Researchers</subject><subject>Respondents</subject><subject>Response time</subject><subject>Time</subject><issn>1047-1987</issn><issn>1476-4989</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>7UB</sourceid><sourceid>8G5</sourceid><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><sourceid>GUQSH</sourceid><sourceid>M2O</sourceid><recordid>eNptkEtLAzEUhYMoWKsr_0DApUzNY2bSuCvFFxSUPtYhk7lTp3aSMUmL_ffO0IIbV-dw-TgXPoRuKRlRQsVDq-2IEUZHnJ2hAU1FnqRyLM-7TlKRUDkWl-gqhA3paCHlAKm5NrVd4_gJeLp15usRr0J_mENonQ2Al3UDWAes8Yd3PwdcOY8nMYKN9R4shICdxQvYVsmkbGpbhwgeSrzY-T0cwjW6qPQ2wM0ph2j1_LScviaz95e36WSWGJbnMTGc8GpshKAs1bkxvOQgSFZlrItC6sJwDpoDpVqKoiAZzUpBeEplyrOyKPkQ3R13W---dxCi2ridt91LxQSlIpWZZB11f6SMdyF4qFTr60b7g6JE9QZVZ1D1BhXv6eRE66bwdbmGv9H_-F_f93J5</recordid><startdate>202210</startdate><enddate>202210</enddate><creator>Read, Blair</creator><creator>Wolters, Lukas</creator><creator>Berinsky, Adam J.</creator><general>Cambridge University Press</general><scope>AAYXX</scope><scope>CITATION</scope><scope>0-V</scope><scope>3V.</scope><scope>7UB</scope><scope>7XB</scope><scope>88F</scope><scope>88J</scope><scope>8FK</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ALSLI</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>DPSOV</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>KC-</scope><scope>M1Q</scope><scope>M2L</scope><scope>M2O</scope><scope>M2R</scope><scope>MBDVC</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>Q9U</scope><orcidid>https://orcid.org/0000-0003-1284-9952</orcidid><orcidid>https://orcid.org/0000-0001-7264-0785</orcidid><orcidid>https://orcid.org/0000-0001-7827-9396</orcidid></search><sort><creationdate>202210</creationdate><title>Racing the Clock: Using Response Time as a Proxy for Attentiveness on Self-Administered Surveys</title><author>Read, Blair ; Wolters, Lukas ; Berinsky, Adam J.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c266t-c303f8c77124a6cc3d3e705f52e70b9abc33ea3e11a97bb0515d703419435dbd3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Classification</topic><topic>Data collection</topic><topic>Data quality</topic><topic>Internet</topic><topic>Polls &amp; surveys</topic><topic>Public opinion</topic><topic>Questionnaires</topic><topic>Researchers</topic><topic>Respondents</topic><topic>Response time</topic><topic>Time</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Read, Blair</creatorcontrib><creatorcontrib>Wolters, Lukas</creatorcontrib><creatorcontrib>Berinsky, Adam J.</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Social Sciences Premium Collection</collection><collection>ProQuest Central (Corporate)</collection><collection>Worldwide Political Science Abstracts</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Military Database (Alumni Edition)</collection><collection>Social Science Database (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Social Science Premium Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>Politics Collection</collection><collection>ProQuest Central Korea</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>ProQuest Politics Collection</collection><collection>Military Database</collection><collection>Political Science Database</collection><collection>Research Library</collection><collection>Social Science Database</collection><collection>Research Library (Corporate)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest Central Basic</collection><jtitle>Political analysis</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Read, Blair</au><au>Wolters, Lukas</au><au>Berinsky, Adam J.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Racing the Clock: Using Response Time as a Proxy for Attentiveness on Self-Administered Surveys</atitle><jtitle>Political analysis</jtitle><addtitle>Polit. Anal</addtitle><date>2022-10</date><risdate>2022</risdate><volume>30</volume><issue>4</issue><spage>550</spage><epage>569</epage><pages>550-569</pages><issn>1047-1987</issn><eissn>1476-4989</eissn><abstract>Internet-based surveys have expanded public opinion data collection at the expense of monitoring respondent attentiveness, potentially compromising data quality. Researchers now have to evaluate attentiveness ex-post. We propose a new proxy for attentiveness—response-time attentiveness clustering (RTAC)—that uses dimension reduction and an unsupervised clustering algorithm to leverage variation in response time between respondents and across questions. We advance the literature theoretically arguing that the existing dichotomous classification of respondents as fast or attentive is insufficient and neglects slow and inattentive respondents. We validate our theoretical classification and empirical strategy against commonly used proxies for survey attentiveness. In contrast to other methods for capturing attentiveness, RTAC allows researchers to collect attentiveness data unobtrusively without sacrificing space on the survey instrument.</abstract><cop>New York, USA</cop><pub>Cambridge University Press</pub><doi>10.1017/pan.2021.32</doi><tpages>20</tpages><orcidid>https://orcid.org/0000-0003-1284-9952</orcidid><orcidid>https://orcid.org/0000-0001-7264-0785</orcidid><orcidid>https://orcid.org/0000-0001-7827-9396</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1047-1987
ispartof Political analysis, 2022-10, Vol.30 (4), p.550-569
issn 1047-1987
1476-4989
language eng
recordid cdi_proquest_journals_2711749592
source Worldwide Political Science Abstracts; Cambridge Journals; Political Science Complete
subjects Classification
Data collection
Data quality
Internet
Polls & surveys
Public opinion
Questionnaires
Researchers
Respondents
Response time
Time
title Racing the Clock: Using Response Time as a Proxy for Attentiveness on Self-Administered Surveys
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T03%3A27%3A21IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Racing%20the%20Clock:%20Using%20Response%20Time%20as%20a%20Proxy%20for%20Attentiveness%20on%20Self-Administered%20Surveys&rft.jtitle=Political%20analysis&rft.au=Read,%20Blair&rft.date=2022-10&rft.volume=30&rft.issue=4&rft.spage=550&rft.epage=569&rft.pages=550-569&rft.issn=1047-1987&rft.eissn=1476-4989&rft_id=info:doi/10.1017/pan.2021.32&rft_dat=%3Cproquest_cross%3E2711749592%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2711749592&rft_id=info:pmid/&rft_cupid=10_1017_pan_2021_32&rfr_iscdi=true