Cognitive burden of survey questions and response times: A psycholinguistic experiment

An important objective in survey question design is to write clear questions that respondents find easy to understand and to answer. This contribution identifies the factors that influence question clarity. Theoretical and empirical evidence from psycholinguistics suggests that specific text feature...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Applied cognitive psychology 2010-10, Vol.24 (7), p.1003-1020
Hauptverfasser: Lenzner, Timo, Kaczmirek, Lars, Lenzner, Alwine
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 1020
container_issue 7
container_start_page 1003
container_title Applied cognitive psychology
container_volume 24
creator Lenzner, Timo
Kaczmirek, Lars
Lenzner, Alwine
description An important objective in survey question design is to write clear questions that respondents find easy to understand and to answer. This contribution identifies the factors that influence question clarity. Theoretical and empirical evidence from psycholinguistics suggests that specific text features (e.g., low‐frequency words (LFRWs), left‐embedded syntax) cause comprehension difficulties and impose a high cognitive burden on respondents. To examine the effect of seven different text features on question clarity, an online experiment was conducted in which well‐formulated questions were compared to suboptimal counterparts. The cognitive burden of the questions was assessed with response times. Data quality was compared in terms of drop‐out rates and survey satisficing behaviour. The results show that at least six of the text features are relevant for the clarity of a question. We provide a detailed explanation of these text features and advise survey designers to avoid them when crafting questions. Copyright © 2009 John Wiley & Sons, Ltd.
doi_str_mv 10.1002/acp.1602
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_818627380</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1758354997</sourcerecordid><originalsourceid>FETCH-LOGICAL-c5582-fdaa41085acbcfb76aa32b21a1c776bf81646c8e84174d47b07e075ed178e0e93</originalsourceid><addsrcrecordid>eNqFkV1rFDEUhoNYcK2CPyEIojdTT5LJJOPddtFWXNoV_LgMmcyZmjrNjMlO7f57M3apUFCvciAPz_l4CXnG4IgB8NfWjUesAv6ALBjUdQGKw0OyAK11UYKGR-RxSpcAUFeML8iX1XAR_NZfI22m2GKgQ0fTFK9xR39MmLZ-CIna0NKIacw10q2_wvSGLumYdu7b0PtwMfkMOoo3I8b8G7ZPyEFn-4RP9-8h-fzu7afVabE-P3m_Wq4LJ6XmRddaWzLQ0rrGdY2qrBW84cwyp1TVdJpVZeU06pKpsi1VAwpBSWyZ0ghYi0Py8tY7xuH3uObKJ4d9bwMOUzKa6YoroSGTr_5JMiW1kGVdq_-jwFStQMgZfX4PvRymGPLKRkmhGRda_vG5OKQUsTNjvpKNu2wyc2gmh2bm0DL6Yu-zydm-izY4n-54LmZhOfctbrmfvsfdX31mudrsvXs-B4U3d7yN302lhJLm69mJ2azlh_r4dGM-il9hKLOA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>753812385</pqid></control><display><type>article</type><title>Cognitive burden of survey questions and response times: A psycholinguistic experiment</title><source>Wiley Journals</source><source>Applied Social Sciences Index &amp; Abstracts (ASSIA)</source><creator>Lenzner, Timo ; Kaczmirek, Lars ; Lenzner, Alwine</creator><creatorcontrib>Lenzner, Timo ; Kaczmirek, Lars ; Lenzner, Alwine</creatorcontrib><description>An important objective in survey question design is to write clear questions that respondents find easy to understand and to answer. This contribution identifies the factors that influence question clarity. Theoretical and empirical evidence from psycholinguistics suggests that specific text features (e.g., low‐frequency words (LFRWs), left‐embedded syntax) cause comprehension difficulties and impose a high cognitive burden on respondents. To examine the effect of seven different text features on question clarity, an online experiment was conducted in which well‐formulated questions were compared to suboptimal counterparts. The cognitive burden of the questions was assessed with response times. Data quality was compared in terms of drop‐out rates and survey satisficing behaviour. The results show that at least six of the text features are relevant for the clarity of a question. We provide a detailed explanation of these text features and advise survey designers to avoid them when crafting questions. Copyright © 2009 John Wiley &amp; Sons, Ltd.</description><identifier>ISSN: 0888-4080</identifier><identifier>ISSN: 1099-0720</identifier><identifier>EISSN: 1099-0720</identifier><identifier>DOI: 10.1002/acp.1602</identifier><identifier>CODEN: ACPSED</identifier><language>eng</language><publisher>Chichester, UK: John Wiley &amp; Sons, Ltd</publisher><subject>Biological and medical sciences ; Burden ; Cognition &amp; reasoning ; Cognitive ability ; Cognitive psychology ; Data processing ; Dropping out ; Experiments ; Fundamental and applied biological sciences. Psychology ; Internet ; Linguistics ; Psycholinguistics ; Psychology. Psychoanalysis. Psychiatry ; Psychology. Psychophysiology ; Psychometrics ; Psychometrics. Statistics. Methodology ; Qualitative research ; Reaction times ; Syntax</subject><ispartof>Applied cognitive psychology, 2010-10, Vol.24 (7), p.1003-1020</ispartof><rights>Copyright © 2009 John Wiley &amp; Sons, Ltd.</rights><rights>2015 INIST-CNRS</rights><rights>Copyright John Wiley and Sons, Limited Oct 2010</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c5582-fdaa41085acbcfb76aa32b21a1c776bf81646c8e84174d47b07e075ed178e0e93</citedby><cites>FETCH-LOGICAL-c5582-fdaa41085acbcfb76aa32b21a1c776bf81646c8e84174d47b07e075ed178e0e93</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1002%2Facp.1602$$EPDF$$P50$$Gwiley$$H</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1002%2Facp.1602$$EHTML$$P50$$Gwiley$$H</linktohtml><link.rule.ids>314,780,784,1417,27924,27925,30999,31000,45574,45575</link.rule.ids><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&amp;idt=23238547$$DView record in Pascal Francis$$Hfree_for_read</backlink></links><search><creatorcontrib>Lenzner, Timo</creatorcontrib><creatorcontrib>Kaczmirek, Lars</creatorcontrib><creatorcontrib>Lenzner, Alwine</creatorcontrib><title>Cognitive burden of survey questions and response times: A psycholinguistic experiment</title><title>Applied cognitive psychology</title><addtitle>Appl. Cognit. Psychol</addtitle><description>An important objective in survey question design is to write clear questions that respondents find easy to understand and to answer. This contribution identifies the factors that influence question clarity. Theoretical and empirical evidence from psycholinguistics suggests that specific text features (e.g., low‐frequency words (LFRWs), left‐embedded syntax) cause comprehension difficulties and impose a high cognitive burden on respondents. To examine the effect of seven different text features on question clarity, an online experiment was conducted in which well‐formulated questions were compared to suboptimal counterparts. The cognitive burden of the questions was assessed with response times. Data quality was compared in terms of drop‐out rates and survey satisficing behaviour. The results show that at least six of the text features are relevant for the clarity of a question. We provide a detailed explanation of these text features and advise survey designers to avoid them when crafting questions. Copyright © 2009 John Wiley &amp; Sons, Ltd.</description><subject>Biological and medical sciences</subject><subject>Burden</subject><subject>Cognition &amp; reasoning</subject><subject>Cognitive ability</subject><subject>Cognitive psychology</subject><subject>Data processing</subject><subject>Dropping out</subject><subject>Experiments</subject><subject>Fundamental and applied biological sciences. Psychology</subject><subject>Internet</subject><subject>Linguistics</subject><subject>Psycholinguistics</subject><subject>Psychology. Psychoanalysis. Psychiatry</subject><subject>Psychology. Psychophysiology</subject><subject>Psychometrics</subject><subject>Psychometrics. Statistics. Methodology</subject><subject>Qualitative research</subject><subject>Reaction times</subject><subject>Syntax</subject><issn>0888-4080</issn><issn>1099-0720</issn><issn>1099-0720</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2010</creationdate><recordtype>article</recordtype><sourceid>7QJ</sourceid><recordid>eNqFkV1rFDEUhoNYcK2CPyEIojdTT5LJJOPddtFWXNoV_LgMmcyZmjrNjMlO7f57M3apUFCvciAPz_l4CXnG4IgB8NfWjUesAv6ALBjUdQGKw0OyAK11UYKGR-RxSpcAUFeML8iX1XAR_NZfI22m2GKgQ0fTFK9xR39MmLZ-CIna0NKIacw10q2_wvSGLumYdu7b0PtwMfkMOoo3I8b8G7ZPyEFn-4RP9-8h-fzu7afVabE-P3m_Wq4LJ6XmRddaWzLQ0rrGdY2qrBW84cwyp1TVdJpVZeU06pKpsi1VAwpBSWyZ0ghYi0Py8tY7xuH3uObKJ4d9bwMOUzKa6YoroSGTr_5JMiW1kGVdq_-jwFStQMgZfX4PvRymGPLKRkmhGRda_vG5OKQUsTNjvpKNu2wyc2gmh2bm0DL6Yu-zydm-izY4n-54LmZhOfctbrmfvsfdX31mudrsvXs-B4U3d7yN302lhJLm69mJ2azlh_r4dGM-il9hKLOA</recordid><startdate>201010</startdate><enddate>201010</enddate><creator>Lenzner, Timo</creator><creator>Kaczmirek, Lars</creator><creator>Lenzner, Alwine</creator><general>John Wiley &amp; Sons, Ltd</general><general>Wiley</general><general>Wiley Subscription Services, Inc</general><scope>BSCLL</scope><scope>IQODW</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QJ</scope><scope>7TK</scope></search><sort><creationdate>201010</creationdate><title>Cognitive burden of survey questions and response times: A psycholinguistic experiment</title><author>Lenzner, Timo ; Kaczmirek, Lars ; Lenzner, Alwine</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c5582-fdaa41085acbcfb76aa32b21a1c776bf81646c8e84174d47b07e075ed178e0e93</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2010</creationdate><topic>Biological and medical sciences</topic><topic>Burden</topic><topic>Cognition &amp; reasoning</topic><topic>Cognitive ability</topic><topic>Cognitive psychology</topic><topic>Data processing</topic><topic>Dropping out</topic><topic>Experiments</topic><topic>Fundamental and applied biological sciences. Psychology</topic><topic>Internet</topic><topic>Linguistics</topic><topic>Psycholinguistics</topic><topic>Psychology. Psychoanalysis. Psychiatry</topic><topic>Psychology. Psychophysiology</topic><topic>Psychometrics</topic><topic>Psychometrics. Statistics. Methodology</topic><topic>Qualitative research</topic><topic>Reaction times</topic><topic>Syntax</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Lenzner, Timo</creatorcontrib><creatorcontrib>Kaczmirek, Lars</creatorcontrib><creatorcontrib>Lenzner, Alwine</creatorcontrib><collection>Istex</collection><collection>Pascal-Francis</collection><collection>CrossRef</collection><collection>Applied Social Sciences Index &amp; Abstracts (ASSIA)</collection><collection>Neurosciences Abstracts</collection><jtitle>Applied cognitive psychology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Lenzner, Timo</au><au>Kaczmirek, Lars</au><au>Lenzner, Alwine</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Cognitive burden of survey questions and response times: A psycholinguistic experiment</atitle><jtitle>Applied cognitive psychology</jtitle><addtitle>Appl. Cognit. Psychol</addtitle><date>2010-10</date><risdate>2010</risdate><volume>24</volume><issue>7</issue><spage>1003</spage><epage>1020</epage><pages>1003-1020</pages><issn>0888-4080</issn><issn>1099-0720</issn><eissn>1099-0720</eissn><coden>ACPSED</coden><abstract>An important objective in survey question design is to write clear questions that respondents find easy to understand and to answer. This contribution identifies the factors that influence question clarity. Theoretical and empirical evidence from psycholinguistics suggests that specific text features (e.g., low‐frequency words (LFRWs), left‐embedded syntax) cause comprehension difficulties and impose a high cognitive burden on respondents. To examine the effect of seven different text features on question clarity, an online experiment was conducted in which well‐formulated questions were compared to suboptimal counterparts. The cognitive burden of the questions was assessed with response times. Data quality was compared in terms of drop‐out rates and survey satisficing behaviour. The results show that at least six of the text features are relevant for the clarity of a question. We provide a detailed explanation of these text features and advise survey designers to avoid them when crafting questions. Copyright © 2009 John Wiley &amp; Sons, Ltd.</abstract><cop>Chichester, UK</cop><pub>John Wiley &amp; Sons, Ltd</pub><doi>10.1002/acp.1602</doi><tpages>18</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0888-4080
ispartof Applied cognitive psychology, 2010-10, Vol.24 (7), p.1003-1020
issn 0888-4080
1099-0720
1099-0720
language eng
recordid cdi_proquest_miscellaneous_818627380
source Wiley Journals; Applied Social Sciences Index & Abstracts (ASSIA)
subjects Biological and medical sciences
Burden
Cognition & reasoning
Cognitive ability
Cognitive psychology
Data processing
Dropping out
Experiments
Fundamental and applied biological sciences. Psychology
Internet
Linguistics
Psycholinguistics
Psychology. Psychoanalysis. Psychiatry
Psychology. Psychophysiology
Psychometrics
Psychometrics. Statistics. Methodology
Qualitative research
Reaction times
Syntax
title Cognitive burden of survey questions and response times: A psycholinguistic experiment
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T07%3A35%3A09IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Cognitive%20burden%20of%20survey%20questions%20and%20response%20times:%20A%20psycholinguistic%20experiment&rft.jtitle=Applied%20cognitive%20psychology&rft.au=Lenzner,%20Timo&rft.date=2010-10&rft.volume=24&rft.issue=7&rft.spage=1003&rft.epage=1020&rft.pages=1003-1020&rft.issn=0888-4080&rft.eissn=1099-0720&rft.coden=ACPSED&rft_id=info:doi/10.1002/acp.1602&rft_dat=%3Cproquest_cross%3E1758354997%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=753812385&rft_id=info:pmid/&rfr_iscdi=true