Cognitive burden of survey questions and response times: A psycholinguistic experiment
An important objective in survey question design is to write clear questions that respondents find easy to understand and to answer. This contribution identifies the factors that influence question clarity. Theoretical and empirical evidence from psycholinguistics suggests that specific text feature...
Gespeichert in:
Veröffentlicht in: | Applied cognitive psychology 2010-10, Vol.24 (7), p.1003-1020 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 1020 |
---|---|
container_issue | 7 |
container_start_page | 1003 |
container_title | Applied cognitive psychology |
container_volume | 24 |
creator | Lenzner, Timo Kaczmirek, Lars Lenzner, Alwine |
description | An important objective in survey question design is to write clear questions that respondents find easy to understand and to answer. This contribution identifies the factors that influence question clarity. Theoretical and empirical evidence from psycholinguistics suggests that specific text features (e.g., low‐frequency words (LFRWs), left‐embedded syntax) cause comprehension difficulties and impose a high cognitive burden on respondents. To examine the effect of seven different text features on question clarity, an online experiment was conducted in which well‐formulated questions were compared to suboptimal counterparts. The cognitive burden of the questions was assessed with response times. Data quality was compared in terms of drop‐out rates and survey satisficing behaviour. The results show that at least six of the text features are relevant for the clarity of a question. We provide a detailed explanation of these text features and advise survey designers to avoid them when crafting questions. Copyright © 2009 John Wiley & Sons, Ltd. |
doi_str_mv | 10.1002/acp.1602 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_818627380</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1758354997</sourcerecordid><originalsourceid>FETCH-LOGICAL-c5582-fdaa41085acbcfb76aa32b21a1c776bf81646c8e84174d47b07e075ed178e0e93</originalsourceid><addsrcrecordid>eNqFkV1rFDEUhoNYcK2CPyEIojdTT5LJJOPddtFWXNoV_LgMmcyZmjrNjMlO7f57M3apUFCvciAPz_l4CXnG4IgB8NfWjUesAv6ALBjUdQGKw0OyAK11UYKGR-RxSpcAUFeML8iX1XAR_NZfI22m2GKgQ0fTFK9xR39MmLZ-CIna0NKIacw10q2_wvSGLumYdu7b0PtwMfkMOoo3I8b8G7ZPyEFn-4RP9-8h-fzu7afVabE-P3m_Wq4LJ6XmRddaWzLQ0rrGdY2qrBW84cwyp1TVdJpVZeU06pKpsi1VAwpBSWyZ0ghYi0Py8tY7xuH3uObKJ4d9bwMOUzKa6YoroSGTr_5JMiW1kGVdq_-jwFStQMgZfX4PvRymGPLKRkmhGRda_vG5OKQUsTNjvpKNu2wyc2gmh2bm0DL6Yu-zydm-izY4n-54LmZhOfctbrmfvsfdX31mudrsvXs-B4U3d7yN302lhJLm69mJ2azlh_r4dGM-il9hKLOA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>753812385</pqid></control><display><type>article</type><title>Cognitive burden of survey questions and response times: A psycholinguistic experiment</title><source>Wiley Journals</source><source>Applied Social Sciences Index & Abstracts (ASSIA)</source><creator>Lenzner, Timo ; Kaczmirek, Lars ; Lenzner, Alwine</creator><creatorcontrib>Lenzner, Timo ; Kaczmirek, Lars ; Lenzner, Alwine</creatorcontrib><description>An important objective in survey question design is to write clear questions that respondents find easy to understand and to answer. This contribution identifies the factors that influence question clarity. Theoretical and empirical evidence from psycholinguistics suggests that specific text features (e.g., low‐frequency words (LFRWs), left‐embedded syntax) cause comprehension difficulties and impose a high cognitive burden on respondents. To examine the effect of seven different text features on question clarity, an online experiment was conducted in which well‐formulated questions were compared to suboptimal counterparts. The cognitive burden of the questions was assessed with response times. Data quality was compared in terms of drop‐out rates and survey satisficing behaviour. The results show that at least six of the text features are relevant for the clarity of a question. We provide a detailed explanation of these text features and advise survey designers to avoid them when crafting questions. Copyright © 2009 John Wiley & Sons, Ltd.</description><identifier>ISSN: 0888-4080</identifier><identifier>ISSN: 1099-0720</identifier><identifier>EISSN: 1099-0720</identifier><identifier>DOI: 10.1002/acp.1602</identifier><identifier>CODEN: ACPSED</identifier><language>eng</language><publisher>Chichester, UK: John Wiley & Sons, Ltd</publisher><subject>Biological and medical sciences ; Burden ; Cognition & reasoning ; Cognitive ability ; Cognitive psychology ; Data processing ; Dropping out ; Experiments ; Fundamental and applied biological sciences. Psychology ; Internet ; Linguistics ; Psycholinguistics ; Psychology. Psychoanalysis. Psychiatry ; Psychology. Psychophysiology ; Psychometrics ; Psychometrics. Statistics. Methodology ; Qualitative research ; Reaction times ; Syntax</subject><ispartof>Applied cognitive psychology, 2010-10, Vol.24 (7), p.1003-1020</ispartof><rights>Copyright © 2009 John Wiley & Sons, Ltd.</rights><rights>2015 INIST-CNRS</rights><rights>Copyright John Wiley and Sons, Limited Oct 2010</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c5582-fdaa41085acbcfb76aa32b21a1c776bf81646c8e84174d47b07e075ed178e0e93</citedby><cites>FETCH-LOGICAL-c5582-fdaa41085acbcfb76aa32b21a1c776bf81646c8e84174d47b07e075ed178e0e93</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1002%2Facp.1602$$EPDF$$P50$$Gwiley$$H</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1002%2Facp.1602$$EHTML$$P50$$Gwiley$$H</linktohtml><link.rule.ids>314,780,784,1417,27924,27925,30999,31000,45574,45575</link.rule.ids><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=23238547$$DView record in Pascal Francis$$Hfree_for_read</backlink></links><search><creatorcontrib>Lenzner, Timo</creatorcontrib><creatorcontrib>Kaczmirek, Lars</creatorcontrib><creatorcontrib>Lenzner, Alwine</creatorcontrib><title>Cognitive burden of survey questions and response times: A psycholinguistic experiment</title><title>Applied cognitive psychology</title><addtitle>Appl. Cognit. Psychol</addtitle><description>An important objective in survey question design is to write clear questions that respondents find easy to understand and to answer. This contribution identifies the factors that influence question clarity. Theoretical and empirical evidence from psycholinguistics suggests that specific text features (e.g., low‐frequency words (LFRWs), left‐embedded syntax) cause comprehension difficulties and impose a high cognitive burden on respondents. To examine the effect of seven different text features on question clarity, an online experiment was conducted in which well‐formulated questions were compared to suboptimal counterparts. The cognitive burden of the questions was assessed with response times. Data quality was compared in terms of drop‐out rates and survey satisficing behaviour. The results show that at least six of the text features are relevant for the clarity of a question. We provide a detailed explanation of these text features and advise survey designers to avoid them when crafting questions. Copyright © 2009 John Wiley & Sons, Ltd.</description><subject>Biological and medical sciences</subject><subject>Burden</subject><subject>Cognition & reasoning</subject><subject>Cognitive ability</subject><subject>Cognitive psychology</subject><subject>Data processing</subject><subject>Dropping out</subject><subject>Experiments</subject><subject>Fundamental and applied biological sciences. Psychology</subject><subject>Internet</subject><subject>Linguistics</subject><subject>Psycholinguistics</subject><subject>Psychology. Psychoanalysis. Psychiatry</subject><subject>Psychology. Psychophysiology</subject><subject>Psychometrics</subject><subject>Psychometrics. Statistics. Methodology</subject><subject>Qualitative research</subject><subject>Reaction times</subject><subject>Syntax</subject><issn>0888-4080</issn><issn>1099-0720</issn><issn>1099-0720</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2010</creationdate><recordtype>article</recordtype><sourceid>7QJ</sourceid><recordid>eNqFkV1rFDEUhoNYcK2CPyEIojdTT5LJJOPddtFWXNoV_LgMmcyZmjrNjMlO7f57M3apUFCvciAPz_l4CXnG4IgB8NfWjUesAv6ALBjUdQGKw0OyAK11UYKGR-RxSpcAUFeML8iX1XAR_NZfI22m2GKgQ0fTFK9xR39MmLZ-CIna0NKIacw10q2_wvSGLumYdu7b0PtwMfkMOoo3I8b8G7ZPyEFn-4RP9-8h-fzu7afVabE-P3m_Wq4LJ6XmRddaWzLQ0rrGdY2qrBW84cwyp1TVdJpVZeU06pKpsi1VAwpBSWyZ0ghYi0Py8tY7xuH3uObKJ4d9bwMOUzKa6YoroSGTr_5JMiW1kGVdq_-jwFStQMgZfX4PvRymGPLKRkmhGRda_vG5OKQUsTNjvpKNu2wyc2gmh2bm0DL6Yu-zydm-izY4n-54LmZhOfctbrmfvsfdX31mudrsvXs-B4U3d7yN302lhJLm69mJ2azlh_r4dGM-il9hKLOA</recordid><startdate>201010</startdate><enddate>201010</enddate><creator>Lenzner, Timo</creator><creator>Kaczmirek, Lars</creator><creator>Lenzner, Alwine</creator><general>John Wiley & Sons, Ltd</general><general>Wiley</general><general>Wiley Subscription Services, Inc</general><scope>BSCLL</scope><scope>IQODW</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QJ</scope><scope>7TK</scope></search><sort><creationdate>201010</creationdate><title>Cognitive burden of survey questions and response times: A psycholinguistic experiment</title><author>Lenzner, Timo ; Kaczmirek, Lars ; Lenzner, Alwine</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c5582-fdaa41085acbcfb76aa32b21a1c776bf81646c8e84174d47b07e075ed178e0e93</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2010</creationdate><topic>Biological and medical sciences</topic><topic>Burden</topic><topic>Cognition & reasoning</topic><topic>Cognitive ability</topic><topic>Cognitive psychology</topic><topic>Data processing</topic><topic>Dropping out</topic><topic>Experiments</topic><topic>Fundamental and applied biological sciences. Psychology</topic><topic>Internet</topic><topic>Linguistics</topic><topic>Psycholinguistics</topic><topic>Psychology. Psychoanalysis. Psychiatry</topic><topic>Psychology. Psychophysiology</topic><topic>Psychometrics</topic><topic>Psychometrics. Statistics. Methodology</topic><topic>Qualitative research</topic><topic>Reaction times</topic><topic>Syntax</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Lenzner, Timo</creatorcontrib><creatorcontrib>Kaczmirek, Lars</creatorcontrib><creatorcontrib>Lenzner, Alwine</creatorcontrib><collection>Istex</collection><collection>Pascal-Francis</collection><collection>CrossRef</collection><collection>Applied Social Sciences Index & Abstracts (ASSIA)</collection><collection>Neurosciences Abstracts</collection><jtitle>Applied cognitive psychology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Lenzner, Timo</au><au>Kaczmirek, Lars</au><au>Lenzner, Alwine</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Cognitive burden of survey questions and response times: A psycholinguistic experiment</atitle><jtitle>Applied cognitive psychology</jtitle><addtitle>Appl. Cognit. Psychol</addtitle><date>2010-10</date><risdate>2010</risdate><volume>24</volume><issue>7</issue><spage>1003</spage><epage>1020</epage><pages>1003-1020</pages><issn>0888-4080</issn><issn>1099-0720</issn><eissn>1099-0720</eissn><coden>ACPSED</coden><abstract>An important objective in survey question design is to write clear questions that respondents find easy to understand and to answer. This contribution identifies the factors that influence question clarity. Theoretical and empirical evidence from psycholinguistics suggests that specific text features (e.g., low‐frequency words (LFRWs), left‐embedded syntax) cause comprehension difficulties and impose a high cognitive burden on respondents. To examine the effect of seven different text features on question clarity, an online experiment was conducted in which well‐formulated questions were compared to suboptimal counterparts. The cognitive burden of the questions was assessed with response times. Data quality was compared in terms of drop‐out rates and survey satisficing behaviour. The results show that at least six of the text features are relevant for the clarity of a question. We provide a detailed explanation of these text features and advise survey designers to avoid them when crafting questions. Copyright © 2009 John Wiley & Sons, Ltd.</abstract><cop>Chichester, UK</cop><pub>John Wiley & Sons, Ltd</pub><doi>10.1002/acp.1602</doi><tpages>18</tpages><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0888-4080 |
ispartof | Applied cognitive psychology, 2010-10, Vol.24 (7), p.1003-1020 |
issn | 0888-4080 1099-0720 1099-0720 |
language | eng |
recordid | cdi_proquest_miscellaneous_818627380 |
source | Wiley Journals; Applied Social Sciences Index & Abstracts (ASSIA) |
subjects | Biological and medical sciences Burden Cognition & reasoning Cognitive ability Cognitive psychology Data processing Dropping out Experiments Fundamental and applied biological sciences. Psychology Internet Linguistics Psycholinguistics Psychology. Psychoanalysis. Psychiatry Psychology. Psychophysiology Psychometrics Psychometrics. Statistics. Methodology Qualitative research Reaction times Syntax |
title | Cognitive burden of survey questions and response times: A psycholinguistic experiment |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T07%3A35%3A09IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Cognitive%20burden%20of%20survey%20questions%20and%20response%20times:%20A%20psycholinguistic%20experiment&rft.jtitle=Applied%20cognitive%20psychology&rft.au=Lenzner,%20Timo&rft.date=2010-10&rft.volume=24&rft.issue=7&rft.spage=1003&rft.epage=1020&rft.pages=1003-1020&rft.issn=0888-4080&rft.eissn=1099-0720&rft.coden=ACPSED&rft_id=info:doi/10.1002/acp.1602&rft_dat=%3Cproquest_cross%3E1758354997%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=753812385&rft_id=info:pmid/&rfr_iscdi=true |