Sample size for pre-tests of questionnaires
Purpose To provide guidance regarding the desirable size of pre-tests of psychometric questionnaires, when the purpose of the pre-test is to detect misunderstandings, ambiguities, or other difficulties participants may encounter with instrument items (called «problems»). Methods We computed (a) the...
Gespeichert in:
| Veröffentlicht in: | Quality of life research 2015-01, Vol.24 (1), p.147-151 |
|---|---|
| Hauptverfasser: | , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 151 |
|---|---|
| container_issue | 1 |
| container_start_page | 147 |
| container_title | Quality of life research |
| container_volume | 24 |
| creator | Perneger, Thomas V. Courvoisier, Delphine S. Hudelson, Patricia M. Gayet-Ageron, Angèle |
| description | Purpose To provide guidance regarding the desirable size of pre-tests of psychometric questionnaires, when the purpose of the pre-test is to detect misunderstandings, ambiguities, or other difficulties participants may encounter with instrument items (called «problems»). Methods We computed (a) the power to detect a problem for various levels of prevalence and various sample sizes, (b) the required sample size to detect problems for various levels of prevalence, and (c) upper confidence limits for problem prevalence in situations where no problems were detected. Results As expected, power increased with problem prevalence and with sample size. If problem prevalence was 0.05, a sample of 10 participants had only a power of 40 % to detect the problem, and a sample of 20 achieved a power of 64 %. To achieve a power of 80 %, 32 participants were necessary if the prevalence of the problem was 0.05, 16 participants if prevalence was 0.10, and 8 if prevalence was 0.20. If no problems were observed in a given sample, the upper limit of a two-sided 90 % confidence interval reached 0.26 for a sample size of 10, 0.14 for a sample size of 20, and 0.10 for a sample of 30 participants. Conclusions Small samples (5-15 participants) that are common in pre-tests of questionaires may fail to uncover even common problems. A default sample size of 30 participants is recommended. |
| doi_str_mv | 10.1007/s11136-014-0752-2 |
| format | Article |
| fullrecord | <record><control><sourceid>jstor_proqu</sourceid><recordid>TN_cdi_proquest_miscellaneous_1642607566</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><jstor_id>44848922</jstor_id><sourcerecordid>44848922</sourcerecordid><originalsourceid>FETCH-LOGICAL-c427t-fd11652eae062ef901260c627c8ad4a680f2b7d51c6442c16ae1dffd0a49fe303</originalsourceid><addsrcrecordid>eNp9kE1LxDAQhoMo7rr6AzwoBS-CRGemadoeZfELFjyo55BtE-nSL5PuQX-9WbuKePCUgTzvM8PL2DHCJQKkVx4RY8kBBYc0IU47bIpJGnOSIt9lU8gl8TwW8YQdeL8CgCwH2mcTSsJIEqfs4kk3fW0iX32YyHYu6p3hg_GDjzobva3DVHVtqytn_CHbs7r25mj7ztjL7c3z_J4vHu8e5tcLXghKB25LRJmQ0QYkGZsDkoRCUlpkuhRaZmBpmZYJFlIIKlBqg6W1JWiRWxNDPGPno7d33dcFqql8Yepat6Zbe4VSBGOaSBnQsz_oqlu7Nly3oVACxpgHCkeqcJ33zljVu6rR7l0hqE2TamxShSbVpklFIXO6Na-XjSl_Et_VBYBGwIev9tW4X6v_sZ6MoZUfOvcjFSITWU4UfwI-oIWS</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1641601319</pqid></control><display><type>article</type><title>Sample size for pre-tests of questionnaires</title><source>Jstor Complete Legacy</source><source>MEDLINE</source><source>SpringerLink Journals</source><creator>Perneger, Thomas V. ; Courvoisier, Delphine S. ; Hudelson, Patricia M. ; Gayet-Ageron, Angèle</creator><creatorcontrib>Perneger, Thomas V. ; Courvoisier, Delphine S. ; Hudelson, Patricia M. ; Gayet-Ageron, Angèle</creatorcontrib><description>Purpose To provide guidance regarding the desirable size of pre-tests of psychometric questionnaires, when the purpose of the pre-test is to detect misunderstandings, ambiguities, or other difficulties participants may encounter with instrument items (called «problems»). Methods We computed (a) the power to detect a problem for various levels of prevalence and various sample sizes, (b) the required sample size to detect problems for various levels of prevalence, and (c) upper confidence limits for problem prevalence in situations where no problems were detected. Results As expected, power increased with problem prevalence and with sample size. If problem prevalence was 0.05, a sample of 10 participants had only a power of 40 % to detect the problem, and a sample of 20 achieved a power of 64 %. To achieve a power of 80 %, 32 participants were necessary if the prevalence of the problem was 0.05, 16 participants if prevalence was 0.10, and 8 if prevalence was 0.20. If no problems were observed in a given sample, the upper limit of a two-sided 90 % confidence interval reached 0.26 for a sample size of 10, 0.14 for a sample size of 20, and 0.10 for a sample of 30 participants. Conclusions Small samples (5-15 participants) that are common in pre-tests of questionaires may fail to uncover even common problems. A default sample size of 30 participants is recommended.</description><identifier>ISSN: 0962-9343</identifier><identifier>EISSN: 1573-2649</identifier><identifier>DOI: 10.1007/s11136-014-0752-2</identifier><identifier>PMID: 25008261</identifier><language>eng</language><publisher>Cham: Springer</publisher><subject>Brief Communication ; Female ; Humans ; INSTRUMENT DEVELOPMENT ; Interviews ; Medical research ; Medicine ; Medicine & Public Health ; Prevalence ; Probability ; Psychometrics - methods ; Public Health ; Qualitative research ; Quality of Life ; Quality of Life Research ; Quantitative psychology ; Questionnaires ; Sample Size ; Sociology ; Statistics as Topic - methods ; Surveys and Questionnaires ; Validity</subject><ispartof>Quality of life research, 2015-01, Vol.24 (1), p.147-151</ispartof><rights>Springer International Publishing 2015</rights><rights>Springer International Publishing Switzerland 2014</rights><rights>Springer International Publishing Switzerland 2015</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c427t-fd11652eae062ef901260c627c8ad4a680f2b7d51c6442c16ae1dffd0a49fe303</citedby><cites>FETCH-LOGICAL-c427t-fd11652eae062ef901260c627c8ad4a680f2b7d51c6442c16ae1dffd0a49fe303</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.jstor.org/stable/pdf/44848922$$EPDF$$P50$$Gjstor$$H</linktopdf><linktohtml>$$Uhttps://www.jstor.org/stable/44848922$$EHTML$$P50$$Gjstor$$H</linktohtml><link.rule.ids>314,776,780,799,27901,27902,41464,42533,51294,57992,58225</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/25008261$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Perneger, Thomas V.</creatorcontrib><creatorcontrib>Courvoisier, Delphine S.</creatorcontrib><creatorcontrib>Hudelson, Patricia M.</creatorcontrib><creatorcontrib>Gayet-Ageron, Angèle</creatorcontrib><title>Sample size for pre-tests of questionnaires</title><title>Quality of life research</title><addtitle>Qual Life Res</addtitle><addtitle>Qual Life Res</addtitle><description>Purpose To provide guidance regarding the desirable size of pre-tests of psychometric questionnaires, when the purpose of the pre-test is to detect misunderstandings, ambiguities, or other difficulties participants may encounter with instrument items (called «problems»). Methods We computed (a) the power to detect a problem for various levels of prevalence and various sample sizes, (b) the required sample size to detect problems for various levels of prevalence, and (c) upper confidence limits for problem prevalence in situations where no problems were detected. Results As expected, power increased with problem prevalence and with sample size. If problem prevalence was 0.05, a sample of 10 participants had only a power of 40 % to detect the problem, and a sample of 20 achieved a power of 64 %. To achieve a power of 80 %, 32 participants were necessary if the prevalence of the problem was 0.05, 16 participants if prevalence was 0.10, and 8 if prevalence was 0.20. If no problems were observed in a given sample, the upper limit of a two-sided 90 % confidence interval reached 0.26 for a sample size of 10, 0.14 for a sample size of 20, and 0.10 for a sample of 30 participants. Conclusions Small samples (5-15 participants) that are common in pre-tests of questionaires may fail to uncover even common problems. A default sample size of 30 participants is recommended.</description><subject>Brief Communication</subject><subject>Female</subject><subject>Humans</subject><subject>INSTRUMENT DEVELOPMENT</subject><subject>Interviews</subject><subject>Medical research</subject><subject>Medicine</subject><subject>Medicine & Public Health</subject><subject>Prevalence</subject><subject>Probability</subject><subject>Psychometrics - methods</subject><subject>Public Health</subject><subject>Qualitative research</subject><subject>Quality of Life</subject><subject>Quality of Life Research</subject><subject>Quantitative psychology</subject><subject>Questionnaires</subject><subject>Sample Size</subject><subject>Sociology</subject><subject>Statistics as Topic - methods</subject><subject>Surveys and Questionnaires</subject><subject>Validity</subject><issn>0962-9343</issn><issn>1573-2649</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2015</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><sourceid>BENPR</sourceid><recordid>eNp9kE1LxDAQhoMo7rr6AzwoBS-CRGemadoeZfELFjyo55BtE-nSL5PuQX-9WbuKePCUgTzvM8PL2DHCJQKkVx4RY8kBBYc0IU47bIpJGnOSIt9lU8gl8TwW8YQdeL8CgCwH2mcTSsJIEqfs4kk3fW0iX32YyHYu6p3hg_GDjzobva3DVHVtqytn_CHbs7r25mj7ztjL7c3z_J4vHu8e5tcLXghKB25LRJmQ0QYkGZsDkoRCUlpkuhRaZmBpmZYJFlIIKlBqg6W1JWiRWxNDPGPno7d33dcFqql8Yepat6Zbe4VSBGOaSBnQsz_oqlu7Nly3oVACxpgHCkeqcJ33zljVu6rR7l0hqE2TamxShSbVpklFIXO6Na-XjSl_Et_VBYBGwIev9tW4X6v_sZ6MoZUfOvcjFSITWU4UfwI-oIWS</recordid><startdate>20150101</startdate><enddate>20150101</enddate><creator>Perneger, Thomas V.</creator><creator>Courvoisier, Delphine S.</creator><creator>Hudelson, Patricia M.</creator><creator>Gayet-Ageron, Angèle</creator><general>Springer</general><general>Springer International Publishing</general><general>Springer Nature B.V</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7RV</scope><scope>7WY</scope><scope>7WZ</scope><scope>7X7</scope><scope>7XB</scope><scope>87Z</scope><scope>88E</scope><scope>88G</scope><scope>8AO</scope><scope>8C1</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>8FL</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BEZIV</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FRNLG</scope><scope>FYUFA</scope><scope>F~G</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>K60</scope><scope>K6~</scope><scope>K9.</scope><scope>KB0</scope><scope>L.-</scope><scope>M0C</scope><scope>M0S</scope><scope>M1P</scope><scope>M2M</scope><scope>NAPCQ</scope><scope>PQBIZ</scope><scope>PQBZA</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PSYQQ</scope><scope>Q9U</scope><scope>7X8</scope></search><sort><creationdate>20150101</creationdate><title>Sample size for pre-tests of questionnaires</title><author>Perneger, Thomas V. ; Courvoisier, Delphine S. ; Hudelson, Patricia M. ; Gayet-Ageron, Angèle</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c427t-fd11652eae062ef901260c627c8ad4a680f2b7d51c6442c16ae1dffd0a49fe303</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2015</creationdate><topic>Brief Communication</topic><topic>Female</topic><topic>Humans</topic><topic>INSTRUMENT DEVELOPMENT</topic><topic>Interviews</topic><topic>Medical research</topic><topic>Medicine</topic><topic>Medicine & Public Health</topic><topic>Prevalence</topic><topic>Probability</topic><topic>Psychometrics - methods</topic><topic>Public Health</topic><topic>Qualitative research</topic><topic>Quality of Life</topic><topic>Quality of Life Research</topic><topic>Quantitative psychology</topic><topic>Questionnaires</topic><topic>Sample Size</topic><topic>Sociology</topic><topic>Statistics as Topic - methods</topic><topic>Surveys and Questionnaires</topic><topic>Validity</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Perneger, Thomas V.</creatorcontrib><creatorcontrib>Courvoisier, Delphine S.</creatorcontrib><creatorcontrib>Hudelson, Patricia M.</creatorcontrib><creatorcontrib>Gayet-Ageron, Angèle</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Nursing & Allied Health Database</collection><collection>ABI/INFORM Collection</collection><collection>ABI/INFORM Global (PDF only)</collection><collection>Health & Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>ABI/INFORM Global (Alumni Edition)</collection><collection>Medical Database (Alumni Edition)</collection><collection>Psychology Database (Alumni)</collection><collection>ProQuest Pharma Collection</collection><collection>Public Health Database</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ABI/INFORM Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Business Premium Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Business Premium Collection (Alumni)</collection><collection>Health Research Premium Collection</collection><collection>ABI/INFORM Global (Corporate)</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>ProQuest Business Collection (Alumni Edition)</collection><collection>ProQuest Business Collection</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Nursing & Allied Health Database (Alumni Edition)</collection><collection>ABI/INFORM Professional Advanced</collection><collection>ABI/INFORM Global</collection><collection>Health & Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>ProQuest Psychology</collection><collection>Nursing & Allied Health Premium</collection><collection>ProQuest One Business</collection><collection>ProQuest One Business (Alumni)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest One Psychology</collection><collection>ProQuest Central Basic</collection><collection>MEDLINE - Academic</collection><jtitle>Quality of life research</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Perneger, Thomas V.</au><au>Courvoisier, Delphine S.</au><au>Hudelson, Patricia M.</au><au>Gayet-Ageron, Angèle</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Sample size for pre-tests of questionnaires</atitle><jtitle>Quality of life research</jtitle><stitle>Qual Life Res</stitle><addtitle>Qual Life Res</addtitle><date>2015-01-01</date><risdate>2015</risdate><volume>24</volume><issue>1</issue><spage>147</spage><epage>151</epage><pages>147-151</pages><issn>0962-9343</issn><eissn>1573-2649</eissn><abstract>Purpose To provide guidance regarding the desirable size of pre-tests of psychometric questionnaires, when the purpose of the pre-test is to detect misunderstandings, ambiguities, or other difficulties participants may encounter with instrument items (called «problems»). Methods We computed (a) the power to detect a problem for various levels of prevalence and various sample sizes, (b) the required sample size to detect problems for various levels of prevalence, and (c) upper confidence limits for problem prevalence in situations where no problems were detected. Results As expected, power increased with problem prevalence and with sample size. If problem prevalence was 0.05, a sample of 10 participants had only a power of 40 % to detect the problem, and a sample of 20 achieved a power of 64 %. To achieve a power of 80 %, 32 participants were necessary if the prevalence of the problem was 0.05, 16 participants if prevalence was 0.10, and 8 if prevalence was 0.20. If no problems were observed in a given sample, the upper limit of a two-sided 90 % confidence interval reached 0.26 for a sample size of 10, 0.14 for a sample size of 20, and 0.10 for a sample of 30 participants. Conclusions Small samples (5-15 participants) that are common in pre-tests of questionaires may fail to uncover even common problems. A default sample size of 30 participants is recommended.</abstract><cop>Cham</cop><pub>Springer</pub><pmid>25008261</pmid><doi>10.1007/s11136-014-0752-2</doi><tpages>5</tpages><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 0962-9343 |
| ispartof | Quality of life research, 2015-01, Vol.24 (1), p.147-151 |
| issn | 0962-9343 1573-2649 |
| language | eng |
| recordid | cdi_proquest_miscellaneous_1642607566 |
| source | Jstor Complete Legacy; MEDLINE; SpringerLink Journals |
| subjects | Brief Communication Female Humans INSTRUMENT DEVELOPMENT Interviews Medical research Medicine Medicine & Public Health Prevalence Probability Psychometrics - methods Public Health Qualitative research Quality of Life Quality of Life Research Quantitative psychology Questionnaires Sample Size Sociology Statistics as Topic - methods Surveys and Questionnaires Validity |
| title | Sample size for pre-tests of questionnaires |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-15T01%3A55%3A49IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-jstor_proqu&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Sample%20size%20for%20pre-tests%20of%20questionnaires&rft.jtitle=Quality%20of%20life%20research&rft.au=Perneger,%20Thomas%20V.&rft.date=2015-01-01&rft.volume=24&rft.issue=1&rft.spage=147&rft.epage=151&rft.pages=147-151&rft.issn=0962-9343&rft.eissn=1573-2649&rft_id=info:doi/10.1007/s11136-014-0752-2&rft_dat=%3Cjstor_proqu%3E44848922%3C/jstor_proqu%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1641601319&rft_id=info:pmid/25008261&rft_jstor_id=44848922&rfr_iscdi=true |