From alpha to omega and beyond! A look at the past, present, and (possible) future of psychometric soundness in the Journal of Applied Psychology

The psychometric soundness of measures has been a central concern of articles published in the Journal of Applied Psychology (JAP) since the inception of the journal. At the same time, it isn’t clear that investigators and reviewers prioritize psychometric soundness to a degree that would allow one...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of applied psychology 2020-12, Vol.105 (12), p.1351-1381
Hauptverfasser: Cortina, Jose M, Sheng, Zitong, Keener, Sheila K, Keeler, Kathleen R, Grubb, Leah K, Schmitt, Neal, Tonidandel, Scott, Summerville, Karoline M, Heggestad, Eric D, Banks, George C
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 1381
container_issue 12
container_start_page 1351
container_title Journal of applied psychology
container_volume 105
creator Cortina, Jose M
Sheng, Zitong
Keener, Sheila K
Keeler, Kathleen R
Grubb, Leah K
Schmitt, Neal
Tonidandel, Scott
Summerville, Karoline M
Heggestad, Eric D
Banks, George C
description The psychometric soundness of measures has been a central concern of articles published in the Journal of Applied Psychology (JAP) since the inception of the journal. At the same time, it isn’t clear that investigators and reviewers prioritize psychometric soundness to a degree that would allow one to have sufficient confidence in conclusions regarding constructs. The purposes of the present article are to (a) examine current scale development and evaluation practices in JAP; (b) compare these practices to recommended practices, previous practices, and practices in other journals; and (c) use these comparisons to make recommendations for reviewers, editors, and investigators regarding the creation and evaluation of measures including Excel-based calculators for various indices. Finally, given that model complexity appears to have increased the need for short scales, we offer a user-friendly R Shiny app (https://orgscience.uncc.edu/about-us/resources) that identifies the subset of items that maximize a variety of psychometric criteria rather than merely maximizing alpha. (PsycInfo Database Record (c) 2022 APA, all rights reserved) (Source: journal abstract)
doi_str_mv 10.1037/apl0000815
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2432867003</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2469840634</sourcerecordid><originalsourceid>FETCH-LOGICAL-c320t-2cd1745fdec77ba8a65789ba2253e0120ee4112d40263851792adb61af20d0bc3</originalsourceid><addsrcrecordid>eNp90b1OwzAQB3ALgUQpLDzBIRZABM52PscK8alKMMAcOfGFBtzY2MnQx-CNSSkSEgNezsPPf935GDvkeMFRZpfKGRxPzpMtNuGFLCKeJ_E2myAKHhXIcZfthfCGyGNZ4IR93ni7BGXcQkFvwS7pVYHqNFS0sp0-ghkYa99B9dAvCJwK_Tk4T4G68bKGJ86G0FaGTqEZ-sET2AZcWNWLMaz3bQ3BDp3uKARou--UBzv4Tpk1nDlnWtLw9P3A2NfVPttplAl08FOn7OXm-vnqLpo_3t5fzeZRLQX2kag1z-Kk0VRnWaVylSZZXlRKiEQScoFEMedCxyhSmSc8K4TSVcpVI1BjVcspO9nkOm8_Bgp9uWxDTcaojuwQShFLkacZohzp8R_6tplgrdIijzGV8f9q7DmVmPJRnW1U7cd_89SUzrdL5Vclx3K9w_J3h_ILinqNrg</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2432063061</pqid></control><display><type>article</type><title>From alpha to omega and beyond! A look at the past, present, and (possible) future of psychometric soundness in the Journal of Applied Psychology</title><source>EBSCOhost APA PsycARTICLES</source><source>Applied Social Sciences Index &amp; Abstracts (ASSIA)</source><creator>Cortina, Jose M ; Sheng, Zitong ; Keener, Sheila K ; Keeler, Kathleen R ; Grubb, Leah K ; Schmitt, Neal ; Tonidandel, Scott ; Summerville, Karoline M ; Heggestad, Eric D ; Banks, George C</creator><creatorcontrib>Cortina, Jose M ; Sheng, Zitong ; Keener, Sheila K ; Keeler, Kathleen R ; Grubb, Leah K ; Schmitt, Neal ; Tonidandel, Scott ; Summerville, Karoline M ; Heggestad, Eric D ; Banks, George C</creatorcontrib><description>The psychometric soundness of measures has been a central concern of articles published in the Journal of Applied Psychology (JAP) since the inception of the journal. At the same time, it isn’t clear that investigators and reviewers prioritize psychometric soundness to a degree that would allow one to have sufficient confidence in conclusions regarding constructs. The purposes of the present article are to (a) examine current scale development and evaluation practices in JAP; (b) compare these practices to recommended practices, previous practices, and practices in other journals; and (c) use these comparisons to make recommendations for reviewers, editors, and investigators regarding the creation and evaluation of measures including Excel-based calculators for various indices. Finally, given that model complexity appears to have increased the need for short scales, we offer a user-friendly R Shiny app (https://orgscience.uncc.edu/about-us/resources) that identifies the subset of items that maximize a variety of psychometric criteria rather than merely maximizing alpha. (PsycInfo Database Record (c) 2022 APA, all rights reserved) (Source: journal abstract)</description><identifier>ISSN: 0021-9010</identifier><identifier>EISSN: 1939-1854</identifier><identifier>DOI: 10.1037/apl0000815</identifier><language>eng</language><publisher>Washington: American Psychological Association</publisher><subject>Applied Psychology ; Industrial and Organizational Psychology ; Psychometrics ; Quantitative psychology ; Scientific Communication ; Short forms ; Test Forms ; Test Reliability ; Test Validity</subject><ispartof>Journal of applied psychology, 2020-12, Vol.105 (12), p.1351-1381</ispartof><rights>2020, American Psychological Association</rights><rights>Copyright American Psychological Association Dec 2020</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c320t-2cd1745fdec77ba8a65789ba2253e0120ee4112d40263851792adb61af20d0bc3</citedby><orcidid>0000-0003-2336-917X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,778,782,27911,27912,30986</link.rule.ids></links><search><creatorcontrib>Cortina, Jose M</creatorcontrib><creatorcontrib>Sheng, Zitong</creatorcontrib><creatorcontrib>Keener, Sheila K</creatorcontrib><creatorcontrib>Keeler, Kathleen R</creatorcontrib><creatorcontrib>Grubb, Leah K</creatorcontrib><creatorcontrib>Schmitt, Neal</creatorcontrib><creatorcontrib>Tonidandel, Scott</creatorcontrib><creatorcontrib>Summerville, Karoline M</creatorcontrib><creatorcontrib>Heggestad, Eric D</creatorcontrib><creatorcontrib>Banks, George C</creatorcontrib><title>From alpha to omega and beyond! A look at the past, present, and (possible) future of psychometric soundness in the Journal of Applied Psychology</title><title>Journal of applied psychology</title><description>The psychometric soundness of measures has been a central concern of articles published in the Journal of Applied Psychology (JAP) since the inception of the journal. At the same time, it isn’t clear that investigators and reviewers prioritize psychometric soundness to a degree that would allow one to have sufficient confidence in conclusions regarding constructs. The purposes of the present article are to (a) examine current scale development and evaluation practices in JAP; (b) compare these practices to recommended practices, previous practices, and practices in other journals; and (c) use these comparisons to make recommendations for reviewers, editors, and investigators regarding the creation and evaluation of measures including Excel-based calculators for various indices. Finally, given that model complexity appears to have increased the need for short scales, we offer a user-friendly R Shiny app (https://orgscience.uncc.edu/about-us/resources) that identifies the subset of items that maximize a variety of psychometric criteria rather than merely maximizing alpha. (PsycInfo Database Record (c) 2022 APA, all rights reserved) (Source: journal abstract)</description><subject>Applied Psychology</subject><subject>Industrial and Organizational Psychology</subject><subject>Psychometrics</subject><subject>Quantitative psychology</subject><subject>Scientific Communication</subject><subject>Short forms</subject><subject>Test Forms</subject><subject>Test Reliability</subject><subject>Test Validity</subject><issn>0021-9010</issn><issn>1939-1854</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>7QJ</sourceid><recordid>eNp90b1OwzAQB3ALgUQpLDzBIRZABM52PscK8alKMMAcOfGFBtzY2MnQx-CNSSkSEgNezsPPf935GDvkeMFRZpfKGRxPzpMtNuGFLCKeJ_E2myAKHhXIcZfthfCGyGNZ4IR93ni7BGXcQkFvwS7pVYHqNFS0sp0-ghkYa99B9dAvCJwK_Tk4T4G68bKGJ86G0FaGTqEZ-sET2AZcWNWLMaz3bQ3BDp3uKARou--UBzv4Tpk1nDlnWtLw9P3A2NfVPttplAl08FOn7OXm-vnqLpo_3t5fzeZRLQX2kag1z-Kk0VRnWaVylSZZXlRKiEQScoFEMedCxyhSmSc8K4TSVcpVI1BjVcspO9nkOm8_Bgp9uWxDTcaojuwQShFLkacZohzp8R_6tplgrdIijzGV8f9q7DmVmPJRnW1U7cd_89SUzrdL5Vclx3K9w_J3h_ILinqNrg</recordid><startdate>20201201</startdate><enddate>20201201</enddate><creator>Cortina, Jose M</creator><creator>Sheng, Zitong</creator><creator>Keener, Sheila K</creator><creator>Keeler, Kathleen R</creator><creator>Grubb, Leah K</creator><creator>Schmitt, Neal</creator><creator>Tonidandel, Scott</creator><creator>Summerville, Karoline M</creator><creator>Heggestad, Eric D</creator><creator>Banks, George C</creator><general>American Psychological Association</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7RZ</scope><scope>PSYQQ</scope><scope>7QJ</scope><scope>8BJ</scope><scope>FQK</scope><scope>JBE</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0003-2336-917X</orcidid></search><sort><creationdate>20201201</creationdate><title>From alpha to omega and beyond! A look at the past, present, and (possible) future of psychometric soundness in the Journal of Applied Psychology</title><author>Cortina, Jose M ; Sheng, Zitong ; Keener, Sheila K ; Keeler, Kathleen R ; Grubb, Leah K ; Schmitt, Neal ; Tonidandel, Scott ; Summerville, Karoline M ; Heggestad, Eric D ; Banks, George C</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c320t-2cd1745fdec77ba8a65789ba2253e0120ee4112d40263851792adb61af20d0bc3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Applied Psychology</topic><topic>Industrial and Organizational Psychology</topic><topic>Psychometrics</topic><topic>Quantitative psychology</topic><topic>Scientific Communication</topic><topic>Short forms</topic><topic>Test Forms</topic><topic>Test Reliability</topic><topic>Test Validity</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Cortina, Jose M</creatorcontrib><creatorcontrib>Sheng, Zitong</creatorcontrib><creatorcontrib>Keener, Sheila K</creatorcontrib><creatorcontrib>Keeler, Kathleen R</creatorcontrib><creatorcontrib>Grubb, Leah K</creatorcontrib><creatorcontrib>Schmitt, Neal</creatorcontrib><creatorcontrib>Tonidandel, Scott</creatorcontrib><creatorcontrib>Summerville, Karoline M</creatorcontrib><creatorcontrib>Heggestad, Eric D</creatorcontrib><creatorcontrib>Banks, George C</creatorcontrib><collection>CrossRef</collection><collection>APA PsycArticles®</collection><collection>ProQuest One Psychology</collection><collection>Applied Social Sciences Index &amp; Abstracts (ASSIA)</collection><collection>International Bibliography of the Social Sciences (IBSS)</collection><collection>International Bibliography of the Social Sciences</collection><collection>International Bibliography of the Social Sciences</collection><collection>MEDLINE - Academic</collection><jtitle>Journal of applied psychology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Cortina, Jose M</au><au>Sheng, Zitong</au><au>Keener, Sheila K</au><au>Keeler, Kathleen R</au><au>Grubb, Leah K</au><au>Schmitt, Neal</au><au>Tonidandel, Scott</au><au>Summerville, Karoline M</au><au>Heggestad, Eric D</au><au>Banks, George C</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>From alpha to omega and beyond! A look at the past, present, and (possible) future of psychometric soundness in the Journal of Applied Psychology</atitle><jtitle>Journal of applied psychology</jtitle><date>2020-12-01</date><risdate>2020</risdate><volume>105</volume><issue>12</issue><spage>1351</spage><epage>1381</epage><pages>1351-1381</pages><issn>0021-9010</issn><eissn>1939-1854</eissn><abstract>The psychometric soundness of measures has been a central concern of articles published in the Journal of Applied Psychology (JAP) since the inception of the journal. At the same time, it isn’t clear that investigators and reviewers prioritize psychometric soundness to a degree that would allow one to have sufficient confidence in conclusions regarding constructs. The purposes of the present article are to (a) examine current scale development and evaluation practices in JAP; (b) compare these practices to recommended practices, previous practices, and practices in other journals; and (c) use these comparisons to make recommendations for reviewers, editors, and investigators regarding the creation and evaluation of measures including Excel-based calculators for various indices. Finally, given that model complexity appears to have increased the need for short scales, we offer a user-friendly R Shiny app (https://orgscience.uncc.edu/about-us/resources) that identifies the subset of items that maximize a variety of psychometric criteria rather than merely maximizing alpha. (PsycInfo Database Record (c) 2022 APA, all rights reserved) (Source: journal abstract)</abstract><cop>Washington</cop><pub>American Psychological Association</pub><doi>10.1037/apl0000815</doi><tpages>31</tpages><orcidid>https://orcid.org/0000-0003-2336-917X</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0021-9010
ispartof Journal of applied psychology, 2020-12, Vol.105 (12), p.1351-1381
issn 0021-9010
1939-1854
language eng
recordid cdi_proquest_miscellaneous_2432867003
source EBSCOhost APA PsycARTICLES; Applied Social Sciences Index & Abstracts (ASSIA)
subjects Applied Psychology
Industrial and Organizational Psychology
Psychometrics
Quantitative psychology
Scientific Communication
Short forms
Test Forms
Test Reliability
Test Validity
title From alpha to omega and beyond! A look at the past, present, and (possible) future of psychometric soundness in the Journal of Applied Psychology
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-16T01%3A01%3A26IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=From%20alpha%20to%20omega%20and%20beyond!%20A%20look%20at%20the%20past,%20present,%20and%20(possible)%20future%20of%20psychometric%20soundness%20in%20the%20Journal%20of%20Applied%20Psychology&rft.jtitle=Journal%20of%20applied%20psychology&rft.au=Cortina,%20Jose%20M&rft.date=2020-12-01&rft.volume=105&rft.issue=12&rft.spage=1351&rft.epage=1381&rft.pages=1351-1381&rft.issn=0021-9010&rft.eissn=1939-1854&rft_id=info:doi/10.1037/apl0000815&rft_dat=%3Cproquest_cross%3E2469840634%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2432063061&rft_id=info:pmid/&rfr_iscdi=true