From alpha to omega and beyond! A look at the past, present, and (possible) future of psychometric soundness in the Journal of Applied Psychology
The psychometric soundness of measures has been a central concern of articles published in the Journal of Applied Psychology (JAP) since the inception of the journal. At the same time, it isn’t clear that investigators and reviewers prioritize psychometric soundness to a degree that would allow one...
Gespeichert in:
Veröffentlicht in: | Journal of applied psychology 2020-12, Vol.105 (12), p.1351-1381 |
---|---|
Hauptverfasser: | , , , , , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 1381 |
---|---|
container_issue | 12 |
container_start_page | 1351 |
container_title | Journal of applied psychology |
container_volume | 105 |
creator | Cortina, Jose M Sheng, Zitong Keener, Sheila K Keeler, Kathleen R Grubb, Leah K Schmitt, Neal Tonidandel, Scott Summerville, Karoline M Heggestad, Eric D Banks, George C |
description | The psychometric soundness of measures has been a central concern of articles published in the Journal of Applied Psychology (JAP) since the inception of the journal. At the same time, it isn’t clear that investigators and reviewers prioritize psychometric soundness to a degree that would allow one to have sufficient confidence in conclusions regarding constructs. The purposes of the present article are to (a) examine current scale development and evaluation practices in JAP; (b) compare these practices to recommended practices, previous practices, and practices in other journals; and (c) use these comparisons to make recommendations for reviewers, editors, and investigators regarding the creation and evaluation of measures including Excel-based calculators for various indices. Finally, given that model complexity appears to have increased the need for short scales, we offer a user-friendly R Shiny app (https://orgscience.uncc.edu/about-us/resources) that identifies the subset of items that maximize a variety of psychometric criteria rather than merely maximizing alpha. (PsycInfo Database Record (c) 2022 APA, all rights reserved) (Source: journal abstract) |
doi_str_mv | 10.1037/apl0000815 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2432867003</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2469840634</sourcerecordid><originalsourceid>FETCH-LOGICAL-c320t-2cd1745fdec77ba8a65789ba2253e0120ee4112d40263851792adb61af20d0bc3</originalsourceid><addsrcrecordid>eNp90b1OwzAQB3ALgUQpLDzBIRZABM52PscK8alKMMAcOfGFBtzY2MnQx-CNSSkSEgNezsPPf935GDvkeMFRZpfKGRxPzpMtNuGFLCKeJ_E2myAKHhXIcZfthfCGyGNZ4IR93ni7BGXcQkFvwS7pVYHqNFS0sp0-ghkYa99B9dAvCJwK_Tk4T4G68bKGJ86G0FaGTqEZ-sET2AZcWNWLMaz3bQ3BDp3uKARou--UBzv4Tpk1nDlnWtLw9P3A2NfVPttplAl08FOn7OXm-vnqLpo_3t5fzeZRLQX2kag1z-Kk0VRnWaVylSZZXlRKiEQScoFEMedCxyhSmSc8K4TSVcpVI1BjVcspO9nkOm8_Bgp9uWxDTcaojuwQShFLkacZohzp8R_6tplgrdIijzGV8f9q7DmVmPJRnW1U7cd_89SUzrdL5Vclx3K9w_J3h_ILinqNrg</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2432063061</pqid></control><display><type>article</type><title>From alpha to omega and beyond! A look at the past, present, and (possible) future of psychometric soundness in the Journal of Applied Psychology</title><source>EBSCOhost APA PsycARTICLES</source><source>Applied Social Sciences Index & Abstracts (ASSIA)</source><creator>Cortina, Jose M ; Sheng, Zitong ; Keener, Sheila K ; Keeler, Kathleen R ; Grubb, Leah K ; Schmitt, Neal ; Tonidandel, Scott ; Summerville, Karoline M ; Heggestad, Eric D ; Banks, George C</creator><creatorcontrib>Cortina, Jose M ; Sheng, Zitong ; Keener, Sheila K ; Keeler, Kathleen R ; Grubb, Leah K ; Schmitt, Neal ; Tonidandel, Scott ; Summerville, Karoline M ; Heggestad, Eric D ; Banks, George C</creatorcontrib><description>The psychometric soundness of measures has been a central concern of articles published in the Journal of Applied Psychology (JAP) since the inception of the journal. At the same time, it isn’t clear that investigators and reviewers prioritize psychometric soundness to a degree that would allow one to have sufficient confidence in conclusions regarding constructs. The purposes of the present article are to (a) examine current scale development and evaluation practices in JAP; (b) compare these practices to recommended practices, previous practices, and practices in other journals; and (c) use these comparisons to make recommendations for reviewers, editors, and investigators regarding the creation and evaluation of measures including Excel-based calculators for various indices. Finally, given that model complexity appears to have increased the need for short scales, we offer a user-friendly R Shiny app (https://orgscience.uncc.edu/about-us/resources) that identifies the subset of items that maximize a variety of psychometric criteria rather than merely maximizing alpha. (PsycInfo Database Record (c) 2022 APA, all rights reserved) (Source: journal abstract)</description><identifier>ISSN: 0021-9010</identifier><identifier>EISSN: 1939-1854</identifier><identifier>DOI: 10.1037/apl0000815</identifier><language>eng</language><publisher>Washington: American Psychological Association</publisher><subject>Applied Psychology ; Industrial and Organizational Psychology ; Psychometrics ; Quantitative psychology ; Scientific Communication ; Short forms ; Test Forms ; Test Reliability ; Test Validity</subject><ispartof>Journal of applied psychology, 2020-12, Vol.105 (12), p.1351-1381</ispartof><rights>2020, American Psychological Association</rights><rights>Copyright American Psychological Association Dec 2020</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c320t-2cd1745fdec77ba8a65789ba2253e0120ee4112d40263851792adb61af20d0bc3</citedby><orcidid>0000-0003-2336-917X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,778,782,27911,27912,30986</link.rule.ids></links><search><creatorcontrib>Cortina, Jose M</creatorcontrib><creatorcontrib>Sheng, Zitong</creatorcontrib><creatorcontrib>Keener, Sheila K</creatorcontrib><creatorcontrib>Keeler, Kathleen R</creatorcontrib><creatorcontrib>Grubb, Leah K</creatorcontrib><creatorcontrib>Schmitt, Neal</creatorcontrib><creatorcontrib>Tonidandel, Scott</creatorcontrib><creatorcontrib>Summerville, Karoline M</creatorcontrib><creatorcontrib>Heggestad, Eric D</creatorcontrib><creatorcontrib>Banks, George C</creatorcontrib><title>From alpha to omega and beyond! A look at the past, present, and (possible) future of psychometric soundness in the Journal of Applied Psychology</title><title>Journal of applied psychology</title><description>The psychometric soundness of measures has been a central concern of articles published in the Journal of Applied Psychology (JAP) since the inception of the journal. At the same time, it isn’t clear that investigators and reviewers prioritize psychometric soundness to a degree that would allow one to have sufficient confidence in conclusions regarding constructs. The purposes of the present article are to (a) examine current scale development and evaluation practices in JAP; (b) compare these practices to recommended practices, previous practices, and practices in other journals; and (c) use these comparisons to make recommendations for reviewers, editors, and investigators regarding the creation and evaluation of measures including Excel-based calculators for various indices. Finally, given that model complexity appears to have increased the need for short scales, we offer a user-friendly R Shiny app (https://orgscience.uncc.edu/about-us/resources) that identifies the subset of items that maximize a variety of psychometric criteria rather than merely maximizing alpha. (PsycInfo Database Record (c) 2022 APA, all rights reserved) (Source: journal abstract)</description><subject>Applied Psychology</subject><subject>Industrial and Organizational Psychology</subject><subject>Psychometrics</subject><subject>Quantitative psychology</subject><subject>Scientific Communication</subject><subject>Short forms</subject><subject>Test Forms</subject><subject>Test Reliability</subject><subject>Test Validity</subject><issn>0021-9010</issn><issn>1939-1854</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>7QJ</sourceid><recordid>eNp90b1OwzAQB3ALgUQpLDzBIRZABM52PscK8alKMMAcOfGFBtzY2MnQx-CNSSkSEgNezsPPf935GDvkeMFRZpfKGRxPzpMtNuGFLCKeJ_E2myAKHhXIcZfthfCGyGNZ4IR93ni7BGXcQkFvwS7pVYHqNFS0sp0-ghkYa99B9dAvCJwK_Tk4T4G68bKGJ86G0FaGTqEZ-sET2AZcWNWLMaz3bQ3BDp3uKARou--UBzv4Tpk1nDlnWtLw9P3A2NfVPttplAl08FOn7OXm-vnqLpo_3t5fzeZRLQX2kag1z-Kk0VRnWaVylSZZXlRKiEQScoFEMedCxyhSmSc8K4TSVcpVI1BjVcspO9nkOm8_Bgp9uWxDTcaojuwQShFLkacZohzp8R_6tplgrdIijzGV8f9q7DmVmPJRnW1U7cd_89SUzrdL5Vclx3K9w_J3h_ILinqNrg</recordid><startdate>20201201</startdate><enddate>20201201</enddate><creator>Cortina, Jose M</creator><creator>Sheng, Zitong</creator><creator>Keener, Sheila K</creator><creator>Keeler, Kathleen R</creator><creator>Grubb, Leah K</creator><creator>Schmitt, Neal</creator><creator>Tonidandel, Scott</creator><creator>Summerville, Karoline M</creator><creator>Heggestad, Eric D</creator><creator>Banks, George C</creator><general>American Psychological Association</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7RZ</scope><scope>PSYQQ</scope><scope>7QJ</scope><scope>8BJ</scope><scope>FQK</scope><scope>JBE</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0003-2336-917X</orcidid></search><sort><creationdate>20201201</creationdate><title>From alpha to omega and beyond! A look at the past, present, and (possible) future of psychometric soundness in the Journal of Applied Psychology</title><author>Cortina, Jose M ; Sheng, Zitong ; Keener, Sheila K ; Keeler, Kathleen R ; Grubb, Leah K ; Schmitt, Neal ; Tonidandel, Scott ; Summerville, Karoline M ; Heggestad, Eric D ; Banks, George C</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c320t-2cd1745fdec77ba8a65789ba2253e0120ee4112d40263851792adb61af20d0bc3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Applied Psychology</topic><topic>Industrial and Organizational Psychology</topic><topic>Psychometrics</topic><topic>Quantitative psychology</topic><topic>Scientific Communication</topic><topic>Short forms</topic><topic>Test Forms</topic><topic>Test Reliability</topic><topic>Test Validity</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Cortina, Jose M</creatorcontrib><creatorcontrib>Sheng, Zitong</creatorcontrib><creatorcontrib>Keener, Sheila K</creatorcontrib><creatorcontrib>Keeler, Kathleen R</creatorcontrib><creatorcontrib>Grubb, Leah K</creatorcontrib><creatorcontrib>Schmitt, Neal</creatorcontrib><creatorcontrib>Tonidandel, Scott</creatorcontrib><creatorcontrib>Summerville, Karoline M</creatorcontrib><creatorcontrib>Heggestad, Eric D</creatorcontrib><creatorcontrib>Banks, George C</creatorcontrib><collection>CrossRef</collection><collection>APA PsycArticles®</collection><collection>ProQuest One Psychology</collection><collection>Applied Social Sciences Index & Abstracts (ASSIA)</collection><collection>International Bibliography of the Social Sciences (IBSS)</collection><collection>International Bibliography of the Social Sciences</collection><collection>International Bibliography of the Social Sciences</collection><collection>MEDLINE - Academic</collection><jtitle>Journal of applied psychology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Cortina, Jose M</au><au>Sheng, Zitong</au><au>Keener, Sheila K</au><au>Keeler, Kathleen R</au><au>Grubb, Leah K</au><au>Schmitt, Neal</au><au>Tonidandel, Scott</au><au>Summerville, Karoline M</au><au>Heggestad, Eric D</au><au>Banks, George C</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>From alpha to omega and beyond! A look at the past, present, and (possible) future of psychometric soundness in the Journal of Applied Psychology</atitle><jtitle>Journal of applied psychology</jtitle><date>2020-12-01</date><risdate>2020</risdate><volume>105</volume><issue>12</issue><spage>1351</spage><epage>1381</epage><pages>1351-1381</pages><issn>0021-9010</issn><eissn>1939-1854</eissn><abstract>The psychometric soundness of measures has been a central concern of articles published in the Journal of Applied Psychology (JAP) since the inception of the journal. At the same time, it isn’t clear that investigators and reviewers prioritize psychometric soundness to a degree that would allow one to have sufficient confidence in conclusions regarding constructs. The purposes of the present article are to (a) examine current scale development and evaluation practices in JAP; (b) compare these practices to recommended practices, previous practices, and practices in other journals; and (c) use these comparisons to make recommendations for reviewers, editors, and investigators regarding the creation and evaluation of measures including Excel-based calculators for various indices. Finally, given that model complexity appears to have increased the need for short scales, we offer a user-friendly R Shiny app (https://orgscience.uncc.edu/about-us/resources) that identifies the subset of items that maximize a variety of psychometric criteria rather than merely maximizing alpha. (PsycInfo Database Record (c) 2022 APA, all rights reserved) (Source: journal abstract)</abstract><cop>Washington</cop><pub>American Psychological Association</pub><doi>10.1037/apl0000815</doi><tpages>31</tpages><orcidid>https://orcid.org/0000-0003-2336-917X</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0021-9010 |
ispartof | Journal of applied psychology, 2020-12, Vol.105 (12), p.1351-1381 |
issn | 0021-9010 1939-1854 |
language | eng |
recordid | cdi_proquest_miscellaneous_2432867003 |
source | EBSCOhost APA PsycARTICLES; Applied Social Sciences Index & Abstracts (ASSIA) |
subjects | Applied Psychology Industrial and Organizational Psychology Psychometrics Quantitative psychology Scientific Communication Short forms Test Forms Test Reliability Test Validity |
title | From alpha to omega and beyond! A look at the past, present, and (possible) future of psychometric soundness in the Journal of Applied Psychology |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-16T01%3A01%3A26IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=From%20alpha%20to%20omega%20and%20beyond!%20A%20look%20at%20the%20past,%20present,%20and%20(possible)%20future%20of%20psychometric%20soundness%20in%20the%20Journal%20of%20Applied%20Psychology&rft.jtitle=Journal%20of%20applied%20psychology&rft.au=Cortina,%20Jose%20M&rft.date=2020-12-01&rft.volume=105&rft.issue=12&rft.spage=1351&rft.epage=1381&rft.pages=1351-1381&rft.issn=0021-9010&rft.eissn=1939-1854&rft_id=info:doi/10.1037/apl0000815&rft_dat=%3Cproquest_cross%3E2469840634%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2432063061&rft_id=info:pmid/&rfr_iscdi=true |