Development and validation of an instrument to measure online assessment acceptance in higher education

Many educational institutions have adopted online assessment in recent years. Previous studies on online assessment have often been tied to studies on learning management systems. As such, questions of online assessment acceptance have typically been overshadowed by a focus on the acceptance of lear...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:British journal of educational technology 2022-07, Vol.53 (4), p.977-997
Hauptverfasser: Or, Caleb, Chapman, Elaine
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 997
container_issue 4
container_start_page 977
container_title British journal of educational technology
container_volume 53
creator Or, Caleb
Chapman, Elaine
description Many educational institutions have adopted online assessment in recent years. Previous studies on online assessment have often been tied to studies on learning management systems. As such, questions of online assessment acceptance have typically been overshadowed by a focus on the acceptance of learning management systems in general. The focus of the present research on online assessment is relatively rare. This paper describes the validation of an instrument to measure online assessment adoption by lecturers in higher education. A total of 213 participants responded to a 20‐item online questionnaire. With the data collected and the model fit, the instrument developed was able to meet the expectations to measure online assessment. The preliminary evidence of the validity of the extended Unified Theory of Acceptance and Use of Technology model, based on its reliability found in the current study, supports the use of the instrument as a technology acceptance framework for online assessment systems. Practitioner notes What is already known about this topic Unified Theory of Acceptance and Use of Technology (UTAUT) model has been found to be a reliable and robust model to study and explain technology acceptance and use across various educational contexts. In the UTAUT model, performance expectancy (PE), effort expectancy (EE), social influence (SI) and facilitating conditions are direct determinants of user acceptance and use behaviour. Subsequent validation by Venkatesh et al. (2003) in a longitudinal study found that the UTAUT model was a competent model that explained the relationships between PE, EE, SI and user behavioural intention (BI). What this paper adds An extended UTAUT model has been proposed, with the removal of EE as many UTAUT studies have shown that its influence has not been as consistent as compared to that of the other original constructs. In its place, constructs such as usability and learnability have been added as potential influences on both BI and use behaviour. Attitude as a construct has been added, as this was first included in an earlier Technology Acceptance Model but absent in the original UTAUT model. Development of a validated instrument suitable for assessing educators' acceptance of online assessment based on the extended UTAUT model. Implications for practice and/or policy The instrument proposed in this study can be used as a tool to examine educators' perception on online assessment. The instrument can also be used as a to
doi_str_mv 10.1111/bjet.13180
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2675150479</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ1338336</ericid><sourcerecordid>2675150479</sourcerecordid><originalsourceid>FETCH-LOGICAL-c3230-be1fecb6dabcb5393bfe6ca772c05acc27cb3fc031bf96faa8a80c348460e4a73</originalsourceid><addsrcrecordid>eNp9kL1PwzAQxS0EEqWwsCNZYkNKseMkTkc-ykdViaXMlu2cW1epE-ykqP89boMYueV09373TnoIXVMyobHu1Qa6CWW0JCdoRLOCJ2XO8lM0IoTwhBLKztFFCJs4EpZnI7R6hh3UTbsF12HpKryTta1kZxuHGxM32LrQ-f6odw3eggy9B9y42jrAMgQIYTjWGtpOOg3xBK_tag0eQ9Xro9klOjOyDnD128fo82W2fHpLFh-v708Pi0SzlJFEATWgVVFJpVXOpkwZKLTkPNUkjx9SrhUzmjCqzLQwUpayJJplZVYQyCRnY3Q7-La--eohdGLT9N7FlyIteE5zkvFppO4GSvsmBA9GtN5upd8LSsQhSHEIUhyDjPDNAIO3-g-czSljJWNF1Omgf9sa9v84icf5bDl4_gC5poHS</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2675150479</pqid></control><display><type>article</type><title>Development and validation of an instrument to measure online assessment acceptance in higher education</title><source>Education Source</source><source>Wiley Online Library Journals Frontfile Complete</source><creator>Or, Caleb ; Chapman, Elaine</creator><creatorcontrib>Or, Caleb ; Chapman, Elaine</creatorcontrib><description>Many educational institutions have adopted online assessment in recent years. Previous studies on online assessment have often been tied to studies on learning management systems. As such, questions of online assessment acceptance have typically been overshadowed by a focus on the acceptance of learning management systems in general. The focus of the present research on online assessment is relatively rare. This paper describes the validation of an instrument to measure online assessment adoption by lecturers in higher education. A total of 213 participants responded to a 20‐item online questionnaire. With the data collected and the model fit, the instrument developed was able to meet the expectations to measure online assessment. The preliminary evidence of the validity of the extended Unified Theory of Acceptance and Use of Technology model, based on its reliability found in the current study, supports the use of the instrument as a technology acceptance framework for online assessment systems. Practitioner notes What is already known about this topic Unified Theory of Acceptance and Use of Technology (UTAUT) model has been found to be a reliable and robust model to study and explain technology acceptance and use across various educational contexts. In the UTAUT model, performance expectancy (PE), effort expectancy (EE), social influence (SI) and facilitating conditions are direct determinants of user acceptance and use behaviour. Subsequent validation by Venkatesh et al. (2003) in a longitudinal study found that the UTAUT model was a competent model that explained the relationships between PE, EE, SI and user behavioural intention (BI). What this paper adds An extended UTAUT model has been proposed, with the removal of EE as many UTAUT studies have shown that its influence has not been as consistent as compared to that of the other original constructs. In its place, constructs such as usability and learnability have been added as potential influences on both BI and use behaviour. Attitude as a construct has been added, as this was first included in an earlier Technology Acceptance Model but absent in the original UTAUT model. Development of a validated instrument suitable for assessing educators' acceptance of online assessment based on the extended UTAUT model. Implications for practice and/or policy The instrument proposed in this study can be used as a tool to examine educators' perception on online assessment. The instrument can also be used as a tool to inform educational institutions the factors that influence the successful implementation of online assessment or assessment‐related systems. Based on its reliability found in the current study, this study supports the use of the instrument as a technology acceptance framework for online assessment systems.</description><identifier>ISSN: 0007-1013</identifier><identifier>EISSN: 1467-8535</identifier><identifier>DOI: 10.1111/bjet.13180</identifier><language>eng</language><publisher>Coventry: Wiley</publisher><subject>Acceptance tests ; Adoption (Ideas) ; Computer Assisted Testing ; Educational Technology ; Educational tests &amp; measurements ; Higher Education ; Higher education institutions ; Influence ; Learning ; Learning management systems ; Longitudinal Studies ; Management Systems ; online assessment ; Reliability analysis ; Social Influences ; technology acceptance ; Technology Acceptance Model ; Technology Uses in Education ; Technology utilization ; Test Validity ; Unified Theory of Acceptance and Use of Technology ; Usability</subject><ispartof>British journal of educational technology, 2022-07, Vol.53 (4), p.977-997</ispartof><rights>2022 British Educational Research Association</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c3230-be1fecb6dabcb5393bfe6ca772c05acc27cb3fc031bf96faa8a80c348460e4a73</citedby><cites>FETCH-LOGICAL-c3230-be1fecb6dabcb5393bfe6ca772c05acc27cb3fc031bf96faa8a80c348460e4a73</cites><orcidid>0000-0002-0509-0338</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1111%2Fbjet.13180$$EPDF$$P50$$Gwiley$$H</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1111%2Fbjet.13180$$EHTML$$P50$$Gwiley$$H</linktohtml><link.rule.ids>314,776,780,1411,27901,27902,45550,45551</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ1338336$$DView record in ERIC$$Hfree_for_read</backlink></links><search><creatorcontrib>Or, Caleb</creatorcontrib><creatorcontrib>Chapman, Elaine</creatorcontrib><title>Development and validation of an instrument to measure online assessment acceptance in higher education</title><title>British journal of educational technology</title><description>Many educational institutions have adopted online assessment in recent years. Previous studies on online assessment have often been tied to studies on learning management systems. As such, questions of online assessment acceptance have typically been overshadowed by a focus on the acceptance of learning management systems in general. The focus of the present research on online assessment is relatively rare. This paper describes the validation of an instrument to measure online assessment adoption by lecturers in higher education. A total of 213 participants responded to a 20‐item online questionnaire. With the data collected and the model fit, the instrument developed was able to meet the expectations to measure online assessment. The preliminary evidence of the validity of the extended Unified Theory of Acceptance and Use of Technology model, based on its reliability found in the current study, supports the use of the instrument as a technology acceptance framework for online assessment systems. Practitioner notes What is already known about this topic Unified Theory of Acceptance and Use of Technology (UTAUT) model has been found to be a reliable and robust model to study and explain technology acceptance and use across various educational contexts. In the UTAUT model, performance expectancy (PE), effort expectancy (EE), social influence (SI) and facilitating conditions are direct determinants of user acceptance and use behaviour. Subsequent validation by Venkatesh et al. (2003) in a longitudinal study found that the UTAUT model was a competent model that explained the relationships between PE, EE, SI and user behavioural intention (BI). What this paper adds An extended UTAUT model has been proposed, with the removal of EE as many UTAUT studies have shown that its influence has not been as consistent as compared to that of the other original constructs. In its place, constructs such as usability and learnability have been added as potential influences on both BI and use behaviour. Attitude as a construct has been added, as this was first included in an earlier Technology Acceptance Model but absent in the original UTAUT model. Development of a validated instrument suitable for assessing educators' acceptance of online assessment based on the extended UTAUT model. Implications for practice and/or policy The instrument proposed in this study can be used as a tool to examine educators' perception on online assessment. The instrument can also be used as a tool to inform educational institutions the factors that influence the successful implementation of online assessment or assessment‐related systems. Based on its reliability found in the current study, this study supports the use of the instrument as a technology acceptance framework for online assessment systems.</description><subject>Acceptance tests</subject><subject>Adoption (Ideas)</subject><subject>Computer Assisted Testing</subject><subject>Educational Technology</subject><subject>Educational tests &amp; measurements</subject><subject>Higher Education</subject><subject>Higher education institutions</subject><subject>Influence</subject><subject>Learning</subject><subject>Learning management systems</subject><subject>Longitudinal Studies</subject><subject>Management Systems</subject><subject>online assessment</subject><subject>Reliability analysis</subject><subject>Social Influences</subject><subject>technology acceptance</subject><subject>Technology Acceptance Model</subject><subject>Technology Uses in Education</subject><subject>Technology utilization</subject><subject>Test Validity</subject><subject>Unified Theory of Acceptance and Use of Technology</subject><subject>Usability</subject><issn>0007-1013</issn><issn>1467-8535</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><recordid>eNp9kL1PwzAQxS0EEqWwsCNZYkNKseMkTkc-ykdViaXMlu2cW1epE-ykqP89boMYueV09373TnoIXVMyobHu1Qa6CWW0JCdoRLOCJ2XO8lM0IoTwhBLKztFFCJs4EpZnI7R6hh3UTbsF12HpKryTta1kZxuHGxM32LrQ-f6odw3eggy9B9y42jrAMgQIYTjWGtpOOg3xBK_tag0eQ9Xro9klOjOyDnD128fo82W2fHpLFh-v708Pi0SzlJFEATWgVVFJpVXOpkwZKLTkPNUkjx9SrhUzmjCqzLQwUpayJJplZVYQyCRnY3Q7-La--eohdGLT9N7FlyIteE5zkvFppO4GSvsmBA9GtN5upd8LSsQhSHEIUhyDjPDNAIO3-g-czSljJWNF1Omgf9sa9v84icf5bDl4_gC5poHS</recordid><startdate>202207</startdate><enddate>202207</enddate><creator>Or, Caleb</creator><creator>Chapman, Elaine</creator><general>Wiley</general><general>Blackwell Publishing Ltd</general><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-0509-0338</orcidid></search><sort><creationdate>202207</creationdate><title>Development and validation of an instrument to measure online assessment acceptance in higher education</title><author>Or, Caleb ; Chapman, Elaine</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c3230-be1fecb6dabcb5393bfe6ca772c05acc27cb3fc031bf96faa8a80c348460e4a73</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Acceptance tests</topic><topic>Adoption (Ideas)</topic><topic>Computer Assisted Testing</topic><topic>Educational Technology</topic><topic>Educational tests &amp; measurements</topic><topic>Higher Education</topic><topic>Higher education institutions</topic><topic>Influence</topic><topic>Learning</topic><topic>Learning management systems</topic><topic>Longitudinal Studies</topic><topic>Management Systems</topic><topic>online assessment</topic><topic>Reliability analysis</topic><topic>Social Influences</topic><topic>technology acceptance</topic><topic>Technology Acceptance Model</topic><topic>Technology Uses in Education</topic><topic>Technology utilization</topic><topic>Test Validity</topic><topic>Unified Theory of Acceptance and Use of Technology</topic><topic>Usability</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Or, Caleb</creatorcontrib><creatorcontrib>Chapman, Elaine</creatorcontrib><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>British journal of educational technology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Or, Caleb</au><au>Chapman, Elaine</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ1338336</ericid><atitle>Development and validation of an instrument to measure online assessment acceptance in higher education</atitle><jtitle>British journal of educational technology</jtitle><date>2022-07</date><risdate>2022</risdate><volume>53</volume><issue>4</issue><spage>977</spage><epage>997</epage><pages>977-997</pages><issn>0007-1013</issn><eissn>1467-8535</eissn><abstract>Many educational institutions have adopted online assessment in recent years. Previous studies on online assessment have often been tied to studies on learning management systems. As such, questions of online assessment acceptance have typically been overshadowed by a focus on the acceptance of learning management systems in general. The focus of the present research on online assessment is relatively rare. This paper describes the validation of an instrument to measure online assessment adoption by lecturers in higher education. A total of 213 participants responded to a 20‐item online questionnaire. With the data collected and the model fit, the instrument developed was able to meet the expectations to measure online assessment. The preliminary evidence of the validity of the extended Unified Theory of Acceptance and Use of Technology model, based on its reliability found in the current study, supports the use of the instrument as a technology acceptance framework for online assessment systems. Practitioner notes What is already known about this topic Unified Theory of Acceptance and Use of Technology (UTAUT) model has been found to be a reliable and robust model to study and explain technology acceptance and use across various educational contexts. In the UTAUT model, performance expectancy (PE), effort expectancy (EE), social influence (SI) and facilitating conditions are direct determinants of user acceptance and use behaviour. Subsequent validation by Venkatesh et al. (2003) in a longitudinal study found that the UTAUT model was a competent model that explained the relationships between PE, EE, SI and user behavioural intention (BI). What this paper adds An extended UTAUT model has been proposed, with the removal of EE as many UTAUT studies have shown that its influence has not been as consistent as compared to that of the other original constructs. In its place, constructs such as usability and learnability have been added as potential influences on both BI and use behaviour. Attitude as a construct has been added, as this was first included in an earlier Technology Acceptance Model but absent in the original UTAUT model. Development of a validated instrument suitable for assessing educators' acceptance of online assessment based on the extended UTAUT model. Implications for practice and/or policy The instrument proposed in this study can be used as a tool to examine educators' perception on online assessment. The instrument can also be used as a tool to inform educational institutions the factors that influence the successful implementation of online assessment or assessment‐related systems. Based on its reliability found in the current study, this study supports the use of the instrument as a technology acceptance framework for online assessment systems.</abstract><cop>Coventry</cop><pub>Wiley</pub><doi>10.1111/bjet.13180</doi><tpages>21</tpages><orcidid>https://orcid.org/0000-0002-0509-0338</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0007-1013
ispartof British journal of educational technology, 2022-07, Vol.53 (4), p.977-997
issn 0007-1013
1467-8535
language eng
recordid cdi_proquest_journals_2675150479
source Education Source; Wiley Online Library Journals Frontfile Complete
subjects Acceptance tests
Adoption (Ideas)
Computer Assisted Testing
Educational Technology
Educational tests & measurements
Higher Education
Higher education institutions
Influence
Learning
Learning management systems
Longitudinal Studies
Management Systems
online assessment
Reliability analysis
Social Influences
technology acceptance
Technology Acceptance Model
Technology Uses in Education
Technology utilization
Test Validity
Unified Theory of Acceptance and Use of Technology
Usability
title Development and validation of an instrument to measure online assessment acceptance in higher education
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-06T05%3A53%3A33IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Development%20and%20validation%20of%20an%20instrument%20to%20measure%20online%20assessment%20acceptance%20in%20higher%20education&rft.jtitle=British%20journal%20of%20educational%20technology&rft.au=Or,%20Caleb&rft.date=2022-07&rft.volume=53&rft.issue=4&rft.spage=977&rft.epage=997&rft.pages=977-997&rft.issn=0007-1013&rft.eissn=1467-8535&rft_id=info:doi/10.1111/bjet.13180&rft_dat=%3Cproquest_cross%3E2675150479%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2675150479&rft_id=info:pmid/&rft_ericid=EJ1338336&rfr_iscdi=true