A framework to support interoperable Game‐based Assessments as a Service (GBAaaS): Design, development, and use cases

During the last few years, there has been increasing attention paid to serious games (SGs), which are games used for non‐entertainment purposes. SGs offer the potential for more valid and reliable assessments compared to traditional methods such as paper‐and‐pencil tests. However, the incorporation...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Software, practice & experience practice & experience, 2023-11, Vol.53 (11), p.2222-2240
Hauptverfasser: Gomez, Manuel J., Ruipérez‐Valiente, José A., García Clemente, Félix J.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 2240
container_issue 11
container_start_page 2222
container_title Software, practice & experience
container_volume 53
creator Gomez, Manuel J.
Ruipérez‐Valiente, José A.
García Clemente, Félix J.
description During the last few years, there has been increasing attention paid to serious games (SGs), which are games used for non‐entertainment purposes. SGs offer the potential for more valid and reliable assessments compared to traditional methods such as paper‐and‐pencil tests. However, the incorporation of assessment features into SGs is still in its early stages, requiring specific design efforts for each game and adding significant time to the design of Game‐based Assessments (GBAs). In this research, we present a completely novel framework that aims to perform interoperable GBAs by: (a) integrating a common GBA ontology model to process RDF data; (b) developing in‐game metrics to infer useful information and assess learners; (c) integrating a service API to provide an easy way to interact with the framework. We then validate our approach through performance evaluation and two use cases, demonstrating its effectiveness in real‐world scenarios with large‐scale datasets. Our results show that the developed framework achieves excellent performance, replicating metrics from previous literature. We anticipate that our work will help alleviate current limitations in the field and facilitate the deployment of GBAs as a Service.
doi_str_mv 10.1002/spe.3254
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2874039534</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2874039534</sourcerecordid><originalsourceid>FETCH-LOGICAL-c289t-8ced160d8ac006eff449c61b7200b494527dc1dd08dfc48c67af485ba145df7f3</originalsourceid><addsrcrecordid>eNotkM1Kw0AUhQdRsFbBRxhwU6GpdyaTP3e1ahUKLqrgLkxm7khqm8S5SYs7H8Fn9ElMUThwNh_nwMfYuYCJAJBX1OAklJE6YAMBWRKAVK-HbAAQpgHESh2zE6IVgBCRjAdsN-XO6w3uav_O25pT1zS1b3lZtejrBr0u1sjnPfHz9V1oQsunREi0waolrvvwJfptaZCP5jdTrZeX1_wWqXyrxtziFtd1s2fHXFeWd4Tc9Ct0yo6cXhOe_feQvdzfPc8egsXT_HE2XQRGplkbpAatiMGm2gDE6JxSmYlFkUiAQmUqkok1wlpIrTMqNXGinUqjQgsVWZe4cMgu_nYbX390SG2-qjtf9Ze5TBMFYRaFqqdGf5TxNZFHlze-3Gj_mQvI91rzXmu-1xr-AthAbA0</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2874039534</pqid></control><display><type>article</type><title>A framework to support interoperable Game‐based Assessments as a Service (GBAaaS): Design, development, and use cases</title><source>Wiley Journals</source><creator>Gomez, Manuel J. ; Ruipérez‐Valiente, José A. ; García Clemente, Félix J.</creator><creatorcontrib>Gomez, Manuel J. ; Ruipérez‐Valiente, José A. ; García Clemente, Félix J.</creatorcontrib><description>During the last few years, there has been increasing attention paid to serious games (SGs), which are games used for non‐entertainment purposes. SGs offer the potential for more valid and reliable assessments compared to traditional methods such as paper‐and‐pencil tests. However, the incorporation of assessment features into SGs is still in its early stages, requiring specific design efforts for each game and adding significant time to the design of Game‐based Assessments (GBAs). In this research, we present a completely novel framework that aims to perform interoperable GBAs by: (a) integrating a common GBA ontology model to process RDF data; (b) developing in‐game metrics to infer useful information and assess learners; (c) integrating a service API to provide an easy way to interact with the framework. We then validate our approach through performance evaluation and two use cases, demonstrating its effectiveness in real‐world scenarios with large‐scale datasets. Our results show that the developed framework achieves excellent performance, replicating metrics from previous literature. We anticipate that our work will help alleviate current limitations in the field and facilitate the deployment of GBAs as a Service.</description><identifier>ISSN: 0038-0644</identifier><identifier>EISSN: 1097-024X</identifier><identifier>DOI: 10.1002/spe.3254</identifier><language>eng</language><publisher>Bognor Regis: Wiley Subscription Services, Inc</publisher><subject>Assessments ; Design analysis ; Games ; Interoperability ; Performance evaluation</subject><ispartof>Software, practice &amp; experience, 2023-11, Vol.53 (11), p.2222-2240</ispartof><rights>2023. This article is published under http://creativecommons.org/licenses/by-nc/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c289t-8ced160d8ac006eff449c61b7200b494527dc1dd08dfc48c67af485ba145df7f3</citedby><cites>FETCH-LOGICAL-c289t-8ced160d8ac006eff449c61b7200b494527dc1dd08dfc48c67af485ba145df7f3</cites><orcidid>0000-0002-2304-6365 ; 0000-0003-0571-2923 ; 0000-0001-6181-5033</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids></links><search><creatorcontrib>Gomez, Manuel J.</creatorcontrib><creatorcontrib>Ruipérez‐Valiente, José A.</creatorcontrib><creatorcontrib>García Clemente, Félix J.</creatorcontrib><title>A framework to support interoperable Game‐based Assessments as a Service (GBAaaS): Design, development, and use cases</title><title>Software, practice &amp; experience</title><description>During the last few years, there has been increasing attention paid to serious games (SGs), which are games used for non‐entertainment purposes. SGs offer the potential for more valid and reliable assessments compared to traditional methods such as paper‐and‐pencil tests. However, the incorporation of assessment features into SGs is still in its early stages, requiring specific design efforts for each game and adding significant time to the design of Game‐based Assessments (GBAs). In this research, we present a completely novel framework that aims to perform interoperable GBAs by: (a) integrating a common GBA ontology model to process RDF data; (b) developing in‐game metrics to infer useful information and assess learners; (c) integrating a service API to provide an easy way to interact with the framework. We then validate our approach through performance evaluation and two use cases, demonstrating its effectiveness in real‐world scenarios with large‐scale datasets. Our results show that the developed framework achieves excellent performance, replicating metrics from previous literature. We anticipate that our work will help alleviate current limitations in the field and facilitate the deployment of GBAs as a Service.</description><subject>Assessments</subject><subject>Design analysis</subject><subject>Games</subject><subject>Interoperability</subject><subject>Performance evaluation</subject><issn>0038-0644</issn><issn>1097-024X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNotkM1Kw0AUhQdRsFbBRxhwU6GpdyaTP3e1ahUKLqrgLkxm7khqm8S5SYs7H8Fn9ElMUThwNh_nwMfYuYCJAJBX1OAklJE6YAMBWRKAVK-HbAAQpgHESh2zE6IVgBCRjAdsN-XO6w3uav_O25pT1zS1b3lZtejrBr0u1sjnPfHz9V1oQsunREi0waolrvvwJfptaZCP5jdTrZeX1_wWqXyrxtziFtd1s2fHXFeWd4Tc9Ct0yo6cXhOe_feQvdzfPc8egsXT_HE2XQRGplkbpAatiMGm2gDE6JxSmYlFkUiAQmUqkok1wlpIrTMqNXGinUqjQgsVWZe4cMgu_nYbX390SG2-qjtf9Ze5TBMFYRaFqqdGf5TxNZFHlze-3Gj_mQvI91rzXmu-1xr-AthAbA0</recordid><startdate>202311</startdate><enddate>202311</enddate><creator>Gomez, Manuel J.</creator><creator>Ruipérez‐Valiente, José A.</creator><creator>García Clemente, Félix J.</creator><general>Wiley Subscription Services, Inc</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>F28</scope><scope>FR3</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-2304-6365</orcidid><orcidid>https://orcid.org/0000-0003-0571-2923</orcidid><orcidid>https://orcid.org/0000-0001-6181-5033</orcidid></search><sort><creationdate>202311</creationdate><title>A framework to support interoperable Game‐based Assessments as a Service (GBAaaS): Design, development, and use cases</title><author>Gomez, Manuel J. ; Ruipérez‐Valiente, José A. ; García Clemente, Félix J.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c289t-8ced160d8ac006eff449c61b7200b494527dc1dd08dfc48c67af485ba145df7f3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Assessments</topic><topic>Design analysis</topic><topic>Games</topic><topic>Interoperability</topic><topic>Performance evaluation</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Gomez, Manuel J.</creatorcontrib><creatorcontrib>Ruipérez‐Valiente, José A.</creatorcontrib><creatorcontrib>García Clemente, Félix J.</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ANTE: Abstracts in New Technology &amp; Engineering</collection><collection>Engineering Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Software, practice &amp; experience</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Gomez, Manuel J.</au><au>Ruipérez‐Valiente, José A.</au><au>García Clemente, Félix J.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A framework to support interoperable Game‐based Assessments as a Service (GBAaaS): Design, development, and use cases</atitle><jtitle>Software, practice &amp; experience</jtitle><date>2023-11</date><risdate>2023</risdate><volume>53</volume><issue>11</issue><spage>2222</spage><epage>2240</epage><pages>2222-2240</pages><issn>0038-0644</issn><eissn>1097-024X</eissn><abstract>During the last few years, there has been increasing attention paid to serious games (SGs), which are games used for non‐entertainment purposes. SGs offer the potential for more valid and reliable assessments compared to traditional methods such as paper‐and‐pencil tests. However, the incorporation of assessment features into SGs is still in its early stages, requiring specific design efforts for each game and adding significant time to the design of Game‐based Assessments (GBAs). In this research, we present a completely novel framework that aims to perform interoperable GBAs by: (a) integrating a common GBA ontology model to process RDF data; (b) developing in‐game metrics to infer useful information and assess learners; (c) integrating a service API to provide an easy way to interact with the framework. We then validate our approach through performance evaluation and two use cases, demonstrating its effectiveness in real‐world scenarios with large‐scale datasets. Our results show that the developed framework achieves excellent performance, replicating metrics from previous literature. We anticipate that our work will help alleviate current limitations in the field and facilitate the deployment of GBAs as a Service.</abstract><cop>Bognor Regis</cop><pub>Wiley Subscription Services, Inc</pub><doi>10.1002/spe.3254</doi><tpages>19</tpages><orcidid>https://orcid.org/0000-0002-2304-6365</orcidid><orcidid>https://orcid.org/0000-0003-0571-2923</orcidid><orcidid>https://orcid.org/0000-0001-6181-5033</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0038-0644
ispartof Software, practice & experience, 2023-11, Vol.53 (11), p.2222-2240
issn 0038-0644
1097-024X
language eng
recordid cdi_proquest_journals_2874039534
source Wiley Journals
subjects Assessments
Design analysis
Games
Interoperability
Performance evaluation
title A framework to support interoperable Game‐based Assessments as a Service (GBAaaS): Design, development, and use cases
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T07%3A56%3A22IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20framework%20to%20support%20interoperable%20Game%E2%80%90based%20Assessments%20as%20a%20Service%20(GBAaaS):%20Design,%20development,%20and%20use%20cases&rft.jtitle=Software,%20practice%20&%20experience&rft.au=Gomez,%20Manuel%20J.&rft.date=2023-11&rft.volume=53&rft.issue=11&rft.spage=2222&rft.epage=2240&rft.pages=2222-2240&rft.issn=0038-0644&rft.eissn=1097-024X&rft_id=info:doi/10.1002/spe.3254&rft_dat=%3Cproquest_cross%3E2874039534%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2874039534&rft_id=info:pmid/&rfr_iscdi=true