A framework to support interoperable Game‐based Assessments as a Service (GBAaaS): Design, development, and use cases
During the last few years, there has been increasing attention paid to serious games (SGs), which are games used for non‐entertainment purposes. SGs offer the potential for more valid and reliable assessments compared to traditional methods such as paper‐and‐pencil tests. However, the incorporation...
Gespeichert in:
Veröffentlicht in: | Software, practice & experience practice & experience, 2023-11, Vol.53 (11), p.2222-2240 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 2240 |
---|---|
container_issue | 11 |
container_start_page | 2222 |
container_title | Software, practice & experience |
container_volume | 53 |
creator | Gomez, Manuel J. Ruipérez‐Valiente, José A. García Clemente, Félix J. |
description | During the last few years, there has been increasing attention paid to serious games (SGs), which are games used for non‐entertainment purposes. SGs offer the potential for more valid and reliable assessments compared to traditional methods such as paper‐and‐pencil tests. However, the incorporation of assessment features into SGs is still in its early stages, requiring specific design efforts for each game and adding significant time to the design of Game‐based Assessments (GBAs). In this research, we present a completely novel framework that aims to perform interoperable GBAs by: (a) integrating a common GBA ontology model to process RDF data; (b) developing in‐game metrics to infer useful information and assess learners; (c) integrating a service API to provide an easy way to interact with the framework. We then validate our approach through performance evaluation and two use cases, demonstrating its effectiveness in real‐world scenarios with large‐scale datasets. Our results show that the developed framework achieves excellent performance, replicating metrics from previous literature. We anticipate that our work will help alleviate current limitations in the field and facilitate the deployment of GBAs as a Service. |
doi_str_mv | 10.1002/spe.3254 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2874039534</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2874039534</sourcerecordid><originalsourceid>FETCH-LOGICAL-c289t-8ced160d8ac006eff449c61b7200b494527dc1dd08dfc48c67af485ba145df7f3</originalsourceid><addsrcrecordid>eNotkM1Kw0AUhQdRsFbBRxhwU6GpdyaTP3e1ahUKLqrgLkxm7khqm8S5SYs7H8Fn9ElMUThwNh_nwMfYuYCJAJBX1OAklJE6YAMBWRKAVK-HbAAQpgHESh2zE6IVgBCRjAdsN-XO6w3uav_O25pT1zS1b3lZtejrBr0u1sjnPfHz9V1oQsunREi0waolrvvwJfptaZCP5jdTrZeX1_wWqXyrxtziFtd1s2fHXFeWd4Tc9Ct0yo6cXhOe_feQvdzfPc8egsXT_HE2XQRGplkbpAatiMGm2gDE6JxSmYlFkUiAQmUqkok1wlpIrTMqNXGinUqjQgsVWZe4cMgu_nYbX390SG2-qjtf9Ze5TBMFYRaFqqdGf5TxNZFHlze-3Gj_mQvI91rzXmu-1xr-AthAbA0</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2874039534</pqid></control><display><type>article</type><title>A framework to support interoperable Game‐based Assessments as a Service (GBAaaS): Design, development, and use cases</title><source>Wiley Journals</source><creator>Gomez, Manuel J. ; Ruipérez‐Valiente, José A. ; García Clemente, Félix J.</creator><creatorcontrib>Gomez, Manuel J. ; Ruipérez‐Valiente, José A. ; García Clemente, Félix J.</creatorcontrib><description>During the last few years, there has been increasing attention paid to serious games (SGs), which are games used for non‐entertainment purposes. SGs offer the potential for more valid and reliable assessments compared to traditional methods such as paper‐and‐pencil tests. However, the incorporation of assessment features into SGs is still in its early stages, requiring specific design efforts for each game and adding significant time to the design of Game‐based Assessments (GBAs). In this research, we present a completely novel framework that aims to perform interoperable GBAs by: (a) integrating a common GBA ontology model to process RDF data; (b) developing in‐game metrics to infer useful information and assess learners; (c) integrating a service API to provide an easy way to interact with the framework. We then validate our approach through performance evaluation and two use cases, demonstrating its effectiveness in real‐world scenarios with large‐scale datasets. Our results show that the developed framework achieves excellent performance, replicating metrics from previous literature. We anticipate that our work will help alleviate current limitations in the field and facilitate the deployment of GBAs as a Service.</description><identifier>ISSN: 0038-0644</identifier><identifier>EISSN: 1097-024X</identifier><identifier>DOI: 10.1002/spe.3254</identifier><language>eng</language><publisher>Bognor Regis: Wiley Subscription Services, Inc</publisher><subject>Assessments ; Design analysis ; Games ; Interoperability ; Performance evaluation</subject><ispartof>Software, practice & experience, 2023-11, Vol.53 (11), p.2222-2240</ispartof><rights>2023. This article is published under http://creativecommons.org/licenses/by-nc/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c289t-8ced160d8ac006eff449c61b7200b494527dc1dd08dfc48c67af485ba145df7f3</citedby><cites>FETCH-LOGICAL-c289t-8ced160d8ac006eff449c61b7200b494527dc1dd08dfc48c67af485ba145df7f3</cites><orcidid>0000-0002-2304-6365 ; 0000-0003-0571-2923 ; 0000-0001-6181-5033</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids></links><search><creatorcontrib>Gomez, Manuel J.</creatorcontrib><creatorcontrib>Ruipérez‐Valiente, José A.</creatorcontrib><creatorcontrib>García Clemente, Félix J.</creatorcontrib><title>A framework to support interoperable Game‐based Assessments as a Service (GBAaaS): Design, development, and use cases</title><title>Software, practice & experience</title><description>During the last few years, there has been increasing attention paid to serious games (SGs), which are games used for non‐entertainment purposes. SGs offer the potential for more valid and reliable assessments compared to traditional methods such as paper‐and‐pencil tests. However, the incorporation of assessment features into SGs is still in its early stages, requiring specific design efforts for each game and adding significant time to the design of Game‐based Assessments (GBAs). In this research, we present a completely novel framework that aims to perform interoperable GBAs by: (a) integrating a common GBA ontology model to process RDF data; (b) developing in‐game metrics to infer useful information and assess learners; (c) integrating a service API to provide an easy way to interact with the framework. We then validate our approach through performance evaluation and two use cases, demonstrating its effectiveness in real‐world scenarios with large‐scale datasets. Our results show that the developed framework achieves excellent performance, replicating metrics from previous literature. We anticipate that our work will help alleviate current limitations in the field and facilitate the deployment of GBAs as a Service.</description><subject>Assessments</subject><subject>Design analysis</subject><subject>Games</subject><subject>Interoperability</subject><subject>Performance evaluation</subject><issn>0038-0644</issn><issn>1097-024X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNotkM1Kw0AUhQdRsFbBRxhwU6GpdyaTP3e1ahUKLqrgLkxm7khqm8S5SYs7H8Fn9ElMUThwNh_nwMfYuYCJAJBX1OAklJE6YAMBWRKAVK-HbAAQpgHESh2zE6IVgBCRjAdsN-XO6w3uav_O25pT1zS1b3lZtejrBr0u1sjnPfHz9V1oQsunREi0waolrvvwJfptaZCP5jdTrZeX1_wWqXyrxtziFtd1s2fHXFeWd4Tc9Ct0yo6cXhOe_feQvdzfPc8egsXT_HE2XQRGplkbpAatiMGm2gDE6JxSmYlFkUiAQmUqkok1wlpIrTMqNXGinUqjQgsVWZe4cMgu_nYbX390SG2-qjtf9Ze5TBMFYRaFqqdGf5TxNZFHlze-3Gj_mQvI91rzXmu-1xr-AthAbA0</recordid><startdate>202311</startdate><enddate>202311</enddate><creator>Gomez, Manuel J.</creator><creator>Ruipérez‐Valiente, José A.</creator><creator>García Clemente, Félix J.</creator><general>Wiley Subscription Services, Inc</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>F28</scope><scope>FR3</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-2304-6365</orcidid><orcidid>https://orcid.org/0000-0003-0571-2923</orcidid><orcidid>https://orcid.org/0000-0001-6181-5033</orcidid></search><sort><creationdate>202311</creationdate><title>A framework to support interoperable Game‐based Assessments as a Service (GBAaaS): Design, development, and use cases</title><author>Gomez, Manuel J. ; Ruipérez‐Valiente, José A. ; García Clemente, Félix J.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c289t-8ced160d8ac006eff449c61b7200b494527dc1dd08dfc48c67af485ba145df7f3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Assessments</topic><topic>Design analysis</topic><topic>Games</topic><topic>Interoperability</topic><topic>Performance evaluation</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Gomez, Manuel J.</creatorcontrib><creatorcontrib>Ruipérez‐Valiente, José A.</creatorcontrib><creatorcontrib>García Clemente, Félix J.</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ANTE: Abstracts in New Technology & Engineering</collection><collection>Engineering Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Software, practice & experience</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Gomez, Manuel J.</au><au>Ruipérez‐Valiente, José A.</au><au>García Clemente, Félix J.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A framework to support interoperable Game‐based Assessments as a Service (GBAaaS): Design, development, and use cases</atitle><jtitle>Software, practice & experience</jtitle><date>2023-11</date><risdate>2023</risdate><volume>53</volume><issue>11</issue><spage>2222</spage><epage>2240</epage><pages>2222-2240</pages><issn>0038-0644</issn><eissn>1097-024X</eissn><abstract>During the last few years, there has been increasing attention paid to serious games (SGs), which are games used for non‐entertainment purposes. SGs offer the potential for more valid and reliable assessments compared to traditional methods such as paper‐and‐pencil tests. However, the incorporation of assessment features into SGs is still in its early stages, requiring specific design efforts for each game and adding significant time to the design of Game‐based Assessments (GBAs). In this research, we present a completely novel framework that aims to perform interoperable GBAs by: (a) integrating a common GBA ontology model to process RDF data; (b) developing in‐game metrics to infer useful information and assess learners; (c) integrating a service API to provide an easy way to interact with the framework. We then validate our approach through performance evaluation and two use cases, demonstrating its effectiveness in real‐world scenarios with large‐scale datasets. Our results show that the developed framework achieves excellent performance, replicating metrics from previous literature. We anticipate that our work will help alleviate current limitations in the field and facilitate the deployment of GBAs as a Service.</abstract><cop>Bognor Regis</cop><pub>Wiley Subscription Services, Inc</pub><doi>10.1002/spe.3254</doi><tpages>19</tpages><orcidid>https://orcid.org/0000-0002-2304-6365</orcidid><orcidid>https://orcid.org/0000-0003-0571-2923</orcidid><orcidid>https://orcid.org/0000-0001-6181-5033</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0038-0644 |
ispartof | Software, practice & experience, 2023-11, Vol.53 (11), p.2222-2240 |
issn | 0038-0644 1097-024X |
language | eng |
recordid | cdi_proquest_journals_2874039534 |
source | Wiley Journals |
subjects | Assessments Design analysis Games Interoperability Performance evaluation |
title | A framework to support interoperable Game‐based Assessments as a Service (GBAaaS): Design, development, and use cases |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T07%3A56%3A22IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20framework%20to%20support%20interoperable%20Game%E2%80%90based%20Assessments%20as%20a%20Service%20(GBAaaS):%20Design,%20development,%20and%20use%20cases&rft.jtitle=Software,%20practice%20&%20experience&rft.au=Gomez,%20Manuel%20J.&rft.date=2023-11&rft.volume=53&rft.issue=11&rft.spage=2222&rft.epage=2240&rft.pages=2222-2240&rft.issn=0038-0644&rft.eissn=1097-024X&rft_id=info:doi/10.1002/spe.3254&rft_dat=%3Cproquest_cross%3E2874039534%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2874039534&rft_id=info:pmid/&rfr_iscdi=true |