Measuring how motivation affects information quality assessment: A gamification approach
Existing research on the measurability of information quality (IQ) has delivered poor results and demonstrated low inter-rater agreement measured by Intra-Class Correlation (ICC) in evaluating IQ dimensions. Low ICC could result in a questionable interpretation of IQ. The purpose of this paper is to...
Gespeichert in:
| Veröffentlicht in: | PloS one 2022-10, Vol.17 (10), p.e0274811-e0274811 |
|---|---|
| Hauptverfasser: | , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | e0274811 |
|---|---|
| container_issue | 10 |
| container_start_page | e0274811 |
| container_title | PloS one |
| container_volume | 17 |
| creator | Pozenel, Marko Zrnec, Aljaz Lavbic, Dejan |
| description | Existing research on the measurability of information quality (IQ) has delivered poor results and demonstrated low inter-rater agreement measured by Intra-Class Correlation (ICC) in evaluating IQ dimensions. Low ICC could result in a questionable interpretation of IQ. The purpose of this paper is to analyse whether assessors' motivation can facilitate ICC. To acquire the participants' views of IQ, we designed a survey as a gamified process. Additionally, we selected Web study to reach a broader audience. We increased the validity of the research by including a diverse set of participants (i.e. individuals with different education, demographic and social backgrounds). The study results indicate that motivation improved the ICC of IQ on average by 0.27, demonstrating an increase in measurability from poor (0.29) to moderate (0.56). The results reveal a positive correlation between motivation level and ICC, with a significant overall increase in ICC relative to previous studies. The research also identified trends in ICC for different dimensions of IQ with the best results achieved for completeness and accuracy. The work has important practical implications for future IQ research and suggests valuable guidelines. The results of this study imply that considering raters' motivation improves the measurability of IQ substantially. |
| doi_str_mv | 10.1371/journal.pone.0274811 |
| format | Article |
| fullrecord | <record><control><sourceid>gale_plos_</sourceid><recordid>TN_cdi_plos_journals_2729490236</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><galeid>A724258920</galeid><doaj_id>oai_doaj_org_article_46cf937bd95444d29fc9801e00ebc6c8</doaj_id><sourcerecordid>A724258920</sourcerecordid><originalsourceid>FETCH-LOGICAL-c548t-2f64688caf5908ceb1cca300b358907a87ad31f92e0e888aeca38fcb2fb39d963</originalsourceid><addsrcrecordid>eNqNkl2L1DAUhosouI7-A8GCIHoxY77aJl4sDIsfAysLfuFdOE2TTpa2mU3S1f33pk6VreyF5CLh5Dlvkjdvlj3FaINphV9futEP0G0ObtAbRCrGMb6XnWBBybokiN6_tX6YPQrhEqGC8rI8yb5_1BBGb4c237sfee-ivYZo3ZCDMVrFkNvBON8fa1cjdDbe5BCCDqHXQ3yTb_MWemusmtsOB-9A7R9nDwx0QT-Z51X29d3bL2cf1ucX73dn2_O1KhiPa2JKVnKuwBQCcaVrrBRQhGpacIEq4BU0FBtBNNKcc9BplxtVE1NT0YiSrrJnR91D54KcnQiSVEQwgQidiN2RaBxcyoO3Pfgb6cDK3wXnWwk-WtVpyUplBK3qRhSMsYYIowRHWCOka1UqnrRO59PGuteNSg546Baiy53B7mXrrqUoMSlIlQRezgLeXY06RNnboHTXwaDdeLx3QSgVLKHP_0Hvft1MtZAeMH1WOldNonJbEUaSjenXV9nmDiqNRvdWpdgYm-qLhleLhsRE_TO2MIYgd58__T978W3JvrjF7jV0cR9cN07ZCUuQHUHlXQhem78mYySn1P9xQ06pl3Pq6S_ZgfYO</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2729490236</pqid></control><display><type>article</type><title>Measuring how motivation affects information quality assessment: A gamification approach</title><source>DOAJ Directory of Open Access Journals</source><source>Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals</source><source>Public Library of Science (PLoS)</source><source>PubMed Central</source><source>Free Full-Text Journals in Chemistry</source><creator>Pozenel, Marko ; Zrnec, Aljaz ; Lavbic, Dejan</creator><contributor>Sadiq, Ali Safaa</contributor><creatorcontrib>Pozenel, Marko ; Zrnec, Aljaz ; Lavbic, Dejan ; Sadiq, Ali Safaa</creatorcontrib><description>Existing research on the measurability of information quality (IQ) has delivered poor results and demonstrated low inter-rater agreement measured by Intra-Class Correlation (ICC) in evaluating IQ dimensions. Low ICC could result in a questionable interpretation of IQ. The purpose of this paper is to analyse whether assessors' motivation can facilitate ICC. To acquire the participants' views of IQ, we designed a survey as a gamified process. Additionally, we selected Web study to reach a broader audience. We increased the validity of the research by including a diverse set of participants (i.e. individuals with different education, demographic and social backgrounds). The study results indicate that motivation improved the ICC of IQ on average by 0.27, demonstrating an increase in measurability from poor (0.29) to moderate (0.56). The results reveal a positive correlation between motivation level and ICC, with a significant overall increase in ICC relative to previous studies. The research also identified trends in ICC for different dimensions of IQ with the best results achieved for completeness and accuracy. The work has important practical implications for future IQ research and suggests valuable guidelines. The results of this study imply that considering raters' motivation improves the measurability of IQ substantially.</description><identifier>ISSN: 1932-6203</identifier><identifier>EISSN: 1932-6203</identifier><identifier>DOI: 10.1371/journal.pone.0274811</identifier><language>eng</language><publisher>San Francisco: Public Library of Science</publisher><subject>Accuracy ; Biology and Life Sciences ; Correlation ; Engineering and Technology ; Evaluation ; Gamification ; Information management ; Intelligence ; Methods ; Motivation ; Motivation (Psychology) ; Objectivity ; Quality assessment ; Quality control ; Research and Analysis Methods ; Social Sciences ; Technology application ; User generated content</subject><ispartof>PloS one, 2022-10, Vol.17 (10), p.e0274811-e0274811</ispartof><rights>COPYRIGHT 2022 Public Library of Science</rights><rights>2022 Poženel et al. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>2022 Poženel et al 2022 Poženel et al</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c548t-2f64688caf5908ceb1cca300b358907a87ad31f92e0e888aeca38fcb2fb39d963</cites><orcidid>0000-0003-2390-4160</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC9612527/pdf/$$EPDF$$P50$$Gpubmedcentral$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC9612527/$$EHTML$$P50$$Gpubmedcentral$$Hfree_for_read</linktohtml><link.rule.ids>230,314,724,777,781,861,882,2096,2915,23847,27905,27906,53772,53774,79349,79350</link.rule.ids></links><search><contributor>Sadiq, Ali Safaa</contributor><creatorcontrib>Pozenel, Marko</creatorcontrib><creatorcontrib>Zrnec, Aljaz</creatorcontrib><creatorcontrib>Lavbic, Dejan</creatorcontrib><title>Measuring how motivation affects information quality assessment: A gamification approach</title><title>PloS one</title><description>Existing research on the measurability of information quality (IQ) has delivered poor results and demonstrated low inter-rater agreement measured by Intra-Class Correlation (ICC) in evaluating IQ dimensions. Low ICC could result in a questionable interpretation of IQ. The purpose of this paper is to analyse whether assessors' motivation can facilitate ICC. To acquire the participants' views of IQ, we designed a survey as a gamified process. Additionally, we selected Web study to reach a broader audience. We increased the validity of the research by including a diverse set of participants (i.e. individuals with different education, demographic and social backgrounds). The study results indicate that motivation improved the ICC of IQ on average by 0.27, demonstrating an increase in measurability from poor (0.29) to moderate (0.56). The results reveal a positive correlation between motivation level and ICC, with a significant overall increase in ICC relative to previous studies. The research also identified trends in ICC for different dimensions of IQ with the best results achieved for completeness and accuracy. The work has important practical implications for future IQ research and suggests valuable guidelines. The results of this study imply that considering raters' motivation improves the measurability of IQ substantially.</description><subject>Accuracy</subject><subject>Biology and Life Sciences</subject><subject>Correlation</subject><subject>Engineering and Technology</subject><subject>Evaluation</subject><subject>Gamification</subject><subject>Information management</subject><subject>Intelligence</subject><subject>Methods</subject><subject>Motivation</subject><subject>Motivation (Psychology)</subject><subject>Objectivity</subject><subject>Quality assessment</subject><subject>Quality control</subject><subject>Research and Analysis Methods</subject><subject>Social Sciences</subject><subject>Technology application</subject><subject>User generated content</subject><issn>1932-6203</issn><issn>1932-6203</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><sourceid>DOA</sourceid><recordid>eNqNkl2L1DAUhosouI7-A8GCIHoxY77aJl4sDIsfAysLfuFdOE2TTpa2mU3S1f33pk6VreyF5CLh5Dlvkjdvlj3FaINphV9futEP0G0ObtAbRCrGMb6XnWBBybokiN6_tX6YPQrhEqGC8rI8yb5_1BBGb4c237sfee-ivYZo3ZCDMVrFkNvBON8fa1cjdDbe5BCCDqHXQ3yTb_MWemusmtsOB-9A7R9nDwx0QT-Z51X29d3bL2cf1ucX73dn2_O1KhiPa2JKVnKuwBQCcaVrrBRQhGpacIEq4BU0FBtBNNKcc9BplxtVE1NT0YiSrrJnR91D54KcnQiSVEQwgQidiN2RaBxcyoO3Pfgb6cDK3wXnWwk-WtVpyUplBK3qRhSMsYYIowRHWCOka1UqnrRO59PGuteNSg546Baiy53B7mXrrqUoMSlIlQRezgLeXY06RNnboHTXwaDdeLx3QSgVLKHP_0Hvft1MtZAeMH1WOldNonJbEUaSjenXV9nmDiqNRvdWpdgYm-qLhleLhsRE_TO2MIYgd58__T978W3JvrjF7jV0cR9cN07ZCUuQHUHlXQhem78mYySn1P9xQ06pl3Pq6S_ZgfYO</recordid><startdate>20221027</startdate><enddate>20221027</enddate><creator>Pozenel, Marko</creator><creator>Zrnec, Aljaz</creator><creator>Lavbic, Dejan</creator><general>Public Library of Science</general><general>Public Library of Science (PLoS)</general><scope>AAYXX</scope><scope>CITATION</scope><scope>IOV</scope><scope>ISR</scope><scope>3V.</scope><scope>7QG</scope><scope>7QL</scope><scope>7QO</scope><scope>7RV</scope><scope>7SN</scope><scope>7SS</scope><scope>7T5</scope><scope>7TG</scope><scope>7TM</scope><scope>7U9</scope><scope>7X2</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>8AO</scope><scope>8C1</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FH</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AEUYN</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>ATCPS</scope><scope>AZQEC</scope><scope>BBNVY</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>BHPHI</scope><scope>C1K</scope><scope>CCPQU</scope><scope>D1I</scope><scope>DWQXO</scope><scope>FR3</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>H94</scope><scope>HCIFZ</scope><scope>K9.</scope><scope>KB.</scope><scope>KB0</scope><scope>KL.</scope><scope>L6V</scope><scope>LK8</scope><scope>M0K</scope><scope>M0S</scope><scope>M1P</scope><scope>M7N</scope><scope>M7P</scope><scope>M7S</scope><scope>NAPCQ</scope><scope>P5Z</scope><scope>P62</scope><scope>P64</scope><scope>PATMY</scope><scope>PDBOC</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>PYCSY</scope><scope>RC3</scope><scope>7X8</scope><scope>5PM</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0003-2390-4160</orcidid></search><sort><creationdate>20221027</creationdate><title>Measuring how motivation affects information quality assessment: A gamification approach</title><author>Pozenel, Marko ; Zrnec, Aljaz ; Lavbic, Dejan</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c548t-2f64688caf5908ceb1cca300b358907a87ad31f92e0e888aeca38fcb2fb39d963</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Accuracy</topic><topic>Biology and Life Sciences</topic><topic>Correlation</topic><topic>Engineering and Technology</topic><topic>Evaluation</topic><topic>Gamification</topic><topic>Information management</topic><topic>Intelligence</topic><topic>Methods</topic><topic>Motivation</topic><topic>Motivation (Psychology)</topic><topic>Objectivity</topic><topic>Quality assessment</topic><topic>Quality control</topic><topic>Research and Analysis Methods</topic><topic>Social Sciences</topic><topic>Technology application</topic><topic>User generated content</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Pozenel, Marko</creatorcontrib><creatorcontrib>Zrnec, Aljaz</creatorcontrib><creatorcontrib>Lavbic, Dejan</creatorcontrib><collection>CrossRef</collection><collection>Gale In Context: Opposing Viewpoints</collection><collection>Gale In Context: Science</collection><collection>ProQuest Central (Corporate)</collection><collection>Animal Behavior Abstracts</collection><collection>Bacteriology Abstracts (Microbiology B)</collection><collection>Biotechnology Research Abstracts</collection><collection>Nursing & Allied Health Database</collection><collection>Ecology Abstracts</collection><collection>Entomology Abstracts (Full archive)</collection><collection>Immunology Abstracts</collection><collection>Meteorological & Geoastrophysical Abstracts</collection><collection>Nucleic Acids Abstracts</collection><collection>Virology and AIDS Abstracts</collection><collection>Agricultural Science Collection</collection><collection>Health & Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Public Health Database</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest One Sustainability</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>Agricultural & Environmental Science Collection</collection><collection>ProQuest Central Essentials</collection><collection>Biological Science Collection</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>Natural Science Collection</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ProQuest One Community College</collection><collection>ProQuest Materials Science Collection</collection><collection>ProQuest Central Korea</collection><collection>Engineering Research Database</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>AIDS and Cancer Research Abstracts</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Materials Science Database</collection><collection>Nursing & Allied Health Database (Alumni Edition)</collection><collection>Meteorological & Geoastrophysical Abstracts - Academic</collection><collection>ProQuest Engineering Collection</collection><collection>ProQuest Biological Science Collection</collection><collection>Agricultural Science Database</collection><collection>Health & Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Algology Mycology and Protozoology Abstracts (Microbiology C)</collection><collection>Biological Science Database</collection><collection>Engineering Database</collection><collection>Nursing & Allied Health Premium</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>Environmental Science Database</collection><collection>Materials Science Collection</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>Environmental Science Collection</collection><collection>Genetics Abstracts</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>PloS one</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Pozenel, Marko</au><au>Zrnec, Aljaz</au><au>Lavbic, Dejan</au><au>Sadiq, Ali Safaa</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Measuring how motivation affects information quality assessment: A gamification approach</atitle><jtitle>PloS one</jtitle><date>2022-10-27</date><risdate>2022</risdate><volume>17</volume><issue>10</issue><spage>e0274811</spage><epage>e0274811</epage><pages>e0274811-e0274811</pages><issn>1932-6203</issn><eissn>1932-6203</eissn><abstract>Existing research on the measurability of information quality (IQ) has delivered poor results and demonstrated low inter-rater agreement measured by Intra-Class Correlation (ICC) in evaluating IQ dimensions. Low ICC could result in a questionable interpretation of IQ. The purpose of this paper is to analyse whether assessors' motivation can facilitate ICC. To acquire the participants' views of IQ, we designed a survey as a gamified process. Additionally, we selected Web study to reach a broader audience. We increased the validity of the research by including a diverse set of participants (i.e. individuals with different education, demographic and social backgrounds). The study results indicate that motivation improved the ICC of IQ on average by 0.27, demonstrating an increase in measurability from poor (0.29) to moderate (0.56). The results reveal a positive correlation between motivation level and ICC, with a significant overall increase in ICC relative to previous studies. The research also identified trends in ICC for different dimensions of IQ with the best results achieved for completeness and accuracy. The work has important practical implications for future IQ research and suggests valuable guidelines. The results of this study imply that considering raters' motivation improves the measurability of IQ substantially.</abstract><cop>San Francisco</cop><pub>Public Library of Science</pub><doi>10.1371/journal.pone.0274811</doi><tpages>e0274811</tpages><orcidid>https://orcid.org/0000-0003-2390-4160</orcidid><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 1932-6203 |
| ispartof | PloS one, 2022-10, Vol.17 (10), p.e0274811-e0274811 |
| issn | 1932-6203 1932-6203 |
| language | eng |
| recordid | cdi_plos_journals_2729490236 |
| source | DOAJ Directory of Open Access Journals; Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals; Public Library of Science (PLoS); PubMed Central; Free Full-Text Journals in Chemistry |
| subjects | Accuracy Biology and Life Sciences Correlation Engineering and Technology Evaluation Gamification Information management Intelligence Methods Motivation Motivation (Psychology) Objectivity Quality assessment Quality control Research and Analysis Methods Social Sciences Technology application User generated content |
| title | Measuring how motivation affects information quality assessment: A gamification approach |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-18T09%3A47%3A51IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-gale_plos_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Measuring%20how%20motivation%20affects%20information%20quality%20assessment:%20A%20gamification%20approach&rft.jtitle=PloS%20one&rft.au=Pozenel,%20Marko&rft.date=2022-10-27&rft.volume=17&rft.issue=10&rft.spage=e0274811&rft.epage=e0274811&rft.pages=e0274811-e0274811&rft.issn=1932-6203&rft.eissn=1932-6203&rft_id=info:doi/10.1371/journal.pone.0274811&rft_dat=%3Cgale_plos_%3EA724258920%3C/gale_plos_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2729490236&rft_id=info:pmid/&rft_galeid=A724258920&rft_doaj_id=oai_doaj_org_article_46cf937bd95444d29fc9801e00ebc6c8&rfr_iscdi=true |