Presenting a comprehensive multi-scale evaluation framework for participatory modelling programs: A scoping review
Systems modelling and simulation can improve understanding of complex systems to support decision making, better managing system challenges. Advances in technology have facilitated accessibility of modelling by diverse stakeholders, allowing them to engage with and contribute to the development of s...
Gespeichert in:
| Veröffentlicht in: | PloS one 2022-04, Vol.17 (4), p.e0266125-e0266125 |
|---|---|
| Hauptverfasser: | , , , , , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | e0266125 |
|---|---|
| container_issue | 4 |
| container_start_page | e0266125 |
| container_title | PloS one |
| container_volume | 17 |
| creator | Lee, Grace Yeeun Hickie, Ian Bernard Occhipinti, Jo-An Song, Yun Ju Christine Skinner, Adam Camacho, Salvador Lawson, Kenny Hilber, Adriane Martin Freebairn, Louise |
| description | Systems modelling and simulation can improve understanding of complex systems to support decision making, better managing system challenges. Advances in technology have facilitated accessibility of modelling by diverse stakeholders, allowing them to engage with and contribute to the development of systems models (participatory modelling). However, despite its increasing applications across a range of disciplines, there is a growing need to improve evaluation efforts to effectively report on the quality, importance, and value of participatory modelling. This paper aims to identify and assess evaluation frameworks, criteria, and/or processes, as well as to synthesize the findings into a comprehensive multi-scale framework for participatory modelling programs.
A scoping review approach was utilized, which involved a systematic literature search via Scopus in consultation with experts to identify and appraise records that described an evaluation framework, criteria, and/or process in the context of participatory modelling. This scoping review is registered with the Open Science Framework.
The review identified 11 studies, which varied in evaluation purposes, terminologies, levels of examination, and time points. The review of studies highlighted areas of overlap and opportunities for further development, which prompted the development of a comprehensive multi-scale evaluation framework to assess participatory modelling programs across disciplines and systems modelling methods. The framework consists of four categories (Feasibility, Value, Change/Action, Sustainability) with 30 evaluation criteria, broken down across project-, individual-, group- and system-level impacts.
The presented novel framework brings together a significant knowledge base into a flexible, cross-sectoral evaluation effort that considers the whole participatory modelling process. Developed through the rigorous synthesis of multidisciplinary expertise from existing studies, the application of the framework can provide the opportunity to understand practical future implications such as which aspects are particularly important for policy decisions, community learning, and the ongoing improvement of participatory modelling methods. |
| doi_str_mv | 10.1371/journal.pone.0266125 |
| format | Article |
| fullrecord | <record><control><sourceid>gale_plos_</sourceid><recordid>TN_cdi_plos_journals_2653544013</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><galeid>A701256914</galeid><doaj_id>oai_doaj_org_article_f5890932ff434573b552f1343671932f</doaj_id><sourcerecordid>A701256914</sourcerecordid><originalsourceid>FETCH-LOGICAL-c692t-98df47a9282f9ae5359a1a1913e5b2e1d0abccacf4d9f78a2f21d67facd2e0623</originalsourceid><addsrcrecordid>eNqNk11v0zAUhiMEYmPwDxBEQkJw0eKvOA0XSNXER6VJQ3zdWq5znLo4cWYnHfv3OG02NWgXyBexTp7zHvv1OUnyHKM5pjl-t3W9b6Sdt66BOSKcY5I9SE5xQcmME0QfHu1PkichbBHK6ILzx8kJzVhGGCenif_qIUDTmaZKZapc3XrYQBPMDtK6t52ZBSUtpLCTtpedcU2qvazh2vnfqXY-baXvjDKt7Jy_SWtXgrWDWOtdFcHwPl2mQbl2iHnYGbh-mjzS0gZ4Nn7Pkp-fPv44_zK7uPy8Ol9ezBQvSDcrFqVmuSzIguhCQkazQmKJC0whWxPAJZJrpaTSrCx0vpBEE1zyXEtVEkCc0LPk5UG3tS6I0a4gCI9SjCFMI7E6EKWTW9F6U0t_I5w0Yh9wvhL721kQOlsUKNqpNaMsy-k6y4jGlFGeDy7rqPVhrNavayhV9NRLOxGd_mnMRlRuJwpECUMsCrwZBby76iF0ojZBRTdlA67fn5uRIlYczv3qH_T-241UFR9QmEa7WFcNomKZo9gtvMBD2fk9VFwl1EbF3tImxicJbycJkengT1fJPgSx-v7t_9nLX1P29RG7AWm7TXC2H3ouTEF2AJV3IXjQdyZjJIbRuHVDDKMhxtGIaS-OH-gu6XYW6F_yjAqZ</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2653544013</pqid></control><display><type>article</type><title>Presenting a comprehensive multi-scale evaluation framework for participatory modelling programs: A scoping review</title><source>DOAJ Directory of Open Access Journals</source><source>Public Library of Science (PLoS) Journals Open Access</source><source>EZB-FREE-00999 freely available EZB journals</source><source>PubMed Central</source><source>Free Full-Text Journals in Chemistry</source><creator>Lee, Grace Yeeun ; Hickie, Ian Bernard ; Occhipinti, Jo-An ; Song, Yun Ju Christine ; Skinner, Adam ; Camacho, Salvador ; Lawson, Kenny ; Hilber, Adriane Martin ; Freebairn, Louise</creator><contributor>Cavallaro, Fausto</contributor><creatorcontrib>Lee, Grace Yeeun ; Hickie, Ian Bernard ; Occhipinti, Jo-An ; Song, Yun Ju Christine ; Skinner, Adam ; Camacho, Salvador ; Lawson, Kenny ; Hilber, Adriane Martin ; Freebairn, Louise ; Cavallaro, Fausto</creatorcontrib><description>Systems modelling and simulation can improve understanding of complex systems to support decision making, better managing system challenges. Advances in technology have facilitated accessibility of modelling by diverse stakeholders, allowing them to engage with and contribute to the development of systems models (participatory modelling). However, despite its increasing applications across a range of disciplines, there is a growing need to improve evaluation efforts to effectively report on the quality, importance, and value of participatory modelling. This paper aims to identify and assess evaluation frameworks, criteria, and/or processes, as well as to synthesize the findings into a comprehensive multi-scale framework for participatory modelling programs.
A scoping review approach was utilized, which involved a systematic literature search via Scopus in consultation with experts to identify and appraise records that described an evaluation framework, criteria, and/or process in the context of participatory modelling. This scoping review is registered with the Open Science Framework.
The review identified 11 studies, which varied in evaluation purposes, terminologies, levels of examination, and time points. The review of studies highlighted areas of overlap and opportunities for further development, which prompted the development of a comprehensive multi-scale evaluation framework to assess participatory modelling programs across disciplines and systems modelling methods. The framework consists of four categories (Feasibility, Value, Change/Action, Sustainability) with 30 evaluation criteria, broken down across project-, individual-, group- and system-level impacts.
The presented novel framework brings together a significant knowledge base into a flexible, cross-sectoral evaluation effort that considers the whole participatory modelling process. Developed through the rigorous synthesis of multidisciplinary expertise from existing studies, the application of the framework can provide the opportunity to understand practical future implications such as which aspects are particularly important for policy decisions, community learning, and the ongoing improvement of participatory modelling methods.</description><identifier>ISSN: 1932-6203</identifier><identifier>EISSN: 1932-6203</identifier><identifier>DOI: 10.1371/journal.pone.0266125</identifier><identifier>PMID: 35452462</identifier><language>eng</language><publisher>United States: Public Library of Science</publisher><subject>Biology and Life Sciences ; Brain research ; Complex systems ; Computer and Information Sciences ; Computer simulation ; Computer-generated environments ; Criteria ; Decision making ; Ecology and Environmental Sciences ; Engineering and Technology ; Evaluation ; Funding ; Knowledge ; Knowledge bases (artificial intelligence) ; Modelling ; Physical Sciences ; Public health ; Research and Analysis Methods ; Reviews ; Social Sciences ; Stakeholders ; Sustainability ; Systems modelling</subject><ispartof>PloS one, 2022-04, Vol.17 (4), p.e0266125-e0266125</ispartof><rights>COPYRIGHT 2022 Public Library of Science</rights><rights>2022 Lee et al. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>2022 Lee et al 2022 Lee et al</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c692t-98df47a9282f9ae5359a1a1913e5b2e1d0abccacf4d9f78a2f21d67facd2e0623</citedby><cites>FETCH-LOGICAL-c692t-98df47a9282f9ae5359a1a1913e5b2e1d0abccacf4d9f78a2f21d67facd2e0623</cites><orcidid>0000-0002-7681-7960 ; 0000-0002-7234-1870</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC9032404/pdf/$$EPDF$$P50$$Gpubmedcentral$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC9032404/$$EHTML$$P50$$Gpubmedcentral$$Hfree_for_read</linktohtml><link.rule.ids>230,314,727,780,784,864,885,2102,2928,23866,27924,27925,53791,53793,79600,79601</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/35452462$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><contributor>Cavallaro, Fausto</contributor><creatorcontrib>Lee, Grace Yeeun</creatorcontrib><creatorcontrib>Hickie, Ian Bernard</creatorcontrib><creatorcontrib>Occhipinti, Jo-An</creatorcontrib><creatorcontrib>Song, Yun Ju Christine</creatorcontrib><creatorcontrib>Skinner, Adam</creatorcontrib><creatorcontrib>Camacho, Salvador</creatorcontrib><creatorcontrib>Lawson, Kenny</creatorcontrib><creatorcontrib>Hilber, Adriane Martin</creatorcontrib><creatorcontrib>Freebairn, Louise</creatorcontrib><title>Presenting a comprehensive multi-scale evaluation framework for participatory modelling programs: A scoping review</title><title>PloS one</title><addtitle>PLoS One</addtitle><description>Systems modelling and simulation can improve understanding of complex systems to support decision making, better managing system challenges. Advances in technology have facilitated accessibility of modelling by diverse stakeholders, allowing them to engage with and contribute to the development of systems models (participatory modelling). However, despite its increasing applications across a range of disciplines, there is a growing need to improve evaluation efforts to effectively report on the quality, importance, and value of participatory modelling. This paper aims to identify and assess evaluation frameworks, criteria, and/or processes, as well as to synthesize the findings into a comprehensive multi-scale framework for participatory modelling programs.
A scoping review approach was utilized, which involved a systematic literature search via Scopus in consultation with experts to identify and appraise records that described an evaluation framework, criteria, and/or process in the context of participatory modelling. This scoping review is registered with the Open Science Framework.
The review identified 11 studies, which varied in evaluation purposes, terminologies, levels of examination, and time points. The review of studies highlighted areas of overlap and opportunities for further development, which prompted the development of a comprehensive multi-scale evaluation framework to assess participatory modelling programs across disciplines and systems modelling methods. The framework consists of four categories (Feasibility, Value, Change/Action, Sustainability) with 30 evaluation criteria, broken down across project-, individual-, group- and system-level impacts.
The presented novel framework brings together a significant knowledge base into a flexible, cross-sectoral evaluation effort that considers the whole participatory modelling process. Developed through the rigorous synthesis of multidisciplinary expertise from existing studies, the application of the framework can provide the opportunity to understand practical future implications such as which aspects are particularly important for policy decisions, community learning, and the ongoing improvement of participatory modelling methods.</description><subject>Biology and Life Sciences</subject><subject>Brain research</subject><subject>Complex systems</subject><subject>Computer and Information Sciences</subject><subject>Computer simulation</subject><subject>Computer-generated environments</subject><subject>Criteria</subject><subject>Decision making</subject><subject>Ecology and Environmental Sciences</subject><subject>Engineering and Technology</subject><subject>Evaluation</subject><subject>Funding</subject><subject>Knowledge</subject><subject>Knowledge bases (artificial intelligence)</subject><subject>Modelling</subject><subject>Physical Sciences</subject><subject>Public health</subject><subject>Research and Analysis Methods</subject><subject>Reviews</subject><subject>Social Sciences</subject><subject>Stakeholders</subject><subject>Sustainability</subject><subject>Systems modelling</subject><issn>1932-6203</issn><issn>1932-6203</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><sourceid>DOA</sourceid><recordid>eNqNk11v0zAUhiMEYmPwDxBEQkJw0eKvOA0XSNXER6VJQ3zdWq5znLo4cWYnHfv3OG02NWgXyBexTp7zHvv1OUnyHKM5pjl-t3W9b6Sdt66BOSKcY5I9SE5xQcmME0QfHu1PkichbBHK6ILzx8kJzVhGGCenif_qIUDTmaZKZapc3XrYQBPMDtK6t52ZBSUtpLCTtpedcU2qvazh2vnfqXY-baXvjDKt7Jy_SWtXgrWDWOtdFcHwPl2mQbl2iHnYGbh-mjzS0gZ4Nn7Pkp-fPv44_zK7uPy8Ol9ezBQvSDcrFqVmuSzIguhCQkazQmKJC0whWxPAJZJrpaTSrCx0vpBEE1zyXEtVEkCc0LPk5UG3tS6I0a4gCI9SjCFMI7E6EKWTW9F6U0t_I5w0Yh9wvhL721kQOlsUKNqpNaMsy-k6y4jGlFGeDy7rqPVhrNavayhV9NRLOxGd_mnMRlRuJwpECUMsCrwZBby76iF0ojZBRTdlA67fn5uRIlYczv3qH_T-241UFR9QmEa7WFcNomKZo9gtvMBD2fk9VFwl1EbF3tImxicJbycJkengT1fJPgSx-v7t_9nLX1P29RG7AWm7TXC2H3ouTEF2AJV3IXjQdyZjJIbRuHVDDKMhxtGIaS-OH-gu6XYW6F_yjAqZ</recordid><startdate>20220422</startdate><enddate>20220422</enddate><creator>Lee, Grace Yeeun</creator><creator>Hickie, Ian Bernard</creator><creator>Occhipinti, Jo-An</creator><creator>Song, Yun Ju Christine</creator><creator>Skinner, Adam</creator><creator>Camacho, Salvador</creator><creator>Lawson, Kenny</creator><creator>Hilber, Adriane Martin</creator><creator>Freebairn, Louise</creator><general>Public Library of Science</general><general>Public Library of Science (PLoS)</general><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>IOV</scope><scope>ISR</scope><scope>3V.</scope><scope>7QG</scope><scope>7QL</scope><scope>7QO</scope><scope>7RV</scope><scope>7SN</scope><scope>7SS</scope><scope>7T5</scope><scope>7TG</scope><scope>7TM</scope><scope>7U9</scope><scope>7X2</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>8AO</scope><scope>8C1</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FH</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>ATCPS</scope><scope>AZQEC</scope><scope>BBNVY</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>BHPHI</scope><scope>C1K</scope><scope>CCPQU</scope><scope>COVID</scope><scope>D1I</scope><scope>DWQXO</scope><scope>FR3</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>H94</scope><scope>HCIFZ</scope><scope>K9.</scope><scope>KB.</scope><scope>KB0</scope><scope>KL.</scope><scope>L6V</scope><scope>LK8</scope><scope>M0K</scope><scope>M0S</scope><scope>M1P</scope><scope>M7N</scope><scope>M7P</scope><scope>M7S</scope><scope>NAPCQ</scope><scope>P5Z</scope><scope>P62</scope><scope>P64</scope><scope>PATMY</scope><scope>PDBOC</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>PYCSY</scope><scope>RC3</scope><scope>7X8</scope><scope>5PM</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-7681-7960</orcidid><orcidid>https://orcid.org/0000-0002-7234-1870</orcidid></search><sort><creationdate>20220422</creationdate><title>Presenting a comprehensive multi-scale evaluation framework for participatory modelling programs: A scoping review</title><author>Lee, Grace Yeeun ; Hickie, Ian Bernard ; Occhipinti, Jo-An ; Song, Yun Ju Christine ; Skinner, Adam ; Camacho, Salvador ; Lawson, Kenny ; Hilber, Adriane Martin ; Freebairn, Louise</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c692t-98df47a9282f9ae5359a1a1913e5b2e1d0abccacf4d9f78a2f21d67facd2e0623</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Biology and Life Sciences</topic><topic>Brain research</topic><topic>Complex systems</topic><topic>Computer and Information Sciences</topic><topic>Computer simulation</topic><topic>Computer-generated environments</topic><topic>Criteria</topic><topic>Decision making</topic><topic>Ecology and Environmental Sciences</topic><topic>Engineering and Technology</topic><topic>Evaluation</topic><topic>Funding</topic><topic>Knowledge</topic><topic>Knowledge bases (artificial intelligence)</topic><topic>Modelling</topic><topic>Physical Sciences</topic><topic>Public health</topic><topic>Research and Analysis Methods</topic><topic>Reviews</topic><topic>Social Sciences</topic><topic>Stakeholders</topic><topic>Sustainability</topic><topic>Systems modelling</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Lee, Grace Yeeun</creatorcontrib><creatorcontrib>Hickie, Ian Bernard</creatorcontrib><creatorcontrib>Occhipinti, Jo-An</creatorcontrib><creatorcontrib>Song, Yun Ju Christine</creatorcontrib><creatorcontrib>Skinner, Adam</creatorcontrib><creatorcontrib>Camacho, Salvador</creatorcontrib><creatorcontrib>Lawson, Kenny</creatorcontrib><creatorcontrib>Hilber, Adriane Martin</creatorcontrib><creatorcontrib>Freebairn, Louise</creatorcontrib><collection>PubMed</collection><collection>CrossRef</collection><collection>Gale In Context: Opposing Viewpoints</collection><collection>Gale In Context: Science</collection><collection>ProQuest Central (Corporate)</collection><collection>Animal Behavior Abstracts</collection><collection>Bacteriology Abstracts (Microbiology B)</collection><collection>Biotechnology Research Abstracts</collection><collection>Nursing & Allied Health Database</collection><collection>Ecology Abstracts</collection><collection>Entomology Abstracts (Full archive)</collection><collection>Immunology Abstracts</collection><collection>Meteorological & Geoastrophysical Abstracts</collection><collection>Nucleic Acids Abstracts</collection><collection>Virology and AIDS Abstracts</collection><collection>Agricultural Science Collection</collection><collection>Health & Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Public Health Database</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>Agricultural & Environmental Science Collection</collection><collection>ProQuest Central Essentials</collection><collection>Biological Science Collection</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>Natural Science Collection</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ProQuest One Community College</collection><collection>Coronavirus Research Database</collection><collection>ProQuest Materials Science Collection</collection><collection>ProQuest Central Korea</collection><collection>Engineering Research Database</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>AIDS and Cancer Research Abstracts</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Materials Science Database</collection><collection>Nursing & Allied Health Database (Alumni Edition)</collection><collection>Meteorological & Geoastrophysical Abstracts - Academic</collection><collection>ProQuest Engineering Collection</collection><collection>ProQuest Biological Science Collection</collection><collection>Agricultural Science Database</collection><collection>Health & Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Algology Mycology and Protozoology Abstracts (Microbiology C)</collection><collection>Biological Science Database</collection><collection>Engineering Database</collection><collection>Nursing & Allied Health Premium</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>Environmental Science Database</collection><collection>Materials Science Collection</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>Environmental Science Collection</collection><collection>Genetics Abstracts</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>PloS one</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Lee, Grace Yeeun</au><au>Hickie, Ian Bernard</au><au>Occhipinti, Jo-An</au><au>Song, Yun Ju Christine</au><au>Skinner, Adam</au><au>Camacho, Salvador</au><au>Lawson, Kenny</au><au>Hilber, Adriane Martin</au><au>Freebairn, Louise</au><au>Cavallaro, Fausto</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Presenting a comprehensive multi-scale evaluation framework for participatory modelling programs: A scoping review</atitle><jtitle>PloS one</jtitle><addtitle>PLoS One</addtitle><date>2022-04-22</date><risdate>2022</risdate><volume>17</volume><issue>4</issue><spage>e0266125</spage><epage>e0266125</epage><pages>e0266125-e0266125</pages><issn>1932-6203</issn><eissn>1932-6203</eissn><abstract>Systems modelling and simulation can improve understanding of complex systems to support decision making, better managing system challenges. Advances in technology have facilitated accessibility of modelling by diverse stakeholders, allowing them to engage with and contribute to the development of systems models (participatory modelling). However, despite its increasing applications across a range of disciplines, there is a growing need to improve evaluation efforts to effectively report on the quality, importance, and value of participatory modelling. This paper aims to identify and assess evaluation frameworks, criteria, and/or processes, as well as to synthesize the findings into a comprehensive multi-scale framework for participatory modelling programs.
A scoping review approach was utilized, which involved a systematic literature search via Scopus in consultation with experts to identify and appraise records that described an evaluation framework, criteria, and/or process in the context of participatory modelling. This scoping review is registered with the Open Science Framework.
The review identified 11 studies, which varied in evaluation purposes, terminologies, levels of examination, and time points. The review of studies highlighted areas of overlap and opportunities for further development, which prompted the development of a comprehensive multi-scale evaluation framework to assess participatory modelling programs across disciplines and systems modelling methods. The framework consists of four categories (Feasibility, Value, Change/Action, Sustainability) with 30 evaluation criteria, broken down across project-, individual-, group- and system-level impacts.
The presented novel framework brings together a significant knowledge base into a flexible, cross-sectoral evaluation effort that considers the whole participatory modelling process. Developed through the rigorous synthesis of multidisciplinary expertise from existing studies, the application of the framework can provide the opportunity to understand practical future implications such as which aspects are particularly important for policy decisions, community learning, and the ongoing improvement of participatory modelling methods.</abstract><cop>United States</cop><pub>Public Library of Science</pub><pmid>35452462</pmid><doi>10.1371/journal.pone.0266125</doi><tpages>e0266125</tpages><orcidid>https://orcid.org/0000-0002-7681-7960</orcidid><orcidid>https://orcid.org/0000-0002-7234-1870</orcidid><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 1932-6203 |
| ispartof | PloS one, 2022-04, Vol.17 (4), p.e0266125-e0266125 |
| issn | 1932-6203 1932-6203 |
| language | eng |
| recordid | cdi_plos_journals_2653544013 |
| source | DOAJ Directory of Open Access Journals; Public Library of Science (PLoS) Journals Open Access; EZB-FREE-00999 freely available EZB journals; PubMed Central; Free Full-Text Journals in Chemistry |
| subjects | Biology and Life Sciences Brain research Complex systems Computer and Information Sciences Computer simulation Computer-generated environments Criteria Decision making Ecology and Environmental Sciences Engineering and Technology Evaluation Funding Knowledge Knowledge bases (artificial intelligence) Modelling Physical Sciences Public health Research and Analysis Methods Reviews Social Sciences Stakeholders Sustainability Systems modelling |
| title | Presenting a comprehensive multi-scale evaluation framework for participatory modelling programs: A scoping review |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-03T06%3A00%3A35IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-gale_plos_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Presenting%20a%20comprehensive%20multi-scale%20evaluation%20framework%20for%20participatory%20modelling%20programs:%20A%20scoping%20review&rft.jtitle=PloS%20one&rft.au=Lee,%20Grace%20Yeeun&rft.date=2022-04-22&rft.volume=17&rft.issue=4&rft.spage=e0266125&rft.epage=e0266125&rft.pages=e0266125-e0266125&rft.issn=1932-6203&rft.eissn=1932-6203&rft_id=info:doi/10.1371/journal.pone.0266125&rft_dat=%3Cgale_plos_%3EA701256914%3C/gale_plos_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2653544013&rft_id=info:pmid/35452462&rft_galeid=A701256914&rft_doaj_id=oai_doaj_org_article_f5890932ff434573b552f1343671932f&rfr_iscdi=true |