Evaluation of Parsons Problems with Menu-Based Self-Explanation Prompts in a Mobile Python Tutor

The overarching goal of our project is to design effective learning activities for PyKinetic, a smartphone Python tutor. In this paper, we present a study using a variant of Parsons problems we designed for PyKinetic. Parsons problems contain randomized code which needs to be re-ordered to produce t...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:International journal of artificial intelligence in education 2019-12, Vol.29 (4), p.507-535
Hauptverfasser: Fabic, Geela Venise Firmalo, Mitrovic, Antonija, Neshatian, Kourosh
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 535
container_issue 4
container_start_page 507
container_title International journal of artificial intelligence in education
container_volume 29
creator Fabic, Geela Venise Firmalo
Mitrovic, Antonija
Neshatian, Kourosh
description The overarching goal of our project is to design effective learning activities for PyKinetic, a smartphone Python tutor. In this paper, we present a study using a variant of Parsons problems we designed for PyKinetic. Parsons problems contain randomized code which needs to be re-ordered to produce the desired effect. In our variant of Parsons problems, students were asked to complete the missing part(s) of some lines of code (LOCs), and rearrange the LOCs to match the problem description. In addition, we added menu-based Self-Explanation (SE) prompts. Students were asked to self-explain concepts related to incomplete LOCs they solved. Our hypotheses were: (H1) PyKinetic would be successful in supporting learning; (H2) menu-based SE prompts would result in further learning benefits; (H3) students with low prior knowledge (LP) would learn more from our Parsons problems in comparison to those with high prior knowledge (HP). We found that the participants’ scores on the post-test improved, thus showing evidence of learning in PyKinetic. The experimental group participants, who had SE prompts, showed improved learning in comparison to the control group. Further analyses revealed that LP students improved more than HP students and the improvement is even more pronounced for LP learners who self-explained. The contributions of our work are a) pedagogically-guided design of Parsons problems with SE prompts used on smartphones, b) showing that our Parsons problems are effective in supporting learning and c) our Parsons problems with SE prompts are especially effective for students with low prior knowledge.
doi_str_mv 10.1007/s40593-019-00184-0
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2933418932</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ1235255</ericid><sourcerecordid>2933418932</sourcerecordid><originalsourceid>FETCH-LOGICAL-c385t-97c976db23b16803453d7f24eb8d13a5f0c7c00153de3b8b40a92491dc23d1483</originalsourceid><addsrcrecordid>eNp9UMlOwzAQtRBIlMIPICFZ4mwYL1l8hKpsakUlytk4iUNTpXGwE6B_jyEsN04zmrdpHkLHFM4oQHLuBUSSE6CSANBUENhBIxrFQASHePdnZ5LtowPv1wAigViM0NP0Vde97irbYFvihXbeNh4vnM1qs_H4repWeG6anlxqbwr8YOqSTN_bWjeDKDA3bedx1WCN5zaraoMX224VoGXfWXeI9kpde3P0Pcfo8Wq6nNyQ2f317eRiRnKeRh2RSS6TuMgYz2icAhcRL5KSCZOlBeU6KiFP8vBaOBuepZkALZmQtMgZL6hI-RidDr6tsy-98Z1a2941IVIxybmgqeQssNjAyp313plSta7aaLdVFNRnk2poUoUm1VeTCoLoZBAZV-W_gukdZTxiURRwPuA-YM2zcX_R_7h-AOXnfvw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2933418932</pqid></control><display><type>article</type><title>Evaluation of Parsons Problems with Menu-Based Self-Explanation Prompts in a Mobile Python Tutor</title><source>ProQuest Central Essentials</source><source>ProQuest Central (Alumni Edition)</source><source>ProQuest Central Student</source><source>SpringerLink Journals</source><source>ProQuest Central Korea</source><source>ProQuest Central UK/Ireland</source><source>ProQuest Central</source><creator>Fabic, Geela Venise Firmalo ; Mitrovic, Antonija ; Neshatian, Kourosh</creator><creatorcontrib>Fabic, Geela Venise Firmalo ; Mitrovic, Antonija ; Neshatian, Kourosh</creatorcontrib><description>The overarching goal of our project is to design effective learning activities for PyKinetic, a smartphone Python tutor. In this paper, we present a study using a variant of Parsons problems we designed for PyKinetic. Parsons problems contain randomized code which needs to be re-ordered to produce the desired effect. In our variant of Parsons problems, students were asked to complete the missing part(s) of some lines of code (LOCs), and rearrange the LOCs to match the problem description. In addition, we added menu-based Self-Explanation (SE) prompts. Students were asked to self-explain concepts related to incomplete LOCs they solved. Our hypotheses were: (H1) PyKinetic would be successful in supporting learning; (H2) menu-based SE prompts would result in further learning benefits; (H3) students with low prior knowledge (LP) would learn more from our Parsons problems in comparison to those with high prior knowledge (HP). We found that the participants’ scores on the post-test improved, thus showing evidence of learning in PyKinetic. The experimental group participants, who had SE prompts, showed improved learning in comparison to the control group. Further analyses revealed that LP students improved more than HP students and the improvement is even more pronounced for LP learners who self-explained. The contributions of our work are a) pedagogically-guided design of Parsons problems with SE prompts used on smartphones, b) showing that our Parsons problems are effective in supporting learning and c) our Parsons problems with SE prompts are especially effective for students with low prior knowledge.</description><identifier>ISSN: 1560-4292</identifier><identifier>EISSN: 1560-4306</identifier><identifier>DOI: 10.1007/s40593-019-00184-0</identifier><language>eng</language><publisher>New York: Springer New York</publisher><subject>Artificial Intelligence ; Coding ; Comparative Analysis ; Computer Science ; Computers ; Computers and Education ; Control Groups ; Correlation ; Cues ; Design ; Educational Benefits ; Educational Technology ; Experimental Groups ; Handheld Devices ; Instructional Effectiveness ; Instructional Materials ; Intelligent Tutoring Systems ; Knowledge ; Learning ; Learning Activities ; Learning Processes ; Novices ; Personal computers ; Pretests Posttests ; Prior Learning ; Problem solving ; Programming Languages ; Python ; Research Design ; Skills ; Smartphones ; Students ; Syntax ; Teaching Methods ; Telecommunications ; Tutors ; User Interfaces and Human Computer Interaction ; Writing ; Writing Exercises ; Writing Instruction ; Writing Skills</subject><ispartof>International journal of artificial intelligence in education, 2019-12, Vol.29 (4), p.507-535</ispartof><rights>International Artificial Intelligence in Education Society 2019</rights><rights>International Artificial Intelligence in Education Society 2019.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c385t-97c976db23b16803453d7f24eb8d13a5f0c7c00153de3b8b40a92491dc23d1483</citedby><cites>FETCH-LOGICAL-c385t-97c976db23b16803453d7f24eb8d13a5f0c7c00153de3b8b40a92491dc23d1483</cites><orcidid>0000-0003-0936-0806</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s40593-019-00184-0$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/2933418932?pq-origsite=primo$$EHTML$$P50$$Gproquest$$H</linktohtml><link.rule.ids>314,780,784,21388,21389,21390,21391,23256,27924,27925,33530,33703,33744,34005,34314,41488,42557,43659,43787,43805,43953,44067,51319,64385,64389,72469</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ1235255$$DView record in ERIC$$Hfree_for_read</backlink></links><search><creatorcontrib>Fabic, Geela Venise Firmalo</creatorcontrib><creatorcontrib>Mitrovic, Antonija</creatorcontrib><creatorcontrib>Neshatian, Kourosh</creatorcontrib><title>Evaluation of Parsons Problems with Menu-Based Self-Explanation Prompts in a Mobile Python Tutor</title><title>International journal of artificial intelligence in education</title><addtitle>Int J Artif Intell Educ</addtitle><description>The overarching goal of our project is to design effective learning activities for PyKinetic, a smartphone Python tutor. In this paper, we present a study using a variant of Parsons problems we designed for PyKinetic. Parsons problems contain randomized code which needs to be re-ordered to produce the desired effect. In our variant of Parsons problems, students were asked to complete the missing part(s) of some lines of code (LOCs), and rearrange the LOCs to match the problem description. In addition, we added menu-based Self-Explanation (SE) prompts. Students were asked to self-explain concepts related to incomplete LOCs they solved. Our hypotheses were: (H1) PyKinetic would be successful in supporting learning; (H2) menu-based SE prompts would result in further learning benefits; (H3) students with low prior knowledge (LP) would learn more from our Parsons problems in comparison to those with high prior knowledge (HP). We found that the participants’ scores on the post-test improved, thus showing evidence of learning in PyKinetic. The experimental group participants, who had SE prompts, showed improved learning in comparison to the control group. Further analyses revealed that LP students improved more than HP students and the improvement is even more pronounced for LP learners who self-explained. The contributions of our work are a) pedagogically-guided design of Parsons problems with SE prompts used on smartphones, b) showing that our Parsons problems are effective in supporting learning and c) our Parsons problems with SE prompts are especially effective for students with low prior knowledge.</description><subject>Artificial Intelligence</subject><subject>Coding</subject><subject>Comparative Analysis</subject><subject>Computer Science</subject><subject>Computers</subject><subject>Computers and Education</subject><subject>Control Groups</subject><subject>Correlation</subject><subject>Cues</subject><subject>Design</subject><subject>Educational Benefits</subject><subject>Educational Technology</subject><subject>Experimental Groups</subject><subject>Handheld Devices</subject><subject>Instructional Effectiveness</subject><subject>Instructional Materials</subject><subject>Intelligent Tutoring Systems</subject><subject>Knowledge</subject><subject>Learning</subject><subject>Learning Activities</subject><subject>Learning Processes</subject><subject>Novices</subject><subject>Personal computers</subject><subject>Pretests Posttests</subject><subject>Prior Learning</subject><subject>Problem solving</subject><subject>Programming Languages</subject><subject>Python</subject><subject>Research Design</subject><subject>Skills</subject><subject>Smartphones</subject><subject>Students</subject><subject>Syntax</subject><subject>Teaching Methods</subject><subject>Telecommunications</subject><subject>Tutors</subject><subject>User Interfaces and Human Computer Interaction</subject><subject>Writing</subject><subject>Writing Exercises</subject><subject>Writing Instruction</subject><subject>Writing Skills</subject><issn>1560-4292</issn><issn>1560-4306</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><recordid>eNp9UMlOwzAQtRBIlMIPICFZ4mwYL1l8hKpsakUlytk4iUNTpXGwE6B_jyEsN04zmrdpHkLHFM4oQHLuBUSSE6CSANBUENhBIxrFQASHePdnZ5LtowPv1wAigViM0NP0Vde97irbYFvihXbeNh4vnM1qs_H4repWeG6anlxqbwr8YOqSTN_bWjeDKDA3bedx1WCN5zaraoMX224VoGXfWXeI9kpde3P0Pcfo8Wq6nNyQ2f317eRiRnKeRh2RSS6TuMgYz2icAhcRL5KSCZOlBeU6KiFP8vBaOBuepZkALZmQtMgZL6hI-RidDr6tsy-98Z1a2941IVIxybmgqeQssNjAyp313plSta7aaLdVFNRnk2poUoUm1VeTCoLoZBAZV-W_gukdZTxiURRwPuA-YM2zcX_R_7h-AOXnfvw</recordid><startdate>20191201</startdate><enddate>20191201</enddate><creator>Fabic, Geela Venise Firmalo</creator><creator>Mitrovic, Antonija</creator><creator>Neshatian, Kourosh</creator><general>Springer New York</general><general>Springer</general><general>Springer Nature B.V</general><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>0-V</scope><scope>3V.</scope><scope>7XB</scope><scope>88B</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ALSLI</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>CJNVE</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M0P</scope><scope>M7S</scope><scope>P5Z</scope><scope>P62</scope><scope>PQEDU</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PTHSS</scope><scope>Q9U</scope><orcidid>https://orcid.org/0000-0003-0936-0806</orcidid></search><sort><creationdate>20191201</creationdate><title>Evaluation of Parsons Problems with Menu-Based Self-Explanation Prompts in a Mobile Python Tutor</title><author>Fabic, Geela Venise Firmalo ; Mitrovic, Antonija ; Neshatian, Kourosh</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c385t-97c976db23b16803453d7f24eb8d13a5f0c7c00153de3b8b40a92491dc23d1483</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Artificial Intelligence</topic><topic>Coding</topic><topic>Comparative Analysis</topic><topic>Computer Science</topic><topic>Computers</topic><topic>Computers and Education</topic><topic>Control Groups</topic><topic>Correlation</topic><topic>Cues</topic><topic>Design</topic><topic>Educational Benefits</topic><topic>Educational Technology</topic><topic>Experimental Groups</topic><topic>Handheld Devices</topic><topic>Instructional Effectiveness</topic><topic>Instructional Materials</topic><topic>Intelligent Tutoring Systems</topic><topic>Knowledge</topic><topic>Learning</topic><topic>Learning Activities</topic><topic>Learning Processes</topic><topic>Novices</topic><topic>Personal computers</topic><topic>Pretests Posttests</topic><topic>Prior Learning</topic><topic>Problem solving</topic><topic>Programming Languages</topic><topic>Python</topic><topic>Research Design</topic><topic>Skills</topic><topic>Smartphones</topic><topic>Students</topic><topic>Syntax</topic><topic>Teaching Methods</topic><topic>Telecommunications</topic><topic>Tutors</topic><topic>User Interfaces and Human Computer Interaction</topic><topic>Writing</topic><topic>Writing Exercises</topic><topic>Writing Instruction</topic><topic>Writing Skills</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Fabic, Geela Venise Firmalo</creatorcontrib><creatorcontrib>Mitrovic, Antonija</creatorcontrib><creatorcontrib>Neshatian, Kourosh</creatorcontrib><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>CrossRef</collection><collection>ProQuest Social Sciences Premium Collection</collection><collection>ProQuest Central (Corporate)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Education Database (Alumni Edition)</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Social Science Premium Collection</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>Education Collection</collection><collection>ProQuest Central Korea</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Education Database</collection><collection>Engineering Database</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest One Education</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>Engineering Collection</collection><collection>ProQuest Central Basic</collection><jtitle>International journal of artificial intelligence in education</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Fabic, Geela Venise Firmalo</au><au>Mitrovic, Antonija</au><au>Neshatian, Kourosh</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ1235255</ericid><atitle>Evaluation of Parsons Problems with Menu-Based Self-Explanation Prompts in a Mobile Python Tutor</atitle><jtitle>International journal of artificial intelligence in education</jtitle><stitle>Int J Artif Intell Educ</stitle><date>2019-12-01</date><risdate>2019</risdate><volume>29</volume><issue>4</issue><spage>507</spage><epage>535</epage><pages>507-535</pages><issn>1560-4292</issn><eissn>1560-4306</eissn><abstract>The overarching goal of our project is to design effective learning activities for PyKinetic, a smartphone Python tutor. In this paper, we present a study using a variant of Parsons problems we designed for PyKinetic. Parsons problems contain randomized code which needs to be re-ordered to produce the desired effect. In our variant of Parsons problems, students were asked to complete the missing part(s) of some lines of code (LOCs), and rearrange the LOCs to match the problem description. In addition, we added menu-based Self-Explanation (SE) prompts. Students were asked to self-explain concepts related to incomplete LOCs they solved. Our hypotheses were: (H1) PyKinetic would be successful in supporting learning; (H2) menu-based SE prompts would result in further learning benefits; (H3) students with low prior knowledge (LP) would learn more from our Parsons problems in comparison to those with high prior knowledge (HP). We found that the participants’ scores on the post-test improved, thus showing evidence of learning in PyKinetic. The experimental group participants, who had SE prompts, showed improved learning in comparison to the control group. Further analyses revealed that LP students improved more than HP students and the improvement is even more pronounced for LP learners who self-explained. The contributions of our work are a) pedagogically-guided design of Parsons problems with SE prompts used on smartphones, b) showing that our Parsons problems are effective in supporting learning and c) our Parsons problems with SE prompts are especially effective for students with low prior knowledge.</abstract><cop>New York</cop><pub>Springer New York</pub><doi>10.1007/s40593-019-00184-0</doi><tpages>29</tpages><orcidid>https://orcid.org/0000-0003-0936-0806</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1560-4292
ispartof International journal of artificial intelligence in education, 2019-12, Vol.29 (4), p.507-535
issn 1560-4292
1560-4306
language eng
recordid cdi_proquest_journals_2933418932
source ProQuest Central Essentials; ProQuest Central (Alumni Edition); ProQuest Central Student; SpringerLink Journals; ProQuest Central Korea; ProQuest Central UK/Ireland; ProQuest Central
subjects Artificial Intelligence
Coding
Comparative Analysis
Computer Science
Computers
Computers and Education
Control Groups
Correlation
Cues
Design
Educational Benefits
Educational Technology
Experimental Groups
Handheld Devices
Instructional Effectiveness
Instructional Materials
Intelligent Tutoring Systems
Knowledge
Learning
Learning Activities
Learning Processes
Novices
Personal computers
Pretests Posttests
Prior Learning
Problem solving
Programming Languages
Python
Research Design
Skills
Smartphones
Students
Syntax
Teaching Methods
Telecommunications
Tutors
User Interfaces and Human Computer Interaction
Writing
Writing Exercises
Writing Instruction
Writing Skills
title Evaluation of Parsons Problems with Menu-Based Self-Explanation Prompts in a Mobile Python Tutor
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T02%3A24%3A36IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Evaluation%20of%20Parsons%20Problems%20with%20Menu-Based%20Self-Explanation%20Prompts%20in%20a%20Mobile%20Python%20Tutor&rft.jtitle=International%20journal%20of%20artificial%20intelligence%20in%20education&rft.au=Fabic,%20Geela%20Venise%20Firmalo&rft.date=2019-12-01&rft.volume=29&rft.issue=4&rft.spage=507&rft.epage=535&rft.pages=507-535&rft.issn=1560-4292&rft.eissn=1560-4306&rft_id=info:doi/10.1007/s40593-019-00184-0&rft_dat=%3Cproquest_cross%3E2933418932%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2933418932&rft_id=info:pmid/&rft_ericid=EJ1235255&rfr_iscdi=true