Automatic Deictic Gestures for Animated Pedagogical Agents
We present a system that automatically generates deictic gestures for animated pedagogical agents (APAs). The system takes audio and text as input, which define what the APA has to say, and generates animated gestures based on a set of rules. The automatically generated gestures point to the exact l...
Gespeichert in:
| Veröffentlicht in: | IEEE transactions on learning technologies 2020-01, Vol.13 (1), p.1-13 |
|---|---|
| Hauptverfasser: | , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 13 |
|---|---|
| container_issue | 1 |
| container_start_page | 1 |
| container_title | IEEE transactions on learning technologies |
| container_volume | 13 |
| creator | Kappagantula, Sri Rama Kartheek Adamo-Villani, Nicoletta Wu, Meng-Lin Popescu, Voicu |
| description | We present a system that automatically generates deictic gestures for animated pedagogical agents (APAs). The system takes audio and text as input, which define what the APA has to say, and generates animated gestures based on a set of rules. The automatically generated gestures point to the exact locations of elements on a whiteboard nearby the APA, which are calculated by searching for keywords mentioned in the speech. We conducted a study with 100 subjects, in which we compared lecture videos containing gestures automatically-scripted by the system to videos of the same lecture containing manually-scripted gestures. The study results show that the manually-scripted and automatically-scripted lectures had comparable number of gestures, and that the gestures were timed equally well. |
| doi_str_mv | 10.1109/TLT.2019.2922134 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_eric_primary_EJ1248034</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ1248034</ericid><ieee_id>8734780</ieee_id><sourcerecordid>2381804600</sourcerecordid><originalsourceid>FETCH-LOGICAL-c355t-d721882d58e9c93b2861e4262930811f938c6d7b3ecda5662ccf047e074c4a143</originalsourceid><addsrcrecordid>eNpNkEFLw0AQhRdRsFbvgggBz6k7s5vNrregtSoFPdTzkm4mJaU2dTc5-O_dmlI8zcD33szjMXYNfALAzf1ivpggBzNBgwhCnrARGGFSEBpP_-3n7CKENecKc4Mj9lD0XftVdo1Lnqhx-zmj0PWeQlK3Pim2TaRUJR9Ulat21bhykxQr2nbhkp3V5SbQ1WGO2efzdPH4ks7fZ6-PxTx1Isu6tMoRtMYq02ScEUvUCkiiQiO4BqiN0E5V-VKQq8pMKXSu5jInnksnS5BizO6GuzvffvcxnF23vd_GlxaFBs2l4jyq-KByvg3BU213Pkb3Pxa43TdkY0N235A9NBQtt4OFfOOO8ukboNT8j98MvCGiI9e5kHnkv-wbaSQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2381804600</pqid></control><display><type>article</type><title>Automatic Deictic Gestures for Animated Pedagogical Agents</title><source>IEEE Electronic Library (IEL)</source><creator>Kappagantula, Sri Rama Kartheek ; Adamo-Villani, Nicoletta ; Wu, Meng-Lin ; Popescu, Voicu</creator><creatorcontrib>Kappagantula, Sri Rama Kartheek ; Adamo-Villani, Nicoletta ; Wu, Meng-Lin ; Popescu, Voicu</creatorcontrib><description>We present a system that automatically generates deictic gestures for animated pedagogical agents (APAs). The system takes audio and text as input, which define what the APA has to say, and generates animated gestures based on a set of rules. The automatically generated gestures point to the exact locations of elements on a whiteboard nearby the APA, which are calculated by searching for keywords mentioned in the speech. We conducted a study with 100 subjects, in which we compared lecture videos containing gestures automatically-scripted by the system to videos of the same lecture containing manually-scripted gestures. The study results show that the manually-scripted and automatically-scripted lectures had comparable number of gestures, and that the gestures were timed equally well.</description><identifier>ISSN: 1939-1382</identifier><identifier>EISSN: 1939-1382</identifier><identifier>EISSN: 2372-0050</identifier><identifier>DOI: 10.1109/TLT.2019.2922134</identifier><identifier>CODEN: ITLTAT</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Animation ; Artificial Intelligence ; automatic programming ; Automation ; CAI ; College Faculty ; College Students ; Computer Assisted Instruction ; Distance learning ; Educational Psychology ; educational simulations ; Electronic Learning ; gesture ; Information Retrieval ; instructor interfaces ; intelligent agents ; learning management systems ; Lecture Method ; Manuals ; Mathematics ; Natural Language Processing ; Nonverbal Communication ; Pedagogy ; Scalability ; speech analysis ; Video Technology ; Videos ; Visual Aids</subject><ispartof>IEEE transactions on learning technologies, 2020-01, Vol.13 (1), p.1-13</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c355t-d721882d58e9c93b2861e4262930811f938c6d7b3ecda5662ccf047e074c4a143</citedby><cites>FETCH-LOGICAL-c355t-d721882d58e9c93b2861e4262930811f938c6d7b3ecda5662ccf047e074c4a143</cites><orcidid>0000-0002-8695-4205 ; 0000-0001-9990-8710 ; 0000-0002-8767-8724</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/8734780$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,4010,27900,27901,27902,54733</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/8734780$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ1248034$$DView record in ERIC$$Hfree_for_read</backlink></links><search><creatorcontrib>Kappagantula, Sri Rama Kartheek</creatorcontrib><creatorcontrib>Adamo-Villani, Nicoletta</creatorcontrib><creatorcontrib>Wu, Meng-Lin</creatorcontrib><creatorcontrib>Popescu, Voicu</creatorcontrib><title>Automatic Deictic Gestures for Animated Pedagogical Agents</title><title>IEEE transactions on learning technologies</title><addtitle>TLT</addtitle><description>We present a system that automatically generates deictic gestures for animated pedagogical agents (APAs). The system takes audio and text as input, which define what the APA has to say, and generates animated gestures based on a set of rules. The automatically generated gestures point to the exact locations of elements on a whiteboard nearby the APA, which are calculated by searching for keywords mentioned in the speech. We conducted a study with 100 subjects, in which we compared lecture videos containing gestures automatically-scripted by the system to videos of the same lecture containing manually-scripted gestures. The study results show that the manually-scripted and automatically-scripted lectures had comparable number of gestures, and that the gestures were timed equally well.</description><subject>Animation</subject><subject>Artificial Intelligence</subject><subject>automatic programming</subject><subject>Automation</subject><subject>CAI</subject><subject>College Faculty</subject><subject>College Students</subject><subject>Computer Assisted Instruction</subject><subject>Distance learning</subject><subject>Educational Psychology</subject><subject>educational simulations</subject><subject>Electronic Learning</subject><subject>gesture</subject><subject>Information Retrieval</subject><subject>instructor interfaces</subject><subject>intelligent agents</subject><subject>learning management systems</subject><subject>Lecture Method</subject><subject>Manuals</subject><subject>Mathematics</subject><subject>Natural Language Processing</subject><subject>Nonverbal Communication</subject><subject>Pedagogy</subject><subject>Scalability</subject><subject>speech analysis</subject><subject>Video Technology</subject><subject>Videos</subject><subject>Visual Aids</subject><issn>1939-1382</issn><issn>1939-1382</issn><issn>2372-0050</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkEFLw0AQhRdRsFbvgggBz6k7s5vNrregtSoFPdTzkm4mJaU2dTc5-O_dmlI8zcD33szjMXYNfALAzf1ivpggBzNBgwhCnrARGGFSEBpP_-3n7CKENecKc4Mj9lD0XftVdo1Lnqhx-zmj0PWeQlK3Pim2TaRUJR9Ulat21bhykxQr2nbhkp3V5SbQ1WGO2efzdPH4ks7fZ6-PxTx1Isu6tMoRtMYq02ScEUvUCkiiQiO4BqiN0E5V-VKQq8pMKXSu5jInnksnS5BizO6GuzvffvcxnF23vd_GlxaFBs2l4jyq-KByvg3BU213Pkb3Pxa43TdkY0N235A9NBQtt4OFfOOO8ukboNT8j98MvCGiI9e5kHnkv-wbaSQ</recordid><startdate>202001</startdate><enddate>202001</enddate><creator>Kappagantula, Sri Rama Kartheek</creator><creator>Adamo-Villani, Nicoletta</creator><creator>Wu, Meng-Lin</creator><creator>Popescu, Voicu</creator><general>IEEE</general><general>Institute of Electrical and Electronics Engineers, Inc</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>7SW</scope><scope>BJH</scope><scope>BNH</scope><scope>BNI</scope><scope>BNJ</scope><scope>BNO</scope><scope>ERI</scope><scope>PET</scope><scope>REK</scope><scope>WWN</scope><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0002-8695-4205</orcidid><orcidid>https://orcid.org/0000-0001-9990-8710</orcidid><orcidid>https://orcid.org/0000-0002-8767-8724</orcidid></search><sort><creationdate>202001</creationdate><title>Automatic Deictic Gestures for Animated Pedagogical Agents</title><author>Kappagantula, Sri Rama Kartheek ; Adamo-Villani, Nicoletta ; Wu, Meng-Lin ; Popescu, Voicu</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c355t-d721882d58e9c93b2861e4262930811f938c6d7b3ecda5662ccf047e074c4a143</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Animation</topic><topic>Artificial Intelligence</topic><topic>automatic programming</topic><topic>Automation</topic><topic>CAI</topic><topic>College Faculty</topic><topic>College Students</topic><topic>Computer Assisted Instruction</topic><topic>Distance learning</topic><topic>Educational Psychology</topic><topic>educational simulations</topic><topic>Electronic Learning</topic><topic>gesture</topic><topic>Information Retrieval</topic><topic>instructor interfaces</topic><topic>intelligent agents</topic><topic>learning management systems</topic><topic>Lecture Method</topic><topic>Manuals</topic><topic>Mathematics</topic><topic>Natural Language Processing</topic><topic>Nonverbal Communication</topic><topic>Pedagogy</topic><topic>Scalability</topic><topic>speech analysis</topic><topic>Video Technology</topic><topic>Videos</topic><topic>Visual Aids</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Kappagantula, Sri Rama Kartheek</creatorcontrib><creatorcontrib>Adamo-Villani, Nicoletta</creatorcontrib><creatorcontrib>Wu, Meng-Lin</creatorcontrib><creatorcontrib>Popescu, Voicu</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>ERIC</collection><collection>ERIC (Ovid)</collection><collection>ERIC</collection><collection>ERIC</collection><collection>ERIC (Legacy Platform)</collection><collection>ERIC( SilverPlatter )</collection><collection>ERIC</collection><collection>ERIC PlusText (Legacy Platform)</collection><collection>Education Resources Information Center (ERIC)</collection><collection>ERIC</collection><collection>CrossRef</collection><jtitle>IEEE transactions on learning technologies</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Kappagantula, Sri Rama Kartheek</au><au>Adamo-Villani, Nicoletta</au><au>Wu, Meng-Lin</au><au>Popescu, Voicu</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ1248034</ericid><atitle>Automatic Deictic Gestures for Animated Pedagogical Agents</atitle><jtitle>IEEE transactions on learning technologies</jtitle><stitle>TLT</stitle><date>2020-01</date><risdate>2020</risdate><volume>13</volume><issue>1</issue><spage>1</spage><epage>13</epage><pages>1-13</pages><issn>1939-1382</issn><eissn>1939-1382</eissn><eissn>2372-0050</eissn><coden>ITLTAT</coden><abstract>We present a system that automatically generates deictic gestures for animated pedagogical agents (APAs). The system takes audio and text as input, which define what the APA has to say, and generates animated gestures based on a set of rules. The automatically generated gestures point to the exact locations of elements on a whiteboard nearby the APA, which are calculated by searching for keywords mentioned in the speech. We conducted a study with 100 subjects, in which we compared lecture videos containing gestures automatically-scripted by the system to videos of the same lecture containing manually-scripted gestures. The study results show that the manually-scripted and automatically-scripted lectures had comparable number of gestures, and that the gestures were timed equally well.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/TLT.2019.2922134</doi><tpages>13</tpages><orcidid>https://orcid.org/0000-0002-8695-4205</orcidid><orcidid>https://orcid.org/0000-0001-9990-8710</orcidid><orcidid>https://orcid.org/0000-0002-8767-8724</orcidid><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext_linktorsrc |
| identifier | ISSN: 1939-1382 |
| ispartof | IEEE transactions on learning technologies, 2020-01, Vol.13 (1), p.1-13 |
| issn | 1939-1382 1939-1382 2372-0050 |
| language | eng |
| recordid | cdi_eric_primary_EJ1248034 |
| source | IEEE Electronic Library (IEL) |
| subjects | Animation Artificial Intelligence automatic programming Automation CAI College Faculty College Students Computer Assisted Instruction Distance learning Educational Psychology educational simulations Electronic Learning gesture Information Retrieval instructor interfaces intelligent agents learning management systems Lecture Method Manuals Mathematics Natural Language Processing Nonverbal Communication Pedagogy Scalability speech analysis Video Technology Videos Visual Aids |
| title | Automatic Deictic Gestures for Animated Pedagogical Agents |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-15T09%3A57%3A00IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Automatic%20Deictic%20Gestures%20for%20Animated%20Pedagogical%20Agents&rft.jtitle=IEEE%20transactions%20on%20learning%20technologies&rft.au=Kappagantula,%20Sri%20Rama%20Kartheek&rft.date=2020-01&rft.volume=13&rft.issue=1&rft.spage=1&rft.epage=13&rft.pages=1-13&rft.issn=1939-1382&rft.eissn=1939-1382&rft.coden=ITLTAT&rft_id=info:doi/10.1109/TLT.2019.2922134&rft_dat=%3Cproquest_RIE%3E2381804600%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2381804600&rft_id=info:pmid/&rft_ericid=EJ1248034&rft_ieee_id=8734780&rfr_iscdi=true |