Aesop: A visual storytelling platform for conversational AI and common sense grounding
We present a new collaborative visual storytelling platform, Aesop, for direction and animation. Our system operates in two main modes, common sense grounding (annotation) and conversation. The Aesop system senses the human state and input using a natural language parser and human gesture monitoring...
Gespeichert in:
| Veröffentlicht in: | Ai communications 2019-01, Vol.32 (1), p.59-76 |
|---|---|
| Hauptverfasser: | , , , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 76 |
|---|---|
| container_issue | 1 |
| container_start_page | 59 |
| container_title | Ai communications |
| container_volume | 32 |
| creator | Meo, Timothy J. Kim, Chris Raghavan, Aswin Tozzo, Alex Salter, David A. Tamrakar, Amir Amer, Mohamed R. |
| description | We present a new collaborative visual storytelling platform, Aesop, for direction and animation. Our system operates in two main modes, common sense grounding (annotation) and conversation. The Aesop system senses the human state and input using a natural language parser and human gesture monitoring for natural interactions. The interface consists of a 3D animation software and a web controller to interact with the internal state of the system. For knowledge representation, we formulate novel knowledge graphs which enable spatio-temporal event representation. Aesop thus enables 3D spatial and temporal reasoning which are both essential for storytelling. Finally, the system utilizes a dialog manager to track the conversation state and manage goals. Aesop provides a rich platform that enables research in language, gestures, vision, and planning in the context of storytelling. |
| doi_str_mv | 10.3233/AIC-180605 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2191383477</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2191383477</sourcerecordid><originalsourceid>FETCH-LOGICAL-c259t-b6f5ec60af4d247a304abc2e04b9fa830cf2ef363bd7eefdc33b25a3fe12f3233</originalsourceid><addsrcrecordid>eNotkM1LxDAQxYMouK5e_AsC3oRqkmn64a0sfiwseFGvIW0nS5c2qUm7sP-9WeplHgy_ebx5hNxz9gQC4LnabhJesIzJC7LiRS6TIpXikqxYKXiSc5Fdk5sQDowxIUCuyE-FwY0vtKLHLsy6p2Fy_jRh33d2T8deT8b5gcZBG2eP6IOeOmcjWG2ptm3cDoOzNKANSPfezbaNl7fkyug-4N2_rsn32-vX5iPZfb5vN9UuaYQsp6TOjMQmY9qkrUhzDSzVdSOQpXVpdAGsMQINZFC3OaJpG4BaSA0GuTDnh9fkYfEdvfudMUzq4GYf4wUleMmhgDTPI_W4UI13IXg0avTdoP1JcabONir2ppbe4A_7yGEG</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2191383477</pqid></control><display><type>article</type><title>Aesop: A visual storytelling platform for conversational AI and common sense grounding</title><source>EBSCOhost Business Source Complete</source><creator>Meo, Timothy J. ; Kim, Chris ; Raghavan, Aswin ; Tozzo, Alex ; Salter, David A. ; Tamrakar, Amir ; Amer, Mohamed R.</creator><contributor>Weng, Paul</contributor><creatorcontrib>Meo, Timothy J. ; Kim, Chris ; Raghavan, Aswin ; Tozzo, Alex ; Salter, David A. ; Tamrakar, Amir ; Amer, Mohamed R. ; Weng, Paul</creatorcontrib><description>We present a new collaborative visual storytelling platform, Aesop, for direction and animation. Our system operates in two main modes, common sense grounding (annotation) and conversation. The Aesop system senses the human state and input using a natural language parser and human gesture monitoring for natural interactions. The interface consists of a 3D animation software and a web controller to interact with the internal state of the system. For knowledge representation, we formulate novel knowledge graphs which enable spatio-temporal event representation. Aesop thus enables 3D spatial and temporal reasoning which are both essential for storytelling. Finally, the system utilizes a dialog manager to track the conversation state and manage goals. Aesop provides a rich platform that enables research in language, gestures, vision, and planning in the context of storytelling.</description><identifier>ISSN: 0921-7126</identifier><identifier>EISSN: 1875-8452</identifier><identifier>DOI: 10.3233/AIC-180605</identifier><language>eng</language><publisher>Amsterdam: IOS Press BV</publisher><subject>Animation ; Annotations ; Artificial intelligence ; Conversational artificial intelligence ; Graphical representations ; Knowledge representation ; Natural language processing ; Storytelling</subject><ispartof>Ai communications, 2019-01, Vol.32 (1), p.59-76</ispartof><rights>Copyright IOS Press BV 2019</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c259t-b6f5ec60af4d247a304abc2e04b9fa830cf2ef363bd7eefdc33b25a3fe12f3233</citedby><cites>FETCH-LOGICAL-c259t-b6f5ec60af4d247a304abc2e04b9fa830cf2ef363bd7eefdc33b25a3fe12f3233</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,27901,27902</link.rule.ids></links><search><contributor>Weng, Paul</contributor><creatorcontrib>Meo, Timothy J.</creatorcontrib><creatorcontrib>Kim, Chris</creatorcontrib><creatorcontrib>Raghavan, Aswin</creatorcontrib><creatorcontrib>Tozzo, Alex</creatorcontrib><creatorcontrib>Salter, David A.</creatorcontrib><creatorcontrib>Tamrakar, Amir</creatorcontrib><creatorcontrib>Amer, Mohamed R.</creatorcontrib><title>Aesop: A visual storytelling platform for conversational AI and common sense grounding</title><title>Ai communications</title><description>We present a new collaborative visual storytelling platform, Aesop, for direction and animation. Our system operates in two main modes, common sense grounding (annotation) and conversation. The Aesop system senses the human state and input using a natural language parser and human gesture monitoring for natural interactions. The interface consists of a 3D animation software and a web controller to interact with the internal state of the system. For knowledge representation, we formulate novel knowledge graphs which enable spatio-temporal event representation. Aesop thus enables 3D spatial and temporal reasoning which are both essential for storytelling. Finally, the system utilizes a dialog manager to track the conversation state and manage goals. Aesop provides a rich platform that enables research in language, gestures, vision, and planning in the context of storytelling.</description><subject>Animation</subject><subject>Annotations</subject><subject>Artificial intelligence</subject><subject>Conversational artificial intelligence</subject><subject>Graphical representations</subject><subject>Knowledge representation</subject><subject>Natural language processing</subject><subject>Storytelling</subject><issn>0921-7126</issn><issn>1875-8452</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><recordid>eNotkM1LxDAQxYMouK5e_AsC3oRqkmn64a0sfiwseFGvIW0nS5c2qUm7sP-9WeplHgy_ebx5hNxz9gQC4LnabhJesIzJC7LiRS6TIpXikqxYKXiSc5Fdk5sQDowxIUCuyE-FwY0vtKLHLsy6p2Fy_jRh33d2T8deT8b5gcZBG2eP6IOeOmcjWG2ptm3cDoOzNKANSPfezbaNl7fkyug-4N2_rsn32-vX5iPZfb5vN9UuaYQsp6TOjMQmY9qkrUhzDSzVdSOQpXVpdAGsMQINZFC3OaJpG4BaSA0GuTDnh9fkYfEdvfudMUzq4GYf4wUleMmhgDTPI_W4UI13IXg0avTdoP1JcabONir2ppbe4A_7yGEG</recordid><startdate>20190101</startdate><enddate>20190101</enddate><creator>Meo, Timothy J.</creator><creator>Kim, Chris</creator><creator>Raghavan, Aswin</creator><creator>Tozzo, Alex</creator><creator>Salter, David A.</creator><creator>Tamrakar, Amir</creator><creator>Amer, Mohamed R.</creator><general>IOS Press BV</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>E3H</scope><scope>F2A</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope></search><sort><creationdate>20190101</creationdate><title>Aesop: A visual storytelling platform for conversational AI and common sense grounding</title><author>Meo, Timothy J. ; Kim, Chris ; Raghavan, Aswin ; Tozzo, Alex ; Salter, David A. ; Tamrakar, Amir ; Amer, Mohamed R.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c259t-b6f5ec60af4d247a304abc2e04b9fa830cf2ef363bd7eefdc33b25a3fe12f3233</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Animation</topic><topic>Annotations</topic><topic>Artificial intelligence</topic><topic>Conversational artificial intelligence</topic><topic>Graphical representations</topic><topic>Knowledge representation</topic><topic>Natural language processing</topic><topic>Storytelling</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Meo, Timothy J.</creatorcontrib><creatorcontrib>Kim, Chris</creatorcontrib><creatorcontrib>Raghavan, Aswin</creatorcontrib><creatorcontrib>Tozzo, Alex</creatorcontrib><creatorcontrib>Salter, David A.</creatorcontrib><creatorcontrib>Tamrakar, Amir</creatorcontrib><creatorcontrib>Amer, Mohamed R.</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>Library & Information Sciences Abstracts (LISA)</collection><collection>Library & Information Science Abstracts (LISA)</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Ai communications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Meo, Timothy J.</au><au>Kim, Chris</au><au>Raghavan, Aswin</au><au>Tozzo, Alex</au><au>Salter, David A.</au><au>Tamrakar, Amir</au><au>Amer, Mohamed R.</au><au>Weng, Paul</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Aesop: A visual storytelling platform for conversational AI and common sense grounding</atitle><jtitle>Ai communications</jtitle><date>2019-01-01</date><risdate>2019</risdate><volume>32</volume><issue>1</issue><spage>59</spage><epage>76</epage><pages>59-76</pages><issn>0921-7126</issn><eissn>1875-8452</eissn><abstract>We present a new collaborative visual storytelling platform, Aesop, for direction and animation. Our system operates in two main modes, common sense grounding (annotation) and conversation. The Aesop system senses the human state and input using a natural language parser and human gesture monitoring for natural interactions. The interface consists of a 3D animation software and a web controller to interact with the internal state of the system. For knowledge representation, we formulate novel knowledge graphs which enable spatio-temporal event representation. Aesop thus enables 3D spatial and temporal reasoning which are both essential for storytelling. Finally, the system utilizes a dialog manager to track the conversation state and manage goals. Aesop provides a rich platform that enables research in language, gestures, vision, and planning in the context of storytelling.</abstract><cop>Amsterdam</cop><pub>IOS Press BV</pub><doi>10.3233/AIC-180605</doi><tpages>18</tpages></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 0921-7126 |
| ispartof | Ai communications, 2019-01, Vol.32 (1), p.59-76 |
| issn | 0921-7126 1875-8452 |
| language | eng |
| recordid | cdi_proquest_journals_2191383477 |
| source | EBSCOhost Business Source Complete |
| subjects | Animation Annotations Artificial intelligence Conversational artificial intelligence Graphical representations Knowledge representation Natural language processing Storytelling |
| title | Aesop: A visual storytelling platform for conversational AI and common sense grounding |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-31T20%3A59%3A32IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Aesop:%20A%20visual%20storytelling%20platform%20for%20conversational%20AI%20and%20common%20sense%20grounding&rft.jtitle=Ai%20communications&rft.au=Meo,%20Timothy%20J.&rft.date=2019-01-01&rft.volume=32&rft.issue=1&rft.spage=59&rft.epage=76&rft.pages=59-76&rft.issn=0921-7126&rft.eissn=1875-8452&rft_id=info:doi/10.3233/AIC-180605&rft_dat=%3Cproquest_cross%3E2191383477%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2191383477&rft_id=info:pmid/&rfr_iscdi=true |