Overview of the Eighth Dialog System Technology Challenge: DSTC8
This paper introduces the Eighth Dialog System Technology Challenge. In line with recent challenges, the eighth edition focuses on applying end-to-end dialog technologies in a pragmatic way for multi-domain task-completion, noetic response selection, audio visual scene-aware dialog, and schema-guide...
Gespeichert in:
| Veröffentlicht in: | IEEE/ACM transactions on audio, speech, and language processing speech, and language processing, 2021, Vol.29, p.2529-2540 |
|---|---|
| Hauptverfasser: | , , , , , , , , , , , , , , , , , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 2540 |
|---|---|
| container_issue | |
| container_start_page | 2529 |
| container_title | IEEE/ACM transactions on audio, speech, and language processing |
| container_volume | 29 |
| creator | Kim, Seokhwan Galley, Michel Gunasekara, Chulaka Lee, Sungjin Atkinson, Adam Peng, Baolin Schulz, Hannes Gao, Jianfeng Li, Jinchao Adada, Mahmoud Huang, Minlie Lastras, Luis Kummerfeld, Jonathan K. Lasecki, Walter S. Hori, Chiori Cherian, Anoop Marks, Tim K. Rastogi, Abhinav Zang, Xiaoxue Sunkara, Srinivas Gupta, Raghav |
| description | This paper introduces the Eighth Dialog System Technology Challenge. In line with recent challenges, the eighth edition focuses on applying end-to-end dialog technologies in a pragmatic way for multi-domain task-completion, noetic response selection, audio visual scene-aware dialog, and schema-guided dialog state tracking tasks. This paper describes the task definition, provided datasets, baselines and evaluation set-up for each track. We also summarize the results of the submitted systems to highlight the overall trends of the state-of-the-art technologies for the tasks. |
| doi_str_mv | 10.1109/TASLP.2021.3078368 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_2560139828</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9426430</ieee_id><sourcerecordid>2560139828</sourcerecordid><originalsourceid>FETCH-LOGICAL-c295t-467c6a09499e2bd1d139888d2abc527fe2efd99523b26333dada2a7b2ed906383</originalsourceid><addsrcrecordid>eNo9kE1Lw0AQhhdRsNT-Ab0seE6dnc3XeLKk9QMKFRrPyyaZNClpU5O00n9vY9XTDMP7vAOPELcKxkoBPcST5fx9jIBqrCEItR9eiAFqJIc0uJd_OxJci1HbrgFAQUAUuAPxtDhwcyj5S9a57AqWs3JVdIWclraqV3J5bDveyJjTYlufDkcZFbaqeLviRzldxlF4I65yW7U8-p1D8fE8i6NXZ754eYsmcydF8jrH9YPUt0AuEWOSqUxpCsMwQ5ukHgY5I-cZkYc6QV9rndnMog0S5IzA16Eeivtz766pP_fcdmZd75vt6aVBz4e-DvsUnlNpU7dtw7nZNeXGNkejwPSyzI8s08syv7JO0N0ZKpn5HyAXfVeD_gYyo2O8</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2560139828</pqid></control><display><type>article</type><title>Overview of the Eighth Dialog System Technology Challenge: DSTC8</title><source>IEEE Electronic Library (IEL)</source><creator>Kim, Seokhwan ; Galley, Michel ; Gunasekara, Chulaka ; Lee, Sungjin ; Atkinson, Adam ; Peng, Baolin ; Schulz, Hannes ; Gao, Jianfeng ; Li, Jinchao ; Adada, Mahmoud ; Huang, Minlie ; Lastras, Luis ; Kummerfeld, Jonathan K. ; Lasecki, Walter S. ; Hori, Chiori ; Cherian, Anoop ; Marks, Tim K. ; Rastogi, Abhinav ; Zang, Xiaoxue ; Sunkara, Srinivas ; Gupta, Raghav</creator><creatorcontrib>Kim, Seokhwan ; Galley, Michel ; Gunasekara, Chulaka ; Lee, Sungjin ; Atkinson, Adam ; Peng, Baolin ; Schulz, Hannes ; Gao, Jianfeng ; Li, Jinchao ; Adada, Mahmoud ; Huang, Minlie ; Lastras, Luis ; Kummerfeld, Jonathan K. ; Lasecki, Walter S. ; Hori, Chiori ; Cherian, Anoop ; Marks, Tim K. ; Rastogi, Abhinav ; Zang, Xiaoxue ; Sunkara, Srinivas ; Gupta, Raghav</creatorcontrib><description>This paper introduces the Eighth Dialog System Technology Challenge. In line with recent challenges, the eighth edition focuses on applying end-to-end dialog technologies in a pragmatic way for multi-domain task-completion, noetic response selection, audio visual scene-aware dialog, and schema-guided dialog state tracking tasks. This paper describes the task definition, provided datasets, baselines and evaluation set-up for each track. We also summarize the results of the submitted systems to highlight the overall trends of the state-of-the-art technologies for the tasks.</description><identifier>ISSN: 2329-9290</identifier><identifier>EISSN: 2329-9304</identifier><identifier>DOI: 10.1109/TASLP.2021.3078368</identifier><identifier>CODEN: ITASFA</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Adaptation models ; Complexity theory ; conversational system ; dialog system ; Measurement ; Natural language processing ; natural language understanding ; Predictive models ; Social networking (online) ; speech processing ; Task analysis ; Training</subject><ispartof>IEEE/ACM transactions on audio, speech, and language processing, 2021, Vol.29, p.2529-2540</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c295t-467c6a09499e2bd1d139888d2abc527fe2efd99523b26333dada2a7b2ed906383</citedby><cites>FETCH-LOGICAL-c295t-467c6a09499e2bd1d139888d2abc527fe2efd99523b26333dada2a7b2ed906383</cites><orcidid>0000-0001-7111-1849 ; 0000-0002-3713-8607 ; 0000-0002-7443-1212 ; 0000-0001-9555-6228 ; 0000-0001-5030-3016 ; 0000-0002-4201-7578 ; 0000-0002-5566-0351</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9426430$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,4024,27923,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9426430$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Kim, Seokhwan</creatorcontrib><creatorcontrib>Galley, Michel</creatorcontrib><creatorcontrib>Gunasekara, Chulaka</creatorcontrib><creatorcontrib>Lee, Sungjin</creatorcontrib><creatorcontrib>Atkinson, Adam</creatorcontrib><creatorcontrib>Peng, Baolin</creatorcontrib><creatorcontrib>Schulz, Hannes</creatorcontrib><creatorcontrib>Gao, Jianfeng</creatorcontrib><creatorcontrib>Li, Jinchao</creatorcontrib><creatorcontrib>Adada, Mahmoud</creatorcontrib><creatorcontrib>Huang, Minlie</creatorcontrib><creatorcontrib>Lastras, Luis</creatorcontrib><creatorcontrib>Kummerfeld, Jonathan K.</creatorcontrib><creatorcontrib>Lasecki, Walter S.</creatorcontrib><creatorcontrib>Hori, Chiori</creatorcontrib><creatorcontrib>Cherian, Anoop</creatorcontrib><creatorcontrib>Marks, Tim K.</creatorcontrib><creatorcontrib>Rastogi, Abhinav</creatorcontrib><creatorcontrib>Zang, Xiaoxue</creatorcontrib><creatorcontrib>Sunkara, Srinivas</creatorcontrib><creatorcontrib>Gupta, Raghav</creatorcontrib><title>Overview of the Eighth Dialog System Technology Challenge: DSTC8</title><title>IEEE/ACM transactions on audio, speech, and language processing</title><addtitle>TASLP</addtitle><description>This paper introduces the Eighth Dialog System Technology Challenge. In line with recent challenges, the eighth edition focuses on applying end-to-end dialog technologies in a pragmatic way for multi-domain task-completion, noetic response selection, audio visual scene-aware dialog, and schema-guided dialog state tracking tasks. This paper describes the task definition, provided datasets, baselines and evaluation set-up for each track. We also summarize the results of the submitted systems to highlight the overall trends of the state-of-the-art technologies for the tasks.</description><subject>Adaptation models</subject><subject>Complexity theory</subject><subject>conversational system</subject><subject>dialog system</subject><subject>Measurement</subject><subject>Natural language processing</subject><subject>natural language understanding</subject><subject>Predictive models</subject><subject>Social networking (online)</subject><subject>speech processing</subject><subject>Task analysis</subject><subject>Training</subject><issn>2329-9290</issn><issn>2329-9304</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kE1Lw0AQhhdRsNT-Ab0seE6dnc3XeLKk9QMKFRrPyyaZNClpU5O00n9vY9XTDMP7vAOPELcKxkoBPcST5fx9jIBqrCEItR9eiAFqJIc0uJd_OxJci1HbrgFAQUAUuAPxtDhwcyj5S9a57AqWs3JVdIWclraqV3J5bDveyJjTYlufDkcZFbaqeLviRzldxlF4I65yW7U8-p1D8fE8i6NXZ754eYsmcydF8jrH9YPUt0AuEWOSqUxpCsMwQ5ukHgY5I-cZkYc6QV9rndnMog0S5IzA16Eeivtz766pP_fcdmZd75vt6aVBz4e-DvsUnlNpU7dtw7nZNeXGNkejwPSyzI8s08syv7JO0N0ZKpn5HyAXfVeD_gYyo2O8</recordid><startdate>2021</startdate><enddate>2021</enddate><creator>Kim, Seokhwan</creator><creator>Galley, Michel</creator><creator>Gunasekara, Chulaka</creator><creator>Lee, Sungjin</creator><creator>Atkinson, Adam</creator><creator>Peng, Baolin</creator><creator>Schulz, Hannes</creator><creator>Gao, Jianfeng</creator><creator>Li, Jinchao</creator><creator>Adada, Mahmoud</creator><creator>Huang, Minlie</creator><creator>Lastras, Luis</creator><creator>Kummerfeld, Jonathan K.</creator><creator>Lasecki, Walter S.</creator><creator>Hori, Chiori</creator><creator>Cherian, Anoop</creator><creator>Marks, Tim K.</creator><creator>Rastogi, Abhinav</creator><creator>Zang, Xiaoxue</creator><creator>Sunkara, Srinivas</creator><creator>Gupta, Raghav</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0001-7111-1849</orcidid><orcidid>https://orcid.org/0000-0002-3713-8607</orcidid><orcidid>https://orcid.org/0000-0002-7443-1212</orcidid><orcidid>https://orcid.org/0000-0001-9555-6228</orcidid><orcidid>https://orcid.org/0000-0001-5030-3016</orcidid><orcidid>https://orcid.org/0000-0002-4201-7578</orcidid><orcidid>https://orcid.org/0000-0002-5566-0351</orcidid></search><sort><creationdate>2021</creationdate><title>Overview of the Eighth Dialog System Technology Challenge: DSTC8</title><author>Kim, Seokhwan ; Galley, Michel ; Gunasekara, Chulaka ; Lee, Sungjin ; Atkinson, Adam ; Peng, Baolin ; Schulz, Hannes ; Gao, Jianfeng ; Li, Jinchao ; Adada, Mahmoud ; Huang, Minlie ; Lastras, Luis ; Kummerfeld, Jonathan K. ; Lasecki, Walter S. ; Hori, Chiori ; Cherian, Anoop ; Marks, Tim K. ; Rastogi, Abhinav ; Zang, Xiaoxue ; Sunkara, Srinivas ; Gupta, Raghav</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c295t-467c6a09499e2bd1d139888d2abc527fe2efd99523b26333dada2a7b2ed906383</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Adaptation models</topic><topic>Complexity theory</topic><topic>conversational system</topic><topic>dialog system</topic><topic>Measurement</topic><topic>Natural language processing</topic><topic>natural language understanding</topic><topic>Predictive models</topic><topic>Social networking (online)</topic><topic>speech processing</topic><topic>Task analysis</topic><topic>Training</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Kim, Seokhwan</creatorcontrib><creatorcontrib>Galley, Michel</creatorcontrib><creatorcontrib>Gunasekara, Chulaka</creatorcontrib><creatorcontrib>Lee, Sungjin</creatorcontrib><creatorcontrib>Atkinson, Adam</creatorcontrib><creatorcontrib>Peng, Baolin</creatorcontrib><creatorcontrib>Schulz, Hannes</creatorcontrib><creatorcontrib>Gao, Jianfeng</creatorcontrib><creatorcontrib>Li, Jinchao</creatorcontrib><creatorcontrib>Adada, Mahmoud</creatorcontrib><creatorcontrib>Huang, Minlie</creatorcontrib><creatorcontrib>Lastras, Luis</creatorcontrib><creatorcontrib>Kummerfeld, Jonathan K.</creatorcontrib><creatorcontrib>Lasecki, Walter S.</creatorcontrib><creatorcontrib>Hori, Chiori</creatorcontrib><creatorcontrib>Cherian, Anoop</creatorcontrib><creatorcontrib>Marks, Tim K.</creatorcontrib><creatorcontrib>Rastogi, Abhinav</creatorcontrib><creatorcontrib>Zang, Xiaoxue</creatorcontrib><creatorcontrib>Sunkara, Srinivas</creatorcontrib><creatorcontrib>Gupta, Raghav</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE/ACM transactions on audio, speech, and language processing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Kim, Seokhwan</au><au>Galley, Michel</au><au>Gunasekara, Chulaka</au><au>Lee, Sungjin</au><au>Atkinson, Adam</au><au>Peng, Baolin</au><au>Schulz, Hannes</au><au>Gao, Jianfeng</au><au>Li, Jinchao</au><au>Adada, Mahmoud</au><au>Huang, Minlie</au><au>Lastras, Luis</au><au>Kummerfeld, Jonathan K.</au><au>Lasecki, Walter S.</au><au>Hori, Chiori</au><au>Cherian, Anoop</au><au>Marks, Tim K.</au><au>Rastogi, Abhinav</au><au>Zang, Xiaoxue</au><au>Sunkara, Srinivas</au><au>Gupta, Raghav</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Overview of the Eighth Dialog System Technology Challenge: DSTC8</atitle><jtitle>IEEE/ACM transactions on audio, speech, and language processing</jtitle><stitle>TASLP</stitle><date>2021</date><risdate>2021</risdate><volume>29</volume><spage>2529</spage><epage>2540</epage><pages>2529-2540</pages><issn>2329-9290</issn><eissn>2329-9304</eissn><coden>ITASFA</coden><abstract>This paper introduces the Eighth Dialog System Technology Challenge. In line with recent challenges, the eighth edition focuses on applying end-to-end dialog technologies in a pragmatic way for multi-domain task-completion, noetic response selection, audio visual scene-aware dialog, and schema-guided dialog state tracking tasks. This paper describes the task definition, provided datasets, baselines and evaluation set-up for each track. We also summarize the results of the submitted systems to highlight the overall trends of the state-of-the-art technologies for the tasks.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/TASLP.2021.3078368</doi><tpages>12</tpages><orcidid>https://orcid.org/0000-0001-7111-1849</orcidid><orcidid>https://orcid.org/0000-0002-3713-8607</orcidid><orcidid>https://orcid.org/0000-0002-7443-1212</orcidid><orcidid>https://orcid.org/0000-0001-9555-6228</orcidid><orcidid>https://orcid.org/0000-0001-5030-3016</orcidid><orcidid>https://orcid.org/0000-0002-4201-7578</orcidid><orcidid>https://orcid.org/0000-0002-5566-0351</orcidid></addata></record> |
| fulltext | fulltext_linktorsrc |
| identifier | ISSN: 2329-9290 |
| ispartof | IEEE/ACM transactions on audio, speech, and language processing, 2021, Vol.29, p.2529-2540 |
| issn | 2329-9290 2329-9304 |
| language | eng |
| recordid | cdi_proquest_journals_2560139828 |
| source | IEEE Electronic Library (IEL) |
| subjects | Adaptation models Complexity theory conversational system dialog system Measurement Natural language processing natural language understanding Predictive models Social networking (online) speech processing Task analysis Training |
| title | Overview of the Eighth Dialog System Technology Challenge: DSTC8 |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-24T13%3A33%3A31IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Overview%20of%20the%20Eighth%20Dialog%20System%20Technology%20Challenge:%20DSTC8&rft.jtitle=IEEE/ACM%20transactions%20on%20audio,%20speech,%20and%20language%20processing&rft.au=Kim,%20Seokhwan&rft.date=2021&rft.volume=29&rft.spage=2529&rft.epage=2540&rft.pages=2529-2540&rft.issn=2329-9290&rft.eissn=2329-9304&rft.coden=ITASFA&rft_id=info:doi/10.1109/TASLP.2021.3078368&rft_dat=%3Cproquest_RIE%3E2560139828%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2560139828&rft_id=info:pmid/&rft_ieee_id=9426430&rfr_iscdi=true |