AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversation

Crowdsourced dialogue corpora are usually limited in scale and topic coverage due to the expensive cost of data curation. This would hinder the generalization of downstream dialogue models to open-domain topics. In this work, we leverage large language models for dialogue augmentation in the task of...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zheng, Chujie, Sabour, Sahand, Wen, Jiaxin, Zhang, Zheng, Huang, Minlie
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Zheng, Chujie
Sabour, Sahand
Wen, Jiaxin
Zhang, Zheng
Huang, Minlie
description Crowdsourced dialogue corpora are usually limited in scale and topic coverage due to the expensive cost of data curation. This would hinder the generalization of downstream dialogue models to open-domain topics. In this work, we leverage large language models for dialogue augmentation in the task of emotional support conversation (ESC). By treating dialogue augmentation as a dialogue completion task, we prompt a fine-tuned language model to complete full dialogues from available dialogue posts of various topics, which are then postprocessed based on heuristics. Applying this approach, we construct AugESC, an augmented dataset for the ESC task, which largely extends the scale and topic coverage of the crowdsourced ESConv corpus. Through comprehensive human evaluation, we demonstrate that our approach is superior to strong baselines of dialogue augmentation and that AugESC has comparable dialogue quality to the crowdsourced corpus. We also conduct human interactive evaluation and prove that post-training on AugESC improves downstream dialogue models' generalization ability to open-domain topics. These results suggest the utility of AugESC and highlight the potential of large language models in improving data-scarce dialogue generation tasks.
doi_str_mv 10.48550/arxiv.2202.13047
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2202_13047</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2202_13047</sourcerecordid><originalsourceid>FETCH-LOGICAL-a677-d01f9b493b73518b55de29f8804650d20758d26aa935c1e47841e66fe442f6183</originalsourceid><addsrcrecordid>eNotj81OhDAUhbtxYUYfwJV9AbD_Le4miD8JxsXMzgW52BZJgJICo769DLo55-Tk3Jt8CN1QkgojJbmD-N2eUsYISyknQl-i9_3SFIf8Hj-00IVmcXgtejfMMLdhwF_t_IlLiI1bdWgWWMNrsK6bsA8RF304z6DDh2UcQ5xxHoaTi9N2fYUuPHSTu_73HTo-Fsf8OSnfnl7yfZmA0jqxhPqsFhmvNZfU1FJaxzJvDBFKEsuIlsYyBZBx-UGd0EZQp5R3QjCvqOE7dPv3dqOrxtj2EH-qM2W1UfJfj7ZMZQ</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversation</title><source>arXiv.org</source><creator>Zheng, Chujie ; Sabour, Sahand ; Wen, Jiaxin ; Zhang, Zheng ; Huang, Minlie</creator><creatorcontrib>Zheng, Chujie ; Sabour, Sahand ; Wen, Jiaxin ; Zhang, Zheng ; Huang, Minlie</creatorcontrib><description>Crowdsourced dialogue corpora are usually limited in scale and topic coverage due to the expensive cost of data curation. This would hinder the generalization of downstream dialogue models to open-domain topics. In this work, we leverage large language models for dialogue augmentation in the task of emotional support conversation (ESC). By treating dialogue augmentation as a dialogue completion task, we prompt a fine-tuned language model to complete full dialogues from available dialogue posts of various topics, which are then postprocessed based on heuristics. Applying this approach, we construct AugESC, an augmented dataset for the ESC task, which largely extends the scale and topic coverage of the crowdsourced ESConv corpus. Through comprehensive human evaluation, we demonstrate that our approach is superior to strong baselines of dialogue augmentation and that AugESC has comparable dialogue quality to the crowdsourced corpus. We also conduct human interactive evaluation and prove that post-training on AugESC improves downstream dialogue models' generalization ability to open-domain topics. These results suggest the utility of AugESC and highlight the potential of large language models in improving data-scarce dialogue generation tasks.</description><identifier>DOI: 10.48550/arxiv.2202.13047</identifier><language>eng</language><subject>Computer Science - Computation and Language</subject><creationdate>2022-02</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2202.13047$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2202.13047$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Zheng, Chujie</creatorcontrib><creatorcontrib>Sabour, Sahand</creatorcontrib><creatorcontrib>Wen, Jiaxin</creatorcontrib><creatorcontrib>Zhang, Zheng</creatorcontrib><creatorcontrib>Huang, Minlie</creatorcontrib><title>AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversation</title><description>Crowdsourced dialogue corpora are usually limited in scale and topic coverage due to the expensive cost of data curation. This would hinder the generalization of downstream dialogue models to open-domain topics. In this work, we leverage large language models for dialogue augmentation in the task of emotional support conversation (ESC). By treating dialogue augmentation as a dialogue completion task, we prompt a fine-tuned language model to complete full dialogues from available dialogue posts of various topics, which are then postprocessed based on heuristics. Applying this approach, we construct AugESC, an augmented dataset for the ESC task, which largely extends the scale and topic coverage of the crowdsourced ESConv corpus. Through comprehensive human evaluation, we demonstrate that our approach is superior to strong baselines of dialogue augmentation and that AugESC has comparable dialogue quality to the crowdsourced corpus. We also conduct human interactive evaluation and prove that post-training on AugESC improves downstream dialogue models' generalization ability to open-domain topics. These results suggest the utility of AugESC and highlight the potential of large language models in improving data-scarce dialogue generation tasks.</description><subject>Computer Science - Computation and Language</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj81OhDAUhbtxYUYfwJV9AbD_Le4miD8JxsXMzgW52BZJgJICo769DLo55-Tk3Jt8CN1QkgojJbmD-N2eUsYISyknQl-i9_3SFIf8Hj-00IVmcXgtejfMMLdhwF_t_IlLiI1bdWgWWMNrsK6bsA8RF304z6DDh2UcQ5xxHoaTi9N2fYUuPHSTu_73HTo-Fsf8OSnfnl7yfZmA0jqxhPqsFhmvNZfU1FJaxzJvDBFKEsuIlsYyBZBx-UGd0EZQp5R3QjCvqOE7dPv3dqOrxtj2EH-qM2W1UfJfj7ZMZQ</recordid><startdate>20220225</startdate><enddate>20220225</enddate><creator>Zheng, Chujie</creator><creator>Sabour, Sahand</creator><creator>Wen, Jiaxin</creator><creator>Zhang, Zheng</creator><creator>Huang, Minlie</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20220225</creationdate><title>AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversation</title><author>Zheng, Chujie ; Sabour, Sahand ; Wen, Jiaxin ; Zhang, Zheng ; Huang, Minlie</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a677-d01f9b493b73518b55de29f8804650d20758d26aa935c1e47841e66fe442f6183</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Computer Science - Computation and Language</topic><toplevel>online_resources</toplevel><creatorcontrib>Zheng, Chujie</creatorcontrib><creatorcontrib>Sabour, Sahand</creatorcontrib><creatorcontrib>Wen, Jiaxin</creatorcontrib><creatorcontrib>Zhang, Zheng</creatorcontrib><creatorcontrib>Huang, Minlie</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Zheng, Chujie</au><au>Sabour, Sahand</au><au>Wen, Jiaxin</au><au>Zhang, Zheng</au><au>Huang, Minlie</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversation</atitle><date>2022-02-25</date><risdate>2022</risdate><abstract>Crowdsourced dialogue corpora are usually limited in scale and topic coverage due to the expensive cost of data curation. This would hinder the generalization of downstream dialogue models to open-domain topics. In this work, we leverage large language models for dialogue augmentation in the task of emotional support conversation (ESC). By treating dialogue augmentation as a dialogue completion task, we prompt a fine-tuned language model to complete full dialogues from available dialogue posts of various topics, which are then postprocessed based on heuristics. Applying this approach, we construct AugESC, an augmented dataset for the ESC task, which largely extends the scale and topic coverage of the crowdsourced ESConv corpus. Through comprehensive human evaluation, we demonstrate that our approach is superior to strong baselines of dialogue augmentation and that AugESC has comparable dialogue quality to the crowdsourced corpus. We also conduct human interactive evaluation and prove that post-training on AugESC improves downstream dialogue models' generalization ability to open-domain topics. These results suggest the utility of AugESC and highlight the potential of large language models in improving data-scarce dialogue generation tasks.</abstract><doi>10.48550/arxiv.2202.13047</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2202.13047
ispartof
issn
language eng
recordid cdi_arxiv_primary_2202_13047
source arXiv.org
subjects Computer Science - Computation and Language
title AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversation
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T11%3A34%3A52IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=AugESC:%20Dialogue%20Augmentation%20with%20Large%20Language%20Models%20for%20Emotional%20Support%20Conversation&rft.au=Zheng,%20Chujie&rft.date=2022-02-25&rft_id=info:doi/10.48550/arxiv.2202.13047&rft_dat=%3Carxiv_GOX%3E2202_13047%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true