AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversation
Crowdsourced dialogue corpora are usually limited in scale and topic coverage due to the expensive cost of data curation. This would hinder the generalization of downstream dialogue models to open-domain topics. In this work, we leverage large language models for dialogue augmentation in the task of...
Gespeichert in:
Hauptverfasser: | , , , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | |
container_volume | |
creator | Zheng, Chujie Sabour, Sahand Wen, Jiaxin Zhang, Zheng Huang, Minlie |
description | Crowdsourced dialogue corpora are usually limited in scale and topic coverage
due to the expensive cost of data curation. This would hinder the
generalization of downstream dialogue models to open-domain topics. In this
work, we leverage large language models for dialogue augmentation in the task
of emotional support conversation (ESC). By treating dialogue augmentation as a
dialogue completion task, we prompt a fine-tuned language model to complete
full dialogues from available dialogue posts of various topics, which are then
postprocessed based on heuristics. Applying this approach, we construct AugESC,
an augmented dataset for the ESC task, which largely extends the scale and
topic coverage of the crowdsourced ESConv corpus. Through comprehensive human
evaluation, we demonstrate that our approach is superior to strong baselines of
dialogue augmentation and that AugESC has comparable dialogue quality to the
crowdsourced corpus. We also conduct human interactive evaluation and prove
that post-training on AugESC improves downstream dialogue models'
generalization ability to open-domain topics. These results suggest the utility
of AugESC and highlight the potential of large language models in improving
data-scarce dialogue generation tasks. |
doi_str_mv | 10.48550/arxiv.2202.13047 |
format | Article |
fullrecord | <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2202_13047</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2202_13047</sourcerecordid><originalsourceid>FETCH-LOGICAL-a677-d01f9b493b73518b55de29f8804650d20758d26aa935c1e47841e66fe442f6183</originalsourceid><addsrcrecordid>eNotj81OhDAUhbtxYUYfwJV9AbD_Le4miD8JxsXMzgW52BZJgJICo769DLo55-Tk3Jt8CN1QkgojJbmD-N2eUsYISyknQl-i9_3SFIf8Hj-00IVmcXgtejfMMLdhwF_t_IlLiI1bdWgWWMNrsK6bsA8RF304z6DDh2UcQ5xxHoaTi9N2fYUuPHSTu_73HTo-Fsf8OSnfnl7yfZmA0jqxhPqsFhmvNZfU1FJaxzJvDBFKEsuIlsYyBZBx-UGd0EZQp5R3QjCvqOE7dPv3dqOrxtj2EH-qM2W1UfJfj7ZMZQ</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversation</title><source>arXiv.org</source><creator>Zheng, Chujie ; Sabour, Sahand ; Wen, Jiaxin ; Zhang, Zheng ; Huang, Minlie</creator><creatorcontrib>Zheng, Chujie ; Sabour, Sahand ; Wen, Jiaxin ; Zhang, Zheng ; Huang, Minlie</creatorcontrib><description>Crowdsourced dialogue corpora are usually limited in scale and topic coverage
due to the expensive cost of data curation. This would hinder the
generalization of downstream dialogue models to open-domain topics. In this
work, we leverage large language models for dialogue augmentation in the task
of emotional support conversation (ESC). By treating dialogue augmentation as a
dialogue completion task, we prompt a fine-tuned language model to complete
full dialogues from available dialogue posts of various topics, which are then
postprocessed based on heuristics. Applying this approach, we construct AugESC,
an augmented dataset for the ESC task, which largely extends the scale and
topic coverage of the crowdsourced ESConv corpus. Through comprehensive human
evaluation, we demonstrate that our approach is superior to strong baselines of
dialogue augmentation and that AugESC has comparable dialogue quality to the
crowdsourced corpus. We also conduct human interactive evaluation and prove
that post-training on AugESC improves downstream dialogue models'
generalization ability to open-domain topics. These results suggest the utility
of AugESC and highlight the potential of large language models in improving
data-scarce dialogue generation tasks.</description><identifier>DOI: 10.48550/arxiv.2202.13047</identifier><language>eng</language><subject>Computer Science - Computation and Language</subject><creationdate>2022-02</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2202.13047$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2202.13047$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Zheng, Chujie</creatorcontrib><creatorcontrib>Sabour, Sahand</creatorcontrib><creatorcontrib>Wen, Jiaxin</creatorcontrib><creatorcontrib>Zhang, Zheng</creatorcontrib><creatorcontrib>Huang, Minlie</creatorcontrib><title>AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversation</title><description>Crowdsourced dialogue corpora are usually limited in scale and topic coverage
due to the expensive cost of data curation. This would hinder the
generalization of downstream dialogue models to open-domain topics. In this
work, we leverage large language models for dialogue augmentation in the task
of emotional support conversation (ESC). By treating dialogue augmentation as a
dialogue completion task, we prompt a fine-tuned language model to complete
full dialogues from available dialogue posts of various topics, which are then
postprocessed based on heuristics. Applying this approach, we construct AugESC,
an augmented dataset for the ESC task, which largely extends the scale and
topic coverage of the crowdsourced ESConv corpus. Through comprehensive human
evaluation, we demonstrate that our approach is superior to strong baselines of
dialogue augmentation and that AugESC has comparable dialogue quality to the
crowdsourced corpus. We also conduct human interactive evaluation and prove
that post-training on AugESC improves downstream dialogue models'
generalization ability to open-domain topics. These results suggest the utility
of AugESC and highlight the potential of large language models in improving
data-scarce dialogue generation tasks.</description><subject>Computer Science - Computation and Language</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj81OhDAUhbtxYUYfwJV9AbD_Le4miD8JxsXMzgW52BZJgJICo769DLo55-Tk3Jt8CN1QkgojJbmD-N2eUsYISyknQl-i9_3SFIf8Hj-00IVmcXgtejfMMLdhwF_t_IlLiI1bdWgWWMNrsK6bsA8RF304z6DDh2UcQ5xxHoaTi9N2fYUuPHSTu_73HTo-Fsf8OSnfnl7yfZmA0jqxhPqsFhmvNZfU1FJaxzJvDBFKEsuIlsYyBZBx-UGd0EZQp5R3QjCvqOE7dPv3dqOrxtj2EH-qM2W1UfJfj7ZMZQ</recordid><startdate>20220225</startdate><enddate>20220225</enddate><creator>Zheng, Chujie</creator><creator>Sabour, Sahand</creator><creator>Wen, Jiaxin</creator><creator>Zhang, Zheng</creator><creator>Huang, Minlie</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20220225</creationdate><title>AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversation</title><author>Zheng, Chujie ; Sabour, Sahand ; Wen, Jiaxin ; Zhang, Zheng ; Huang, Minlie</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a677-d01f9b493b73518b55de29f8804650d20758d26aa935c1e47841e66fe442f6183</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Computer Science - Computation and Language</topic><toplevel>online_resources</toplevel><creatorcontrib>Zheng, Chujie</creatorcontrib><creatorcontrib>Sabour, Sahand</creatorcontrib><creatorcontrib>Wen, Jiaxin</creatorcontrib><creatorcontrib>Zhang, Zheng</creatorcontrib><creatorcontrib>Huang, Minlie</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Zheng, Chujie</au><au>Sabour, Sahand</au><au>Wen, Jiaxin</au><au>Zhang, Zheng</au><au>Huang, Minlie</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversation</atitle><date>2022-02-25</date><risdate>2022</risdate><abstract>Crowdsourced dialogue corpora are usually limited in scale and topic coverage
due to the expensive cost of data curation. This would hinder the
generalization of downstream dialogue models to open-domain topics. In this
work, we leverage large language models for dialogue augmentation in the task
of emotional support conversation (ESC). By treating dialogue augmentation as a
dialogue completion task, we prompt a fine-tuned language model to complete
full dialogues from available dialogue posts of various topics, which are then
postprocessed based on heuristics. Applying this approach, we construct AugESC,
an augmented dataset for the ESC task, which largely extends the scale and
topic coverage of the crowdsourced ESConv corpus. Through comprehensive human
evaluation, we demonstrate that our approach is superior to strong baselines of
dialogue augmentation and that AugESC has comparable dialogue quality to the
crowdsourced corpus. We also conduct human interactive evaluation and prove
that post-training on AugESC improves downstream dialogue models'
generalization ability to open-domain topics. These results suggest the utility
of AugESC and highlight the potential of large language models in improving
data-scarce dialogue generation tasks.</abstract><doi>10.48550/arxiv.2202.13047</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | DOI: 10.48550/arxiv.2202.13047 |
ispartof | |
issn | |
language | eng |
recordid | cdi_arxiv_primary_2202_13047 |
source | arXiv.org |
subjects | Computer Science - Computation and Language |
title | AugESC: Dialogue Augmentation with Large Language Models for Emotional Support Conversation |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T11%3A34%3A52IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=AugESC:%20Dialogue%20Augmentation%20with%20Large%20Language%20Models%20for%20Emotional%20Support%20Conversation&rft.au=Zheng,%20Chujie&rft.date=2022-02-25&rft_id=info:doi/10.48550/arxiv.2202.13047&rft_dat=%3Carxiv_GOX%3E2202_13047%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |