IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selection

The task of response selection in multi-turn dialogue is to find the best option from all candidates. In order to improve the reasoning ability of the model, previous studies pay more attention to using explicit algorithms to model the dependencies between utterances, which are deterministic, limite...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Deng, Jingcheng, Dai, Hengwei, Guo, Xuewei, Ju, Yuanchen, Peng, Wei
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Deng, Jingcheng
Dai, Hengwei
Guo, Xuewei
Ju, Yuanchen
Peng, Wei
description The task of response selection in multi-turn dialogue is to find the best option from all candidates. In order to improve the reasoning ability of the model, previous studies pay more attention to using explicit algorithms to model the dependencies between utterances, which are deterministic, limited and inflexible. In addition, few studies consider differences between the options before and after reasoning. In this paper, we propose an Implicit Relational Reasoning Graph Network to address these issues, which consists of the Utterance Relational Reasoner (URR) and the Option Dual Comparator (ODC). URR aims to implicitly extract dependencies between utterances, as well as utterances and options, and make reasoning with relational graph convolutional networks. ODC focuses on perceiving the difference between the options through dual comparison, which can eliminate the interference of the noise options. Experimental results on two multi-turn dialogue reasoning benchmark datasets MuTual and MuTual+ show that our method significantly improves the baseline of four pretrained language models and achieves state-of-the-art performance. The model surpasses human performance for the first time on the MuTual dataset.
doi_str_mv 10.48550/arxiv.2212.00482
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2212_00482</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2212_00482</sourcerecordid><originalsourceid>FETCH-LOGICAL-a672-95422c0af7a7a7ad41f9ac1c5a7883a45af7b9338fb005a5ebb5e83cf1fc06ad3</originalsourceid><addsrcrecordid>eNotj8tOwzAURL1hgQofwAr_QIKfjcOuqiBEaosUKrGMblwbLFwnclwef09S0CxmpJl7pYPQDSW5UFKSO4jf7jNnjLKcEKHYJXqtm6ba3eNVwPVx8E67hBvjIbk-gJ8ijH1w4Q1XEYZ3vDPpq48f2PYRb08-uSydYphm49CH0eAX442eb6_QhQU_mut_X6D948N-_ZRtnqt6vdpksCxYVkrBmCZgC5h1ENSWoKmWUCjFQcip6UrOle0IkSBN10mjuLbUarKEA1-g27-3Z7J2iO4I8aedCdszIf8FPWxMXA</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selection</title><source>arXiv.org</source><creator>Deng, Jingcheng ; Dai, Hengwei ; Guo, Xuewei ; Ju, Yuanchen ; Peng, Wei</creator><creatorcontrib>Deng, Jingcheng ; Dai, Hengwei ; Guo, Xuewei ; Ju, Yuanchen ; Peng, Wei</creatorcontrib><description>The task of response selection in multi-turn dialogue is to find the best option from all candidates. In order to improve the reasoning ability of the model, previous studies pay more attention to using explicit algorithms to model the dependencies between utterances, which are deterministic, limited and inflexible. In addition, few studies consider differences between the options before and after reasoning. In this paper, we propose an Implicit Relational Reasoning Graph Network to address these issues, which consists of the Utterance Relational Reasoner (URR) and the Option Dual Comparator (ODC). URR aims to implicitly extract dependencies between utterances, as well as utterances and options, and make reasoning with relational graph convolutional networks. ODC focuses on perceiving the difference between the options through dual comparison, which can eliminate the interference of the noise options. Experimental results on two multi-turn dialogue reasoning benchmark datasets MuTual and MuTual+ show that our method significantly improves the baseline of four pretrained language models and achieves state-of-the-art performance. The model surpasses human performance for the first time on the MuTual dataset.</description><identifier>DOI: 10.48550/arxiv.2212.00482</identifier><language>eng</language><subject>Computer Science - Computation and Language</subject><creationdate>2022-12</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,782,887</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2212.00482$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2212.00482$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Deng, Jingcheng</creatorcontrib><creatorcontrib>Dai, Hengwei</creatorcontrib><creatorcontrib>Guo, Xuewei</creatorcontrib><creatorcontrib>Ju, Yuanchen</creatorcontrib><creatorcontrib>Peng, Wei</creatorcontrib><title>IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selection</title><description>The task of response selection in multi-turn dialogue is to find the best option from all candidates. In order to improve the reasoning ability of the model, previous studies pay more attention to using explicit algorithms to model the dependencies between utterances, which are deterministic, limited and inflexible. In addition, few studies consider differences between the options before and after reasoning. In this paper, we propose an Implicit Relational Reasoning Graph Network to address these issues, which consists of the Utterance Relational Reasoner (URR) and the Option Dual Comparator (ODC). URR aims to implicitly extract dependencies between utterances, as well as utterances and options, and make reasoning with relational graph convolutional networks. ODC focuses on perceiving the difference between the options through dual comparison, which can eliminate the interference of the noise options. Experimental results on two multi-turn dialogue reasoning benchmark datasets MuTual and MuTual+ show that our method significantly improves the baseline of four pretrained language models and achieves state-of-the-art performance. The model surpasses human performance for the first time on the MuTual dataset.</description><subject>Computer Science - Computation and Language</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj8tOwzAURL1hgQofwAr_QIKfjcOuqiBEaosUKrGMblwbLFwnclwef09S0CxmpJl7pYPQDSW5UFKSO4jf7jNnjLKcEKHYJXqtm6ba3eNVwPVx8E67hBvjIbk-gJ8ijH1w4Q1XEYZ3vDPpq48f2PYRb08-uSydYphm49CH0eAX442eb6_QhQU_mut_X6D948N-_ZRtnqt6vdpksCxYVkrBmCZgC5h1ENSWoKmWUCjFQcip6UrOle0IkSBN10mjuLbUarKEA1-g27-3Z7J2iO4I8aedCdszIf8FPWxMXA</recordid><startdate>20221201</startdate><enddate>20221201</enddate><creator>Deng, Jingcheng</creator><creator>Dai, Hengwei</creator><creator>Guo, Xuewei</creator><creator>Ju, Yuanchen</creator><creator>Peng, Wei</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20221201</creationdate><title>IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selection</title><author>Deng, Jingcheng ; Dai, Hengwei ; Guo, Xuewei ; Ju, Yuanchen ; Peng, Wei</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a672-95422c0af7a7a7ad41f9ac1c5a7883a45af7b9338fb005a5ebb5e83cf1fc06ad3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Computer Science - Computation and Language</topic><toplevel>online_resources</toplevel><creatorcontrib>Deng, Jingcheng</creatorcontrib><creatorcontrib>Dai, Hengwei</creatorcontrib><creatorcontrib>Guo, Xuewei</creatorcontrib><creatorcontrib>Ju, Yuanchen</creatorcontrib><creatorcontrib>Peng, Wei</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Deng, Jingcheng</au><au>Dai, Hengwei</au><au>Guo, Xuewei</au><au>Ju, Yuanchen</au><au>Peng, Wei</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selection</atitle><date>2022-12-01</date><risdate>2022</risdate><abstract>The task of response selection in multi-turn dialogue is to find the best option from all candidates. In order to improve the reasoning ability of the model, previous studies pay more attention to using explicit algorithms to model the dependencies between utterances, which are deterministic, limited and inflexible. In addition, few studies consider differences between the options before and after reasoning. In this paper, we propose an Implicit Relational Reasoning Graph Network to address these issues, which consists of the Utterance Relational Reasoner (URR) and the Option Dual Comparator (ODC). URR aims to implicitly extract dependencies between utterances, as well as utterances and options, and make reasoning with relational graph convolutional networks. ODC focuses on perceiving the difference between the options through dual comparison, which can eliminate the interference of the noise options. Experimental results on two multi-turn dialogue reasoning benchmark datasets MuTual and MuTual+ show that our method significantly improves the baseline of four pretrained language models and achieves state-of-the-art performance. The model surpasses human performance for the first time on the MuTual dataset.</abstract><doi>10.48550/arxiv.2212.00482</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2212.00482
ispartof
issn
language eng
recordid cdi_arxiv_primary_2212_00482
source arXiv.org
subjects Computer Science - Computation and Language
title IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selection
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-04T17%3A07%3A20IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=IRRGN:%20An%20Implicit%20Relational%20Reasoning%20Graph%20Network%20for%20Multi-turn%20Response%20Selection&rft.au=Deng,%20Jingcheng&rft.date=2022-12-01&rft_id=info:doi/10.48550/arxiv.2212.00482&rft_dat=%3Carxiv_GOX%3E2212_00482%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true