Domain Adaptation of Machine Translation with Crowdworkers

Although a machine translation model trained with a large in-domain parallel corpus achieves remarkable results, it still works poorly when no in-domain data are available. This situation restricts the applicability of machine translation when the target domain's data are limited. However, ther...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Morishita, Makoto, Suzuki, Jun, Nagata, Masaaki
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Morishita, Makoto
Suzuki, Jun
Nagata, Masaaki
description Although a machine translation model trained with a large in-domain parallel corpus achieves remarkable results, it still works poorly when no in-domain data are available. This situation restricts the applicability of machine translation when the target domain's data are limited. However, there is great demand for high-quality domain-specific machine translation models for many domains. We propose a framework that efficiently and effectively collects parallel sentences in a target domain from the web with the help of crowdworkers. With the collected parallel data, we can quickly adapt a machine translation model to the target domain. Our experiments show that the proposed method can collect target-domain parallel data over a few days at a reasonable cost. We tested it with five domains, and the domain-adapted model improved the BLEU scores to +19.7 by an average of +7.8 points compared to a general-purpose translation model.
doi_str_mv 10.48550/arxiv.2210.15861
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2210_15861</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2210_15861</sourcerecordid><originalsourceid>FETCH-LOGICAL-a671-fcc876d2b2a5618d2fad922fc6229968e64176793a54e200c363210216b71bcc3</originalsourceid><addsrcrecordid>eNotj71OwzAURr0woMIDMOEXSImv42unWxV-pVYs2aMb_6hW27hyIgJvT2mZPukMn85h7EGUy8ooVT5R_o5fS4AzEMqguGWr53SkOPC1o9NEU0wDT4Fvye7i4HmbaRgPVzzHacebnGY3p7z3ebxjN4EOo7__3wVrX1_a5r3YfL59NOtNQahFEaw1Gh30QAqFcRDI1QDBIkBdo_FYCY26lqQqD2VpJcqzHwjsteitlQv2eL29yHenHI-Uf7q_iO4SIX8BIPNA7Q</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Domain Adaptation of Machine Translation with Crowdworkers</title><source>arXiv.org</source><creator>Morishita, Makoto ; Suzuki, Jun ; Nagata, Masaaki</creator><creatorcontrib>Morishita, Makoto ; Suzuki, Jun ; Nagata, Masaaki</creatorcontrib><description>Although a machine translation model trained with a large in-domain parallel corpus achieves remarkable results, it still works poorly when no in-domain data are available. This situation restricts the applicability of machine translation when the target domain's data are limited. However, there is great demand for high-quality domain-specific machine translation models for many domains. We propose a framework that efficiently and effectively collects parallel sentences in a target domain from the web with the help of crowdworkers. With the collected parallel data, we can quickly adapt a machine translation model to the target domain. Our experiments show that the proposed method can collect target-domain parallel data over a few days at a reasonable cost. We tested it with five domains, and the domain-adapted model improved the BLEU scores to +19.7 by an average of +7.8 points compared to a general-purpose translation model.</description><identifier>DOI: 10.48550/arxiv.2210.15861</identifier><language>eng</language><subject>Computer Science - Computation and Language</subject><creationdate>2022-10</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2210.15861$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2210.15861$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Morishita, Makoto</creatorcontrib><creatorcontrib>Suzuki, Jun</creatorcontrib><creatorcontrib>Nagata, Masaaki</creatorcontrib><title>Domain Adaptation of Machine Translation with Crowdworkers</title><description>Although a machine translation model trained with a large in-domain parallel corpus achieves remarkable results, it still works poorly when no in-domain data are available. This situation restricts the applicability of machine translation when the target domain's data are limited. However, there is great demand for high-quality domain-specific machine translation models for many domains. We propose a framework that efficiently and effectively collects parallel sentences in a target domain from the web with the help of crowdworkers. With the collected parallel data, we can quickly adapt a machine translation model to the target domain. Our experiments show that the proposed method can collect target-domain parallel data over a few days at a reasonable cost. We tested it with five domains, and the domain-adapted model improved the BLEU scores to +19.7 by an average of +7.8 points compared to a general-purpose translation model.</description><subject>Computer Science - Computation and Language</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj71OwzAURr0woMIDMOEXSImv42unWxV-pVYs2aMb_6hW27hyIgJvT2mZPukMn85h7EGUy8ooVT5R_o5fS4AzEMqguGWr53SkOPC1o9NEU0wDT4Fvye7i4HmbaRgPVzzHacebnGY3p7z3ebxjN4EOo7__3wVrX1_a5r3YfL59NOtNQahFEaw1Gh30QAqFcRDI1QDBIkBdo_FYCY26lqQqD2VpJcqzHwjsteitlQv2eL29yHenHI-Uf7q_iO4SIX8BIPNA7Q</recordid><startdate>20221027</startdate><enddate>20221027</enddate><creator>Morishita, Makoto</creator><creator>Suzuki, Jun</creator><creator>Nagata, Masaaki</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20221027</creationdate><title>Domain Adaptation of Machine Translation with Crowdworkers</title><author>Morishita, Makoto ; Suzuki, Jun ; Nagata, Masaaki</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a671-fcc876d2b2a5618d2fad922fc6229968e64176793a54e200c363210216b71bcc3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Computer Science - Computation and Language</topic><toplevel>online_resources</toplevel><creatorcontrib>Morishita, Makoto</creatorcontrib><creatorcontrib>Suzuki, Jun</creatorcontrib><creatorcontrib>Nagata, Masaaki</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Morishita, Makoto</au><au>Suzuki, Jun</au><au>Nagata, Masaaki</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Domain Adaptation of Machine Translation with Crowdworkers</atitle><date>2022-10-27</date><risdate>2022</risdate><abstract>Although a machine translation model trained with a large in-domain parallel corpus achieves remarkable results, it still works poorly when no in-domain data are available. This situation restricts the applicability of machine translation when the target domain's data are limited. However, there is great demand for high-quality domain-specific machine translation models for many domains. We propose a framework that efficiently and effectively collects parallel sentences in a target domain from the web with the help of crowdworkers. With the collected parallel data, we can quickly adapt a machine translation model to the target domain. Our experiments show that the proposed method can collect target-domain parallel data over a few days at a reasonable cost. We tested it with five domains, and the domain-adapted model improved the BLEU scores to +19.7 by an average of +7.8 points compared to a general-purpose translation model.</abstract><doi>10.48550/arxiv.2210.15861</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2210.15861
ispartof
issn
language eng
recordid cdi_arxiv_primary_2210_15861
source arXiv.org
subjects Computer Science - Computation and Language
title Domain Adaptation of Machine Translation with Crowdworkers
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-07T19%3A45%3A49IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Domain%20Adaptation%20of%20Machine%20Translation%20with%20Crowdworkers&rft.au=Morishita,%20Makoto&rft.date=2022-10-27&rft_id=info:doi/10.48550/arxiv.2210.15861&rft_dat=%3Carxiv_GOX%3E2210_15861%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true