From Data Fusion to Knowledge Fusion

The task of {\em data fusion} is to identify the true values of data items (eg, the true date of birth for {\em Tom Cruise}) among multiple observed values drawn from different sources (eg, Web sites) of varying (and unknown) reliability. A recent survey\cite{LDL+12} has provided a detailed comparis...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Dong, Xin Luna, Gabrilovich, Evgeniy, Heitz, Geremy, Horn, Wilko, Murphy, Kevin, Sun, Shaohua, Zhang, Wei
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Dong, Xin Luna
Gabrilovich, Evgeniy
Heitz, Geremy
Horn, Wilko
Murphy, Kevin
Sun, Shaohua
Zhang, Wei
description The task of {\em data fusion} is to identify the true values of data items (eg, the true date of birth for {\em Tom Cruise}) among multiple observed values drawn from different sources (eg, Web sites) of varying (and unknown) reliability. A recent survey\cite{LDL+12} has provided a detailed comparison of various fusion methods on Deep Web data. In this paper, we study the applicability and limitations of different fusion techniques on a more challenging problem: {\em knowledge fusion}. Knowledge fusion identifies true subject-predicate-object triples extracted by multiple information extractors from multiple information sources. These extractors perform the tasks of entity linkage and schema alignment, thus introducing an additional source of noise that is quite different from that traditionally considered in the data fusion literature, which only focuses on factual errors in the original sources. We adapt state-of-the-art data fusion techniques and apply them to a knowledge base with 1.6B unique knowledge triples extracted by 12 extractors from over 1B Web pages, which is three orders of magnitude larger than the data sets used in previous data fusion papers. We show great promise of the data fusion approaches in solving the knowledge fusion problem, and suggest interesting research directions through a detailed error analysis of the methods.
doi_str_mv 10.48550/arxiv.1503.00302
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_1503_00302</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1503_00302</sourcerecordid><originalsourceid>FETCH-LOGICAL-a672-a27581b6a9c8c90f9f91dda054c9af12c482f92fccb2d2e4f7dcf101a290a2f83</originalsourceid><addsrcrecordid>eNotzrsOgkAQheFtLIz6AFZS2IKzAwu7pVFRI4mNPRl2GUOiYvD-9kakOslfnHxCjCUEkVYKZtS8q2cgFYQBQAjYF9O0qc_eku7kpY9bVV-8e-3tLvXrVLpj2bWh6DGdbuWo24E4pKvDYuNn-_V2Mc98ihP0CROlZRGTsdoaYMNGOkegImuIJdpIIxtkawt0WEacOMsSJKEBQtbhQEz-ty0zvzbVmZpP_uPmLTf8An21OV4</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>From Data Fusion to Knowledge Fusion</title><source>arXiv.org</source><creator>Dong, Xin Luna ; Gabrilovich, Evgeniy ; Heitz, Geremy ; Horn, Wilko ; Murphy, Kevin ; Sun, Shaohua ; Zhang, Wei</creator><creatorcontrib>Dong, Xin Luna ; Gabrilovich, Evgeniy ; Heitz, Geremy ; Horn, Wilko ; Murphy, Kevin ; Sun, Shaohua ; Zhang, Wei</creatorcontrib><description>The task of {\em data fusion} is to identify the true values of data items (eg, the true date of birth for {\em Tom Cruise}) among multiple observed values drawn from different sources (eg, Web sites) of varying (and unknown) reliability. A recent survey\cite{LDL+12} has provided a detailed comparison of various fusion methods on Deep Web data. In this paper, we study the applicability and limitations of different fusion techniques on a more challenging problem: {\em knowledge fusion}. Knowledge fusion identifies true subject-predicate-object triples extracted by multiple information extractors from multiple information sources. These extractors perform the tasks of entity linkage and schema alignment, thus introducing an additional source of noise that is quite different from that traditionally considered in the data fusion literature, which only focuses on factual errors in the original sources. We adapt state-of-the-art data fusion techniques and apply them to a knowledge base with 1.6B unique knowledge triples extracted by 12 extractors from over 1B Web pages, which is three orders of magnitude larger than the data sets used in previous data fusion papers. We show great promise of the data fusion approaches in solving the knowledge fusion problem, and suggest interesting research directions through a detailed error analysis of the methods.</description><identifier>DOI: 10.48550/arxiv.1503.00302</identifier><language>eng</language><subject>Computer Science - Databases</subject><creationdate>2015-03</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,881</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/1503.00302$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.1503.00302$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Dong, Xin Luna</creatorcontrib><creatorcontrib>Gabrilovich, Evgeniy</creatorcontrib><creatorcontrib>Heitz, Geremy</creatorcontrib><creatorcontrib>Horn, Wilko</creatorcontrib><creatorcontrib>Murphy, Kevin</creatorcontrib><creatorcontrib>Sun, Shaohua</creatorcontrib><creatorcontrib>Zhang, Wei</creatorcontrib><title>From Data Fusion to Knowledge Fusion</title><description>The task of {\em data fusion} is to identify the true values of data items (eg, the true date of birth for {\em Tom Cruise}) among multiple observed values drawn from different sources (eg, Web sites) of varying (and unknown) reliability. A recent survey\cite{LDL+12} has provided a detailed comparison of various fusion methods on Deep Web data. In this paper, we study the applicability and limitations of different fusion techniques on a more challenging problem: {\em knowledge fusion}. Knowledge fusion identifies true subject-predicate-object triples extracted by multiple information extractors from multiple information sources. These extractors perform the tasks of entity linkage and schema alignment, thus introducing an additional source of noise that is quite different from that traditionally considered in the data fusion literature, which only focuses on factual errors in the original sources. We adapt state-of-the-art data fusion techniques and apply them to a knowledge base with 1.6B unique knowledge triples extracted by 12 extractors from over 1B Web pages, which is three orders of magnitude larger than the data sets used in previous data fusion papers. We show great promise of the data fusion approaches in solving the knowledge fusion problem, and suggest interesting research directions through a detailed error analysis of the methods.</description><subject>Computer Science - Databases</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2015</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotzrsOgkAQheFtLIz6AFZS2IKzAwu7pVFRI4mNPRl2GUOiYvD-9kakOslfnHxCjCUEkVYKZtS8q2cgFYQBQAjYF9O0qc_eku7kpY9bVV-8e-3tLvXrVLpj2bWh6DGdbuWo24E4pKvDYuNn-_V2Mc98ihP0CROlZRGTsdoaYMNGOkegImuIJdpIIxtkawt0WEacOMsSJKEBQtbhQEz-ty0zvzbVmZpP_uPmLTf8An21OV4</recordid><startdate>20150301</startdate><enddate>20150301</enddate><creator>Dong, Xin Luna</creator><creator>Gabrilovich, Evgeniy</creator><creator>Heitz, Geremy</creator><creator>Horn, Wilko</creator><creator>Murphy, Kevin</creator><creator>Sun, Shaohua</creator><creator>Zhang, Wei</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20150301</creationdate><title>From Data Fusion to Knowledge Fusion</title><author>Dong, Xin Luna ; Gabrilovich, Evgeniy ; Heitz, Geremy ; Horn, Wilko ; Murphy, Kevin ; Sun, Shaohua ; Zhang, Wei</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a672-a27581b6a9c8c90f9f91dda054c9af12c482f92fccb2d2e4f7dcf101a290a2f83</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2015</creationdate><topic>Computer Science - Databases</topic><toplevel>online_resources</toplevel><creatorcontrib>Dong, Xin Luna</creatorcontrib><creatorcontrib>Gabrilovich, Evgeniy</creatorcontrib><creatorcontrib>Heitz, Geremy</creatorcontrib><creatorcontrib>Horn, Wilko</creatorcontrib><creatorcontrib>Murphy, Kevin</creatorcontrib><creatorcontrib>Sun, Shaohua</creatorcontrib><creatorcontrib>Zhang, Wei</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Dong, Xin Luna</au><au>Gabrilovich, Evgeniy</au><au>Heitz, Geremy</au><au>Horn, Wilko</au><au>Murphy, Kevin</au><au>Sun, Shaohua</au><au>Zhang, Wei</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>From Data Fusion to Knowledge Fusion</atitle><date>2015-03-01</date><risdate>2015</risdate><abstract>The task of {\em data fusion} is to identify the true values of data items (eg, the true date of birth for {\em Tom Cruise}) among multiple observed values drawn from different sources (eg, Web sites) of varying (and unknown) reliability. A recent survey\cite{LDL+12} has provided a detailed comparison of various fusion methods on Deep Web data. In this paper, we study the applicability and limitations of different fusion techniques on a more challenging problem: {\em knowledge fusion}. Knowledge fusion identifies true subject-predicate-object triples extracted by multiple information extractors from multiple information sources. These extractors perform the tasks of entity linkage and schema alignment, thus introducing an additional source of noise that is quite different from that traditionally considered in the data fusion literature, which only focuses on factual errors in the original sources. We adapt state-of-the-art data fusion techniques and apply them to a knowledge base with 1.6B unique knowledge triples extracted by 12 extractors from over 1B Web pages, which is three orders of magnitude larger than the data sets used in previous data fusion papers. We show great promise of the data fusion approaches in solving the knowledge fusion problem, and suggest interesting research directions through a detailed error analysis of the methods.</abstract><doi>10.48550/arxiv.1503.00302</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.1503.00302
ispartof
issn
language eng
recordid cdi_arxiv_primary_1503_00302
source arXiv.org
subjects Computer Science - Databases
title From Data Fusion to Knowledge Fusion
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-08T16%3A31%3A23IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=From%20Data%20Fusion%20to%20Knowledge%20Fusion&rft.au=Dong,%20Xin%20Luna&rft.date=2015-03-01&rft_id=info:doi/10.48550/arxiv.1503.00302&rft_dat=%3Carxiv_GOX%3E1503_00302%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true