Incremental discovery of denial constraints
We investigate the problem of incremental denial constraint (DC) discovery, aiming at discovering DCs in response to a set ▵ r of tuple insertions to a given relational instance r and the known set Σ of DCs holding on r . The need for the study is evident since real-life data are often frequently up...
Gespeichert in:
Veröffentlicht in: | The VLDB journal 2023-11, Vol.32 (6), p.1289-1313 |
---|---|
Hauptverfasser: | , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 1313 |
---|---|
container_issue | 6 |
container_start_page | 1289 |
container_title | The VLDB journal |
container_volume | 32 |
creator | Qian, Chaoqin Li, Menglu Tan, Zijing Ran, Ai Ma, Shuai |
description | We investigate the problem of incremental denial constraint (DC) discovery, aiming at discovering DCs in response to a set
▵
r
of tuple insertions to a given relational instance
r
and the known set
Σ
of DCs holding on
r
. The need for the study is evident since real-life data are often frequently updated, and it is often prohibitively expensive to perform DC discovery from scratch for every update. We tackle this problem with two steps. We first employ indexing techniques to efficiently identify the
incremental evidences
caused by
▵
r
. We present algorithms to build indexes for
Σ
and
r
in the pre-processing step, and to visit and update indexes in response to
▵
r. In particular, we propose a novel indexing technique for two inequality comparisons possibly across the attributes of
r
. By leveraging the indexes, we can identify all the tuple pairs incurred by
▵
r that simultaneously satisfy the two comparisons, with a cost dependent on log(
|
r
|
). We then compute the changes
▵
Σ
to
Σ
based on the incremental evidences, such that
Σ
⊕
▵
Σ
is the set of DCs holding on
r
+
▵
r
.
▵
Σ
may contain new DCs that are added into
Σ
and obsolete DCs that are removed from
Σ
. Our experimental evaluations show that our incremental approach is faster than the two state-of-the-art batch DC discovery approaches that compute from scratch on
r
+
▵
r
by orders of magnitude, even when
▵
r
is up to 30% of
r
. |
doi_str_mv | 10.1007/s00778-023-00788-y |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2879581498</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2879581498</sourcerecordid><originalsourceid>FETCH-LOGICAL-c270t-b9237addbe05a88841f6a9aab2349aaafd4bc392f62efc2a04741a16a751f0df3</originalsourceid><addsrcrecordid>eNp9UE1LxDAQDaJgXf0DngoeJTpJ0yY5yuLHwoIXBW9hmibSZTddk67Qf2-0gjfnMG8Y3gc8Qi4Z3DAAeZvykooCr2i-lKLTESlAC02VlG_HpGDQNFTlOSVnKW0AgHNeF-R6FWx0OxdG3JZdn-zw6eJUDr7sXOjzzw4hjRH7MKZzcuJxm9zFLy7I68P9y_KJrp8fV8u7NbVcwkhbzSuJXdc6qDEnCuYb1Igtr0QG9J1obaW5b7jzliMIKRiyBmXNPHS-WpCr2Xcfh4-DS6PZDIcYcqThSupaMaFVZvGZZeOQUnTe7GO_wzgZBua7FDOXYnIp5qcUM2VRNYtSJod3F_-s_1F9AVdwZZs</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2879581498</pqid></control><display><type>article</type><title>Incremental discovery of denial constraints</title><source>ACM Digital Library</source><source>SpringerLink (Online service)</source><creator>Qian, Chaoqin ; Li, Menglu ; Tan, Zijing ; Ran, Ai ; Ma, Shuai</creator><creatorcontrib>Qian, Chaoqin ; Li, Menglu ; Tan, Zijing ; Ran, Ai ; Ma, Shuai</creatorcontrib><description>We investigate the problem of incremental denial constraint (DC) discovery, aiming at discovering DCs in response to a set
▵
r
of tuple insertions to a given relational instance
r
and the known set
Σ
of DCs holding on
r
. The need for the study is evident since real-life data are often frequently updated, and it is often prohibitively expensive to perform DC discovery from scratch for every update. We tackle this problem with two steps. We first employ indexing techniques to efficiently identify the
incremental evidences
caused by
▵
r
. We present algorithms to build indexes for
Σ
and
r
in the pre-processing step, and to visit and update indexes in response to
▵
r. In particular, we propose a novel indexing technique for two inequality comparisons possibly across the attributes of
r
. By leveraging the indexes, we can identify all the tuple pairs incurred by
▵
r that simultaneously satisfy the two comparisons, with a cost dependent on log(
|
r
|
). We then compute the changes
▵
Σ
to
Σ
based on the incremental evidences, such that
Σ
⊕
▵
Σ
is the set of DCs holding on
r
+
▵
r
.
▵
Σ
may contain new DCs that are added into
Σ
and obsolete DCs that are removed from
Σ
. Our experimental evaluations show that our incremental approach is faster than the two state-of-the-art batch DC discovery approaches that compute from scratch on
r
+
▵
r
by orders of magnitude, even when
▵
r
is up to 30% of
r
.</description><identifier>ISSN: 1066-8888</identifier><identifier>EISSN: 0949-877X</identifier><identifier>DOI: 10.1007/s00778-023-00788-y</identifier><language>eng</language><publisher>Berlin/Heidelberg: Springer Berlin Heidelberg</publisher><subject>Algorithms ; Computer Science ; Database Management ; Indexing ; Regular Paper</subject><ispartof>The VLDB journal, 2023-11, Vol.32 (6), p.1289-1313</ispartof><rights>The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.</rights><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c270t-b9237addbe05a88841f6a9aab2349aaafd4bc392f62efc2a04741a16a751f0df3</cites><orcidid>0000-0001-6332-780X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s00778-023-00788-y$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s00778-023-00788-y$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,776,780,27903,27904,41467,42536,51298</link.rule.ids></links><search><creatorcontrib>Qian, Chaoqin</creatorcontrib><creatorcontrib>Li, Menglu</creatorcontrib><creatorcontrib>Tan, Zijing</creatorcontrib><creatorcontrib>Ran, Ai</creatorcontrib><creatorcontrib>Ma, Shuai</creatorcontrib><title>Incremental discovery of denial constraints</title><title>The VLDB journal</title><addtitle>The VLDB Journal</addtitle><description>We investigate the problem of incremental denial constraint (DC) discovery, aiming at discovering DCs in response to a set
▵
r
of tuple insertions to a given relational instance
r
and the known set
Σ
of DCs holding on
r
. The need for the study is evident since real-life data are often frequently updated, and it is often prohibitively expensive to perform DC discovery from scratch for every update. We tackle this problem with two steps. We first employ indexing techniques to efficiently identify the
incremental evidences
caused by
▵
r
. We present algorithms to build indexes for
Σ
and
r
in the pre-processing step, and to visit and update indexes in response to
▵
r. In particular, we propose a novel indexing technique for two inequality comparisons possibly across the attributes of
r
. By leveraging the indexes, we can identify all the tuple pairs incurred by
▵
r that simultaneously satisfy the two comparisons, with a cost dependent on log(
|
r
|
). We then compute the changes
▵
Σ
to
Σ
based on the incremental evidences, such that
Σ
⊕
▵
Σ
is the set of DCs holding on
r
+
▵
r
.
▵
Σ
may contain new DCs that are added into
Σ
and obsolete DCs that are removed from
Σ
. Our experimental evaluations show that our incremental approach is faster than the two state-of-the-art batch DC discovery approaches that compute from scratch on
r
+
▵
r
by orders of magnitude, even when
▵
r
is up to 30% of
r
.</description><subject>Algorithms</subject><subject>Computer Science</subject><subject>Database Management</subject><subject>Indexing</subject><subject>Regular Paper</subject><issn>1066-8888</issn><issn>0949-877X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNp9UE1LxDAQDaJgXf0DngoeJTpJ0yY5yuLHwoIXBW9hmibSZTddk67Qf2-0gjfnMG8Y3gc8Qi4Z3DAAeZvykooCr2i-lKLTESlAC02VlG_HpGDQNFTlOSVnKW0AgHNeF-R6FWx0OxdG3JZdn-zw6eJUDr7sXOjzzw4hjRH7MKZzcuJxm9zFLy7I68P9y_KJrp8fV8u7NbVcwkhbzSuJXdc6qDEnCuYb1Igtr0QG9J1obaW5b7jzliMIKRiyBmXNPHS-WpCr2Xcfh4-DS6PZDIcYcqThSupaMaFVZvGZZeOQUnTe7GO_wzgZBua7FDOXYnIp5qcUM2VRNYtSJod3F_-s_1F9AVdwZZs</recordid><startdate>20231101</startdate><enddate>20231101</enddate><creator>Qian, Chaoqin</creator><creator>Li, Menglu</creator><creator>Tan, Zijing</creator><creator>Ran, Ai</creator><creator>Ma, Shuai</creator><general>Springer Berlin Heidelberg</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0001-6332-780X</orcidid></search><sort><creationdate>20231101</creationdate><title>Incremental discovery of denial constraints</title><author>Qian, Chaoqin ; Li, Menglu ; Tan, Zijing ; Ran, Ai ; Ma, Shuai</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c270t-b9237addbe05a88841f6a9aab2349aaafd4bc392f62efc2a04741a16a751f0df3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Algorithms</topic><topic>Computer Science</topic><topic>Database Management</topic><topic>Indexing</topic><topic>Regular Paper</topic><toplevel>online_resources</toplevel><creatorcontrib>Qian, Chaoqin</creatorcontrib><creatorcontrib>Li, Menglu</creatorcontrib><creatorcontrib>Tan, Zijing</creatorcontrib><creatorcontrib>Ran, Ai</creatorcontrib><creatorcontrib>Ma, Shuai</creatorcontrib><collection>CrossRef</collection><jtitle>The VLDB journal</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Qian, Chaoqin</au><au>Li, Menglu</au><au>Tan, Zijing</au><au>Ran, Ai</au><au>Ma, Shuai</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Incremental discovery of denial constraints</atitle><jtitle>The VLDB journal</jtitle><stitle>The VLDB Journal</stitle><date>2023-11-01</date><risdate>2023</risdate><volume>32</volume><issue>6</issue><spage>1289</spage><epage>1313</epage><pages>1289-1313</pages><issn>1066-8888</issn><eissn>0949-877X</eissn><abstract>We investigate the problem of incremental denial constraint (DC) discovery, aiming at discovering DCs in response to a set
▵
r
of tuple insertions to a given relational instance
r
and the known set
Σ
of DCs holding on
r
. The need for the study is evident since real-life data are often frequently updated, and it is often prohibitively expensive to perform DC discovery from scratch for every update. We tackle this problem with two steps. We first employ indexing techniques to efficiently identify the
incremental evidences
caused by
▵
r
. We present algorithms to build indexes for
Σ
and
r
in the pre-processing step, and to visit and update indexes in response to
▵
r. In particular, we propose a novel indexing technique for two inequality comparisons possibly across the attributes of
r
. By leveraging the indexes, we can identify all the tuple pairs incurred by
▵
r that simultaneously satisfy the two comparisons, with a cost dependent on log(
|
r
|
). We then compute the changes
▵
Σ
to
Σ
based on the incremental evidences, such that
Σ
⊕
▵
Σ
is the set of DCs holding on
r
+
▵
r
.
▵
Σ
may contain new DCs that are added into
Σ
and obsolete DCs that are removed from
Σ
. Our experimental evaluations show that our incremental approach is faster than the two state-of-the-art batch DC discovery approaches that compute from scratch on
r
+
▵
r
by orders of magnitude, even when
▵
r
is up to 30% of
r
.</abstract><cop>Berlin/Heidelberg</cop><pub>Springer Berlin Heidelberg</pub><doi>10.1007/s00778-023-00788-y</doi><tpages>25</tpages><orcidid>https://orcid.org/0000-0001-6332-780X</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1066-8888 |
ispartof | The VLDB journal, 2023-11, Vol.32 (6), p.1289-1313 |
issn | 1066-8888 0949-877X |
language | eng |
recordid | cdi_proquest_journals_2879581498 |
source | ACM Digital Library; SpringerLink (Online service) |
subjects | Algorithms Computer Science Database Management Indexing Regular Paper |
title | Incremental discovery of denial constraints |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-22T16%3A53%3A00IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Incremental%20discovery%20of%20denial%20constraints&rft.jtitle=The%20VLDB%20journal&rft.au=Qian,%20Chaoqin&rft.date=2023-11-01&rft.volume=32&rft.issue=6&rft.spage=1289&rft.epage=1313&rft.pages=1289-1313&rft.issn=1066-8888&rft.eissn=0949-877X&rft_id=info:doi/10.1007/s00778-023-00788-y&rft_dat=%3Cproquest_cross%3E2879581498%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2879581498&rft_id=info:pmid/&rfr_iscdi=true |