Monitoring of Domain-Related Problems in Distributed Data Streams

Consider a network in which $n$ distributed nodes are connected to a single server. Each node continuously observes a data stream consisting of one value per discrete time step. The server has to continuously monitor a given parameter defined over all information available at the distributed nodes....

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Bemmann, Pascal, Biermeier, Felix, Bürmann, Jan, Kemper, Arne, Knollmann, Till, Knorr, Steffen, Kothe, Nils, Mäcker, Alexander, Malatyali, Manuel, der Heide, Friedhelm Meyer auf, Riechers, Sören, Schaefer, Johannes, Sundermeier, Jannik
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Bemmann, Pascal
Biermeier, Felix
Bürmann, Jan
Kemper, Arne
Knollmann, Till
Knorr, Steffen
Kothe, Nils
Mäcker, Alexander
Malatyali, Manuel
der Heide, Friedhelm Meyer auf
Riechers, Sören
Schaefer, Johannes
Sundermeier, Jannik
description Consider a network in which $n$ distributed nodes are connected to a single server. Each node continuously observes a data stream consisting of one value per discrete time step. The server has to continuously monitor a given parameter defined over all information available at the distributed nodes. That is, in any time step $t$, it has to compute an output based on all values currently observed across all streams. To do so, nodes can send messages to the server and the server can broadcast messages to the nodes. The objective is the minimisation of communication while allowing the server to compute the desired output. We consider monitoring problems related to the domain $D_t$ defined to be the set of values observed by at least one node at time $t$. We provide randomised algorithms for monitoring $D_t$, (approximations of) the size $|D_t|$ and the frequencies of all members of $D_t$. Besides worst-case bounds, we also obtain improved results when inputs are parameterised according to the similarity of observations between consecutive time steps. This parameterisation allows to exclude inputs with rapid and heavy changes, which usually lead to the worst-case bounds but might be rather artificial in certain scenarios.
doi_str_mv 10.48550/arxiv.1706.03568
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_1706_03568</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1706_03568</sourcerecordid><originalsourceid>FETCH-LOGICAL-a678-99c9210c061187657a366465783196ccccefedd82bd3c192d74a698474d40a533</originalsourceid><addsrcrecordid>eNotj7FOwzAURb10QIUPYKp_IMGO7Wd7rBqglYpAtHv0EjvIUhJXjkHw97SFuxzpDkc6hNxzVkqjFHvA9B2-Sq4ZlEwoMDdk_RKnkGMK0weNPa3jiGEq3v2A2Tv6lmI7-HGmYaJ1mHMK7eflrzEjPeTkcZxvyaLHYfZ3_1yS49PjcbMt9q_Pu816XyBoU1jb2YqzjgHnRoPSKADkmUZwC915vvfOmap1ouO2cloiWCO1dJKhEmJJVn_aa0NzSmHE9NNcWppri_gF_lNDFQ</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Monitoring of Domain-Related Problems in Distributed Data Streams</title><source>arXiv.org</source><creator>Bemmann, Pascal ; Biermeier, Felix ; Bürmann, Jan ; Kemper, Arne ; Knollmann, Till ; Knorr, Steffen ; Kothe, Nils ; Mäcker, Alexander ; Malatyali, Manuel ; der Heide, Friedhelm Meyer auf ; Riechers, Sören ; Schaefer, Johannes ; Sundermeier, Jannik</creator><creatorcontrib>Bemmann, Pascal ; Biermeier, Felix ; Bürmann, Jan ; Kemper, Arne ; Knollmann, Till ; Knorr, Steffen ; Kothe, Nils ; Mäcker, Alexander ; Malatyali, Manuel ; der Heide, Friedhelm Meyer auf ; Riechers, Sören ; Schaefer, Johannes ; Sundermeier, Jannik</creatorcontrib><description>Consider a network in which $n$ distributed nodes are connected to a single server. Each node continuously observes a data stream consisting of one value per discrete time step. The server has to continuously monitor a given parameter defined over all information available at the distributed nodes. That is, in any time step $t$, it has to compute an output based on all values currently observed across all streams. To do so, nodes can send messages to the server and the server can broadcast messages to the nodes. The objective is the minimisation of communication while allowing the server to compute the desired output. We consider monitoring problems related to the domain $D_t$ defined to be the set of values observed by at least one node at time $t$. We provide randomised algorithms for monitoring $D_t$, (approximations of) the size $|D_t|$ and the frequencies of all members of $D_t$. Besides worst-case bounds, we also obtain improved results when inputs are parameterised according to the similarity of observations between consecutive time steps. This parameterisation allows to exclude inputs with rapid and heavy changes, which usually lead to the worst-case bounds but might be rather artificial in certain scenarios.</description><identifier>DOI: 10.48550/arxiv.1706.03568</identifier><language>eng</language><subject>Computer Science - Data Structures and Algorithms</subject><creationdate>2017-06</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/1706.03568$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.1706.03568$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Bemmann, Pascal</creatorcontrib><creatorcontrib>Biermeier, Felix</creatorcontrib><creatorcontrib>Bürmann, Jan</creatorcontrib><creatorcontrib>Kemper, Arne</creatorcontrib><creatorcontrib>Knollmann, Till</creatorcontrib><creatorcontrib>Knorr, Steffen</creatorcontrib><creatorcontrib>Kothe, Nils</creatorcontrib><creatorcontrib>Mäcker, Alexander</creatorcontrib><creatorcontrib>Malatyali, Manuel</creatorcontrib><creatorcontrib>der Heide, Friedhelm Meyer auf</creatorcontrib><creatorcontrib>Riechers, Sören</creatorcontrib><creatorcontrib>Schaefer, Johannes</creatorcontrib><creatorcontrib>Sundermeier, Jannik</creatorcontrib><title>Monitoring of Domain-Related Problems in Distributed Data Streams</title><description>Consider a network in which $n$ distributed nodes are connected to a single server. Each node continuously observes a data stream consisting of one value per discrete time step. The server has to continuously monitor a given parameter defined over all information available at the distributed nodes. That is, in any time step $t$, it has to compute an output based on all values currently observed across all streams. To do so, nodes can send messages to the server and the server can broadcast messages to the nodes. The objective is the minimisation of communication while allowing the server to compute the desired output. We consider monitoring problems related to the domain $D_t$ defined to be the set of values observed by at least one node at time $t$. We provide randomised algorithms for monitoring $D_t$, (approximations of) the size $|D_t|$ and the frequencies of all members of $D_t$. Besides worst-case bounds, we also obtain improved results when inputs are parameterised according to the similarity of observations between consecutive time steps. This parameterisation allows to exclude inputs with rapid and heavy changes, which usually lead to the worst-case bounds but might be rather artificial in certain scenarios.</description><subject>Computer Science - Data Structures and Algorithms</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2017</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj7FOwzAURb10QIUPYKp_IMGO7Wd7rBqglYpAtHv0EjvIUhJXjkHw97SFuxzpDkc6hNxzVkqjFHvA9B2-Sq4ZlEwoMDdk_RKnkGMK0weNPa3jiGEq3v2A2Tv6lmI7-HGmYaJ1mHMK7eflrzEjPeTkcZxvyaLHYfZ3_1yS49PjcbMt9q_Pu816XyBoU1jb2YqzjgHnRoPSKADkmUZwC915vvfOmap1ouO2cloiWCO1dJKhEmJJVn_aa0NzSmHE9NNcWppri_gF_lNDFQ</recordid><startdate>20170612</startdate><enddate>20170612</enddate><creator>Bemmann, Pascal</creator><creator>Biermeier, Felix</creator><creator>Bürmann, Jan</creator><creator>Kemper, Arne</creator><creator>Knollmann, Till</creator><creator>Knorr, Steffen</creator><creator>Kothe, Nils</creator><creator>Mäcker, Alexander</creator><creator>Malatyali, Manuel</creator><creator>der Heide, Friedhelm Meyer auf</creator><creator>Riechers, Sören</creator><creator>Schaefer, Johannes</creator><creator>Sundermeier, Jannik</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20170612</creationdate><title>Monitoring of Domain-Related Problems in Distributed Data Streams</title><author>Bemmann, Pascal ; Biermeier, Felix ; Bürmann, Jan ; Kemper, Arne ; Knollmann, Till ; Knorr, Steffen ; Kothe, Nils ; Mäcker, Alexander ; Malatyali, Manuel ; der Heide, Friedhelm Meyer auf ; Riechers, Sören ; Schaefer, Johannes ; Sundermeier, Jannik</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a678-99c9210c061187657a366465783196ccccefedd82bd3c192d74a698474d40a533</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2017</creationdate><topic>Computer Science - Data Structures and Algorithms</topic><toplevel>online_resources</toplevel><creatorcontrib>Bemmann, Pascal</creatorcontrib><creatorcontrib>Biermeier, Felix</creatorcontrib><creatorcontrib>Bürmann, Jan</creatorcontrib><creatorcontrib>Kemper, Arne</creatorcontrib><creatorcontrib>Knollmann, Till</creatorcontrib><creatorcontrib>Knorr, Steffen</creatorcontrib><creatorcontrib>Kothe, Nils</creatorcontrib><creatorcontrib>Mäcker, Alexander</creatorcontrib><creatorcontrib>Malatyali, Manuel</creatorcontrib><creatorcontrib>der Heide, Friedhelm Meyer auf</creatorcontrib><creatorcontrib>Riechers, Sören</creatorcontrib><creatorcontrib>Schaefer, Johannes</creatorcontrib><creatorcontrib>Sundermeier, Jannik</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Bemmann, Pascal</au><au>Biermeier, Felix</au><au>Bürmann, Jan</au><au>Kemper, Arne</au><au>Knollmann, Till</au><au>Knorr, Steffen</au><au>Kothe, Nils</au><au>Mäcker, Alexander</au><au>Malatyali, Manuel</au><au>der Heide, Friedhelm Meyer auf</au><au>Riechers, Sören</au><au>Schaefer, Johannes</au><au>Sundermeier, Jannik</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Monitoring of Domain-Related Problems in Distributed Data Streams</atitle><date>2017-06-12</date><risdate>2017</risdate><abstract>Consider a network in which $n$ distributed nodes are connected to a single server. Each node continuously observes a data stream consisting of one value per discrete time step. The server has to continuously monitor a given parameter defined over all information available at the distributed nodes. That is, in any time step $t$, it has to compute an output based on all values currently observed across all streams. To do so, nodes can send messages to the server and the server can broadcast messages to the nodes. The objective is the minimisation of communication while allowing the server to compute the desired output. We consider monitoring problems related to the domain $D_t$ defined to be the set of values observed by at least one node at time $t$. We provide randomised algorithms for monitoring $D_t$, (approximations of) the size $|D_t|$ and the frequencies of all members of $D_t$. Besides worst-case bounds, we also obtain improved results when inputs are parameterised according to the similarity of observations between consecutive time steps. This parameterisation allows to exclude inputs with rapid and heavy changes, which usually lead to the worst-case bounds but might be rather artificial in certain scenarios.</abstract><doi>10.48550/arxiv.1706.03568</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.1706.03568
ispartof
issn
language eng
recordid cdi_arxiv_primary_1706_03568
source arXiv.org
subjects Computer Science - Data Structures and Algorithms
title Monitoring of Domain-Related Problems in Distributed Data Streams
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-19T19%3A14%3A57IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Monitoring%20of%20Domain-Related%20Problems%20in%20Distributed%20Data%20Streams&rft.au=Bemmann,%20Pascal&rft.date=2017-06-12&rft_id=info:doi/10.48550/arxiv.1706.03568&rft_dat=%3Carxiv_GOX%3E1706_03568%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true