Transitioning between historical and real time data streams in the processing of data change messages

Provided are techniques for data stream switching. While accepting data change messages from a historical data stream, in response to determining that the end of the historical data stream is approaching, consumption from a real time data stream is resumed. In accepting data change messages from one...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Cadarette, Paul Michael, Kirk, Lawrence E, Love, Robert Daniel, Upton, Gregg Andrew, Varkhedi, Anil Venkatesh, Weigel, III, Charles Joseph
Format: Patent
Sprache:eng
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Cadarette, Paul Michael
Kirk, Lawrence E
Love, Robert Daniel
Upton, Gregg Andrew
Varkhedi, Anil Venkatesh
Weigel, III, Charles Joseph
description Provided are techniques for data stream switching. While accepting data change messages from a historical data stream, in response to determining that the end of the historical data stream is approaching, consumption from a real time data stream is resumed. In accepting data change messages from one of a historical data stream and a real time data stream, a data change message identifier (DCMID) for a data change message is obtained. Then, it is determined whether the data change message is from the real time data stream. In response to determining that the data change message is from the real time data stream, the DCMID is processed against a historical data structure to determine whether the related data change message has been seen in the historical data stream. In response to determining that the data change message is from the historical data stream, the DCMID is processed against a real time data structure to determine whether the related data change message has been seen in the real time data stream. It is determined whether a threshold for a number of DCMIDs that correspond to each other in the real time data stream and the historical data stream has been met. In response to determining that the threshold has been met, there is a switch from capturing data change messages in the historical data stream to capturing data change messages in the real time data stream.
format Patent
fullrecord <record><control><sourceid>uspatents_EFH</sourceid><recordid>TN_cdi_uspatents_grants_07827299</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>07827299</sourcerecordid><originalsourceid>FETCH-uspatents_grants_078272993</originalsourceid><addsrcrecordid>eNqNjkEKwkAQBHPxIOof5gOCxEPMWRQfkLuMm85mIJkNOyN-3xV9gKduimrodYUus5q4JBWN9IC_AKVRzFOWwBOx9pRRissM6tmZzAuYjUTJR9CSU4DZZ5-GrxFG1giaC-YI21argSfD7pebiq6X7nzbP21hh7rdY_lR4tCc6qZu2-MfyhvxH0A4</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>Transitioning between historical and real time data streams in the processing of data change messages</title><source>USPTO Issued Patents</source><creator>Cadarette, Paul Michael ; Kirk, Lawrence E ; Love, Robert Daniel ; Upton, Gregg Andrew ; Varkhedi, Anil Venkatesh ; Weigel, III, Charles Joseph</creator><creatorcontrib>Cadarette, Paul Michael ; Kirk, Lawrence E ; Love, Robert Daniel ; Upton, Gregg Andrew ; Varkhedi, Anil Venkatesh ; Weigel, III, Charles Joseph ; International Business Machines Corporation</creatorcontrib><description>Provided are techniques for data stream switching. While accepting data change messages from a historical data stream, in response to determining that the end of the historical data stream is approaching, consumption from a real time data stream is resumed. In accepting data change messages from one of a historical data stream and a real time data stream, a data change message identifier (DCMID) for a data change message is obtained. Then, it is determined whether the data change message is from the real time data stream. In response to determining that the data change message is from the real time data stream, the DCMID is processed against a historical data structure to determine whether the related data change message has been seen in the historical data stream. In response to determining that the data change message is from the historical data stream, the DCMID is processed against a real time data structure to determine whether the related data change message has been seen in the real time data stream. It is determined whether a threshold for a number of DCMIDs that correspond to each other in the real time data stream and the historical data stream has been met. In response to determining that the threshold has been met, there is a switch from capturing data change messages in the historical data stream to capturing data change messages in the real time data stream.</description><language>eng</language><creationdate>2010</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7827299$$EPDF$$P50$$Guspatents$$Hfree_for_read</linktopdf><link.rule.ids>230,308,776,798,881,64012</link.rule.ids><linktorsrc>$$Uhttps://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7827299$$EView_record_in_USPTO$$FView_record_in_$$GUSPTO$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>Cadarette, Paul Michael</creatorcontrib><creatorcontrib>Kirk, Lawrence E</creatorcontrib><creatorcontrib>Love, Robert Daniel</creatorcontrib><creatorcontrib>Upton, Gregg Andrew</creatorcontrib><creatorcontrib>Varkhedi, Anil Venkatesh</creatorcontrib><creatorcontrib>Weigel, III, Charles Joseph</creatorcontrib><creatorcontrib>International Business Machines Corporation</creatorcontrib><title>Transitioning between historical and real time data streams in the processing of data change messages</title><description>Provided are techniques for data stream switching. While accepting data change messages from a historical data stream, in response to determining that the end of the historical data stream is approaching, consumption from a real time data stream is resumed. In accepting data change messages from one of a historical data stream and a real time data stream, a data change message identifier (DCMID) for a data change message is obtained. Then, it is determined whether the data change message is from the real time data stream. In response to determining that the data change message is from the real time data stream, the DCMID is processed against a historical data structure to determine whether the related data change message has been seen in the historical data stream. In response to determining that the data change message is from the historical data stream, the DCMID is processed against a real time data structure to determine whether the related data change message has been seen in the real time data stream. It is determined whether a threshold for a number of DCMIDs that correspond to each other in the real time data stream and the historical data stream has been met. In response to determining that the threshold has been met, there is a switch from capturing data change messages in the historical data stream to capturing data change messages in the real time data stream.</description><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2010</creationdate><recordtype>patent</recordtype><sourceid>EFH</sourceid><recordid>eNqNjkEKwkAQBHPxIOof5gOCxEPMWRQfkLuMm85mIJkNOyN-3xV9gKduimrodYUus5q4JBWN9IC_AKVRzFOWwBOx9pRRissM6tmZzAuYjUTJR9CSU4DZZ5-GrxFG1giaC-YI21argSfD7pebiq6X7nzbP21hh7rdY_lR4tCc6qZu2-MfyhvxH0A4</recordid><startdate>20101102</startdate><enddate>20101102</enddate><creator>Cadarette, Paul Michael</creator><creator>Kirk, Lawrence E</creator><creator>Love, Robert Daniel</creator><creator>Upton, Gregg Andrew</creator><creator>Varkhedi, Anil Venkatesh</creator><creator>Weigel, III, Charles Joseph</creator><scope>EFH</scope></search><sort><creationdate>20101102</creationdate><title>Transitioning between historical and real time data streams in the processing of data change messages</title><author>Cadarette, Paul Michael ; Kirk, Lawrence E ; Love, Robert Daniel ; Upton, Gregg Andrew ; Varkhedi, Anil Venkatesh ; Weigel, III, Charles Joseph</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-uspatents_grants_078272993</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>eng</language><creationdate>2010</creationdate><toplevel>online_resources</toplevel><creatorcontrib>Cadarette, Paul Michael</creatorcontrib><creatorcontrib>Kirk, Lawrence E</creatorcontrib><creatorcontrib>Love, Robert Daniel</creatorcontrib><creatorcontrib>Upton, Gregg Andrew</creatorcontrib><creatorcontrib>Varkhedi, Anil Venkatesh</creatorcontrib><creatorcontrib>Weigel, III, Charles Joseph</creatorcontrib><creatorcontrib>International Business Machines Corporation</creatorcontrib><collection>USPTO Issued Patents</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Cadarette, Paul Michael</au><au>Kirk, Lawrence E</au><au>Love, Robert Daniel</au><au>Upton, Gregg Andrew</au><au>Varkhedi, Anil Venkatesh</au><au>Weigel, III, Charles Joseph</au><aucorp>International Business Machines Corporation</aucorp><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>Transitioning between historical and real time data streams in the processing of data change messages</title><date>2010-11-02</date><risdate>2010</risdate><abstract>Provided are techniques for data stream switching. While accepting data change messages from a historical data stream, in response to determining that the end of the historical data stream is approaching, consumption from a real time data stream is resumed. In accepting data change messages from one of a historical data stream and a real time data stream, a data change message identifier (DCMID) for a data change message is obtained. Then, it is determined whether the data change message is from the real time data stream. In response to determining that the data change message is from the real time data stream, the DCMID is processed against a historical data structure to determine whether the related data change message has been seen in the historical data stream. In response to determining that the data change message is from the historical data stream, the DCMID is processed against a real time data structure to determine whether the related data change message has been seen in the real time data stream. It is determined whether a threshold for a number of DCMIDs that correspond to each other in the real time data stream and the historical data stream has been met. In response to determining that the threshold has been met, there is a switch from capturing data change messages in the historical data stream to capturing data change messages in the real time data stream.</abstract><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier
ispartof
issn
language eng
recordid cdi_uspatents_grants_07827299
source USPTO Issued Patents
title Transitioning between historical and real time data streams in the processing of data change messages
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-15T21%3A50%3A07IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-uspatents_EFH&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=Cadarette,%20Paul%20Michael&rft.aucorp=International%20Business%20Machines%20Corporation&rft.date=2010-11-02&rft_id=info:doi/&rft_dat=%3Cuspatents_EFH%3E07827299%3C/uspatents_EFH%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true