REDUCING DATA I/O USING IN-MEMORY DATA STRUCTURES

Techniques are described herein for generating and using in-memory data structures to represent columns in data block sets. In an embodiment, a database management system (DBMS) receives a query for a target data set managed by the DBMS. The query may specify a predicate for a column of the target d...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	MACNICOL ROGER D, MEIYYAPPAN KRISHNAN, WANG LAURA LIAORUO, NG ADRIAN TSZ HIM, UMAMAGESWARAN KOTHANDA, LAHIRI TIRTHANKAR
Format:	Patent
Sprache:	eng
Schlagworte:	CALCULATING COMPUTING COUNTING ELECTRIC COMMUNICATION TECHNIQUE ELECTRIC DIGITAL DATA PROCESSING ELECTRICITY PHYSICS TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

container_end_page
container_issue
container_start_page
container_title
container_volume
creator	MACNICOL ROGER D MEIYYAPPAN KRISHNAN WANG LAURA LIAORUO NG ADRIAN TSZ HIM UMAMAGESWARAN KOTHANDA LAHIRI TIRTHANKAR
description	Techniques are described herein for generating and using in-memory data structures to represent columns in data block sets. In an embodiment, a database management system (DBMS) receives a query for a target data set managed by the DBMS. The query may specify a predicate for a column of the target data set. The predicate may include a filtering value to be compared with row values of the column of the target data set. Prior to accessing data block sets storing the target data set from persistent storage, the DBMS identifies an in-memory summary that corresponds to a data block set, in an embodiment. The in-memory summary may include in-memory data structures, each representing a column stored in the data block set. The DBMS determines that a particular in-memory data structure exists in the in-memory summary that represents a portion of values of the column indicated in the predicate of the query. Based on the particular in-memory data structure, the DBMS determines whether or not the data block set can possibly contain the filtering value in the column of the target data set. Based on this determination, the DBMS skips or retrieves the data block set from the persistent storage as part of the query evaluation.
format	Patent
fullrecord	<record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_US2017116136A1</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>US2017116136A1</sourcerecordid><originalsourceid>FETCH-epo_espacenet_US2017116136A13</originalsourceid><addsrcrecordid>eNrjZDAMcnUJdfb0c1dwcQxxVPDU91cIDQZxPf10fV19_YMiIRLBIUGhziGhQa7BPAysaYk5xam8UJqbQdnNNcTZQze1ID8-tbggMTk1L7UkPjTYyMDQ3NDQzNDYzNHQmDhVANeFJ1c</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>REDUCING DATA I/O USING IN-MEMORY DATA STRUCTURES</title><source>esp@cenet</source><creator>MACNICOL ROGER D ; MEIYYAPPAN KRISHNAN ; WANG LAURA LIAORUO ; NG ADRIAN TSZ HIM ; UMAMAGESWARAN KOTHANDA ; LAHIRI TIRTHANKAR</creator><creatorcontrib>MACNICOL ROGER D ; MEIYYAPPAN KRISHNAN ; WANG LAURA LIAORUO ; NG ADRIAN TSZ HIM ; UMAMAGESWARAN KOTHANDA ; LAHIRI TIRTHANKAR</creatorcontrib><description>Techniques are described herein for generating and using in-memory data structures to represent columns in data block sets. In an embodiment, a database management system (DBMS) receives a query for a target data set managed by the DBMS. The query may specify a predicate for a column of the target data set. The predicate may include a filtering value to be compared with row values of the column of the target data set. Prior to accessing data block sets storing the target data set from persistent storage, the DBMS identifies an in-memory summary that corresponds to a data block set, in an embodiment. The in-memory summary may include in-memory data structures, each representing a column stored in the data block set. The DBMS determines that a particular in-memory data structure exists in the in-memory summary that represents a portion of values of the column indicated in the predicate of the query. Based on the particular in-memory data structure, the DBMS determines whether or not the data block set can possibly contain the filtering value in the column of the target data set. Based on this determination, the DBMS skips or retrieves the data block set from the persistent storage as part of the query evaluation.</description><language>eng</language><subject>CALCULATING ; COMPUTING ; COUNTING ; ELECTRIC COMMUNICATION TECHNIQUE ; ELECTRIC DIGITAL DATA PROCESSING ; ELECTRICITY ; PHYSICS ; TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION</subject><creationdate>2017</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20170427&DB=EPODOC&CC=US&NR=2017116136A1$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,308,776,881,25542,76289</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20170427&DB=EPODOC&CC=US&NR=2017116136A1$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>MACNICOL ROGER D</creatorcontrib><creatorcontrib>MEIYYAPPAN KRISHNAN</creatorcontrib><creatorcontrib>WANG LAURA LIAORUO</creatorcontrib><creatorcontrib>NG ADRIAN TSZ HIM</creatorcontrib><creatorcontrib>UMAMAGESWARAN KOTHANDA</creatorcontrib><creatorcontrib>LAHIRI TIRTHANKAR</creatorcontrib><title>REDUCING DATA I/O USING IN-MEMORY DATA STRUCTURES</title><description>Techniques are described herein for generating and using in-memory data structures to represent columns in data block sets. In an embodiment, a database management system (DBMS) receives a query for a target data set managed by the DBMS. The query may specify a predicate for a column of the target data set. The predicate may include a filtering value to be compared with row values of the column of the target data set. Prior to accessing data block sets storing the target data set from persistent storage, the DBMS identifies an in-memory summary that corresponds to a data block set, in an embodiment. The in-memory summary may include in-memory data structures, each representing a column stored in the data block set. The DBMS determines that a particular in-memory data structure exists in the in-memory summary that represents a portion of values of the column indicated in the predicate of the query. Based on the particular in-memory data structure, the DBMS determines whether or not the data block set can possibly contain the filtering value in the column of the target data set. Based on this determination, the DBMS skips or retrieves the data block set from the persistent storage as part of the query evaluation.</description><subject>CALCULATING</subject><subject>COMPUTING</subject><subject>COUNTING</subject><subject>ELECTRIC COMMUNICATION TECHNIQUE</subject><subject>ELECTRIC DIGITAL DATA PROCESSING</subject><subject>ELECTRICITY</subject><subject>PHYSICS</subject><subject>TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2017</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNrjZDAMcnUJdfb0c1dwcQxxVPDU91cIDQZxPf10fV19_YMiIRLBIUGhziGhQa7BPAysaYk5xam8UJqbQdnNNcTZQze1ID8-tbggMTk1L7UkPjTYyMDQ3NDQzNDYzNHQmDhVANeFJ1c</recordid><startdate>20170427</startdate><enddate>20170427</enddate><creator>MACNICOL ROGER D</creator><creator>MEIYYAPPAN KRISHNAN</creator><creator>WANG LAURA LIAORUO</creator><creator>NG ADRIAN TSZ HIM</creator><creator>UMAMAGESWARAN KOTHANDA</creator><creator>LAHIRI TIRTHANKAR</creator><scope>EVB</scope></search><sort><creationdate>20170427</creationdate><title>REDUCING DATA I/O USING IN-MEMORY DATA STRUCTURES</title><author>MACNICOL ROGER D ; MEIYYAPPAN KRISHNAN ; WANG LAURA LIAORUO ; NG ADRIAN TSZ HIM ; UMAMAGESWARAN KOTHANDA ; LAHIRI TIRTHANKAR</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_US2017116136A13</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>eng</language><creationdate>2017</creationdate><topic>CALCULATING</topic><topic>COMPUTING</topic><topic>COUNTING</topic><topic>ELECTRIC COMMUNICATION TECHNIQUE</topic><topic>ELECTRIC DIGITAL DATA PROCESSING</topic><topic>ELECTRICITY</topic><topic>PHYSICS</topic><topic>TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION</topic><toplevel>online_resources</toplevel><creatorcontrib>MACNICOL ROGER D</creatorcontrib><creatorcontrib>MEIYYAPPAN KRISHNAN</creatorcontrib><creatorcontrib>WANG LAURA LIAORUO</creatorcontrib><creatorcontrib>NG ADRIAN TSZ HIM</creatorcontrib><creatorcontrib>UMAMAGESWARAN KOTHANDA</creatorcontrib><creatorcontrib>LAHIRI TIRTHANKAR</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>MACNICOL ROGER D</au><au>MEIYYAPPAN KRISHNAN</au><au>WANG LAURA LIAORUO</au><au>NG ADRIAN TSZ HIM</au><au>UMAMAGESWARAN KOTHANDA</au><au>LAHIRI TIRTHANKAR</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>REDUCING DATA I/O USING IN-MEMORY DATA STRUCTURES</title><date>2017-04-27</date><risdate>2017</risdate><abstract>Techniques are described herein for generating and using in-memory data structures to represent columns in data block sets. In an embodiment, a database management system (DBMS) receives a query for a target data set managed by the DBMS. The query may specify a predicate for a column of the target data set. The predicate may include a filtering value to be compared with row values of the column of the target data set. Prior to accessing data block sets storing the target data set from persistent storage, the DBMS identifies an in-memory summary that corresponds to a data block set, in an embodiment. The in-memory summary may include in-memory data structures, each representing a column stored in the data block set. The DBMS determines that a particular in-memory data structure exists in the in-memory summary that represents a portion of values of the column indicated in the predicate of the query. Based on the particular in-memory data structure, the DBMS determines whether or not the data block set can possibly contain the filtering value in the column of the target data set. Based on this determination, the DBMS skips or retrieves the data block set from the persistent storage as part of the query evaluation.</abstract><oa>free_for_read</oa></addata></record>
fulltext	fulltext_linktorsrc
identifier
ispartof
issn
language	eng
recordid	cdi_epo_espacenet_US2017116136A1
source	esp@cenet
subjects	CALCULATING COMPUTING COUNTING ELECTRIC COMMUNICATION TECHNIQUE ELECTRIC DIGITAL DATA PROCESSING ELECTRICITY PHYSICS TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION
title	REDUCING DATA I/O USING IN-MEMORY DATA STRUCTURES
url	https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-10T21%3A48%3A34IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=MACNICOL%20ROGER%20D&rft.date=2017-04-27&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3EUS2017116136A1%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true