Optimized execution method for queries with materialized views: Design and implementation

A query application for On-Line Analytical Processing (OLAP) examines various kinds of data stored in a Data Warehouse (DW). There have been no systematic studies that look at the impact of query optimizations on performance and energy consumption in relational and NoSQL databases. Indeed, due to a...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of intelligent & fuzzy systems 2021-01, Vol.41 (6), p.6191-6205
Hauptverfasser: Raipurkar, Abhijeet R., Chandak, Manoj B.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 6205
container_issue 6
container_start_page 6191
container_title Journal of intelligent & fuzzy systems
container_volume 41
creator Raipurkar, Abhijeet R.
Chandak, Manoj B.
description A query application for On-Line Analytical Processing (OLAP) examines various kinds of data stored in a Data Warehouse (DW). There have been no systematic studies that look at the impact of query optimizations on performance and energy consumption in relational and NoSQL databases. Indeed, due to a lack of precise power calculation techniques in various databases and queries, the energy activity of several basic database operations is mostly unknown, as are the queries themselves, which are very complicated, extensive, and exploratory. As a result of the rapidly growing size of the DW system, query response times are regularly increasing. To improve decision-making performance, the response time of such queries should be as short as possible. To resolve these issues, multiple materialized views from individual database tables have been collected, and queries have been handled. Similarly, due to overall maintenance and storage expenses, as well as the selection of an optimal view set to increase the data storage facility’s efficacy, materializing all conceivable views is not viable. Thus, to overcome these issues, this paper proposed the method of energy-aware query optimization and processing, on materialized views using enhanced simulated annealing (EAQO-ESA). This work was carried out in four stages. First, a Simulated Annealing (SA) based meta-heuristic approach was used to pre-process the query and optimize the scheduling performance. Second, the optimal sets of views were materialized, resulting in enhanced query response efficiency. Third, the authors assessed the performance of the query execution time and computational complexity with and without optimization. Finally, based on processing time, efficiency, and computing cost, the system’s performance was validated and compared to the traditional technique.
doi_str_mv 10.3233/JIFS-202821
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2610946084</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2610946084</sourcerecordid><originalsourceid>FETCH-LOGICAL-c261t-87766e2407ea1cf5811d34c76212a56d05719950e1fcf40f95307e821037a2113</originalsourceid><addsrcrecordid>eNotkE9LAzEQxYMoWKsnv0DAo6xmkt1k15tUq5VCD-rBUwi7E5vS_WOSWvXTm1pPMwM_3pv3CDkHdiW4ENdPs-lzxhkvORyQEZSqyMpKqsO0M5lnwHN5TE5CWDEGquBsRN4WQ3St-8GG4hfWm-j6jrYYl31Dbe_pxwa9w0C3Li5pa2K6zPoP_3S4DTf0DoN776jpGuraYY0tdtHsVE7JkTXrgGf_c0xep_cvk8dsvniYTW7nWc0lxKxUSkrkOVNooLZFCdCIvFaSAzeFbFihoKoKhmBrmzNbFSKhKSATynAAMSYXe93B9-nbEPWq3_guWepkwKpcsjJP1OWeqn0fgkerB-9a4781ML3rTu-60_vuxC-ZumDH</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2610946084</pqid></control><display><type>article</type><title>Optimized execution method for queries with materialized views: Design and implementation</title><source>Business Source Complete</source><creator>Raipurkar, Abhijeet R. ; Chandak, Manoj B.</creator><creatorcontrib>Raipurkar, Abhijeet R. ; Chandak, Manoj B.</creatorcontrib><description>A query application for On-Line Analytical Processing (OLAP) examines various kinds of data stored in a Data Warehouse (DW). There have been no systematic studies that look at the impact of query optimizations on performance and energy consumption in relational and NoSQL databases. Indeed, due to a lack of precise power calculation techniques in various databases and queries, the energy activity of several basic database operations is mostly unknown, as are the queries themselves, which are very complicated, extensive, and exploratory. As a result of the rapidly growing size of the DW system, query response times are regularly increasing. To improve decision-making performance, the response time of such queries should be as short as possible. To resolve these issues, multiple materialized views from individual database tables have been collected, and queries have been handled. Similarly, due to overall maintenance and storage expenses, as well as the selection of an optimal view set to increase the data storage facility’s efficacy, materializing all conceivable views is not viable. Thus, to overcome these issues, this paper proposed the method of energy-aware query optimization and processing, on materialized views using enhanced simulated annealing (EAQO-ESA). This work was carried out in four stages. First, a Simulated Annealing (SA) based meta-heuristic approach was used to pre-process the query and optimize the scheduling performance. Second, the optimal sets of views were materialized, resulting in enhanced query response efficiency. Third, the authors assessed the performance of the query execution time and computational complexity with and without optimization. Finally, based on processing time, efficiency, and computing cost, the system’s performance was validated and compared to the traditional technique.</description><identifier>ISSN: 1064-1246</identifier><identifier>EISSN: 1875-8967</identifier><identifier>DOI: 10.3233/JIFS-202821</identifier><language>eng</language><publisher>Amsterdam: IOS Press BV</publisher><subject>Data storage ; Data warehouses ; Decision making ; Energy consumption ; Energy management ; Heuristic methods ; Online analytical processing ; Optimization ; Queries ; Query processing ; Response time (computers) ; Simulated annealing ; Storage facilities ; Tables (data)</subject><ispartof>Journal of intelligent &amp; fuzzy systems, 2021-01, Vol.41 (6), p.6191-6205</ispartof><rights>Copyright IOS Press BV 2021</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c261t-87766e2407ea1cf5811d34c76212a56d05719950e1fcf40f95307e821037a2113</citedby><cites>FETCH-LOGICAL-c261t-87766e2407ea1cf5811d34c76212a56d05719950e1fcf40f95307e821037a2113</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,27903,27904</link.rule.ids></links><search><creatorcontrib>Raipurkar, Abhijeet R.</creatorcontrib><creatorcontrib>Chandak, Manoj B.</creatorcontrib><title>Optimized execution method for queries with materialized views: Design and implementation</title><title>Journal of intelligent &amp; fuzzy systems</title><description>A query application for On-Line Analytical Processing (OLAP) examines various kinds of data stored in a Data Warehouse (DW). There have been no systematic studies that look at the impact of query optimizations on performance and energy consumption in relational and NoSQL databases. Indeed, due to a lack of precise power calculation techniques in various databases and queries, the energy activity of several basic database operations is mostly unknown, as are the queries themselves, which are very complicated, extensive, and exploratory. As a result of the rapidly growing size of the DW system, query response times are regularly increasing. To improve decision-making performance, the response time of such queries should be as short as possible. To resolve these issues, multiple materialized views from individual database tables have been collected, and queries have been handled. Similarly, due to overall maintenance and storage expenses, as well as the selection of an optimal view set to increase the data storage facility’s efficacy, materializing all conceivable views is not viable. Thus, to overcome these issues, this paper proposed the method of energy-aware query optimization and processing, on materialized views using enhanced simulated annealing (EAQO-ESA). This work was carried out in four stages. First, a Simulated Annealing (SA) based meta-heuristic approach was used to pre-process the query and optimize the scheduling performance. Second, the optimal sets of views were materialized, resulting in enhanced query response efficiency. Third, the authors assessed the performance of the query execution time and computational complexity with and without optimization. Finally, based on processing time, efficiency, and computing cost, the system’s performance was validated and compared to the traditional technique.</description><subject>Data storage</subject><subject>Data warehouses</subject><subject>Decision making</subject><subject>Energy consumption</subject><subject>Energy management</subject><subject>Heuristic methods</subject><subject>Online analytical processing</subject><subject>Optimization</subject><subject>Queries</subject><subject>Query processing</subject><subject>Response time (computers)</subject><subject>Simulated annealing</subject><subject>Storage facilities</subject><subject>Tables (data)</subject><issn>1064-1246</issn><issn>1875-8967</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><recordid>eNotkE9LAzEQxYMoWKsnv0DAo6xmkt1k15tUq5VCD-rBUwi7E5vS_WOSWvXTm1pPMwM_3pv3CDkHdiW4ENdPs-lzxhkvORyQEZSqyMpKqsO0M5lnwHN5TE5CWDEGquBsRN4WQ3St-8GG4hfWm-j6jrYYl31Dbe_pxwa9w0C3Li5pa2K6zPoP_3S4DTf0DoN776jpGuraYY0tdtHsVE7JkTXrgGf_c0xep_cvk8dsvniYTW7nWc0lxKxUSkrkOVNooLZFCdCIvFaSAzeFbFihoKoKhmBrmzNbFSKhKSATynAAMSYXe93B9-nbEPWq3_guWepkwKpcsjJP1OWeqn0fgkerB-9a4781ML3rTu-60_vuxC-ZumDH</recordid><startdate>20210101</startdate><enddate>20210101</enddate><creator>Raipurkar, Abhijeet R.</creator><creator>Chandak, Manoj B.</creator><general>IOS Press BV</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope></search><sort><creationdate>20210101</creationdate><title>Optimized execution method for queries with materialized views: Design and implementation</title><author>Raipurkar, Abhijeet R. ; Chandak, Manoj B.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c261t-87766e2407ea1cf5811d34c76212a56d05719950e1fcf40f95307e821037a2113</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Data storage</topic><topic>Data warehouses</topic><topic>Decision making</topic><topic>Energy consumption</topic><topic>Energy management</topic><topic>Heuristic methods</topic><topic>Online analytical processing</topic><topic>Optimization</topic><topic>Queries</topic><topic>Query processing</topic><topic>Response time (computers)</topic><topic>Simulated annealing</topic><topic>Storage facilities</topic><topic>Tables (data)</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Raipurkar, Abhijeet R.</creatorcontrib><creatorcontrib>Chandak, Manoj B.</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Journal of intelligent &amp; fuzzy systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Raipurkar, Abhijeet R.</au><au>Chandak, Manoj B.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Optimized execution method for queries with materialized views: Design and implementation</atitle><jtitle>Journal of intelligent &amp; fuzzy systems</jtitle><date>2021-01-01</date><risdate>2021</risdate><volume>41</volume><issue>6</issue><spage>6191</spage><epage>6205</epage><pages>6191-6205</pages><issn>1064-1246</issn><eissn>1875-8967</eissn><abstract>A query application for On-Line Analytical Processing (OLAP) examines various kinds of data stored in a Data Warehouse (DW). There have been no systematic studies that look at the impact of query optimizations on performance and energy consumption in relational and NoSQL databases. Indeed, due to a lack of precise power calculation techniques in various databases and queries, the energy activity of several basic database operations is mostly unknown, as are the queries themselves, which are very complicated, extensive, and exploratory. As a result of the rapidly growing size of the DW system, query response times are regularly increasing. To improve decision-making performance, the response time of such queries should be as short as possible. To resolve these issues, multiple materialized views from individual database tables have been collected, and queries have been handled. Similarly, due to overall maintenance and storage expenses, as well as the selection of an optimal view set to increase the data storage facility’s efficacy, materializing all conceivable views is not viable. Thus, to overcome these issues, this paper proposed the method of energy-aware query optimization and processing, on materialized views using enhanced simulated annealing (EAQO-ESA). This work was carried out in four stages. First, a Simulated Annealing (SA) based meta-heuristic approach was used to pre-process the query and optimize the scheduling performance. Second, the optimal sets of views were materialized, resulting in enhanced query response efficiency. Third, the authors assessed the performance of the query execution time and computational complexity with and without optimization. Finally, based on processing time, efficiency, and computing cost, the system’s performance was validated and compared to the traditional technique.</abstract><cop>Amsterdam</cop><pub>IOS Press BV</pub><doi>10.3233/JIFS-202821</doi><tpages>15</tpages></addata></record>
fulltext fulltext
identifier ISSN: 1064-1246
ispartof Journal of intelligent & fuzzy systems, 2021-01, Vol.41 (6), p.6191-6205
issn 1064-1246
1875-8967
language eng
recordid cdi_proquest_journals_2610946084
source Business Source Complete
subjects Data storage
Data warehouses
Decision making
Energy consumption
Energy management
Heuristic methods
Online analytical processing
Optimization
Queries
Query processing
Response time (computers)
Simulated annealing
Storage facilities
Tables (data)
title Optimized execution method for queries with materialized views: Design and implementation
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-21T14%3A28%3A17IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Optimized%20execution%20method%20for%20queries%20with%20materialized%20views:%20Design%20and%20implementation&rft.jtitle=Journal%20of%20intelligent%20&%20fuzzy%20systems&rft.au=Raipurkar,%20Abhijeet%20R.&rft.date=2021-01-01&rft.volume=41&rft.issue=6&rft.spage=6191&rft.epage=6205&rft.pages=6191-6205&rft.issn=1064-1246&rft.eissn=1875-8967&rft_id=info:doi/10.3233/JIFS-202821&rft_dat=%3Cproquest_cross%3E2610946084%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2610946084&rft_id=info:pmid/&rfr_iscdi=true