Optimized execution method for queries with materialized views: Design and implementation
A query application for On-Line Analytical Processing (OLAP) examines various kinds of data stored in a Data Warehouse (DW). There have been no systematic studies that look at the impact of query optimizations on performance and energy consumption in relational and NoSQL databases. Indeed, due to a...
Gespeichert in:
Veröffentlicht in: | Journal of intelligent & fuzzy systems 2021-01, Vol.41 (6), p.6191-6205 |
---|---|
Hauptverfasser: | , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 6205 |
---|---|
container_issue | 6 |
container_start_page | 6191 |
container_title | Journal of intelligent & fuzzy systems |
container_volume | 41 |
creator | Raipurkar, Abhijeet R. Chandak, Manoj B. |
description | A query application for On-Line Analytical Processing (OLAP) examines various kinds of data stored in a Data Warehouse (DW). There have been no systematic studies that look at the impact of query optimizations on performance and energy consumption in relational and NoSQL databases. Indeed, due to a lack of precise power calculation techniques in various databases and queries, the energy activity of several basic database operations is mostly unknown, as are the queries themselves, which are very complicated, extensive, and exploratory. As a result of the rapidly growing size of the DW system, query response times are regularly increasing. To improve decision-making performance, the response time of such queries should be as short as possible. To resolve these issues, multiple materialized views from individual database tables have been collected, and queries have been handled. Similarly, due to overall maintenance and storage expenses, as well as the selection of an optimal view set to increase the data storage facility’s efficacy, materializing all conceivable views is not viable. Thus, to overcome these issues, this paper proposed the method of energy-aware query optimization and processing, on materialized views using enhanced simulated annealing (EAQO-ESA). This work was carried out in four stages. First, a Simulated Annealing (SA) based meta-heuristic approach was used to pre-process the query and optimize the scheduling performance. Second, the optimal sets of views were materialized, resulting in enhanced query response efficiency. Third, the authors assessed the performance of the query execution time and computational complexity with and without optimization. Finally, based on processing time, efficiency, and computing cost, the system’s performance was validated and compared to the traditional technique. |
doi_str_mv | 10.3233/JIFS-202821 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2610946084</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2610946084</sourcerecordid><originalsourceid>FETCH-LOGICAL-c261t-87766e2407ea1cf5811d34c76212a56d05719950e1fcf40f95307e821037a2113</originalsourceid><addsrcrecordid>eNotkE9LAzEQxYMoWKsnv0DAo6xmkt1k15tUq5VCD-rBUwi7E5vS_WOSWvXTm1pPMwM_3pv3CDkHdiW4ENdPs-lzxhkvORyQEZSqyMpKqsO0M5lnwHN5TE5CWDEGquBsRN4WQ3St-8GG4hfWm-j6jrYYl31Dbe_pxwa9w0C3Li5pa2K6zPoP_3S4DTf0DoN776jpGuraYY0tdtHsVE7JkTXrgGf_c0xep_cvk8dsvniYTW7nWc0lxKxUSkrkOVNooLZFCdCIvFaSAzeFbFihoKoKhmBrmzNbFSKhKSATynAAMSYXe93B9-nbEPWq3_guWepkwKpcsjJP1OWeqn0fgkerB-9a4781ML3rTu-60_vuxC-ZumDH</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2610946084</pqid></control><display><type>article</type><title>Optimized execution method for queries with materialized views: Design and implementation</title><source>Business Source Complete</source><creator>Raipurkar, Abhijeet R. ; Chandak, Manoj B.</creator><creatorcontrib>Raipurkar, Abhijeet R. ; Chandak, Manoj B.</creatorcontrib><description>A query application for On-Line Analytical Processing (OLAP) examines various kinds of data stored in a Data Warehouse (DW). There have been no systematic studies that look at the impact of query optimizations on performance and energy consumption in relational and NoSQL databases. Indeed, due to a lack of precise power calculation techniques in various databases and queries, the energy activity of several basic database operations is mostly unknown, as are the queries themselves, which are very complicated, extensive, and exploratory. As a result of the rapidly growing size of the DW system, query response times are regularly increasing. To improve decision-making performance, the response time of such queries should be as short as possible. To resolve these issues, multiple materialized views from individual database tables have been collected, and queries have been handled. Similarly, due to overall maintenance and storage expenses, as well as the selection of an optimal view set to increase the data storage facility’s efficacy, materializing all conceivable views is not viable. Thus, to overcome these issues, this paper proposed the method of energy-aware query optimization and processing, on materialized views using enhanced simulated annealing (EAQO-ESA). This work was carried out in four stages. First, a Simulated Annealing (SA) based meta-heuristic approach was used to pre-process the query and optimize the scheduling performance. Second, the optimal sets of views were materialized, resulting in enhanced query response efficiency. Third, the authors assessed the performance of the query execution time and computational complexity with and without optimization. Finally, based on processing time, efficiency, and computing cost, the system’s performance was validated and compared to the traditional technique.</description><identifier>ISSN: 1064-1246</identifier><identifier>EISSN: 1875-8967</identifier><identifier>DOI: 10.3233/JIFS-202821</identifier><language>eng</language><publisher>Amsterdam: IOS Press BV</publisher><subject>Data storage ; Data warehouses ; Decision making ; Energy consumption ; Energy management ; Heuristic methods ; Online analytical processing ; Optimization ; Queries ; Query processing ; Response time (computers) ; Simulated annealing ; Storage facilities ; Tables (data)</subject><ispartof>Journal of intelligent & fuzzy systems, 2021-01, Vol.41 (6), p.6191-6205</ispartof><rights>Copyright IOS Press BV 2021</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c261t-87766e2407ea1cf5811d34c76212a56d05719950e1fcf40f95307e821037a2113</citedby><cites>FETCH-LOGICAL-c261t-87766e2407ea1cf5811d34c76212a56d05719950e1fcf40f95307e821037a2113</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,27903,27904</link.rule.ids></links><search><creatorcontrib>Raipurkar, Abhijeet R.</creatorcontrib><creatorcontrib>Chandak, Manoj B.</creatorcontrib><title>Optimized execution method for queries with materialized views: Design and implementation</title><title>Journal of intelligent & fuzzy systems</title><description>A query application for On-Line Analytical Processing (OLAP) examines various kinds of data stored in a Data Warehouse (DW). There have been no systematic studies that look at the impact of query optimizations on performance and energy consumption in relational and NoSQL databases. Indeed, due to a lack of precise power calculation techniques in various databases and queries, the energy activity of several basic database operations is mostly unknown, as are the queries themselves, which are very complicated, extensive, and exploratory. As a result of the rapidly growing size of the DW system, query response times are regularly increasing. To improve decision-making performance, the response time of such queries should be as short as possible. To resolve these issues, multiple materialized views from individual database tables have been collected, and queries have been handled. Similarly, due to overall maintenance and storage expenses, as well as the selection of an optimal view set to increase the data storage facility’s efficacy, materializing all conceivable views is not viable. Thus, to overcome these issues, this paper proposed the method of energy-aware query optimization and processing, on materialized views using enhanced simulated annealing (EAQO-ESA). This work was carried out in four stages. First, a Simulated Annealing (SA) based meta-heuristic approach was used to pre-process the query and optimize the scheduling performance. Second, the optimal sets of views were materialized, resulting in enhanced query response efficiency. Third, the authors assessed the performance of the query execution time and computational complexity with and without optimization. Finally, based on processing time, efficiency, and computing cost, the system’s performance was validated and compared to the traditional technique.</description><subject>Data storage</subject><subject>Data warehouses</subject><subject>Decision making</subject><subject>Energy consumption</subject><subject>Energy management</subject><subject>Heuristic methods</subject><subject>Online analytical processing</subject><subject>Optimization</subject><subject>Queries</subject><subject>Query processing</subject><subject>Response time (computers)</subject><subject>Simulated annealing</subject><subject>Storage facilities</subject><subject>Tables (data)</subject><issn>1064-1246</issn><issn>1875-8967</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><recordid>eNotkE9LAzEQxYMoWKsnv0DAo6xmkt1k15tUq5VCD-rBUwi7E5vS_WOSWvXTm1pPMwM_3pv3CDkHdiW4ENdPs-lzxhkvORyQEZSqyMpKqsO0M5lnwHN5TE5CWDEGquBsRN4WQ3St-8GG4hfWm-j6jrYYl31Dbe_pxwa9w0C3Li5pa2K6zPoP_3S4DTf0DoN776jpGuraYY0tdtHsVE7JkTXrgGf_c0xep_cvk8dsvniYTW7nWc0lxKxUSkrkOVNooLZFCdCIvFaSAzeFbFihoKoKhmBrmzNbFSKhKSATynAAMSYXe93B9-nbEPWq3_guWepkwKpcsjJP1OWeqn0fgkerB-9a4781ML3rTu-60_vuxC-ZumDH</recordid><startdate>20210101</startdate><enddate>20210101</enddate><creator>Raipurkar, Abhijeet R.</creator><creator>Chandak, Manoj B.</creator><general>IOS Press BV</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope></search><sort><creationdate>20210101</creationdate><title>Optimized execution method for queries with materialized views: Design and implementation</title><author>Raipurkar, Abhijeet R. ; Chandak, Manoj B.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c261t-87766e2407ea1cf5811d34c76212a56d05719950e1fcf40f95307e821037a2113</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Data storage</topic><topic>Data warehouses</topic><topic>Decision making</topic><topic>Energy consumption</topic><topic>Energy management</topic><topic>Heuristic methods</topic><topic>Online analytical processing</topic><topic>Optimization</topic><topic>Queries</topic><topic>Query processing</topic><topic>Response time (computers)</topic><topic>Simulated annealing</topic><topic>Storage facilities</topic><topic>Tables (data)</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Raipurkar, Abhijeet R.</creatorcontrib><creatorcontrib>Chandak, Manoj B.</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Journal of intelligent & fuzzy systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Raipurkar, Abhijeet R.</au><au>Chandak, Manoj B.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Optimized execution method for queries with materialized views: Design and implementation</atitle><jtitle>Journal of intelligent & fuzzy systems</jtitle><date>2021-01-01</date><risdate>2021</risdate><volume>41</volume><issue>6</issue><spage>6191</spage><epage>6205</epage><pages>6191-6205</pages><issn>1064-1246</issn><eissn>1875-8967</eissn><abstract>A query application for On-Line Analytical Processing (OLAP) examines various kinds of data stored in a Data Warehouse (DW). There have been no systematic studies that look at the impact of query optimizations on performance and energy consumption in relational and NoSQL databases. Indeed, due to a lack of precise power calculation techniques in various databases and queries, the energy activity of several basic database operations is mostly unknown, as are the queries themselves, which are very complicated, extensive, and exploratory. As a result of the rapidly growing size of the DW system, query response times are regularly increasing. To improve decision-making performance, the response time of such queries should be as short as possible. To resolve these issues, multiple materialized views from individual database tables have been collected, and queries have been handled. Similarly, due to overall maintenance and storage expenses, as well as the selection of an optimal view set to increase the data storage facility’s efficacy, materializing all conceivable views is not viable. Thus, to overcome these issues, this paper proposed the method of energy-aware query optimization and processing, on materialized views using enhanced simulated annealing (EAQO-ESA). This work was carried out in four stages. First, a Simulated Annealing (SA) based meta-heuristic approach was used to pre-process the query and optimize the scheduling performance. Second, the optimal sets of views were materialized, resulting in enhanced query response efficiency. Third, the authors assessed the performance of the query execution time and computational complexity with and without optimization. Finally, based on processing time, efficiency, and computing cost, the system’s performance was validated and compared to the traditional technique.</abstract><cop>Amsterdam</cop><pub>IOS Press BV</pub><doi>10.3233/JIFS-202821</doi><tpages>15</tpages></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1064-1246 |
ispartof | Journal of intelligent & fuzzy systems, 2021-01, Vol.41 (6), p.6191-6205 |
issn | 1064-1246 1875-8967 |
language | eng |
recordid | cdi_proquest_journals_2610946084 |
source | Business Source Complete |
subjects | Data storage Data warehouses Decision making Energy consumption Energy management Heuristic methods Online analytical processing Optimization Queries Query processing Response time (computers) Simulated annealing Storage facilities Tables (data) |
title | Optimized execution method for queries with materialized views: Design and implementation |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-21T14%3A28%3A17IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Optimized%20execution%20method%20for%20queries%20with%20materialized%20views:%20Design%20and%20implementation&rft.jtitle=Journal%20of%20intelligent%20&%20fuzzy%20systems&rft.au=Raipurkar,%20Abhijeet%20R.&rft.date=2021-01-01&rft.volume=41&rft.issue=6&rft.spage=6191&rft.epage=6205&rft.pages=6191-6205&rft.issn=1064-1246&rft.eissn=1875-8967&rft_id=info:doi/10.3233/JIFS-202821&rft_dat=%3Cproquest_cross%3E2610946084%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2610946084&rft_id=info:pmid/&rfr_iscdi=true |