Optimized resource management for map/reduce computing

The present invention includes a method for resource optimization of map/reduce computing in a computing cluster. The method can include receiving a computational problem for processing in a map/reduce module, subdividing the computational problem into a set of sub-problems and mapping a selection o...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: KAMINSKY DAVID L, DOYLE RONALD P
Format: Patent
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator KAMINSKY DAVID L
DOYLE RONALD P
description The present invention includes a method for resource optimization of map/reduce computing in a computing cluster. The method can include receiving a computational problem for processing in a map/reduce module, subdividing the computational problem into a set of sub-problems and mapping a selection of the sub-problems in the set to respective nodes in a computing cluster, for example a cloud computing cluster, computing for a subset of the nodes in the computing cluster a required resource capacity of the subset of the nodes to process a mapped one of the sub-problems and an existing capacity of the subset of the nodes, and augmenting the existing capacity to an augmented capacity when the required resource capacity exceeds the existing capacity, and when a cost of augmenting the existing capacity to the augmented capacity does not exceed a penalty for breaching a service level agreement (SLA) for the subset of the nodes.
format Patent
fullrecord <record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_US9323580B2</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>US9323580B2</sourcerecordid><originalsourceid>FETCH-epo_espacenet_US9323580B23</originalsourceid><addsrcrecordid>eNrjZDDzLyjJzM2sSk1RKEotzi8tSk5VyE3MS0xPzU3NK1FIyy8Ccgv0i1JTSoEyyfm5BaUlmXnpPAysaYk5xam8UJqbQcHNNcTZQze1ID8-tbggMTk1L7UkPjTY0tjI2NTCwMnImAglAH7CLcc</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>Optimized resource management for map/reduce computing</title><source>esp@cenet</source><creator>KAMINSKY DAVID L ; DOYLE RONALD P</creator><creatorcontrib>KAMINSKY DAVID L ; DOYLE RONALD P</creatorcontrib><description>The present invention includes a method for resource optimization of map/reduce computing in a computing cluster. The method can include receiving a computational problem for processing in a map/reduce module, subdividing the computational problem into a set of sub-problems and mapping a selection of the sub-problems in the set to respective nodes in a computing cluster, for example a cloud computing cluster, computing for a subset of the nodes in the computing cluster a required resource capacity of the subset of the nodes to process a mapped one of the sub-problems and an existing capacity of the subset of the nodes, and augmenting the existing capacity to an augmented capacity when the required resource capacity exceeds the existing capacity, and when a cost of augmenting the existing capacity to the augmented capacity does not exceed a penalty for breaching a service level agreement (SLA) for the subset of the nodes.</description><language>eng</language><subject>CALCULATING ; COMPUTING ; COUNTING ; ELECTRIC COMMUNICATION TECHNIQUE ; ELECTRIC DIGITAL DATA PROCESSING ; ELECTRICITY ; PHYSICS ; TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION</subject><creationdate>2016</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20160426&amp;DB=EPODOC&amp;CC=US&amp;NR=9323580B2$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,308,780,885,25564,76547</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20160426&amp;DB=EPODOC&amp;CC=US&amp;NR=9323580B2$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>KAMINSKY DAVID L</creatorcontrib><creatorcontrib>DOYLE RONALD P</creatorcontrib><title>Optimized resource management for map/reduce computing</title><description>The present invention includes a method for resource optimization of map/reduce computing in a computing cluster. The method can include receiving a computational problem for processing in a map/reduce module, subdividing the computational problem into a set of sub-problems and mapping a selection of the sub-problems in the set to respective nodes in a computing cluster, for example a cloud computing cluster, computing for a subset of the nodes in the computing cluster a required resource capacity of the subset of the nodes to process a mapped one of the sub-problems and an existing capacity of the subset of the nodes, and augmenting the existing capacity to an augmented capacity when the required resource capacity exceeds the existing capacity, and when a cost of augmenting the existing capacity to the augmented capacity does not exceed a penalty for breaching a service level agreement (SLA) for the subset of the nodes.</description><subject>CALCULATING</subject><subject>COMPUTING</subject><subject>COUNTING</subject><subject>ELECTRIC COMMUNICATION TECHNIQUE</subject><subject>ELECTRIC DIGITAL DATA PROCESSING</subject><subject>ELECTRICITY</subject><subject>PHYSICS</subject><subject>TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2016</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNrjZDDzLyjJzM2sSk1RKEotzi8tSk5VyE3MS0xPzU3NK1FIyy8Ccgv0i1JTSoEyyfm5BaUlmXnpPAysaYk5xam8UJqbQcHNNcTZQze1ID8-tbggMTk1L7UkPjTY0tjI2NTCwMnImAglAH7CLcc</recordid><startdate>20160426</startdate><enddate>20160426</enddate><creator>KAMINSKY DAVID L</creator><creator>DOYLE RONALD P</creator><scope>EVB</scope></search><sort><creationdate>20160426</creationdate><title>Optimized resource management for map/reduce computing</title><author>KAMINSKY DAVID L ; DOYLE RONALD P</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_US9323580B23</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>eng</language><creationdate>2016</creationdate><topic>CALCULATING</topic><topic>COMPUTING</topic><topic>COUNTING</topic><topic>ELECTRIC COMMUNICATION TECHNIQUE</topic><topic>ELECTRIC DIGITAL DATA PROCESSING</topic><topic>ELECTRICITY</topic><topic>PHYSICS</topic><topic>TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION</topic><toplevel>online_resources</toplevel><creatorcontrib>KAMINSKY DAVID L</creatorcontrib><creatorcontrib>DOYLE RONALD P</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>KAMINSKY DAVID L</au><au>DOYLE RONALD P</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>Optimized resource management for map/reduce computing</title><date>2016-04-26</date><risdate>2016</risdate><abstract>The present invention includes a method for resource optimization of map/reduce computing in a computing cluster. The method can include receiving a computational problem for processing in a map/reduce module, subdividing the computational problem into a set of sub-problems and mapping a selection of the sub-problems in the set to respective nodes in a computing cluster, for example a cloud computing cluster, computing for a subset of the nodes in the computing cluster a required resource capacity of the subset of the nodes to process a mapped one of the sub-problems and an existing capacity of the subset of the nodes, and augmenting the existing capacity to an augmented capacity when the required resource capacity exceeds the existing capacity, and when a cost of augmenting the existing capacity to the augmented capacity does not exceed a penalty for breaching a service level agreement (SLA) for the subset of the nodes.</abstract><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier
ispartof
issn
language eng
recordid cdi_epo_espacenet_US9323580B2
source esp@cenet
subjects CALCULATING
COMPUTING
COUNTING
ELECTRIC COMMUNICATION TECHNIQUE
ELECTRIC DIGITAL DATA PROCESSING
ELECTRICITY
PHYSICS
TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION
title Optimized resource management for map/reduce computing
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-02T11%3A27%3A20IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=KAMINSKY%20DAVID%20L&rft.date=2016-04-26&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3EUS9323580B2%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true