Distributed system resource optimal allocation method based on LSTM and genetic algorithm

The invention discloses a resource allocation method based on an LSTM (Long Short Term Memory) time prediction model and a genetic algorithm. The method comprises the following steps: 1) training a job execution time prediction model based on an LSTM network; 2) distributing a reasonable resource qu...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: MAO JIAFA, PAN ENYU, HU YAHONG
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator MAO JIAFA
PAN ENYU
HU YAHONG
description The invention discloses a resource allocation method based on an LSTM (Long Short Term Memory) time prediction model and a genetic algorithm. The method comprises the following steps: 1) training a job execution time prediction model based on an LSTM network; 2) distributing a reasonable resource quantity for each job in batch jobs by using a genetic algorithm; a fitness function of the genetic algorithm is changed into a time prediction model based on LSTM, and the resource quantity suitable for each job is iterated through selection, intersection and variation of the genetic algorithm; 3) giving different resource quantities for different jobs by using a resource allocation algorithm based on a genetic algorithm; when the Spark distributed computing framework receives jobs, computing is carried out according to the quantity of cluster resources which can be used by different jobs, and the shortest processing time of the jobs is obtained. After the information of the batch jobs needing to be processed is sub
format Patent
fullrecord <record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_CN114528094A</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>CN114528094A</sourcerecordid><originalsourceid>FETCH-epo_espacenet_CN114528094A3</originalsourceid><addsrcrecordid>eNrjZIh0ySwuKcpMKi1JTVEoriwuSc1VKEotzi8tSk5VyC8oycxNzFFIzMnJT04syczPU8hNLcnIT1FISiwGqgfyfYJDfBUS81IU0lPzUksyk4Fq0_OLMksycnkYWNMSc4pTeaE0N4Oim2uIs4duakF-fGpxQWIySEe8s5-hoYmpkYWBpYmjMTFqAAxvOsY</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>Distributed system resource optimal allocation method based on LSTM and genetic algorithm</title><source>esp@cenet</source><creator>MAO JIAFA ; PAN ENYU ; HU YAHONG</creator><creatorcontrib>MAO JIAFA ; PAN ENYU ; HU YAHONG</creatorcontrib><description>The invention discloses a resource allocation method based on an LSTM (Long Short Term Memory) time prediction model and a genetic algorithm. The method comprises the following steps: 1) training a job execution time prediction model based on an LSTM network; 2) distributing a reasonable resource quantity for each job in batch jobs by using a genetic algorithm; a fitness function of the genetic algorithm is changed into a time prediction model based on LSTM, and the resource quantity suitable for each job is iterated through selection, intersection and variation of the genetic algorithm; 3) giving different resource quantities for different jobs by using a resource allocation algorithm based on a genetic algorithm; when the Spark distributed computing framework receives jobs, computing is carried out according to the quantity of cluster resources which can be used by different jobs, and the shortest processing time of the jobs is obtained. After the information of the batch jobs needing to be processed is sub</description><language>chi ; eng</language><subject>CALCULATING ; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS ; COMPUTING ; COUNTING ; ELECTRIC DIGITAL DATA PROCESSING ; PHYSICS</subject><creationdate>2022</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20220524&amp;DB=EPODOC&amp;CC=CN&amp;NR=114528094A$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,308,780,885,25564,76547</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20220524&amp;DB=EPODOC&amp;CC=CN&amp;NR=114528094A$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>MAO JIAFA</creatorcontrib><creatorcontrib>PAN ENYU</creatorcontrib><creatorcontrib>HU YAHONG</creatorcontrib><title>Distributed system resource optimal allocation method based on LSTM and genetic algorithm</title><description>The invention discloses a resource allocation method based on an LSTM (Long Short Term Memory) time prediction model and a genetic algorithm. The method comprises the following steps: 1) training a job execution time prediction model based on an LSTM network; 2) distributing a reasonable resource quantity for each job in batch jobs by using a genetic algorithm; a fitness function of the genetic algorithm is changed into a time prediction model based on LSTM, and the resource quantity suitable for each job is iterated through selection, intersection and variation of the genetic algorithm; 3) giving different resource quantities for different jobs by using a resource allocation algorithm based on a genetic algorithm; when the Spark distributed computing framework receives jobs, computing is carried out according to the quantity of cluster resources which can be used by different jobs, and the shortest processing time of the jobs is obtained. After the information of the batch jobs needing to be processed is sub</description><subject>CALCULATING</subject><subject>COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS</subject><subject>COMPUTING</subject><subject>COUNTING</subject><subject>ELECTRIC DIGITAL DATA PROCESSING</subject><subject>PHYSICS</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2022</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNrjZIh0ySwuKcpMKi1JTVEoriwuSc1VKEotzi8tSk5VyC8oycxNzFFIzMnJT04syczPU8hNLcnIT1FISiwGqgfyfYJDfBUS81IU0lPzUksyk4Fq0_OLMksycnkYWNMSc4pTeaE0N4Oim2uIs4duakF-fGpxQWIySEe8s5-hoYmpkYWBpYmjMTFqAAxvOsY</recordid><startdate>20220524</startdate><enddate>20220524</enddate><creator>MAO JIAFA</creator><creator>PAN ENYU</creator><creator>HU YAHONG</creator><scope>EVB</scope></search><sort><creationdate>20220524</creationdate><title>Distributed system resource optimal allocation method based on LSTM and genetic algorithm</title><author>MAO JIAFA ; PAN ENYU ; HU YAHONG</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_CN114528094A3</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>chi ; eng</language><creationdate>2022</creationdate><topic>CALCULATING</topic><topic>COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS</topic><topic>COMPUTING</topic><topic>COUNTING</topic><topic>ELECTRIC DIGITAL DATA PROCESSING</topic><topic>PHYSICS</topic><toplevel>online_resources</toplevel><creatorcontrib>MAO JIAFA</creatorcontrib><creatorcontrib>PAN ENYU</creatorcontrib><creatorcontrib>HU YAHONG</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>MAO JIAFA</au><au>PAN ENYU</au><au>HU YAHONG</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>Distributed system resource optimal allocation method based on LSTM and genetic algorithm</title><date>2022-05-24</date><risdate>2022</risdate><abstract>The invention discloses a resource allocation method based on an LSTM (Long Short Term Memory) time prediction model and a genetic algorithm. The method comprises the following steps: 1) training a job execution time prediction model based on an LSTM network; 2) distributing a reasonable resource quantity for each job in batch jobs by using a genetic algorithm; a fitness function of the genetic algorithm is changed into a time prediction model based on LSTM, and the resource quantity suitable for each job is iterated through selection, intersection and variation of the genetic algorithm; 3) giving different resource quantities for different jobs by using a resource allocation algorithm based on a genetic algorithm; when the Spark distributed computing framework receives jobs, computing is carried out according to the quantity of cluster resources which can be used by different jobs, and the shortest processing time of the jobs is obtained. After the information of the batch jobs needing to be processed is sub</abstract><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier
ispartof
issn
language chi ; eng
recordid cdi_epo_espacenet_CN114528094A
source esp@cenet
subjects CALCULATING
COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
title Distributed system resource optimal allocation method based on LSTM and genetic algorithm
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-27T02%3A38%3A28IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=MAO%20JIAFA&rft.date=2022-05-24&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3ECN114528094A%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true