Distributed system resource optimal allocation method based on LSTM and genetic algorithm
The invention discloses a resource allocation method based on an LSTM (Long Short Term Memory) time prediction model and a genetic algorithm. The method comprises the following steps: 1) training a job execution time prediction model based on an LSTM network; 2) distributing a reasonable resource qu...
Gespeichert in:
Hauptverfasser: | , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | |
container_volume | |
creator | MAO JIAFA PAN ENYU HU YAHONG |
description | The invention discloses a resource allocation method based on an LSTM (Long Short Term Memory) time prediction model and a genetic algorithm. The method comprises the following steps: 1) training a job execution time prediction model based on an LSTM network; 2) distributing a reasonable resource quantity for each job in batch jobs by using a genetic algorithm; a fitness function of the genetic algorithm is changed into a time prediction model based on LSTM, and the resource quantity suitable for each job is iterated through selection, intersection and variation of the genetic algorithm; 3) giving different resource quantities for different jobs by using a resource allocation algorithm based on a genetic algorithm; when the Spark distributed computing framework receives jobs, computing is carried out according to the quantity of cluster resources which can be used by different jobs, and the shortest processing time of the jobs is obtained. After the information of the batch jobs needing to be processed is sub |
format | Patent |
fullrecord | <record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_CN114528094A</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>CN114528094A</sourcerecordid><originalsourceid>FETCH-epo_espacenet_CN114528094A3</originalsourceid><addsrcrecordid>eNrjZIh0ySwuKcpMKi1JTVEoriwuSc1VKEotzi8tSk5VyC8oycxNzFFIzMnJT04syczPU8hNLcnIT1FISiwGqgfyfYJDfBUS81IU0lPzUksyk4Fq0_OLMksycnkYWNMSc4pTeaE0N4Oim2uIs4duakF-fGpxQWIySEe8s5-hoYmpkYWBpYmjMTFqAAxvOsY</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>Distributed system resource optimal allocation method based on LSTM and genetic algorithm</title><source>esp@cenet</source><creator>MAO JIAFA ; PAN ENYU ; HU YAHONG</creator><creatorcontrib>MAO JIAFA ; PAN ENYU ; HU YAHONG</creatorcontrib><description>The invention discloses a resource allocation method based on an LSTM (Long Short Term Memory) time prediction model and a genetic algorithm. The method comprises the following steps: 1) training a job execution time prediction model based on an LSTM network; 2) distributing a reasonable resource quantity for each job in batch jobs by using a genetic algorithm; a fitness function of the genetic algorithm is changed into a time prediction model based on LSTM, and the resource quantity suitable for each job is iterated through selection, intersection and variation of the genetic algorithm; 3) giving different resource quantities for different jobs by using a resource allocation algorithm based on a genetic algorithm; when the Spark distributed computing framework receives jobs, computing is carried out according to the quantity of cluster resources which can be used by different jobs, and the shortest processing time of the jobs is obtained. After the information of the batch jobs needing to be processed is sub</description><language>chi ; eng</language><subject>CALCULATING ; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS ; COMPUTING ; COUNTING ; ELECTRIC DIGITAL DATA PROCESSING ; PHYSICS</subject><creationdate>2022</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20220524&DB=EPODOC&CC=CN&NR=114528094A$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,308,780,885,25564,76547</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&date=20220524&DB=EPODOC&CC=CN&NR=114528094A$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>MAO JIAFA</creatorcontrib><creatorcontrib>PAN ENYU</creatorcontrib><creatorcontrib>HU YAHONG</creatorcontrib><title>Distributed system resource optimal allocation method based on LSTM and genetic algorithm</title><description>The invention discloses a resource allocation method based on an LSTM (Long Short Term Memory) time prediction model and a genetic algorithm. The method comprises the following steps: 1) training a job execution time prediction model based on an LSTM network; 2) distributing a reasonable resource quantity for each job in batch jobs by using a genetic algorithm; a fitness function of the genetic algorithm is changed into a time prediction model based on LSTM, and the resource quantity suitable for each job is iterated through selection, intersection and variation of the genetic algorithm; 3) giving different resource quantities for different jobs by using a resource allocation algorithm based on a genetic algorithm; when the Spark distributed computing framework receives jobs, computing is carried out according to the quantity of cluster resources which can be used by different jobs, and the shortest processing time of the jobs is obtained. After the information of the batch jobs needing to be processed is sub</description><subject>CALCULATING</subject><subject>COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS</subject><subject>COMPUTING</subject><subject>COUNTING</subject><subject>ELECTRIC DIGITAL DATA PROCESSING</subject><subject>PHYSICS</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2022</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNrjZIh0ySwuKcpMKi1JTVEoriwuSc1VKEotzi8tSk5VyC8oycxNzFFIzMnJT04syczPU8hNLcnIT1FISiwGqgfyfYJDfBUS81IU0lPzUksyk4Fq0_OLMksycnkYWNMSc4pTeaE0N4Oim2uIs4duakF-fGpxQWIySEe8s5-hoYmpkYWBpYmjMTFqAAxvOsY</recordid><startdate>20220524</startdate><enddate>20220524</enddate><creator>MAO JIAFA</creator><creator>PAN ENYU</creator><creator>HU YAHONG</creator><scope>EVB</scope></search><sort><creationdate>20220524</creationdate><title>Distributed system resource optimal allocation method based on LSTM and genetic algorithm</title><author>MAO JIAFA ; PAN ENYU ; HU YAHONG</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_CN114528094A3</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>chi ; eng</language><creationdate>2022</creationdate><topic>CALCULATING</topic><topic>COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS</topic><topic>COMPUTING</topic><topic>COUNTING</topic><topic>ELECTRIC DIGITAL DATA PROCESSING</topic><topic>PHYSICS</topic><toplevel>online_resources</toplevel><creatorcontrib>MAO JIAFA</creatorcontrib><creatorcontrib>PAN ENYU</creatorcontrib><creatorcontrib>HU YAHONG</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>MAO JIAFA</au><au>PAN ENYU</au><au>HU YAHONG</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>Distributed system resource optimal allocation method based on LSTM and genetic algorithm</title><date>2022-05-24</date><risdate>2022</risdate><abstract>The invention discloses a resource allocation method based on an LSTM (Long Short Term Memory) time prediction model and a genetic algorithm. The method comprises the following steps: 1) training a job execution time prediction model based on an LSTM network; 2) distributing a reasonable resource quantity for each job in batch jobs by using a genetic algorithm; a fitness function of the genetic algorithm is changed into a time prediction model based on LSTM, and the resource quantity suitable for each job is iterated through selection, intersection and variation of the genetic algorithm; 3) giving different resource quantities for different jobs by using a resource allocation algorithm based on a genetic algorithm; when the Spark distributed computing framework receives jobs, computing is carried out according to the quantity of cluster resources which can be used by different jobs, and the shortest processing time of the jobs is obtained. After the information of the batch jobs needing to be processed is sub</abstract><oa>free_for_read</oa></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | |
ispartof | |
issn | |
language | chi ; eng |
recordid | cdi_epo_espacenet_CN114528094A |
source | esp@cenet |
subjects | CALCULATING COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS COMPUTING COUNTING ELECTRIC DIGITAL DATA PROCESSING PHYSICS |
title | Distributed system resource optimal allocation method based on LSTM and genetic algorithm |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-27T02%3A38%3A28IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=MAO%20JIAFA&rft.date=2022-05-24&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3ECN114528094A%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |