Routing optimization method and system based on graph neural network and deep reinforcement learning

The invention discloses a routing optimization method and system based on a graph neural network and deep reinforcement learning, and belongs to the field of network routing optimization. The method comprises the following steps: measuring a current network state s, and selecting k shortest paths fr...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: WU ZHONGLI, LYU MENGDA, DAI BIN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator WU ZHONGLI
LYU MENGDA
DAI BIN
description The invention discloses a routing optimization method and system based on a graph neural network and deep reinforcement learning, and belongs to the field of network routing optimization. The method comprises the following steps: measuring a current network state s, and selecting k shortest paths from a source node to a target node as an action set a according to a traffic demand distributed by a current network state request; inputting the action set a into the graph neural network, aggregating and iteratively updating link features , and obtaining a network state s and an estimated Q value of the action set a through a Q function; and performing deep reinforcement learning according to the estimated Q value to obtain a routing strategy in the current network state, and feeding back the routing strategy to the network topology to execute a corresponding routing action. The invention provides a network routing optimization system structure based on the graph neural network and deep reinforcement learning, and
format Patent
fullrecord <record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_CN113194034A</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>CN113194034A</sourcerecordid><originalsourceid>FETCH-epo_espacenet_CN113194034A3</originalsourceid><addsrcrecordid>eNqNjLEKwkAQBdNYiPoP6wcIhqSxlKBYWYh9WHMv8TC3d9xtEP16D_EDrKaYYeaFufhJrQzkg1pn36zWCzno3RtiMZReSeHoxgmGshoihzsJpshjhj59fHxDAwSKsNL72MFBlEZwlDxfFrOex4TVj4tifTxcm9MGwbdIgTvkU9ucy7Iqd_W2qvfVP80HNGI_WA</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>Routing optimization method and system based on graph neural network and deep reinforcement learning</title><source>esp@cenet</source><creator>WU ZHONGLI ; LYU MENGDA ; DAI BIN</creator><creatorcontrib>WU ZHONGLI ; LYU MENGDA ; DAI BIN</creatorcontrib><description>The invention discloses a routing optimization method and system based on a graph neural network and deep reinforcement learning, and belongs to the field of network routing optimization. The method comprises the following steps: measuring a current network state s, and selecting k shortest paths from a source node to a target node as an action set a according to a traffic demand distributed by a current network state request; inputting the action set a into the graph neural network, aggregating and iteratively updating link features , and obtaining a network state s and an estimated Q value of the action set a through a Q function; and performing deep reinforcement learning according to the estimated Q value to obtain a routing strategy in the current network state, and feeding back the routing strategy to the network topology to execute a corresponding routing action. The invention provides a network routing optimization system structure based on the graph neural network and deep reinforcement learning, and</description><language>chi ; eng</language><subject>CALCULATING ; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS ; COMPUTING ; COUNTING ; ELECTRIC COMMUNICATION TECHNIQUE ; ELECTRICITY ; PHYSICS ; TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION</subject><creationdate>2021</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20210730&amp;DB=EPODOC&amp;CC=CN&amp;NR=113194034A$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,308,780,885,25564,76547</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20210730&amp;DB=EPODOC&amp;CC=CN&amp;NR=113194034A$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>WU ZHONGLI</creatorcontrib><creatorcontrib>LYU MENGDA</creatorcontrib><creatorcontrib>DAI BIN</creatorcontrib><title>Routing optimization method and system based on graph neural network and deep reinforcement learning</title><description>The invention discloses a routing optimization method and system based on a graph neural network and deep reinforcement learning, and belongs to the field of network routing optimization. The method comprises the following steps: measuring a current network state s, and selecting k shortest paths from a source node to a target node as an action set a according to a traffic demand distributed by a current network state request; inputting the action set a into the graph neural network, aggregating and iteratively updating link features , and obtaining a network state s and an estimated Q value of the action set a through a Q function; and performing deep reinforcement learning according to the estimated Q value to obtain a routing strategy in the current network state, and feeding back the routing strategy to the network topology to execute a corresponding routing action. The invention provides a network routing optimization system structure based on the graph neural network and deep reinforcement learning, and</description><subject>CALCULATING</subject><subject>COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS</subject><subject>COMPUTING</subject><subject>COUNTING</subject><subject>ELECTRIC COMMUNICATION TECHNIQUE</subject><subject>ELECTRICITY</subject><subject>PHYSICS</subject><subject>TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2021</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNqNjLEKwkAQBdNYiPoP6wcIhqSxlKBYWYh9WHMv8TC3d9xtEP16D_EDrKaYYeaFufhJrQzkg1pn36zWCzno3RtiMZReSeHoxgmGshoihzsJpshjhj59fHxDAwSKsNL72MFBlEZwlDxfFrOex4TVj4tifTxcm9MGwbdIgTvkU9ucy7Iqd_W2qvfVP80HNGI_WA</recordid><startdate>20210730</startdate><enddate>20210730</enddate><creator>WU ZHONGLI</creator><creator>LYU MENGDA</creator><creator>DAI BIN</creator><scope>EVB</scope></search><sort><creationdate>20210730</creationdate><title>Routing optimization method and system based on graph neural network and deep reinforcement learning</title><author>WU ZHONGLI ; LYU MENGDA ; DAI BIN</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_CN113194034A3</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>chi ; eng</language><creationdate>2021</creationdate><topic>CALCULATING</topic><topic>COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS</topic><topic>COMPUTING</topic><topic>COUNTING</topic><topic>ELECTRIC COMMUNICATION TECHNIQUE</topic><topic>ELECTRICITY</topic><topic>PHYSICS</topic><topic>TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION</topic><toplevel>online_resources</toplevel><creatorcontrib>WU ZHONGLI</creatorcontrib><creatorcontrib>LYU MENGDA</creatorcontrib><creatorcontrib>DAI BIN</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>WU ZHONGLI</au><au>LYU MENGDA</au><au>DAI BIN</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>Routing optimization method and system based on graph neural network and deep reinforcement learning</title><date>2021-07-30</date><risdate>2021</risdate><abstract>The invention discloses a routing optimization method and system based on a graph neural network and deep reinforcement learning, and belongs to the field of network routing optimization. The method comprises the following steps: measuring a current network state s, and selecting k shortest paths from a source node to a target node as an action set a according to a traffic demand distributed by a current network state request; inputting the action set a into the graph neural network, aggregating and iteratively updating link features , and obtaining a network state s and an estimated Q value of the action set a through a Q function; and performing deep reinforcement learning according to the estimated Q value to obtain a routing strategy in the current network state, and feeding back the routing strategy to the network topology to execute a corresponding routing action. The invention provides a network routing optimization system structure based on the graph neural network and deep reinforcement learning, and</abstract><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier
ispartof
issn
language chi ; eng
recordid cdi_epo_espacenet_CN113194034A
source esp@cenet
subjects CALCULATING
COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
COMPUTING
COUNTING
ELECTRIC COMMUNICATION TECHNIQUE
ELECTRICITY
PHYSICS
TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION
title Routing optimization method and system based on graph neural network and deep reinforcement learning
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-07T02%3A26%3A56IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=WU%20ZHONGLI&rft.date=2021-07-30&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3ECN113194034A%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true