Federation-based Deep Reinforcement Learning Cooperative Cache in Vehicular Edge Networks
With the emergence of a large number of computing resource-intensive applications and a variety of content delivery services, data in Internet of Vehicles (IoV) is exploding. In order to improve the service performance of IoV, Vehicle Edge Computing (VEC) accelerates the response process of content...
Gespeichert in:
Veröffentlicht in: | IEEE internet of things journal 2024-01, Vol.11 (2), p.1-1 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 1 |
---|---|
container_issue | 2 |
container_start_page | 1 |
container_title | IEEE internet of things journal |
container_volume | 11 |
creator | Wu, Honghai Jin, Jichong Ma, Huahong Xing, Ling |
description | With the emergence of a large number of computing resource-intensive applications and a variety of content delivery services, data in Internet of Vehicles (IoV) is exploding. In order to improve the service performance of IoV, Vehicle Edge Computing (VEC) accelerates the response process of content requests and reduces the backhaul burden of the base station by caching content at the nodes of the edge network. However, the existing caching strategies are usually affected by high computing and communication overhead, and can not well capture the dynamic changes and content popularity of the vehicle network. In order to solve these problems, we design a novel Cooperative Caching scheme by using Mobility Prediction and Consistent Hash for Federated Learning (called CMCF), which integrates mobility prediction and consistent hashing into the content caching scheme, and uses the federated learning framework to optimize the cached content, then we use deep reinforcement learning algorithm to develop the optimal cooperative caching policy to reduce the average delay of content transmission. Extensive simulation results prove the superiority of our method. Compared with other advanced caching schemes, CMCF can increase the cache hit rate by 8.7% and reduce the average content delivery delay by 17.8%. |
doi_str_mv | 10.1109/JIOT.2023.3292374 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_2912945367</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10173652</ieee_id><sourcerecordid>2912945367</sourcerecordid><originalsourceid>FETCH-LOGICAL-c246t-d1ab47c229225cc8969780e17dce5c104505674e6af3fe236f0bc17e4563f5153</originalsourceid><addsrcrecordid>eNpNkE1PwkAQhjdGEwnyA0w8bOK5uN9Lj6aCYogkBk08bZbtFIrQrbutxn9vEQ6cZg7P-87kQeiakiGlJL17ns4XQ0YYH3KWMq7FGeoxznQilGLnJ_slGsS4IYR0MUlT1UMfE8gh2Kb0VbK0EXL8AFDjVyirwgcHO6gaPAMbqrJa4cz7-p_-BpxZtwZcVvgd1qVrtzbgcb4C_ALNjw-f8QpdFHYbYXCcffQ2GS-yp2Q2f5xm97PEMaGaJKd2KbRj3eNMOjdKVapHBKjOHUhHiZBEKi1A2YIXwLgqyNJRDUIqXkgqeR_dHnrr4L9aiI3Z-DZU3UnDUspSIbnSHUUPlAs-xgCFqUO5s-HXUGL2Es1eotlLNEeJXebmkCkB4ISnmivJ-B9fnGzH</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2912945367</pqid></control><display><type>article</type><title>Federation-based Deep Reinforcement Learning Cooperative Cache in Vehicular Edge Networks</title><source>IEEE Electronic Library (IEL)</source><creator>Wu, Honghai ; Jin, Jichong ; Ma, Huahong ; Xing, Ling</creator><creatorcontrib>Wu, Honghai ; Jin, Jichong ; Ma, Huahong ; Xing, Ling</creatorcontrib><description>With the emergence of a large number of computing resource-intensive applications and a variety of content delivery services, data in Internet of Vehicles (IoV) is exploding. In order to improve the service performance of IoV, Vehicle Edge Computing (VEC) accelerates the response process of content requests and reduces the backhaul burden of the base station by caching content at the nodes of the edge network. However, the existing caching strategies are usually affected by high computing and communication overhead, and can not well capture the dynamic changes and content popularity of the vehicle network. In order to solve these problems, we design a novel Cooperative Caching scheme by using Mobility Prediction and Consistent Hash for Federated Learning (called CMCF), which integrates mobility prediction and consistent hashing into the content caching scheme, and uses the federated learning framework to optimize the cached content, then we use deep reinforcement learning algorithm to develop the optimal cooperative caching policy to reduce the average delay of content transmission. Extensive simulation results prove the superiority of our method. Compared with other advanced caching schemes, CMCF can increase the cache hit rate by 8.7% and reduce the average content delivery delay by 17.8%.</description><identifier>ISSN: 2327-4662</identifier><identifier>EISSN: 2327-4662</identifier><identifier>DOI: 10.1109/JIOT.2023.3292374</identifier><identifier>CODEN: IITJAU</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Algorithms ; Caching ; Collaboration ; Consistent Hashing ; Cooperative caching ; Deep learning ; Deep Reinforcement Learning ; Delays ; Delivery services ; Edge computing ; Federated learning ; Internet of Things ; Internet of Vehicles ; Machine learning ; Optimization ; Radio equipment ; Reinforcement learning ; Servers ; Vehicle dynamics</subject><ispartof>IEEE internet of things journal, 2024-01, Vol.11 (2), p.1-1</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024</rights><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c246t-d1ab47c229225cc8969780e17dce5c104505674e6af3fe236f0bc17e4563f5153</cites><orcidid>0000-0001-5784-9003 ; 0000-0003-0209-4488 ; 0000-0002-0291-3001 ; 0000-0002-5132-3817</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10173652$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27922,27923,54756</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10173652$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Wu, Honghai</creatorcontrib><creatorcontrib>Jin, Jichong</creatorcontrib><creatorcontrib>Ma, Huahong</creatorcontrib><creatorcontrib>Xing, Ling</creatorcontrib><title>Federation-based Deep Reinforcement Learning Cooperative Cache in Vehicular Edge Networks</title><title>IEEE internet of things journal</title><addtitle>JIoT</addtitle><description>With the emergence of a large number of computing resource-intensive applications and a variety of content delivery services, data in Internet of Vehicles (IoV) is exploding. In order to improve the service performance of IoV, Vehicle Edge Computing (VEC) accelerates the response process of content requests and reduces the backhaul burden of the base station by caching content at the nodes of the edge network. However, the existing caching strategies are usually affected by high computing and communication overhead, and can not well capture the dynamic changes and content popularity of the vehicle network. In order to solve these problems, we design a novel Cooperative Caching scheme by using Mobility Prediction and Consistent Hash for Federated Learning (called CMCF), which integrates mobility prediction and consistent hashing into the content caching scheme, and uses the federated learning framework to optimize the cached content, then we use deep reinforcement learning algorithm to develop the optimal cooperative caching policy to reduce the average delay of content transmission. Extensive simulation results prove the superiority of our method. Compared with other advanced caching schemes, CMCF can increase the cache hit rate by 8.7% and reduce the average content delivery delay by 17.8%.</description><subject>Algorithms</subject><subject>Caching</subject><subject>Collaboration</subject><subject>Consistent Hashing</subject><subject>Cooperative caching</subject><subject>Deep learning</subject><subject>Deep Reinforcement Learning</subject><subject>Delays</subject><subject>Delivery services</subject><subject>Edge computing</subject><subject>Federated learning</subject><subject>Internet of Things</subject><subject>Internet of Vehicles</subject><subject>Machine learning</subject><subject>Optimization</subject><subject>Radio equipment</subject><subject>Reinforcement learning</subject><subject>Servers</subject><subject>Vehicle dynamics</subject><issn>2327-4662</issn><issn>2327-4662</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkE1PwkAQhjdGEwnyA0w8bOK5uN9Lj6aCYogkBk08bZbtFIrQrbutxn9vEQ6cZg7P-87kQeiakiGlJL17ns4XQ0YYH3KWMq7FGeoxznQilGLnJ_slGsS4IYR0MUlT1UMfE8gh2Kb0VbK0EXL8AFDjVyirwgcHO6gaPAMbqrJa4cz7-p_-BpxZtwZcVvgd1qVrtzbgcb4C_ALNjw-f8QpdFHYbYXCcffQ2GS-yp2Q2f5xm97PEMaGaJKd2KbRj3eNMOjdKVapHBKjOHUhHiZBEKi1A2YIXwLgqyNJRDUIqXkgqeR_dHnrr4L9aiI3Z-DZU3UnDUspSIbnSHUUPlAs-xgCFqUO5s-HXUGL2Es1eotlLNEeJXebmkCkB4ISnmivJ-B9fnGzH</recordid><startdate>20240115</startdate><enddate>20240115</enddate><creator>Wu, Honghai</creator><creator>Jin, Jichong</creator><creator>Ma, Huahong</creator><creator>Xing, Ling</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0001-5784-9003</orcidid><orcidid>https://orcid.org/0000-0003-0209-4488</orcidid><orcidid>https://orcid.org/0000-0002-0291-3001</orcidid><orcidid>https://orcid.org/0000-0002-5132-3817</orcidid></search><sort><creationdate>20240115</creationdate><title>Federation-based Deep Reinforcement Learning Cooperative Cache in Vehicular Edge Networks</title><author>Wu, Honghai ; Jin, Jichong ; Ma, Huahong ; Xing, Ling</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c246t-d1ab47c229225cc8969780e17dce5c104505674e6af3fe236f0bc17e4563f5153</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Algorithms</topic><topic>Caching</topic><topic>Collaboration</topic><topic>Consistent Hashing</topic><topic>Cooperative caching</topic><topic>Deep learning</topic><topic>Deep Reinforcement Learning</topic><topic>Delays</topic><topic>Delivery services</topic><topic>Edge computing</topic><topic>Federated learning</topic><topic>Internet of Things</topic><topic>Internet of Vehicles</topic><topic>Machine learning</topic><topic>Optimization</topic><topic>Radio equipment</topic><topic>Reinforcement learning</topic><topic>Servers</topic><topic>Vehicle dynamics</topic><toplevel>online_resources</toplevel><creatorcontrib>Wu, Honghai</creatorcontrib><creatorcontrib>Jin, Jichong</creatorcontrib><creatorcontrib>Ma, Huahong</creatorcontrib><creatorcontrib>Xing, Ling</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE internet of things journal</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Wu, Honghai</au><au>Jin, Jichong</au><au>Ma, Huahong</au><au>Xing, Ling</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Federation-based Deep Reinforcement Learning Cooperative Cache in Vehicular Edge Networks</atitle><jtitle>IEEE internet of things journal</jtitle><stitle>JIoT</stitle><date>2024-01-15</date><risdate>2024</risdate><volume>11</volume><issue>2</issue><spage>1</spage><epage>1</epage><pages>1-1</pages><issn>2327-4662</issn><eissn>2327-4662</eissn><coden>IITJAU</coden><abstract>With the emergence of a large number of computing resource-intensive applications and a variety of content delivery services, data in Internet of Vehicles (IoV) is exploding. In order to improve the service performance of IoV, Vehicle Edge Computing (VEC) accelerates the response process of content requests and reduces the backhaul burden of the base station by caching content at the nodes of the edge network. However, the existing caching strategies are usually affected by high computing and communication overhead, and can not well capture the dynamic changes and content popularity of the vehicle network. In order to solve these problems, we design a novel Cooperative Caching scheme by using Mobility Prediction and Consistent Hash for Federated Learning (called CMCF), which integrates mobility prediction and consistent hashing into the content caching scheme, and uses the federated learning framework to optimize the cached content, then we use deep reinforcement learning algorithm to develop the optimal cooperative caching policy to reduce the average delay of content transmission. Extensive simulation results prove the superiority of our method. Compared with other advanced caching schemes, CMCF can increase the cache hit rate by 8.7% and reduce the average content delivery delay by 17.8%.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/JIOT.2023.3292374</doi><tpages>1</tpages><orcidid>https://orcid.org/0000-0001-5784-9003</orcidid><orcidid>https://orcid.org/0000-0003-0209-4488</orcidid><orcidid>https://orcid.org/0000-0002-0291-3001</orcidid><orcidid>https://orcid.org/0000-0002-5132-3817</orcidid></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 2327-4662 |
ispartof | IEEE internet of things journal, 2024-01, Vol.11 (2), p.1-1 |
issn | 2327-4662 2327-4662 |
language | eng |
recordid | cdi_proquest_journals_2912945367 |
source | IEEE Electronic Library (IEL) |
subjects | Algorithms Caching Collaboration Consistent Hashing Cooperative caching Deep learning Deep Reinforcement Learning Delays Delivery services Edge computing Federated learning Internet of Things Internet of Vehicles Machine learning Optimization Radio equipment Reinforcement learning Servers Vehicle dynamics |
title | Federation-based Deep Reinforcement Learning Cooperative Cache in Vehicular Edge Networks |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-13T23%3A25%3A47IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Federation-based%20Deep%20Reinforcement%20Learning%20Cooperative%20Cache%20in%20Vehicular%20Edge%20Networks&rft.jtitle=IEEE%20internet%20of%20things%20journal&rft.au=Wu,%20Honghai&rft.date=2024-01-15&rft.volume=11&rft.issue=2&rft.spage=1&rft.epage=1&rft.pages=1-1&rft.issn=2327-4662&rft.eissn=2327-4662&rft.coden=IITJAU&rft_id=info:doi/10.1109/JIOT.2023.3292374&rft_dat=%3Cproquest_RIE%3E2912945367%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2912945367&rft_id=info:pmid/&rft_ieee_id=10173652&rfr_iscdi=true |