Learning-Assisted Energy Minimization for MEC Systems With Noncompletely Overlapping NOMA

This article investigates the long-term energy minimization of mobile edge computing (MEC) systems with multiuser noncompletely overlapping nonorthogonal multiple access (NOMA) when time varying channel is considered. Different from the existing work with multiuser noncompletely overlapping NOMA tha...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE systems journal 2023-12, Vol.17 (4), p.1-12
Hauptverfasser: Han, Siping, Lu, Baoshan, Lin, Shijun, Hong, Xuemin, Shi, Jianghong
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 12
container_issue 4
container_start_page 1
container_title IEEE systems journal
container_volume 17
creator Han, Siping
Lu, Baoshan
Lin, Shijun
Hong, Xuemin
Shi, Jianghong
description This article investigates the long-term energy minimization of mobile edge computing (MEC) systems with multiuser noncompletely overlapping nonorthogonal multiple access (NOMA) when time varying channel is considered. Different from the existing work with multiuser noncompletely overlapping NOMA that adopted the delay-based successive interference cancellation (SIC) decoding order, we adopt the channel gain-based SIC decoding order, which is widely used and has been proved to be more energy-efficient. We formulate the problem as a joint transmit power, transmission time, and computing resource optimization problem with multiple deeply coupled variables. To ensure the real-time decision-making, the considered problem is characterized as a deep reinforcement learning (DRL) problem by introducing penalty mechanism into the immediate reward function when the constraints are violated, and we propose a soft actor-critic (SAC) algorithm to solve it. Simulations show that the proposed algorithm can significantly improve the system's performance, and, compared with the noncompletely overlapping NOMA mechanism with delay-based SIC decoding order, the completely overlapping NOMA mechanism and time division multiple access (TDMA) mechanism, the noncompletely overlapping NOMA mechanism with channel gain-based SIC decoding order can achieve an average energy consumption reduction of 32.4%, 49.9%, and 74.4%, respectively.
doi_str_mv 10.1109/JSYST.2023.3283254
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_2901426038</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10158329</ieee_id><sourcerecordid>2901426038</sourcerecordid><originalsourceid>FETCH-LOGICAL-c296t-60ff57aecee9962aec8e4fea705cbc01a607b87b92f78c0c78658a3f9ba054b93</originalsourceid><addsrcrecordid>eNpNkElLAzEYhoMoqNU_IB4CnqdmmUySYyl1o8uhFelpyMRvaspsJlNh_PVOl4On74XvXeBB6I6SIaVEP74t18vVkBHGh5wpzkR8hq6o5jLSjMfnB80iRVV8ia5D2BIilJD6Cq2nYHzlqk00CsGFFj7xpAK_6fDMVa50v6Z1dYXz2uPZZIyXXW8pA_5w7Ree15Wty6aAFooOL37AF6Zp-i48X8xGN-giN0WA29MdoPenyWr8Ek0Xz6_j0TSyTCdtlJA8F9KABdA6Yb1QEOdgJBE2s4SahMhMyUyzXCpLrFSJUIbnOjNExJnmA_Rw7G18_b2D0KbbeuerfjJlmtCYJYSr3sWOLuvrEDzkaeNdaXyXUpLuEaYHhOkeYXpC2IfujyEHAP8CVPR_zf8AkkdubQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2901426038</pqid></control><display><type>article</type><title>Learning-Assisted Energy Minimization for MEC Systems With Noncompletely Overlapping NOMA</title><source>IEEE Electronic Library (IEL)</source><creator>Han, Siping ; Lu, Baoshan ; Lin, Shijun ; Hong, Xuemin ; Shi, Jianghong</creator><creatorcontrib>Han, Siping ; Lu, Baoshan ; Lin, Shijun ; Hong, Xuemin ; Shi, Jianghong</creatorcontrib><description>This article investigates the long-term energy minimization of mobile edge computing (MEC) systems with multiuser noncompletely overlapping nonorthogonal multiple access (NOMA) when time varying channel is considered. Different from the existing work with multiuser noncompletely overlapping NOMA that adopted the delay-based successive interference cancellation (SIC) decoding order, we adopt the channel gain-based SIC decoding order, which is widely used and has been proved to be more energy-efficient. We formulate the problem as a joint transmit power, transmission time, and computing resource optimization problem with multiple deeply coupled variables. To ensure the real-time decision-making, the considered problem is characterized as a deep reinforcement learning (DRL) problem by introducing penalty mechanism into the immediate reward function when the constraints are violated, and we propose a soft actor-critic (SAC) algorithm to solve it. Simulations show that the proposed algorithm can significantly improve the system's performance, and, compared with the noncompletely overlapping NOMA mechanism with delay-based SIC decoding order, the completely overlapping NOMA mechanism and time division multiple access (TDMA) mechanism, the noncompletely overlapping NOMA mechanism with channel gain-based SIC decoding order can achieve an average energy consumption reduction of 32.4%, 49.9%, and 74.4%, respectively.</description><identifier>ISSN: 1932-8184</identifier><identifier>EISSN: 1937-9234</identifier><identifier>DOI: 10.1109/JSYST.2023.3283254</identifier><identifier>CODEN: ISJEB2</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Algorithms ; Decoding ; Deep learning ; Deep reinforcement learning ; Delays ; Edge computing ; Energy consumption ; energy minimization ; Minimization ; Mobile computing ; mobile edge computing ; multiuser noncompletely overlapping ; NOMA ; Nonorthogonal multiple access ; Optimization ; Real variables ; Resource management ; Task analysis ; Time Division Multiple Access ; time varying channel</subject><ispartof>IEEE systems journal, 2023-12, Vol.17 (4), p.1-12</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2023</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c296t-60ff57aecee9962aec8e4fea705cbc01a607b87b92f78c0c78658a3f9ba054b93</citedby><cites>FETCH-LOGICAL-c296t-60ff57aecee9962aec8e4fea705cbc01a607b87b92f78c0c78658a3f9ba054b93</cites><orcidid>0000-0001-6537-5653 ; 0000-0002-3438-0510 ; 0000-0001-8545-0016</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10158329$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10158329$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Han, Siping</creatorcontrib><creatorcontrib>Lu, Baoshan</creatorcontrib><creatorcontrib>Lin, Shijun</creatorcontrib><creatorcontrib>Hong, Xuemin</creatorcontrib><creatorcontrib>Shi, Jianghong</creatorcontrib><title>Learning-Assisted Energy Minimization for MEC Systems With Noncompletely Overlapping NOMA</title><title>IEEE systems journal</title><addtitle>JSYST</addtitle><description>This article investigates the long-term energy minimization of mobile edge computing (MEC) systems with multiuser noncompletely overlapping nonorthogonal multiple access (NOMA) when time varying channel is considered. Different from the existing work with multiuser noncompletely overlapping NOMA that adopted the delay-based successive interference cancellation (SIC) decoding order, we adopt the channel gain-based SIC decoding order, which is widely used and has been proved to be more energy-efficient. We formulate the problem as a joint transmit power, transmission time, and computing resource optimization problem with multiple deeply coupled variables. To ensure the real-time decision-making, the considered problem is characterized as a deep reinforcement learning (DRL) problem by introducing penalty mechanism into the immediate reward function when the constraints are violated, and we propose a soft actor-critic (SAC) algorithm to solve it. Simulations show that the proposed algorithm can significantly improve the system's performance, and, compared with the noncompletely overlapping NOMA mechanism with delay-based SIC decoding order, the completely overlapping NOMA mechanism and time division multiple access (TDMA) mechanism, the noncompletely overlapping NOMA mechanism with channel gain-based SIC decoding order can achieve an average energy consumption reduction of 32.4%, 49.9%, and 74.4%, respectively.</description><subject>Algorithms</subject><subject>Decoding</subject><subject>Deep learning</subject><subject>Deep reinforcement learning</subject><subject>Delays</subject><subject>Edge computing</subject><subject>Energy consumption</subject><subject>energy minimization</subject><subject>Minimization</subject><subject>Mobile computing</subject><subject>mobile edge computing</subject><subject>multiuser noncompletely overlapping</subject><subject>NOMA</subject><subject>Nonorthogonal multiple access</subject><subject>Optimization</subject><subject>Real variables</subject><subject>Resource management</subject><subject>Task analysis</subject><subject>Time Division Multiple Access</subject><subject>time varying channel</subject><issn>1932-8184</issn><issn>1937-9234</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkElLAzEYhoMoqNU_IB4CnqdmmUySYyl1o8uhFelpyMRvaspsJlNh_PVOl4On74XvXeBB6I6SIaVEP74t18vVkBHGh5wpzkR8hq6o5jLSjMfnB80iRVV8ia5D2BIilJD6Cq2nYHzlqk00CsGFFj7xpAK_6fDMVa50v6Z1dYXz2uPZZIyXXW8pA_5w7Ree15Wty6aAFooOL37AF6Zp-i48X8xGN-giN0WA29MdoPenyWr8Ek0Xz6_j0TSyTCdtlJA8F9KABdA6Yb1QEOdgJBE2s4SahMhMyUyzXCpLrFSJUIbnOjNExJnmA_Rw7G18_b2D0KbbeuerfjJlmtCYJYSr3sWOLuvrEDzkaeNdaXyXUpLuEaYHhOkeYXpC2IfujyEHAP8CVPR_zf8AkkdubQ</recordid><startdate>20231201</startdate><enddate>20231201</enddate><creator>Han, Siping</creator><creator>Lu, Baoshan</creator><creator>Lin, Shijun</creator><creator>Hong, Xuemin</creator><creator>Shi, Jianghong</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0001-6537-5653</orcidid><orcidid>https://orcid.org/0000-0002-3438-0510</orcidid><orcidid>https://orcid.org/0000-0001-8545-0016</orcidid></search><sort><creationdate>20231201</creationdate><title>Learning-Assisted Energy Minimization for MEC Systems With Noncompletely Overlapping NOMA</title><author>Han, Siping ; Lu, Baoshan ; Lin, Shijun ; Hong, Xuemin ; Shi, Jianghong</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c296t-60ff57aecee9962aec8e4fea705cbc01a607b87b92f78c0c78658a3f9ba054b93</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Algorithms</topic><topic>Decoding</topic><topic>Deep learning</topic><topic>Deep reinforcement learning</topic><topic>Delays</topic><topic>Edge computing</topic><topic>Energy consumption</topic><topic>energy minimization</topic><topic>Minimization</topic><topic>Mobile computing</topic><topic>mobile edge computing</topic><topic>multiuser noncompletely overlapping</topic><topic>NOMA</topic><topic>Nonorthogonal multiple access</topic><topic>Optimization</topic><topic>Real variables</topic><topic>Resource management</topic><topic>Task analysis</topic><topic>Time Division Multiple Access</topic><topic>time varying channel</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Han, Siping</creatorcontrib><creatorcontrib>Lu, Baoshan</creatorcontrib><creatorcontrib>Lin, Shijun</creatorcontrib><creatorcontrib>Hong, Xuemin</creatorcontrib><creatorcontrib>Shi, Jianghong</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><jtitle>IEEE systems journal</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Han, Siping</au><au>Lu, Baoshan</au><au>Lin, Shijun</au><au>Hong, Xuemin</au><au>Shi, Jianghong</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Learning-Assisted Energy Minimization for MEC Systems With Noncompletely Overlapping NOMA</atitle><jtitle>IEEE systems journal</jtitle><stitle>JSYST</stitle><date>2023-12-01</date><risdate>2023</risdate><volume>17</volume><issue>4</issue><spage>1</spage><epage>12</epage><pages>1-12</pages><issn>1932-8184</issn><eissn>1937-9234</eissn><coden>ISJEB2</coden><abstract>This article investigates the long-term energy minimization of mobile edge computing (MEC) systems with multiuser noncompletely overlapping nonorthogonal multiple access (NOMA) when time varying channel is considered. Different from the existing work with multiuser noncompletely overlapping NOMA that adopted the delay-based successive interference cancellation (SIC) decoding order, we adopt the channel gain-based SIC decoding order, which is widely used and has been proved to be more energy-efficient. We formulate the problem as a joint transmit power, transmission time, and computing resource optimization problem with multiple deeply coupled variables. To ensure the real-time decision-making, the considered problem is characterized as a deep reinforcement learning (DRL) problem by introducing penalty mechanism into the immediate reward function when the constraints are violated, and we propose a soft actor-critic (SAC) algorithm to solve it. Simulations show that the proposed algorithm can significantly improve the system's performance, and, compared with the noncompletely overlapping NOMA mechanism with delay-based SIC decoding order, the completely overlapping NOMA mechanism and time division multiple access (TDMA) mechanism, the noncompletely overlapping NOMA mechanism with channel gain-based SIC decoding order can achieve an average energy consumption reduction of 32.4%, 49.9%, and 74.4%, respectively.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/JSYST.2023.3283254</doi><tpages>12</tpages><orcidid>https://orcid.org/0000-0001-6537-5653</orcidid><orcidid>https://orcid.org/0000-0002-3438-0510</orcidid><orcidid>https://orcid.org/0000-0001-8545-0016</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1932-8184
ispartof IEEE systems journal, 2023-12, Vol.17 (4), p.1-12
issn 1932-8184
1937-9234
language eng
recordid cdi_proquest_journals_2901426038
source IEEE Electronic Library (IEL)
subjects Algorithms
Decoding
Deep learning
Deep reinforcement learning
Delays
Edge computing
Energy consumption
energy minimization
Minimization
Mobile computing
mobile edge computing
multiuser noncompletely overlapping
NOMA
Nonorthogonal multiple access
Optimization
Real variables
Resource management
Task analysis
Time Division Multiple Access
time varying channel
title Learning-Assisted Energy Minimization for MEC Systems With Noncompletely Overlapping NOMA
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-02T00%3A48%3A01IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Learning-Assisted%20Energy%20Minimization%20for%20MEC%20Systems%20With%20Noncompletely%20Overlapping%20NOMA&rft.jtitle=IEEE%20systems%20journal&rft.au=Han,%20Siping&rft.date=2023-12-01&rft.volume=17&rft.issue=4&rft.spage=1&rft.epage=12&rft.pages=1-12&rft.issn=1932-8184&rft.eissn=1937-9234&rft.coden=ISJEB2&rft_id=info:doi/10.1109/JSYST.2023.3283254&rft_dat=%3Cproquest_RIE%3E2901426038%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2901426038&rft_id=info:pmid/&rft_ieee_id=10158329&rfr_iscdi=true