Diffusion Quantum-Least Mean Square Algorithm with Steady-State Analysis
Diffusion least mean square (LMS) algorithm is a well-known algorithm for distributed estimation where estimation takes place at multiple nodes. However, it inherits slow convergence speed due to its gradient descent-based design. To deal with this challenge, we proposed a modified diffusion LMS wit...
Gespeichert in:
Veröffentlicht in: | Circuits, systems, and signal processing systems, and signal processing, 2022-06, Vol.41 (6), p.3306-3327 |
---|---|
Hauptverfasser: | , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 3327 |
---|---|
container_issue | 6 |
container_start_page | 3306 |
container_title | Circuits, systems, and signal processing |
container_volume | 41 |
creator | Arif, Muhammad Moinuddin, Muhammad Naseem, Imran Alsaggaf, Abdulrahman U. Al-Saggaf, Ubaid M. |
description | Diffusion least mean square (LMS) algorithm is a well-known algorithm for distributed estimation where estimation takes place at multiple nodes. However, it inherits slow convergence speed due to its gradient descent-based design. To deal with this challenge, we proposed a modified diffusion LMS with improved convergence performance by employing quantum-calculus-based gradient descent, and hence, we called it diffusion
q
-least mean square (Diff-
q
LMS). In the proposed design, we derive the weight update mechanism by minimizing the conventional mean square error (MSE) cost function via quantum-derivative in a distributed estimation environment. We developed two different modes of diffusion
q
LMS operation: combine-then-adapt (CTA) and adapt-then-combine (ATC). To improve the performance in terms of faster convergence and lower steady-state error, we also developed an efficient mechanism to obtain the optimal values of
q
-parameter for each tap-weight of the filter in order to achieve both faster convergence and lower steady-state error. With the aim to achieve the performance of the proposed algorithm theoretically, convergence analysis for both the transient and the steady-state scenarios is presented. Consequently, closed-form expressions governing both the transient and the steady-state behaviors in terms of mean square deviation (MSD) and excess mean square error (EMSE) for both local node and global network are derived. The theoretical claims are validated via Monte Carlo simulations. The performance of the proposed algorithm is investigated for various system noises and the results show the superiority of the proposed algorithm in terms of both the convergence speed and the steady-state error. |
doi_str_mv | 10.1007/s00034-021-01934-z |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2654822453</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2654822453</sourcerecordid><originalsourceid>FETCH-LOGICAL-c319t-c1f039e7343f9673150c7976956bb3c68254adede92ac7f108345338cbf031fb3</originalsourceid><addsrcrecordid>eNp9kMFKAzEQhoMoWKsv4GnBc3SS7G6SY6naChWRKngL2TSpW9rdNski7dObuoI3LzMD833D8CN0TeCWAPC7AAAsx0AJBiLTdDhBA1IwggvBxSkaAOUCgyAf5-gihBUkKpd0gKb3tXNdqNsme-10E7sNnlkdYvZsdZPNd532Nhutl62v4-cm-0o1m0erF3s8jzqmXaPX-1CHS3Tm9DrYq98-RO-PD2_jKZ69TJ7Goxk2jMiIDXHApOUsZ06WnJECDJe8lEVZVcyUgha5XtiFlVQb7ggIlheMCVMlj7iKDdFNf3fr211nQ1SrtvPpiaBoWeSC0iM_RLSnjG9D8Napra832u8VAXVMTPWJqZSY-klMHZLEeikkuFla_3f6H-sbxppuAg</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2654822453</pqid></control><display><type>article</type><title>Diffusion Quantum-Least Mean Square Algorithm with Steady-State Analysis</title><source>SpringerNature Journals</source><creator>Arif, Muhammad ; Moinuddin, Muhammad ; Naseem, Imran ; Alsaggaf, Abdulrahman U. ; Al-Saggaf, Ubaid M.</creator><creatorcontrib>Arif, Muhammad ; Moinuddin, Muhammad ; Naseem, Imran ; Alsaggaf, Abdulrahman U. ; Al-Saggaf, Ubaid M.</creatorcontrib><description>Diffusion least mean square (LMS) algorithm is a well-known algorithm for distributed estimation where estimation takes place at multiple nodes. However, it inherits slow convergence speed due to its gradient descent-based design. To deal with this challenge, we proposed a modified diffusion LMS with improved convergence performance by employing quantum-calculus-based gradient descent, and hence, we called it diffusion
q
-least mean square (Diff-
q
LMS). In the proposed design, we derive the weight update mechanism by minimizing the conventional mean square error (MSE) cost function via quantum-derivative in a distributed estimation environment. We developed two different modes of diffusion
q
LMS operation: combine-then-adapt (CTA) and adapt-then-combine (ATC). To improve the performance in terms of faster convergence and lower steady-state error, we also developed an efficient mechanism to obtain the optimal values of
q
-parameter for each tap-weight of the filter in order to achieve both faster convergence and lower steady-state error. With the aim to achieve the performance of the proposed algorithm theoretically, convergence analysis for both the transient and the steady-state scenarios is presented. Consequently, closed-form expressions governing both the transient and the steady-state behaviors in terms of mean square deviation (MSD) and excess mean square error (EMSE) for both local node and global network are derived. The theoretical claims are validated via Monte Carlo simulations. The performance of the proposed algorithm is investigated for various system noises and the results show the superiority of the proposed algorithm in terms of both the convergence speed and the steady-state error.</description><identifier>ISSN: 0278-081X</identifier><identifier>EISSN: 1531-5878</identifier><identifier>DOI: 10.1007/s00034-021-01934-z</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Algorithms ; Circuits and Systems ; Convergence ; Cost function ; Design modifications ; Diffusion ; Electrical Engineering ; Electronics and Microelectronics ; Engineering ; Errors ; Instrumentation ; Mean square errors ; Mean square values ; Performance enhancement ; Signal,Image and Speech Processing ; Steady state</subject><ispartof>Circuits, systems, and signal processing, 2022-06, Vol.41 (6), p.3306-3327</ispartof><rights>The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2021</rights><rights>The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2021.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c319t-c1f039e7343f9673150c7976956bb3c68254adede92ac7f108345338cbf031fb3</citedby><cites>FETCH-LOGICAL-c319t-c1f039e7343f9673150c7976956bb3c68254adede92ac7f108345338cbf031fb3</cites><orcidid>0000-0003-4735-0692</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s00034-021-01934-z$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s00034-021-01934-z$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,41488,42557,51319</link.rule.ids></links><search><creatorcontrib>Arif, Muhammad</creatorcontrib><creatorcontrib>Moinuddin, Muhammad</creatorcontrib><creatorcontrib>Naseem, Imran</creatorcontrib><creatorcontrib>Alsaggaf, Abdulrahman U.</creatorcontrib><creatorcontrib>Al-Saggaf, Ubaid M.</creatorcontrib><title>Diffusion Quantum-Least Mean Square Algorithm with Steady-State Analysis</title><title>Circuits, systems, and signal processing</title><addtitle>Circuits Syst Signal Process</addtitle><description>Diffusion least mean square (LMS) algorithm is a well-known algorithm for distributed estimation where estimation takes place at multiple nodes. However, it inherits slow convergence speed due to its gradient descent-based design. To deal with this challenge, we proposed a modified diffusion LMS with improved convergence performance by employing quantum-calculus-based gradient descent, and hence, we called it diffusion
q
-least mean square (Diff-
q
LMS). In the proposed design, we derive the weight update mechanism by minimizing the conventional mean square error (MSE) cost function via quantum-derivative in a distributed estimation environment. We developed two different modes of diffusion
q
LMS operation: combine-then-adapt (CTA) and adapt-then-combine (ATC). To improve the performance in terms of faster convergence and lower steady-state error, we also developed an efficient mechanism to obtain the optimal values of
q
-parameter for each tap-weight of the filter in order to achieve both faster convergence and lower steady-state error. With the aim to achieve the performance of the proposed algorithm theoretically, convergence analysis for both the transient and the steady-state scenarios is presented. Consequently, closed-form expressions governing both the transient and the steady-state behaviors in terms of mean square deviation (MSD) and excess mean square error (EMSE) for both local node and global network are derived. The theoretical claims are validated via Monte Carlo simulations. The performance of the proposed algorithm is investigated for various system noises and the results show the superiority of the proposed algorithm in terms of both the convergence speed and the steady-state error.</description><subject>Algorithms</subject><subject>Circuits and Systems</subject><subject>Convergence</subject><subject>Cost function</subject><subject>Design modifications</subject><subject>Diffusion</subject><subject>Electrical Engineering</subject><subject>Electronics and Microelectronics</subject><subject>Engineering</subject><subject>Errors</subject><subject>Instrumentation</subject><subject>Mean square errors</subject><subject>Mean square values</subject><subject>Performance enhancement</subject><subject>Signal,Image and Speech Processing</subject><subject>Steady state</subject><issn>0278-081X</issn><issn>1531-5878</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><recordid>eNp9kMFKAzEQhoMoWKsv4GnBc3SS7G6SY6naChWRKngL2TSpW9rdNski7dObuoI3LzMD833D8CN0TeCWAPC7AAAsx0AJBiLTdDhBA1IwggvBxSkaAOUCgyAf5-gihBUkKpd0gKb3tXNdqNsme-10E7sNnlkdYvZsdZPNd532Nhutl62v4-cm-0o1m0erF3s8jzqmXaPX-1CHS3Tm9DrYq98-RO-PD2_jKZ69TJ7Goxk2jMiIDXHApOUsZ06WnJECDJe8lEVZVcyUgha5XtiFlVQb7ggIlheMCVMlj7iKDdFNf3fr211nQ1SrtvPpiaBoWeSC0iM_RLSnjG9D8Napra832u8VAXVMTPWJqZSY-klMHZLEeikkuFla_3f6H-sbxppuAg</recordid><startdate>20220601</startdate><enddate>20220601</enddate><creator>Arif, Muhammad</creator><creator>Moinuddin, Muhammad</creator><creator>Naseem, Imran</creator><creator>Alsaggaf, Abdulrahman U.</creator><creator>Al-Saggaf, Ubaid M.</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7SC</scope><scope>7SP</scope><scope>7XB</scope><scope>88I</scope><scope>8AL</scope><scope>8AO</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K7-</scope><scope>L6V</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>M0N</scope><scope>M2P</scope><scope>M7S</scope><scope>P5Z</scope><scope>P62</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>Q9U</scope><scope>S0W</scope><orcidid>https://orcid.org/0000-0003-4735-0692</orcidid></search><sort><creationdate>20220601</creationdate><title>Diffusion Quantum-Least Mean Square Algorithm with Steady-State Analysis</title><author>Arif, Muhammad ; Moinuddin, Muhammad ; Naseem, Imran ; Alsaggaf, Abdulrahman U. ; Al-Saggaf, Ubaid M.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c319t-c1f039e7343f9673150c7976956bb3c68254adede92ac7f108345338cbf031fb3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Algorithms</topic><topic>Circuits and Systems</topic><topic>Convergence</topic><topic>Cost function</topic><topic>Design modifications</topic><topic>Diffusion</topic><topic>Electrical Engineering</topic><topic>Electronics and Microelectronics</topic><topic>Engineering</topic><topic>Errors</topic><topic>Instrumentation</topic><topic>Mean square errors</topic><topic>Mean square values</topic><topic>Performance enhancement</topic><topic>Signal,Image and Speech Processing</topic><topic>Steady state</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Arif, Muhammad</creatorcontrib><creatorcontrib>Moinuddin, Muhammad</creatorcontrib><creatorcontrib>Naseem, Imran</creatorcontrib><creatorcontrib>Alsaggaf, Abdulrahman U.</creatorcontrib><creatorcontrib>Al-Saggaf, Ubaid M.</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Science Database (Alumni Edition)</collection><collection>Computing Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>Computer Science Database</collection><collection>ProQuest Engineering Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>Computing Database</collection><collection>Science Database</collection><collection>Engineering Database</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>ProQuest Central Basic</collection><collection>DELNET Engineering & Technology Collection</collection><jtitle>Circuits, systems, and signal processing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Arif, Muhammad</au><au>Moinuddin, Muhammad</au><au>Naseem, Imran</au><au>Alsaggaf, Abdulrahman U.</au><au>Al-Saggaf, Ubaid M.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Diffusion Quantum-Least Mean Square Algorithm with Steady-State Analysis</atitle><jtitle>Circuits, systems, and signal processing</jtitle><stitle>Circuits Syst Signal Process</stitle><date>2022-06-01</date><risdate>2022</risdate><volume>41</volume><issue>6</issue><spage>3306</spage><epage>3327</epage><pages>3306-3327</pages><issn>0278-081X</issn><eissn>1531-5878</eissn><abstract>Diffusion least mean square (LMS) algorithm is a well-known algorithm for distributed estimation where estimation takes place at multiple nodes. However, it inherits slow convergence speed due to its gradient descent-based design. To deal with this challenge, we proposed a modified diffusion LMS with improved convergence performance by employing quantum-calculus-based gradient descent, and hence, we called it diffusion
q
-least mean square (Diff-
q
LMS). In the proposed design, we derive the weight update mechanism by minimizing the conventional mean square error (MSE) cost function via quantum-derivative in a distributed estimation environment. We developed two different modes of diffusion
q
LMS operation: combine-then-adapt (CTA) and adapt-then-combine (ATC). To improve the performance in terms of faster convergence and lower steady-state error, we also developed an efficient mechanism to obtain the optimal values of
q
-parameter for each tap-weight of the filter in order to achieve both faster convergence and lower steady-state error. With the aim to achieve the performance of the proposed algorithm theoretically, convergence analysis for both the transient and the steady-state scenarios is presented. Consequently, closed-form expressions governing both the transient and the steady-state behaviors in terms of mean square deviation (MSD) and excess mean square error (EMSE) for both local node and global network are derived. The theoretical claims are validated via Monte Carlo simulations. The performance of the proposed algorithm is investigated for various system noises and the results show the superiority of the proposed algorithm in terms of both the convergence speed and the steady-state error.</abstract><cop>New York</cop><pub>Springer US</pub><doi>10.1007/s00034-021-01934-z</doi><tpages>22</tpages><orcidid>https://orcid.org/0000-0003-4735-0692</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0278-081X |
ispartof | Circuits, systems, and signal processing, 2022-06, Vol.41 (6), p.3306-3327 |
issn | 0278-081X 1531-5878 |
language | eng |
recordid | cdi_proquest_journals_2654822453 |
source | SpringerNature Journals |
subjects | Algorithms Circuits and Systems Convergence Cost function Design modifications Diffusion Electrical Engineering Electronics and Microelectronics Engineering Errors Instrumentation Mean square errors Mean square values Performance enhancement Signal,Image and Speech Processing Steady state |
title | Diffusion Quantum-Least Mean Square Algorithm with Steady-State Analysis |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-28T15%3A52%3A24IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Diffusion%20Quantum-Least%20Mean%20Square%20Algorithm%20with%20Steady-State%20Analysis&rft.jtitle=Circuits,%20systems,%20and%20signal%20processing&rft.au=Arif,%20Muhammad&rft.date=2022-06-01&rft.volume=41&rft.issue=6&rft.spage=3306&rft.epage=3327&rft.pages=3306-3327&rft.issn=0278-081X&rft.eissn=1531-5878&rft_id=info:doi/10.1007/s00034-021-01934-z&rft_dat=%3Cproquest_cross%3E2654822453%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2654822453&rft_id=info:pmid/&rfr_iscdi=true |