Diffusion Quantum-Least Mean Square Algorithm with Steady-State Analysis

Diffusion least mean square (LMS) algorithm is a well-known algorithm for distributed estimation where estimation takes place at multiple nodes. However, it inherits slow convergence speed due to its gradient descent-based design. To deal with this challenge, we proposed a modified diffusion LMS wit...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Circuits, systems, and signal processing systems, and signal processing, 2022-06, Vol.41 (6), p.3306-3327
Hauptverfasser: Arif, Muhammad, Moinuddin, Muhammad, Naseem, Imran, Alsaggaf, Abdulrahman U., Al-Saggaf, Ubaid M.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 3327
container_issue 6
container_start_page 3306
container_title Circuits, systems, and signal processing
container_volume 41
creator Arif, Muhammad
Moinuddin, Muhammad
Naseem, Imran
Alsaggaf, Abdulrahman U.
Al-Saggaf, Ubaid M.
description Diffusion least mean square (LMS) algorithm is a well-known algorithm for distributed estimation where estimation takes place at multiple nodes. However, it inherits slow convergence speed due to its gradient descent-based design. To deal with this challenge, we proposed a modified diffusion LMS with improved convergence performance by employing quantum-calculus-based gradient descent, and hence, we called it diffusion q -least mean square (Diff- q LMS). In the proposed design, we derive the weight update mechanism by minimizing the conventional mean square error (MSE) cost function via quantum-derivative in a distributed estimation environment. We developed two different modes of diffusion q LMS operation: combine-then-adapt (CTA) and adapt-then-combine (ATC). To improve the performance in terms of faster convergence and lower steady-state error, we also developed an efficient mechanism to obtain the optimal values of q -parameter for each tap-weight of the filter in order to achieve both faster convergence and lower steady-state error. With the aim to achieve the performance of the proposed algorithm theoretically, convergence analysis for both the transient and the steady-state scenarios is presented. Consequently, closed-form expressions governing both the transient and the steady-state behaviors in terms of mean square deviation (MSD) and excess mean square error (EMSE) for both local node and global network are derived. The theoretical claims are validated via Monte Carlo simulations. The performance of the proposed algorithm is investigated for various system noises and the results show the superiority of the proposed algorithm in terms of both the convergence speed and the steady-state error.
doi_str_mv 10.1007/s00034-021-01934-z
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2654822453</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2654822453</sourcerecordid><originalsourceid>FETCH-LOGICAL-c319t-c1f039e7343f9673150c7976956bb3c68254adede92ac7f108345338cbf031fb3</originalsourceid><addsrcrecordid>eNp9kMFKAzEQhoMoWKsv4GnBc3SS7G6SY6naChWRKngL2TSpW9rdNski7dObuoI3LzMD833D8CN0TeCWAPC7AAAsx0AJBiLTdDhBA1IwggvBxSkaAOUCgyAf5-gihBUkKpd0gKb3tXNdqNsme-10E7sNnlkdYvZsdZPNd532Nhutl62v4-cm-0o1m0erF3s8jzqmXaPX-1CHS3Tm9DrYq98-RO-PD2_jKZ69TJ7Goxk2jMiIDXHApOUsZ06WnJECDJe8lEVZVcyUgha5XtiFlVQb7ggIlheMCVMlj7iKDdFNf3fr211nQ1SrtvPpiaBoWeSC0iM_RLSnjG9D8Napra832u8VAXVMTPWJqZSY-klMHZLEeikkuFla_3f6H-sbxppuAg</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2654822453</pqid></control><display><type>article</type><title>Diffusion Quantum-Least Mean Square Algorithm with Steady-State Analysis</title><source>SpringerNature Journals</source><creator>Arif, Muhammad ; Moinuddin, Muhammad ; Naseem, Imran ; Alsaggaf, Abdulrahman U. ; Al-Saggaf, Ubaid M.</creator><creatorcontrib>Arif, Muhammad ; Moinuddin, Muhammad ; Naseem, Imran ; Alsaggaf, Abdulrahman U. ; Al-Saggaf, Ubaid M.</creatorcontrib><description>Diffusion least mean square (LMS) algorithm is a well-known algorithm for distributed estimation where estimation takes place at multiple nodes. However, it inherits slow convergence speed due to its gradient descent-based design. To deal with this challenge, we proposed a modified diffusion LMS with improved convergence performance by employing quantum-calculus-based gradient descent, and hence, we called it diffusion q -least mean square (Diff- q LMS). In the proposed design, we derive the weight update mechanism by minimizing the conventional mean square error (MSE) cost function via quantum-derivative in a distributed estimation environment. We developed two different modes of diffusion q LMS operation: combine-then-adapt (CTA) and adapt-then-combine (ATC). To improve the performance in terms of faster convergence and lower steady-state error, we also developed an efficient mechanism to obtain the optimal values of q -parameter for each tap-weight of the filter in order to achieve both faster convergence and lower steady-state error. With the aim to achieve the performance of the proposed algorithm theoretically, convergence analysis for both the transient and the steady-state scenarios is presented. Consequently, closed-form expressions governing both the transient and the steady-state behaviors in terms of mean square deviation (MSD) and excess mean square error (EMSE) for both local node and global network are derived. The theoretical claims are validated via Monte Carlo simulations. The performance of the proposed algorithm is investigated for various system noises and the results show the superiority of the proposed algorithm in terms of both the convergence speed and the steady-state error.</description><identifier>ISSN: 0278-081X</identifier><identifier>EISSN: 1531-5878</identifier><identifier>DOI: 10.1007/s00034-021-01934-z</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Algorithms ; Circuits and Systems ; Convergence ; Cost function ; Design modifications ; Diffusion ; Electrical Engineering ; Electronics and Microelectronics ; Engineering ; Errors ; Instrumentation ; Mean square errors ; Mean square values ; Performance enhancement ; Signal,Image and Speech Processing ; Steady state</subject><ispartof>Circuits, systems, and signal processing, 2022-06, Vol.41 (6), p.3306-3327</ispartof><rights>The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2021</rights><rights>The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2021.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c319t-c1f039e7343f9673150c7976956bb3c68254adede92ac7f108345338cbf031fb3</citedby><cites>FETCH-LOGICAL-c319t-c1f039e7343f9673150c7976956bb3c68254adede92ac7f108345338cbf031fb3</cites><orcidid>0000-0003-4735-0692</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s00034-021-01934-z$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s00034-021-01934-z$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,41488,42557,51319</link.rule.ids></links><search><creatorcontrib>Arif, Muhammad</creatorcontrib><creatorcontrib>Moinuddin, Muhammad</creatorcontrib><creatorcontrib>Naseem, Imran</creatorcontrib><creatorcontrib>Alsaggaf, Abdulrahman U.</creatorcontrib><creatorcontrib>Al-Saggaf, Ubaid M.</creatorcontrib><title>Diffusion Quantum-Least Mean Square Algorithm with Steady-State Analysis</title><title>Circuits, systems, and signal processing</title><addtitle>Circuits Syst Signal Process</addtitle><description>Diffusion least mean square (LMS) algorithm is a well-known algorithm for distributed estimation where estimation takes place at multiple nodes. However, it inherits slow convergence speed due to its gradient descent-based design. To deal with this challenge, we proposed a modified diffusion LMS with improved convergence performance by employing quantum-calculus-based gradient descent, and hence, we called it diffusion q -least mean square (Diff- q LMS). In the proposed design, we derive the weight update mechanism by minimizing the conventional mean square error (MSE) cost function via quantum-derivative in a distributed estimation environment. We developed two different modes of diffusion q LMS operation: combine-then-adapt (CTA) and adapt-then-combine (ATC). To improve the performance in terms of faster convergence and lower steady-state error, we also developed an efficient mechanism to obtain the optimal values of q -parameter for each tap-weight of the filter in order to achieve both faster convergence and lower steady-state error. With the aim to achieve the performance of the proposed algorithm theoretically, convergence analysis for both the transient and the steady-state scenarios is presented. Consequently, closed-form expressions governing both the transient and the steady-state behaviors in terms of mean square deviation (MSD) and excess mean square error (EMSE) for both local node and global network are derived. The theoretical claims are validated via Monte Carlo simulations. The performance of the proposed algorithm is investigated for various system noises and the results show the superiority of the proposed algorithm in terms of both the convergence speed and the steady-state error.</description><subject>Algorithms</subject><subject>Circuits and Systems</subject><subject>Convergence</subject><subject>Cost function</subject><subject>Design modifications</subject><subject>Diffusion</subject><subject>Electrical Engineering</subject><subject>Electronics and Microelectronics</subject><subject>Engineering</subject><subject>Errors</subject><subject>Instrumentation</subject><subject>Mean square errors</subject><subject>Mean square values</subject><subject>Performance enhancement</subject><subject>Signal,Image and Speech Processing</subject><subject>Steady state</subject><issn>0278-081X</issn><issn>1531-5878</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><recordid>eNp9kMFKAzEQhoMoWKsv4GnBc3SS7G6SY6naChWRKngL2TSpW9rdNski7dObuoI3LzMD833D8CN0TeCWAPC7AAAsx0AJBiLTdDhBA1IwggvBxSkaAOUCgyAf5-gihBUkKpd0gKb3tXNdqNsme-10E7sNnlkdYvZsdZPNd532Nhutl62v4-cm-0o1m0erF3s8jzqmXaPX-1CHS3Tm9DrYq98-RO-PD2_jKZ69TJ7Goxk2jMiIDXHApOUsZ06WnJECDJe8lEVZVcyUgha5XtiFlVQb7ggIlheMCVMlj7iKDdFNf3fr211nQ1SrtvPpiaBoWeSC0iM_RLSnjG9D8Napra832u8VAXVMTPWJqZSY-klMHZLEeikkuFla_3f6H-sbxppuAg</recordid><startdate>20220601</startdate><enddate>20220601</enddate><creator>Arif, Muhammad</creator><creator>Moinuddin, Muhammad</creator><creator>Naseem, Imran</creator><creator>Alsaggaf, Abdulrahman U.</creator><creator>Al-Saggaf, Ubaid M.</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7SC</scope><scope>7SP</scope><scope>7XB</scope><scope>88I</scope><scope>8AL</scope><scope>8AO</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K7-</scope><scope>L6V</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>M0N</scope><scope>M2P</scope><scope>M7S</scope><scope>P5Z</scope><scope>P62</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>Q9U</scope><scope>S0W</scope><orcidid>https://orcid.org/0000-0003-4735-0692</orcidid></search><sort><creationdate>20220601</creationdate><title>Diffusion Quantum-Least Mean Square Algorithm with Steady-State Analysis</title><author>Arif, Muhammad ; Moinuddin, Muhammad ; Naseem, Imran ; Alsaggaf, Abdulrahman U. ; Al-Saggaf, Ubaid M.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c319t-c1f039e7343f9673150c7976956bb3c68254adede92ac7f108345338cbf031fb3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Algorithms</topic><topic>Circuits and Systems</topic><topic>Convergence</topic><topic>Cost function</topic><topic>Design modifications</topic><topic>Diffusion</topic><topic>Electrical Engineering</topic><topic>Electronics and Microelectronics</topic><topic>Engineering</topic><topic>Errors</topic><topic>Instrumentation</topic><topic>Mean square errors</topic><topic>Mean square values</topic><topic>Performance enhancement</topic><topic>Signal,Image and Speech Processing</topic><topic>Steady state</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Arif, Muhammad</creatorcontrib><creatorcontrib>Moinuddin, Muhammad</creatorcontrib><creatorcontrib>Naseem, Imran</creatorcontrib><creatorcontrib>Alsaggaf, Abdulrahman U.</creatorcontrib><creatorcontrib>Al-Saggaf, Ubaid M.</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Science Database (Alumni Edition)</collection><collection>Computing Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>Computer Science Database</collection><collection>ProQuest Engineering Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>Computing Database</collection><collection>Science Database</collection><collection>Engineering Database</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>ProQuest Central Basic</collection><collection>DELNET Engineering &amp; Technology Collection</collection><jtitle>Circuits, systems, and signal processing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Arif, Muhammad</au><au>Moinuddin, Muhammad</au><au>Naseem, Imran</au><au>Alsaggaf, Abdulrahman U.</au><au>Al-Saggaf, Ubaid M.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Diffusion Quantum-Least Mean Square Algorithm with Steady-State Analysis</atitle><jtitle>Circuits, systems, and signal processing</jtitle><stitle>Circuits Syst Signal Process</stitle><date>2022-06-01</date><risdate>2022</risdate><volume>41</volume><issue>6</issue><spage>3306</spage><epage>3327</epage><pages>3306-3327</pages><issn>0278-081X</issn><eissn>1531-5878</eissn><abstract>Diffusion least mean square (LMS) algorithm is a well-known algorithm for distributed estimation where estimation takes place at multiple nodes. However, it inherits slow convergence speed due to its gradient descent-based design. To deal with this challenge, we proposed a modified diffusion LMS with improved convergence performance by employing quantum-calculus-based gradient descent, and hence, we called it diffusion q -least mean square (Diff- q LMS). In the proposed design, we derive the weight update mechanism by minimizing the conventional mean square error (MSE) cost function via quantum-derivative in a distributed estimation environment. We developed two different modes of diffusion q LMS operation: combine-then-adapt (CTA) and adapt-then-combine (ATC). To improve the performance in terms of faster convergence and lower steady-state error, we also developed an efficient mechanism to obtain the optimal values of q -parameter for each tap-weight of the filter in order to achieve both faster convergence and lower steady-state error. With the aim to achieve the performance of the proposed algorithm theoretically, convergence analysis for both the transient and the steady-state scenarios is presented. Consequently, closed-form expressions governing both the transient and the steady-state behaviors in terms of mean square deviation (MSD) and excess mean square error (EMSE) for both local node and global network are derived. The theoretical claims are validated via Monte Carlo simulations. The performance of the proposed algorithm is investigated for various system noises and the results show the superiority of the proposed algorithm in terms of both the convergence speed and the steady-state error.</abstract><cop>New York</cop><pub>Springer US</pub><doi>10.1007/s00034-021-01934-z</doi><tpages>22</tpages><orcidid>https://orcid.org/0000-0003-4735-0692</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0278-081X
ispartof Circuits, systems, and signal processing, 2022-06, Vol.41 (6), p.3306-3327
issn 0278-081X
1531-5878
language eng
recordid cdi_proquest_journals_2654822453
source SpringerNature Journals
subjects Algorithms
Circuits and Systems
Convergence
Cost function
Design modifications
Diffusion
Electrical Engineering
Electronics and Microelectronics
Engineering
Errors
Instrumentation
Mean square errors
Mean square values
Performance enhancement
Signal,Image and Speech Processing
Steady state
title Diffusion Quantum-Least Mean Square Algorithm with Steady-State Analysis
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-28T15%3A52%3A24IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Diffusion%20Quantum-Least%20Mean%20Square%20Algorithm%20with%20Steady-State%20Analysis&rft.jtitle=Circuits,%20systems,%20and%20signal%20processing&rft.au=Arif,%20Muhammad&rft.date=2022-06-01&rft.volume=41&rft.issue=6&rft.spage=3306&rft.epage=3327&rft.pages=3306-3327&rft.issn=0278-081X&rft.eissn=1531-5878&rft_id=info:doi/10.1007/s00034-021-01934-z&rft_dat=%3Cproquest_cross%3E2654822453%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2654822453&rft_id=info:pmid/&rfr_iscdi=true