Integrated Sidelobe Cancellation and Linear Prediction Kalman Filter for Joint Multi-Microphone Speech Dereverberation, Interfering Speech Cancellation, and Noise Reduction
In multi-microphone speech enhancement, reverberation as well as additive noise and/or interfering speech are commonly suppressed by deconvolution and spatial filtering, e.g., using multi-channel linear prediction (MCLP) on the one hand and beamforming, e.g., a generalized sidelobe canceler (GSC), o...
Gespeichert in:
Veröffentlicht in: | IEEE/ACM transactions on audio, speech, and language processing speech, and language processing, 2020, Vol.28, p.740-754 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 754 |
---|---|
container_issue | |
container_start_page | 740 |
container_title | IEEE/ACM transactions on audio, speech, and language processing |
container_volume | 28 |
creator | Dietzen, Thomas Doclo, Simon Moonen, Marc van Waterschoot, Toon |
description | In multi-microphone speech enhancement, reverberation as well as additive noise and/or interfering speech are commonly suppressed by deconvolution and spatial filtering, e.g., using multi-channel linear prediction (MCLP) on the one hand and beamforming, e.g., a generalized sidelobe canceler (GSC), on the other hand. In this article, we consider several reverberant speech components, whereof some are to be dereverberated and others to be canceled, as well as a diffuse (e.g., babble) noise component to be suppressed. In order to perform both deconvolution and spatial filtering, we integrate MCLP and the GSC into a novel architecture referred to as integrated sidelobe cancellation and linear prediction (ISCLP), where the sidelobe-cancellation (SC) filter and the linear prediction (LP) filter operate in parallel, but on different microphone signal frames. Within ISCLP, we estimate both filters jointly by means of a single Kalman filter. We further propose a spectral Wiener gain post-processor, which is shown to relate to the Kalman filter's posterior state estimate. The presented ISCLP Kalman filter is benchmarked against two state-of-the-art approaches, namely first a pair of alternating Kalman filters respectively performing dereverberation and noise reduction, and second an MCLP+GSC Kalman filter cascade. While the ISCLP Kalman filter is roughly M^2 times less expensive than both reference algorithms, where M denotes the number of microphones, it is shown to perform at least similarly as compared to the former, and to outperform the latter. A MATLAB implementation is available. |
doi_str_mv | 10.1109/TASLP.2020.2966869 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_crossref_primary_10_1109_TASLP_2020_2966869</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>8960444</ieee_id><sourcerecordid>2352194183</sourcerecordid><originalsourceid>FETCH-LOGICAL-c295t-5ce543cb8503ab52c83f9dc38af33f849593456a83a22ce1032fc1b43ebdec033</originalsourceid><addsrcrecordid>eNpNkd1OwkAQhRujiQR5Ab3ZxFuK-9fSvSQoihYlgtfNdjuFJWUXt62J7-RDSgsYr2YyOed8mRzPuyZ4QAgWd8vRIp4PKKZ4QEUYRqE48zqUUeELhvn5aacCX3q9stxgjAkeCjHkHe9naipYOVlBhhY6g8KmgMbSKCgKWWlrkDQZirUB6dDcQaZVe32RxVYaNNFFBQ7l1qFnq02FZnVRaX-mlbO7tTWAFjsAtUb34OALXAquTe2jhutycNqsTpr_2H7LfbW6BPQOWd1Sr7yLXBYl9I6z631MHpbjJz9-e5yOR7GvqAgqP1AQcKbSKMBMpgFVEctFplgkc8byiItAMB6EMmKSUgUEM5orknIGaQYKM9b1bg-5O2c_ayirZGNrZ_bIhLKAEsFJ1KjoQbX_tSwd5MnO6a103wnBSVNM0haTNMUkx2L2ppuDSQPAnyESIeacs1-6PIz1</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2352194183</pqid></control><display><type>article</type><title>Integrated Sidelobe Cancellation and Linear Prediction Kalman Filter for Joint Multi-Microphone Speech Dereverberation, Interfering Speech Cancellation, and Noise Reduction</title><source>IEEE Electronic Library (IEL)</source><creator>Dietzen, Thomas ; Doclo, Simon ; Moonen, Marc ; van Waterschoot, Toon</creator><creatorcontrib>Dietzen, Thomas ; Doclo, Simon ; Moonen, Marc ; van Waterschoot, Toon</creatorcontrib><description>In multi-microphone speech enhancement, reverberation as well as additive noise and/or interfering speech are commonly suppressed by deconvolution and spatial filtering, e.g., using multi-channel linear prediction (MCLP) on the one hand and beamforming, e.g., a generalized sidelobe canceler (GSC), on the other hand. In this article, we consider several reverberant speech components, whereof some are to be dereverberated and others to be canceled, as well as a diffuse (e.g., babble) noise component to be suppressed. In order to perform both deconvolution and spatial filtering, we integrate MCLP and the GSC into a novel architecture referred to as integrated sidelobe cancellation and linear prediction (ISCLP), where the sidelobe-cancellation (SC) filter and the linear prediction (LP) filter operate in parallel, but on different microphone signal frames. Within ISCLP, we estimate both filters jointly by means of a single Kalman filter. We further propose a spectral Wiener gain post-processor, which is shown to relate to the Kalman filter's posterior state estimate. The presented ISCLP Kalman filter is benchmarked against two state-of-the-art approaches, namely first a pair of alternating Kalman filters respectively performing dereverberation and noise reduction, and second an MCLP+GSC Kalman filter cascade. While the ISCLP Kalman filter is roughly M^2 times less expensive than both reference algorithms, where M denotes the number of microphones, it is shown to perform at least similarly as compared to the former, and to outperform the latter. A MATLAB implementation is available.</description><identifier>ISSN: 2329-9290</identifier><identifier>EISSN: 2329-9304</identifier><identifier>DOI: 10.1109/TASLP.2020.2966869</identifier><identifier>CODEN: ITASD8</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Algorithms ; Array signal processing ; Beamforming ; Cancellation ; Deconvolution ; Dereverberation ; interfering speech cancellation ; Kalman filter ; Kalman filters ; Linear prediction ; Microphones ; Microprocessors ; multi-channel linear prediction (MCLP) ; Noise control ; Noise reduction ; Sidelobes ; Spatial filtering ; Speech enhancement ; Speech processing</subject><ispartof>IEEE/ACM transactions on audio, speech, and language processing, 2020, Vol.28, p.740-754</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c295t-5ce543cb8503ab52c83f9dc38af33f849593456a83a22ce1032fc1b43ebdec033</citedby><cites>FETCH-LOGICAL-c295t-5ce543cb8503ab52c83f9dc38af33f849593456a83a22ce1032fc1b43ebdec033</cites><orcidid>0000-0002-8924-4962 ; 0000-0002-3392-2381 ; 0000-0003-4461-0073</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/8960444$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,777,781,793,4010,27904,27905,27906,54739</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/8960444$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Dietzen, Thomas</creatorcontrib><creatorcontrib>Doclo, Simon</creatorcontrib><creatorcontrib>Moonen, Marc</creatorcontrib><creatorcontrib>van Waterschoot, Toon</creatorcontrib><title>Integrated Sidelobe Cancellation and Linear Prediction Kalman Filter for Joint Multi-Microphone Speech Dereverberation, Interfering Speech Cancellation, and Noise Reduction</title><title>IEEE/ACM transactions on audio, speech, and language processing</title><addtitle>TASLP</addtitle><description>In multi-microphone speech enhancement, reverberation as well as additive noise and/or interfering speech are commonly suppressed by deconvolution and spatial filtering, e.g., using multi-channel linear prediction (MCLP) on the one hand and beamforming, e.g., a generalized sidelobe canceler (GSC), on the other hand. In this article, we consider several reverberant speech components, whereof some are to be dereverberated and others to be canceled, as well as a diffuse (e.g., babble) noise component to be suppressed. In order to perform both deconvolution and spatial filtering, we integrate MCLP and the GSC into a novel architecture referred to as integrated sidelobe cancellation and linear prediction (ISCLP), where the sidelobe-cancellation (SC) filter and the linear prediction (LP) filter operate in parallel, but on different microphone signal frames. Within ISCLP, we estimate both filters jointly by means of a single Kalman filter. We further propose a spectral Wiener gain post-processor, which is shown to relate to the Kalman filter's posterior state estimate. The presented ISCLP Kalman filter is benchmarked against two state-of-the-art approaches, namely first a pair of alternating Kalman filters respectively performing dereverberation and noise reduction, and second an MCLP+GSC Kalman filter cascade. While the ISCLP Kalman filter is roughly M^2 times less expensive than both reference algorithms, where M denotes the number of microphones, it is shown to perform at least similarly as compared to the former, and to outperform the latter. A MATLAB implementation is available.</description><subject>Algorithms</subject><subject>Array signal processing</subject><subject>Beamforming</subject><subject>Cancellation</subject><subject>Deconvolution</subject><subject>Dereverberation</subject><subject>interfering speech cancellation</subject><subject>Kalman filter</subject><subject>Kalman filters</subject><subject>Linear prediction</subject><subject>Microphones</subject><subject>Microprocessors</subject><subject>multi-channel linear prediction (MCLP)</subject><subject>Noise control</subject><subject>Noise reduction</subject><subject>Sidelobes</subject><subject>Spatial filtering</subject><subject>Speech enhancement</subject><subject>Speech processing</subject><issn>2329-9290</issn><issn>2329-9304</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkd1OwkAQhRujiQR5Ab3ZxFuK-9fSvSQoihYlgtfNdjuFJWUXt62J7-RDSgsYr2YyOed8mRzPuyZ4QAgWd8vRIp4PKKZ4QEUYRqE48zqUUeELhvn5aacCX3q9stxgjAkeCjHkHe9naipYOVlBhhY6g8KmgMbSKCgKWWlrkDQZirUB6dDcQaZVe32RxVYaNNFFBQ7l1qFnq02FZnVRaX-mlbO7tTWAFjsAtUb34OALXAquTe2jhutycNqsTpr_2H7LfbW6BPQOWd1Sr7yLXBYl9I6z631MHpbjJz9-e5yOR7GvqAgqP1AQcKbSKMBMpgFVEctFplgkc8byiItAMB6EMmKSUgUEM5orknIGaQYKM9b1bg-5O2c_ayirZGNrZ_bIhLKAEsFJ1KjoQbX_tSwd5MnO6a103wnBSVNM0haTNMUkx2L2ppuDSQPAnyESIeacs1-6PIz1</recordid><startdate>2020</startdate><enddate>2020</enddate><creator>Dietzen, Thomas</creator><creator>Doclo, Simon</creator><creator>Moonen, Marc</creator><creator>van Waterschoot, Toon</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-8924-4962</orcidid><orcidid>https://orcid.org/0000-0002-3392-2381</orcidid><orcidid>https://orcid.org/0000-0003-4461-0073</orcidid></search><sort><creationdate>2020</creationdate><title>Integrated Sidelobe Cancellation and Linear Prediction Kalman Filter for Joint Multi-Microphone Speech Dereverberation, Interfering Speech Cancellation, and Noise Reduction</title><author>Dietzen, Thomas ; Doclo, Simon ; Moonen, Marc ; van Waterschoot, Toon</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c295t-5ce543cb8503ab52c83f9dc38af33f849593456a83a22ce1032fc1b43ebdec033</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Algorithms</topic><topic>Array signal processing</topic><topic>Beamforming</topic><topic>Cancellation</topic><topic>Deconvolution</topic><topic>Dereverberation</topic><topic>interfering speech cancellation</topic><topic>Kalman filter</topic><topic>Kalman filters</topic><topic>Linear prediction</topic><topic>Microphones</topic><topic>Microprocessors</topic><topic>multi-channel linear prediction (MCLP)</topic><topic>Noise control</topic><topic>Noise reduction</topic><topic>Sidelobes</topic><topic>Spatial filtering</topic><topic>Speech enhancement</topic><topic>Speech processing</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Dietzen, Thomas</creatorcontrib><creatorcontrib>Doclo, Simon</creatorcontrib><creatorcontrib>Moonen, Marc</creatorcontrib><creatorcontrib>van Waterschoot, Toon</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE/ACM transactions on audio, speech, and language processing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Dietzen, Thomas</au><au>Doclo, Simon</au><au>Moonen, Marc</au><au>van Waterschoot, Toon</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Integrated Sidelobe Cancellation and Linear Prediction Kalman Filter for Joint Multi-Microphone Speech Dereverberation, Interfering Speech Cancellation, and Noise Reduction</atitle><jtitle>IEEE/ACM transactions on audio, speech, and language processing</jtitle><stitle>TASLP</stitle><date>2020</date><risdate>2020</risdate><volume>28</volume><spage>740</spage><epage>754</epage><pages>740-754</pages><issn>2329-9290</issn><eissn>2329-9304</eissn><coden>ITASD8</coden><abstract>In multi-microphone speech enhancement, reverberation as well as additive noise and/or interfering speech are commonly suppressed by deconvolution and spatial filtering, e.g., using multi-channel linear prediction (MCLP) on the one hand and beamforming, e.g., a generalized sidelobe canceler (GSC), on the other hand. In this article, we consider several reverberant speech components, whereof some are to be dereverberated and others to be canceled, as well as a diffuse (e.g., babble) noise component to be suppressed. In order to perform both deconvolution and spatial filtering, we integrate MCLP and the GSC into a novel architecture referred to as integrated sidelobe cancellation and linear prediction (ISCLP), where the sidelobe-cancellation (SC) filter and the linear prediction (LP) filter operate in parallel, but on different microphone signal frames. Within ISCLP, we estimate both filters jointly by means of a single Kalman filter. We further propose a spectral Wiener gain post-processor, which is shown to relate to the Kalman filter's posterior state estimate. The presented ISCLP Kalman filter is benchmarked against two state-of-the-art approaches, namely first a pair of alternating Kalman filters respectively performing dereverberation and noise reduction, and second an MCLP+GSC Kalman filter cascade. While the ISCLP Kalman filter is roughly M^2 times less expensive than both reference algorithms, where M denotes the number of microphones, it is shown to perform at least similarly as compared to the former, and to outperform the latter. A MATLAB implementation is available.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/TASLP.2020.2966869</doi><tpages>15</tpages><orcidid>https://orcid.org/0000-0002-8924-4962</orcidid><orcidid>https://orcid.org/0000-0002-3392-2381</orcidid><orcidid>https://orcid.org/0000-0003-4461-0073</orcidid></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 2329-9290 |
ispartof | IEEE/ACM transactions on audio, speech, and language processing, 2020, Vol.28, p.740-754 |
issn | 2329-9290 2329-9304 |
language | eng |
recordid | cdi_crossref_primary_10_1109_TASLP_2020_2966869 |
source | IEEE Electronic Library (IEL) |
subjects | Algorithms Array signal processing Beamforming Cancellation Deconvolution Dereverberation interfering speech cancellation Kalman filter Kalman filters Linear prediction Microphones Microprocessors multi-channel linear prediction (MCLP) Noise control Noise reduction Sidelobes Spatial filtering Speech enhancement Speech processing |
title | Integrated Sidelobe Cancellation and Linear Prediction Kalman Filter for Joint Multi-Microphone Speech Dereverberation, Interfering Speech Cancellation, and Noise Reduction |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-19T13%3A51%3A39IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Integrated%20Sidelobe%20Cancellation%20and%20Linear%20Prediction%20Kalman%20Filter%20for%20Joint%20Multi-Microphone%20Speech%20Dereverberation,%20Interfering%20Speech%20Cancellation,%20and%20Noise%20Reduction&rft.jtitle=IEEE/ACM%20transactions%20on%20audio,%20speech,%20and%20language%20processing&rft.au=Dietzen,%20Thomas&rft.date=2020&rft.volume=28&rft.spage=740&rft.epage=754&rft.pages=740-754&rft.issn=2329-9290&rft.eissn=2329-9304&rft.coden=ITASD8&rft_id=info:doi/10.1109/TASLP.2020.2966869&rft_dat=%3Cproquest_RIE%3E2352194183%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2352194183&rft_id=info:pmid/&rft_ieee_id=8960444&rfr_iscdi=true |