Monitoring of Domestic Activities Using Multiple Beamformers and Attention Mechanism

Acoustic scene classification is one of the important technologies for classifying domestic activities. When considering domestic activities as acoustic scenes, unlike the general task of acoustic scene classification, there is the problem that the sounds of the target scene and interference scene c...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of Signal Processing 2021/11/01, Vol.25(6), pp.239-243
Hauptverfasser: Kaneko, Yuki, Yamada, Takeshi, Makino, Shoji
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Acoustic scene classification is one of the important technologies for classifying domestic activities. When considering domestic activities as acoustic scenes, unlike the general task of acoustic scene classification, there is the problem that the sounds of the target scene and interference scene can become mixed. To deal with this problem, we propose a classification method using multiple beamformers and an attention mechanism. In the proposed method, multiple beamformers for different target directions are prepared and their outputs are input to a classifier. The proposed method then estimates the importance of each beamformer output by using an attention mechanism. To verify the effectiveness of the proposed method, we generated acoustic data by mixing the sounds of the target scene and the interference scene, and conducted a classification experiment. The experimental results confirmed that the F-score could be greatly improved by the proposed method.
ISSN:1342-6230
1880-1013
DOI:10.2299/jsp.25.239