EAFL: Equilibrium Augmentation Mechanism to Enhance Federated Learning for Aspect Category Sentiment Analysis

Aspect Category Sentiment Analysis (ACSA) involves identifying sentiment categories for specific aspects of a sentence. Despite the progress made in pre-trained language models for extracting semantic and categorical representations, the sharing of sensitive data remains challenging due to data priv...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Expert systems with applications 2024-12, Vol.256, p.124828, Article 124828
Hauptverfasser: Ahmad, Khwaja Mutahir, Liu, Qiao, Khan, Abdullah Aman, Gan, Yanglei, Lin, Run
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Aspect Category Sentiment Analysis (ACSA) involves identifying sentiment categories for specific aspects of a sentence. Despite the progress made in pre-trained language models for extracting semantic and categorical representations, the sharing of sensitive data remains challenging due to data privacy protection. Federated Learning (FL) offers a solution by enabling decentralized model training without accessing raw datasets. However, isolated data encounters difficulties with text heterogeneity, which is crucial for aspect-based sentiment analysis (ABSA) subtask like ACSA. To address these problems, this paper presents a novel method called the Equilibrium Augmentation Mechanism to Enhance Federated Learning for Aspect Category Sentiment Analysis (EAFL-ACSA). The EAFL mechanism seamlessly integrates FL’s data privacy preservation capabilities with a variety of augmented data representations. Our unified model safeguards data privacy through FL and incorporates multiple features through data augmentation to enhance encrypted data. Furthermore, the parameter-efficient tuning mechanism incorporated in our framework enhances model performance and generates fine-tuned augmented sentences. Extensive experiments on five benchmark datasets demonstrates that EAFL consistently outperforms the best models, achieving a competitive level of performance while protecting data privacy. The equilibrium data augmentation mechanism not only advances aspect category detection but also enhances semantic data representations, effectively addressing critical concerns surrounding data privacy preservation within a unified framework. •Recent advancements in ACSA leveraged PLMs to extract data representations.•Traditional FL encounters difficulties in data heterogeneity or domain-specific tasks.•A novel approach EAFL integrates privacy preservation and augmentation.•A unified model utilize term, polarity, and categorical representations to overcome data heterogeneity.•A parameter-efficient tuning mechanism exploits to fine-tune the model during sentence generation.
ISSN:0957-4174
DOI:10.1016/j.eswa.2024.124828