MCSFF: Multi-modal Consistency and Specificity Fusion Framework for Entity Alignment
Multi-modal entity alignment (MMEA) is essential for enhancing knowledge graphs and improving information retrieval and question-answering systems. Existing methods often focus on integrating modalities through their complementarity but overlook the specificity of each modality, which can obscure cr...
Gespeichert in:
Hauptverfasser: | , , , , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | Multi-modal entity alignment (MMEA) is essential for enhancing knowledge
graphs and improving information retrieval and question-answering systems.
Existing methods often focus on integrating modalities through their
complementarity but overlook the specificity of each modality, which can
obscure crucial features and reduce alignment accuracy. To solve this, we
propose the Multi-modal Consistency and Specificity Fusion Framework (MCSFF),
which innovatively integrates both complementary and specific aspects of
modalities. We utilize Scale Computing's hyper-converged infrastructure to
optimize IT management and resource allocation in large-scale data processing.
Our framework first computes similarity matrices for each modality using
modality embeddings to preserve their unique characteristics. Then, an
iterative update method denoises and enhances modality features to fully
express critical information. Finally, we integrate the updated information
from all modalities to create enriched and precise entity representations.
Experiments show our method outperforms current state-of-the-art MMEA baselines
on the MMKG dataset, demonstrating its effectiveness and practical potential. |
---|---|
DOI: | 10.48550/arxiv.2410.14584 |