Learning Commonality, Divergence and Variety for Unsupervised Visible-Infrared Person Re-identification
Unsupervised visible-infrared person re-identification (USVI-ReID) aims to match specified people in infrared images to visible images without annotations, and vice versa. USVI-ReID is a challenging yet under-explored task. Most existing methods address the USVI-ReID using cluster-based contrastive...
Gespeichert in:
Hauptverfasser: | , , , , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | Unsupervised visible-infrared person re-identification (USVI-ReID) aims to
match specified people in infrared images to visible images without
annotations, and vice versa. USVI-ReID is a challenging yet under-explored
task. Most existing methods address the USVI-ReID using cluster-based
contrastive learning, which simply employs the cluster center as a
representation of a person. However, the cluster center primarily focuses on
commonality, overlooking divergence and variety. To address the problem, we
propose a Progressive Contrastive Learning with Hard and Dynamic Prototypes
method for USVI-ReID. In brief, we generate the hard prototype by selecting the
sample with the maximum distance from the cluster center. We theoretically show
that the hard prototype is used in the contrastive loss to emphasize
divergence. Additionally, instead of rigidly aligning query images to a
specific prototype, we generate the dynamic prototype by randomly picking
samples within a cluster. The dynamic prototype is used to encourage the
variety. Finally, we introduce a progressive learning strategy to gradually
shift the model's attention towards divergence and variety, avoiding cluster
deterioration. Extensive experiments conducted on the publicly available
SYSU-MM01 and RegDB datasets validate the effectiveness of the proposed method. |
---|---|
DOI: | 10.48550/arxiv.2402.19026 |