Noise-Resistance Learning via Multi-Granularity Consistency for Unsupervised Domain Adaptive Person Re-Identification

Unsupervised domain adaptive person re-identification aims at adapting the re-identification model trained on a labeled source domain to an unlabeled target domain. The mainstream pipeline alternates between clustering-based pseudo-label prediction and representation learning, but the imperfect inte...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:ACM transactions on multimedia computing communications and applications 2024-11
Hauptverfasser: Zhu, Yangchun, Zheng, Yufei, Liu, Jiawei, Li, Yao, Zha, Zheng-Jun
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title ACM transactions on multimedia computing communications and applications
container_volume
creator Zhu, Yangchun
Zheng, Yufei
Liu, Jiawei
Li, Yao
Zha, Zheng-Jun
description Unsupervised domain adaptive person re-identification aims at adapting the re-identification model trained on a labeled source domain to an unlabeled target domain. The mainstream pipeline alternates between clustering-based pseudo-label prediction and representation learning, but the imperfect interaction between these steps generates noisy pseudo labels that diminish the model’s effectiveness. Previous methods reduce noisy pseudo labels impact by assessing consistency only at a single granularity level, overlooking multi-level confidence analysis for better feature representation. To address the issue, we propose a novel Multi-Granularity Consistency Network (MGCN) to perform the noise-resistance learning across different granularity consistency perspectives, including prototype-wise consistency, triplet-wise consistency and list-wise consistency, to suppress the contribution of noisy samples simultaneously. Specifically, the prototype-wise consistency leverages the prototypical output affinity between teacher and student networks to evaluate the reliability of pseudo label of a target sample, thus reducing their negative impact on identity classification loss. Triplet-wise consistency focuses on the triplet distance discrepancies between the teacher and student networks to retain the reliable and informative samples that satisfy triplet distance constraint in the triplet loss, thereby facilitating more effective model training and improved performance in the target domain. Furthermore, the list-wise consistency uses accurate list-wise similarity rankings from the teacher’s memory bank to select more dependable neighboring samples in the student’s memory bank, pulling these closer in feature space to alleviate the detrimental effects of noisy labels in contrastive loss. Based on the multi-granularity consistency, MGCN evaluates the credibility of pseudo labels and adjusts their impact across three re-ID losses for effective domain adaptation. Experimental results demonstrate that our proposed method achieves significant improvements over the existing methods on multiple benchmarks.
doi_str_mv 10.1145/3702328
format Article
fullrecord <record><control><sourceid>acm_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1145_3702328</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3702328</sourcerecordid><originalsourceid>FETCH-LOGICAL-a848-decfd1e369ce73b57381de1c2a6032bb98753c25850feab42b00407829720fdf3</originalsourceid><addsrcrecordid>eNo9kEtLAzEYRYMoWKu4d5Wdq2gek0m6LFVroT4odT1kki8SaZOSzBT6722xdnUv3MNZXIRuGX1grJKPQlEuuD5DAyYlI7Wu5fmpS3WJrkr5oVTUsqoHqH9PoQBZQAmlM9ECnoPJMcRvvA0Gv_WrLpBpNrFfmRy6HZ6keEAh2h32KeOvWPoN5O3e4vBTWpsQ8diZTRe2gD8hlxTxAsjMQeyCD9Z0IcVrdOHNqsDNMYdo-fK8nLyS-cd0NhnPidGVJg6sdwxEPbKgRCuV0MwBs9zUVPC2HWklheVSS-rBtBVvKa2o0nykOPXOiyG6_9PanErJ4JtNDmuTdw2jzeGs5njWnrz7I41dn6D_8ReoFmYq</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Noise-Resistance Learning via Multi-Granularity Consistency for Unsupervised Domain Adaptive Person Re-Identification</title><source>Access via ACM Digital Library</source><creator>Zhu, Yangchun ; Zheng, Yufei ; Liu, Jiawei ; Li, Yao ; Zha, Zheng-Jun</creator><creatorcontrib>Zhu, Yangchun ; Zheng, Yufei ; Liu, Jiawei ; Li, Yao ; Zha, Zheng-Jun</creatorcontrib><description>Unsupervised domain adaptive person re-identification aims at adapting the re-identification model trained on a labeled source domain to an unlabeled target domain. The mainstream pipeline alternates between clustering-based pseudo-label prediction and representation learning, but the imperfect interaction between these steps generates noisy pseudo labels that diminish the model’s effectiveness. Previous methods reduce noisy pseudo labels impact by assessing consistency only at a single granularity level, overlooking multi-level confidence analysis for better feature representation. To address the issue, we propose a novel Multi-Granularity Consistency Network (MGCN) to perform the noise-resistance learning across different granularity consistency perspectives, including prototype-wise consistency, triplet-wise consistency and list-wise consistency, to suppress the contribution of noisy samples simultaneously. Specifically, the prototype-wise consistency leverages the prototypical output affinity between teacher and student networks to evaluate the reliability of pseudo label of a target sample, thus reducing their negative impact on identity classification loss. Triplet-wise consistency focuses on the triplet distance discrepancies between the teacher and student networks to retain the reliable and informative samples that satisfy triplet distance constraint in the triplet loss, thereby facilitating more effective model training and improved performance in the target domain. Furthermore, the list-wise consistency uses accurate list-wise similarity rankings from the teacher’s memory bank to select more dependable neighboring samples in the student’s memory bank, pulling these closer in feature space to alleviate the detrimental effects of noisy labels in contrastive loss. Based on the multi-granularity consistency, MGCN evaluates the credibility of pseudo labels and adjusts their impact across three re-ID losses for effective domain adaptation. Experimental results demonstrate that our proposed method achieves significant improvements over the existing methods on multiple benchmarks.</description><identifier>ISSN: 1551-6857</identifier><identifier>EISSN: 1551-6865</identifier><identifier>DOI: 10.1145/3702328</identifier><language>eng</language><publisher>New York, NY: ACM</publisher><subject>Computing methodologies ; Object identification ; Visual content-based indexing and retrieval</subject><ispartof>ACM transactions on multimedia computing communications and applications, 2024-11</ispartof><rights>Copyright held by the owner/author(s).</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-a848-decfd1e369ce73b57381de1c2a6032bb98753c25850feab42b00407829720fdf3</cites><orcidid>0009-0009-0774-2027 ; 0009-0001-5035-2587 ; 0009-0009-1526-8361 ; 0000-0003-2510-8993 ; 0000-0001-9940-6366</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>315,781,785,27929,27930</link.rule.ids></links><search><creatorcontrib>Zhu, Yangchun</creatorcontrib><creatorcontrib>Zheng, Yufei</creatorcontrib><creatorcontrib>Liu, Jiawei</creatorcontrib><creatorcontrib>Li, Yao</creatorcontrib><creatorcontrib>Zha, Zheng-Jun</creatorcontrib><title>Noise-Resistance Learning via Multi-Granularity Consistency for Unsupervised Domain Adaptive Person Re-Identification</title><title>ACM transactions on multimedia computing communications and applications</title><addtitle>ACM TOMM</addtitle><description>Unsupervised domain adaptive person re-identification aims at adapting the re-identification model trained on a labeled source domain to an unlabeled target domain. The mainstream pipeline alternates between clustering-based pseudo-label prediction and representation learning, but the imperfect interaction between these steps generates noisy pseudo labels that diminish the model’s effectiveness. Previous methods reduce noisy pseudo labels impact by assessing consistency only at a single granularity level, overlooking multi-level confidence analysis for better feature representation. To address the issue, we propose a novel Multi-Granularity Consistency Network (MGCN) to perform the noise-resistance learning across different granularity consistency perspectives, including prototype-wise consistency, triplet-wise consistency and list-wise consistency, to suppress the contribution of noisy samples simultaneously. Specifically, the prototype-wise consistency leverages the prototypical output affinity between teacher and student networks to evaluate the reliability of pseudo label of a target sample, thus reducing their negative impact on identity classification loss. Triplet-wise consistency focuses on the triplet distance discrepancies between the teacher and student networks to retain the reliable and informative samples that satisfy triplet distance constraint in the triplet loss, thereby facilitating more effective model training and improved performance in the target domain. Furthermore, the list-wise consistency uses accurate list-wise similarity rankings from the teacher’s memory bank to select more dependable neighboring samples in the student’s memory bank, pulling these closer in feature space to alleviate the detrimental effects of noisy labels in contrastive loss. Based on the multi-granularity consistency, MGCN evaluates the credibility of pseudo labels and adjusts their impact across three re-ID losses for effective domain adaptation. Experimental results demonstrate that our proposed method achieves significant improvements over the existing methods on multiple benchmarks.</description><subject>Computing methodologies</subject><subject>Object identification</subject><subject>Visual content-based indexing and retrieval</subject><issn>1551-6857</issn><issn>1551-6865</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNo9kEtLAzEYRYMoWKu4d5Wdq2gek0m6LFVroT4odT1kki8SaZOSzBT6722xdnUv3MNZXIRuGX1grJKPQlEuuD5DAyYlI7Wu5fmpS3WJrkr5oVTUsqoHqH9PoQBZQAmlM9ECnoPJMcRvvA0Gv_WrLpBpNrFfmRy6HZ6keEAh2h32KeOvWPoN5O3e4vBTWpsQ8diZTRe2gD8hlxTxAsjMQeyCD9Z0IcVrdOHNqsDNMYdo-fK8nLyS-cd0NhnPidGVJg6sdwxEPbKgRCuV0MwBs9zUVPC2HWklheVSS-rBtBVvKa2o0nykOPXOiyG6_9PanErJ4JtNDmuTdw2jzeGs5njWnrz7I41dn6D_8ReoFmYq</recordid><startdate>20241102</startdate><enddate>20241102</enddate><creator>Zhu, Yangchun</creator><creator>Zheng, Yufei</creator><creator>Liu, Jiawei</creator><creator>Li, Yao</creator><creator>Zha, Zheng-Jun</creator><general>ACM</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0009-0009-0774-2027</orcidid><orcidid>https://orcid.org/0009-0001-5035-2587</orcidid><orcidid>https://orcid.org/0009-0009-1526-8361</orcidid><orcidid>https://orcid.org/0000-0003-2510-8993</orcidid><orcidid>https://orcid.org/0000-0001-9940-6366</orcidid></search><sort><creationdate>20241102</creationdate><title>Noise-Resistance Learning via Multi-Granularity Consistency for Unsupervised Domain Adaptive Person Re-Identification</title><author>Zhu, Yangchun ; Zheng, Yufei ; Liu, Jiawei ; Li, Yao ; Zha, Zheng-Jun</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a848-decfd1e369ce73b57381de1c2a6032bb98753c25850feab42b00407829720fdf3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computing methodologies</topic><topic>Object identification</topic><topic>Visual content-based indexing and retrieval</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zhu, Yangchun</creatorcontrib><creatorcontrib>Zheng, Yufei</creatorcontrib><creatorcontrib>Liu, Jiawei</creatorcontrib><creatorcontrib>Li, Yao</creatorcontrib><creatorcontrib>Zha, Zheng-Jun</creatorcontrib><collection>CrossRef</collection><jtitle>ACM transactions on multimedia computing communications and applications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zhu, Yangchun</au><au>Zheng, Yufei</au><au>Liu, Jiawei</au><au>Li, Yao</au><au>Zha, Zheng-Jun</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Noise-Resistance Learning via Multi-Granularity Consistency for Unsupervised Domain Adaptive Person Re-Identification</atitle><jtitle>ACM transactions on multimedia computing communications and applications</jtitle><stitle>ACM TOMM</stitle><date>2024-11-02</date><risdate>2024</risdate><issn>1551-6857</issn><eissn>1551-6865</eissn><abstract>Unsupervised domain adaptive person re-identification aims at adapting the re-identification model trained on a labeled source domain to an unlabeled target domain. The mainstream pipeline alternates between clustering-based pseudo-label prediction and representation learning, but the imperfect interaction between these steps generates noisy pseudo labels that diminish the model’s effectiveness. Previous methods reduce noisy pseudo labels impact by assessing consistency only at a single granularity level, overlooking multi-level confidence analysis for better feature representation. To address the issue, we propose a novel Multi-Granularity Consistency Network (MGCN) to perform the noise-resistance learning across different granularity consistency perspectives, including prototype-wise consistency, triplet-wise consistency and list-wise consistency, to suppress the contribution of noisy samples simultaneously. Specifically, the prototype-wise consistency leverages the prototypical output affinity between teacher and student networks to evaluate the reliability of pseudo label of a target sample, thus reducing their negative impact on identity classification loss. Triplet-wise consistency focuses on the triplet distance discrepancies between the teacher and student networks to retain the reliable and informative samples that satisfy triplet distance constraint in the triplet loss, thereby facilitating more effective model training and improved performance in the target domain. Furthermore, the list-wise consistency uses accurate list-wise similarity rankings from the teacher’s memory bank to select more dependable neighboring samples in the student’s memory bank, pulling these closer in feature space to alleviate the detrimental effects of noisy labels in contrastive loss. Based on the multi-granularity consistency, MGCN evaluates the credibility of pseudo labels and adjusts their impact across three re-ID losses for effective domain adaptation. Experimental results demonstrate that our proposed method achieves significant improvements over the existing methods on multiple benchmarks.</abstract><cop>New York, NY</cop><pub>ACM</pub><doi>10.1145/3702328</doi><orcidid>https://orcid.org/0009-0009-0774-2027</orcidid><orcidid>https://orcid.org/0009-0001-5035-2587</orcidid><orcidid>https://orcid.org/0009-0009-1526-8361</orcidid><orcidid>https://orcid.org/0000-0003-2510-8993</orcidid><orcidid>https://orcid.org/0000-0001-9940-6366</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1551-6857
ispartof ACM transactions on multimedia computing communications and applications, 2024-11
issn 1551-6857
1551-6865
language eng
recordid cdi_crossref_primary_10_1145_3702328
source Access via ACM Digital Library
subjects Computing methodologies
Object identification
Visual content-based indexing and retrieval
title Noise-Resistance Learning via Multi-Granularity Consistency for Unsupervised Domain Adaptive Person Re-Identification
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-16T00%3A04%3A53IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-acm_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Noise-Resistance%20Learning%20via%20Multi-Granularity%20Consistency%20for%20Unsupervised%20Domain%20Adaptive%20Person%20Re-Identification&rft.jtitle=ACM%20transactions%20on%20multimedia%20computing%20communications%20and%20applications&rft.au=Zhu,%20Yangchun&rft.date=2024-11-02&rft.issn=1551-6857&rft.eissn=1551-6865&rft_id=info:doi/10.1145/3702328&rft_dat=%3Cacm_cross%3E3702328%3C/acm_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true