Semisupervised Subspace Learning With Adaptive Pairwise Graph Embedding

Graph-based semisupervised learning can explore the graph topology information behind the samples, becoming one of the most attractive research areas in machine learning in recent years. Nevertheless, existing graph-based methods also suffer from two shortcomings. On the one hand, the existing metho...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transaction on neural networks and learning systems 2023-09, Vol.35 (12), p.18105-18119
Hauptverfasser: Nie, Hebing, Li, Qi, Wang, Zheng, Zhao, Haifeng, Nie, Feiping
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 18119
container_issue 12
container_start_page 18105
container_title IEEE transaction on neural networks and learning systems
container_volume 35
creator Nie, Hebing
Li, Qi
Wang, Zheng
Zhao, Haifeng
Nie, Feiping
description Graph-based semisupervised learning can explore the graph topology information behind the samples, becoming one of the most attractive research areas in machine learning in recent years. Nevertheless, existing graph-based methods also suffer from two shortcomings. On the one hand, the existing methods generate graphs in the original high-dimensional space, which are easily disturbed by noisy and redundancy features, resulting in low-quality constructed graphs that cannot accurately portray the relationships between data. On the other hand, most of the existing models are based on the Gaussian assumption, which cannot capture the local submanifold structure information of the data, thus reducing the discriminativeness of the learned low-dimensional representations. This article proposes a semisupervised subspace learning with adaptive pairwise graph embedding (APGE), which first builds a k_{1} -nearest neighbor graph on the labeled data to learn local discriminant embeddings for exploring the intrinsic structure of the non-Gaussian labeled data, i.e., the submanifold structure. Then, a k_{2} -nearest neighbor graph is constructed on all samples and mapped to GE learning to adaptively explore the global structure of all samples. Clustering unlabeled data and its corresponding labeled neighbors into the same submanifold, sharing the same label information, improves embedded data's discriminative ability. And the adaptive neighborhood learning method is used to learn the graph structure in the continuously optimized subspace to ensure that the optimal graph matrix and projection matrix are finally learned, which has strong robustness. Meanwhile, the rank constraint is added to the Laplacian matrix of the similarity matrix of all samples so that the connected components in the obtained similarity matrix are precisely equal to the number of classes in the sample, which makes the structure of the graph clearer and the relationship between the near-neighbor sample points more explicit. Finally, multiple experiments on several synthetic and real-world datasets show that the method performs well in exploring local structure and classification tasks.
doi_str_mv 10.1109/TNNLS.2023.3311789
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_pubmed_primary_37721887</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10253951</ieee_id><sourcerecordid>2866377117</sourcerecordid><originalsourceid>FETCH-LOGICAL-c275t-4e3e4850992d232bfd41715a550d3756a77cd4be735fa919e285ebf03533a8833</originalsourceid><addsrcrecordid>eNpNkE1PwkAQhjdGIwT5A8aYHr0U96Pb3T0SomjSoAkYvW223anUUKi7LcZ_7yJInMvM4Zk3Mw9ClwSPCMHqdjGbZfMRxZSNGCNESHWC-pSkNKZMytPjLN56aOj9Bw6VYp4m6hz1mBCUSCn6aDqHuvJdA25bebDRvMt9YwqIMjBuXa3fo9eqXUZja5q22kL0bCr3Fcho6kyzjO7qHKwN2AU6K83Kw_DQB-jl_m4xeYizp-njZJzFBRW8jRNgkEiOlaKWMpqXNiGCcMM5tkzw1AhR2CQHwXhpFFFAJYe8xIwzZqRkbIBu9rmN23x24Fsdzi9gtTJr2HReU5mm4bsgJKB0jxZu472DUjeuqo371gTrnUP961DvHOqDw7B0fcjv8hrsceXPWACu9kAFAP8SKWeKE_YDOpx0wA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2866377117</pqid></control><display><type>article</type><title>Semisupervised Subspace Learning With Adaptive Pairwise Graph Embedding</title><source>IEEE Electronic Library (IEL)</source><creator>Nie, Hebing ; Li, Qi ; Wang, Zheng ; Zhao, Haifeng ; Nie, Feiping</creator><creatorcontrib>Nie, Hebing ; Li, Qi ; Wang, Zheng ; Zhao, Haifeng ; Nie, Feiping</creatorcontrib><description><![CDATA[Graph-based semisupervised learning can explore the graph topology information behind the samples, becoming one of the most attractive research areas in machine learning in recent years. Nevertheless, existing graph-based methods also suffer from two shortcomings. On the one hand, the existing methods generate graphs in the original high-dimensional space, which are easily disturbed by noisy and redundancy features, resulting in low-quality constructed graphs that cannot accurately portray the relationships between data. On the other hand, most of the existing models are based on the Gaussian assumption, which cannot capture the local submanifold structure information of the data, thus reducing the discriminativeness of the learned low-dimensional representations. This article proposes a semisupervised subspace learning with adaptive pairwise graph embedding (APGE), which first builds a <inline-formula> <tex-math notation="LaTeX">k_{1} </tex-math></inline-formula>-nearest neighbor graph on the labeled data to learn local discriminant embeddings for exploring the intrinsic structure of the non-Gaussian labeled data, i.e., the submanifold structure. Then, a <inline-formula> <tex-math notation="LaTeX">k_{2} </tex-math></inline-formula>-nearest neighbor graph is constructed on all samples and mapped to GE learning to adaptively explore the global structure of all samples. Clustering unlabeled data and its corresponding labeled neighbors into the same submanifold, sharing the same label information, improves embedded data's discriminative ability. And the adaptive neighborhood learning method is used to learn the graph structure in the continuously optimized subspace to ensure that the optimal graph matrix and projection matrix are finally learned, which has strong robustness. Meanwhile, the rank constraint is added to the Laplacian matrix of the similarity matrix of all samples so that the connected components in the obtained similarity matrix are precisely equal to the number of classes in the sample, which makes the structure of the graph clearer and the relationship between the near-neighbor sample points more explicit. Finally, multiple experiments on several synthetic and real-world datasets show that the method performs well in exploring local structure and classification tasks.]]></description><identifier>ISSN: 2162-237X</identifier><identifier>EISSN: 2162-2388</identifier><identifier>DOI: 10.1109/TNNLS.2023.3311789</identifier><identifier>PMID: 37721887</identifier><identifier>CODEN: ITNNAL</identifier><language>eng</language><publisher>United States: IEEE</publisher><subject>Adaptive neighbors ; Data models ; Dimensionality reduction ; Distributed databases ; label propagation ; Linear programming ; local embedding learning ; Manifolds ; semisupervised dimension reduction ; Training ; Unsupervised learning</subject><ispartof>IEEE transaction on neural networks and learning systems, 2023-09, Vol.35 (12), p.18105-18119</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c275t-4e3e4850992d232bfd41715a550d3756a77cd4be735fa919e285ebf03533a8833</cites><orcidid>0000-0002-0871-6519 ; 0000-0002-4814-1115 ; 0000-0003-0373-2488 ; 0000-0002-8655-5781</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10253951$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,778,782,794,27907,27908,54741</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10253951$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/37721887$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Nie, Hebing</creatorcontrib><creatorcontrib>Li, Qi</creatorcontrib><creatorcontrib>Wang, Zheng</creatorcontrib><creatorcontrib>Zhao, Haifeng</creatorcontrib><creatorcontrib>Nie, Feiping</creatorcontrib><title>Semisupervised Subspace Learning With Adaptive Pairwise Graph Embedding</title><title>IEEE transaction on neural networks and learning systems</title><addtitle>TNNLS</addtitle><addtitle>IEEE Trans Neural Netw Learn Syst</addtitle><description><![CDATA[Graph-based semisupervised learning can explore the graph topology information behind the samples, becoming one of the most attractive research areas in machine learning in recent years. Nevertheless, existing graph-based methods also suffer from two shortcomings. On the one hand, the existing methods generate graphs in the original high-dimensional space, which are easily disturbed by noisy and redundancy features, resulting in low-quality constructed graphs that cannot accurately portray the relationships between data. On the other hand, most of the existing models are based on the Gaussian assumption, which cannot capture the local submanifold structure information of the data, thus reducing the discriminativeness of the learned low-dimensional representations. This article proposes a semisupervised subspace learning with adaptive pairwise graph embedding (APGE), which first builds a <inline-formula> <tex-math notation="LaTeX">k_{1} </tex-math></inline-formula>-nearest neighbor graph on the labeled data to learn local discriminant embeddings for exploring the intrinsic structure of the non-Gaussian labeled data, i.e., the submanifold structure. Then, a <inline-formula> <tex-math notation="LaTeX">k_{2} </tex-math></inline-formula>-nearest neighbor graph is constructed on all samples and mapped to GE learning to adaptively explore the global structure of all samples. Clustering unlabeled data and its corresponding labeled neighbors into the same submanifold, sharing the same label information, improves embedded data's discriminative ability. And the adaptive neighborhood learning method is used to learn the graph structure in the continuously optimized subspace to ensure that the optimal graph matrix and projection matrix are finally learned, which has strong robustness. Meanwhile, the rank constraint is added to the Laplacian matrix of the similarity matrix of all samples so that the connected components in the obtained similarity matrix are precisely equal to the number of classes in the sample, which makes the structure of the graph clearer and the relationship between the near-neighbor sample points more explicit. Finally, multiple experiments on several synthetic and real-world datasets show that the method performs well in exploring local structure and classification tasks.]]></description><subject>Adaptive neighbors</subject><subject>Data models</subject><subject>Dimensionality reduction</subject><subject>Distributed databases</subject><subject>label propagation</subject><subject>Linear programming</subject><subject>local embedding learning</subject><subject>Manifolds</subject><subject>semisupervised dimension reduction</subject><subject>Training</subject><subject>Unsupervised learning</subject><issn>2162-237X</issn><issn>2162-2388</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkE1PwkAQhjdGIwT5A8aYHr0U96Pb3T0SomjSoAkYvW223anUUKi7LcZ_7yJInMvM4Zk3Mw9ClwSPCMHqdjGbZfMRxZSNGCNESHWC-pSkNKZMytPjLN56aOj9Bw6VYp4m6hz1mBCUSCn6aDqHuvJdA25bebDRvMt9YwqIMjBuXa3fo9eqXUZja5q22kL0bCr3Fcho6kyzjO7qHKwN2AU6K83Kw_DQB-jl_m4xeYizp-njZJzFBRW8jRNgkEiOlaKWMpqXNiGCcMM5tkzw1AhR2CQHwXhpFFFAJYe8xIwzZqRkbIBu9rmN23x24Fsdzi9gtTJr2HReU5mm4bsgJKB0jxZu472DUjeuqo371gTrnUP961DvHOqDw7B0fcjv8hrsceXPWACu9kAFAP8SKWeKE_YDOpx0wA</recordid><startdate>20230918</startdate><enddate>20230918</enddate><creator>Nie, Hebing</creator><creator>Li, Qi</creator><creator>Wang, Zheng</creator><creator>Zhao, Haifeng</creator><creator>Nie, Feiping</creator><general>IEEE</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-0871-6519</orcidid><orcidid>https://orcid.org/0000-0002-4814-1115</orcidid><orcidid>https://orcid.org/0000-0003-0373-2488</orcidid><orcidid>https://orcid.org/0000-0002-8655-5781</orcidid></search><sort><creationdate>20230918</creationdate><title>Semisupervised Subspace Learning With Adaptive Pairwise Graph Embedding</title><author>Nie, Hebing ; Li, Qi ; Wang, Zheng ; Zhao, Haifeng ; Nie, Feiping</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c275t-4e3e4850992d232bfd41715a550d3756a77cd4be735fa919e285ebf03533a8833</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Adaptive neighbors</topic><topic>Data models</topic><topic>Dimensionality reduction</topic><topic>Distributed databases</topic><topic>label propagation</topic><topic>Linear programming</topic><topic>local embedding learning</topic><topic>Manifolds</topic><topic>semisupervised dimension reduction</topic><topic>Training</topic><topic>Unsupervised learning</topic><toplevel>online_resources</toplevel><creatorcontrib>Nie, Hebing</creatorcontrib><creatorcontrib>Li, Qi</creatorcontrib><creatorcontrib>Wang, Zheng</creatorcontrib><creatorcontrib>Zhao, Haifeng</creatorcontrib><creatorcontrib>Nie, Feiping</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>IEEE transaction on neural networks and learning systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Nie, Hebing</au><au>Li, Qi</au><au>Wang, Zheng</au><au>Zhao, Haifeng</au><au>Nie, Feiping</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Semisupervised Subspace Learning With Adaptive Pairwise Graph Embedding</atitle><jtitle>IEEE transaction on neural networks and learning systems</jtitle><stitle>TNNLS</stitle><addtitle>IEEE Trans Neural Netw Learn Syst</addtitle><date>2023-09-18</date><risdate>2023</risdate><volume>35</volume><issue>12</issue><spage>18105</spage><epage>18119</epage><pages>18105-18119</pages><issn>2162-237X</issn><eissn>2162-2388</eissn><coden>ITNNAL</coden><abstract><![CDATA[Graph-based semisupervised learning can explore the graph topology information behind the samples, becoming one of the most attractive research areas in machine learning in recent years. Nevertheless, existing graph-based methods also suffer from two shortcomings. On the one hand, the existing methods generate graphs in the original high-dimensional space, which are easily disturbed by noisy and redundancy features, resulting in low-quality constructed graphs that cannot accurately portray the relationships between data. On the other hand, most of the existing models are based on the Gaussian assumption, which cannot capture the local submanifold structure information of the data, thus reducing the discriminativeness of the learned low-dimensional representations. This article proposes a semisupervised subspace learning with adaptive pairwise graph embedding (APGE), which first builds a <inline-formula> <tex-math notation="LaTeX">k_{1} </tex-math></inline-formula>-nearest neighbor graph on the labeled data to learn local discriminant embeddings for exploring the intrinsic structure of the non-Gaussian labeled data, i.e., the submanifold structure. Then, a <inline-formula> <tex-math notation="LaTeX">k_{2} </tex-math></inline-formula>-nearest neighbor graph is constructed on all samples and mapped to GE learning to adaptively explore the global structure of all samples. Clustering unlabeled data and its corresponding labeled neighbors into the same submanifold, sharing the same label information, improves embedded data's discriminative ability. And the adaptive neighborhood learning method is used to learn the graph structure in the continuously optimized subspace to ensure that the optimal graph matrix and projection matrix are finally learned, which has strong robustness. Meanwhile, the rank constraint is added to the Laplacian matrix of the similarity matrix of all samples so that the connected components in the obtained similarity matrix are precisely equal to the number of classes in the sample, which makes the structure of the graph clearer and the relationship between the near-neighbor sample points more explicit. Finally, multiple experiments on several synthetic and real-world datasets show that the method performs well in exploring local structure and classification tasks.]]></abstract><cop>United States</cop><pub>IEEE</pub><pmid>37721887</pmid><doi>10.1109/TNNLS.2023.3311789</doi><tpages>15</tpages><orcidid>https://orcid.org/0000-0002-0871-6519</orcidid><orcidid>https://orcid.org/0000-0002-4814-1115</orcidid><orcidid>https://orcid.org/0000-0003-0373-2488</orcidid><orcidid>https://orcid.org/0000-0002-8655-5781</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 2162-237X
ispartof IEEE transaction on neural networks and learning systems, 2023-09, Vol.35 (12), p.18105-18119
issn 2162-237X
2162-2388
language eng
recordid cdi_pubmed_primary_37721887
source IEEE Electronic Library (IEL)
subjects Adaptive neighbors
Data models
Dimensionality reduction
Distributed databases
label propagation
Linear programming
local embedding learning
Manifolds
semisupervised dimension reduction
Training
Unsupervised learning
title Semisupervised Subspace Learning With Adaptive Pairwise Graph Embedding
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-16T14%3A48%3A05IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Semisupervised%20Subspace%20Learning%20With%20Adaptive%20Pairwise%20Graph%20Embedding&rft.jtitle=IEEE%20transaction%20on%20neural%20networks%20and%20learning%20systems&rft.au=Nie,%20Hebing&rft.date=2023-09-18&rft.volume=35&rft.issue=12&rft.spage=18105&rft.epage=18119&rft.pages=18105-18119&rft.issn=2162-237X&rft.eissn=2162-2388&rft.coden=ITNNAL&rft_id=info:doi/10.1109/TNNLS.2023.3311789&rft_dat=%3Cproquest_RIE%3E2866377117%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2866377117&rft_id=info:pmid/37721887&rft_ieee_id=10253951&rfr_iscdi=true