Graph based semi-supervised classification with probabilistic nearest neighbors

•PNN jointly learns graph structure and probability transition matrix for inference.•PNN explore complex data structure preferably, with low computation complexity.•PNN enhances relevance between graph construction and inference.•PNN is optimized according to min-max normalization for discriminate d...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Pattern recognition letters 2020-05, Vol.133, p.94-101
Hauptverfasser: Ma, Junliang, Xiao, Bing, Deng, Cheng
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 101
container_issue
container_start_page 94
container_title Pattern recognition letters
container_volume 133
creator Ma, Junliang
Xiao, Bing
Deng, Cheng
description •PNN jointly learns graph structure and probability transition matrix for inference.•PNN explore complex data structure preferably, with low computation complexity.•PNN enhances relevance between graph construction and inference.•PNN is optimized according to min-max normalization for discriminate data.•PNN is more conducive to classification accuracy and efficiency. Label propagation (LP) is one of the state-of-the-art graph based semi-supervised learning (GSSL) algorithm. Probability transition matrix (PTM) is the key for LP to propagate label information among samples. Conventionally, PTM is calculated based on the graph constructed in advance, and graph construction independent of PTM calculation. It leads to complex steps for acquiring PTM, and more importantly, brings about the lack of correlation between graph construction and inference. Based on adaptive neighbors-based method, probabilistic nearest neighbors (PNN) based graph construction algorithm is proposed for effective ℓ2 norm optimization, and the solving process of the objective function is optimized by incorporating min-max normalization. The derived PNN matrix is more discriminative and directly serve as PTM for LP. It makes PTM computation more conveniently and more applicable for classification task. In addition, number of neighbors is adaptively determined on the premise of its preset value. Experimental results show that the proposed PNN algorithm specializes in reflecting probability differences of neighboring nodes in a graph, and positive results are achieved in semi-supervised classification. The average classification accuracy on synthetic data sets is 84.24%, and that on image data sets achieves 89.08%.
doi_str_mv 10.1016/j.patrec.2020.01.021
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2440491082</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0167865520300337</els_id><sourcerecordid>2440491082</sourcerecordid><originalsourceid>FETCH-LOGICAL-c334t-38f23c6f408d3af666c262f4a802b3466b4a4bf83a4ba387700961dcbc7660d03</originalsourceid><addsrcrecordid>eNp9UE1LAzEUDKJgrf4DDwued335aDa9CFK0CoVe9BySbGLf0u6uyVbx35uynr284cHMvHlDyC2FigKV9201mDF6VzFgUAGtgNEzMqOqZmXNhTgns0yrSyUXi0tylVILAJIv1Yxs19EMu8Ka5Jsi-QOW6Tj4-IWn3e1NShjQmRH7rvjGcVcMsbfG4h7TiK7ovIk-jRnxY2f7mK7JRTD75G_-cE7en5_eVi_lZrt-XT1uSse5GEuuAuNOBgGq4SZIKR2TLAijgFkupLTCCBsUz9NwVdcAS0kbZ10tJTTA5-Ru8s15Po85gm77Y-zySc2EALGkoFhmiYnlYp9S9EEPEQ8m_mgK-lSdbvVUnT5Vp4HqXF2WPUwynz_4Qh91cug75xvM1FE3Pf5v8AtRcnm6</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2440491082</pqid></control><display><type>article</type><title>Graph based semi-supervised classification with probabilistic nearest neighbors</title><source>Elsevier ScienceDirect Journals Complete</source><creator>Ma, Junliang ; Xiao, Bing ; Deng, Cheng</creator><creatorcontrib>Ma, Junliang ; Xiao, Bing ; Deng, Cheng</creatorcontrib><description>•PNN jointly learns graph structure and probability transition matrix for inference.•PNN explore complex data structure preferably, with low computation complexity.•PNN enhances relevance between graph construction and inference.•PNN is optimized according to min-max normalization for discriminate data.•PNN is more conducive to classification accuracy and efficiency. Label propagation (LP) is one of the state-of-the-art graph based semi-supervised learning (GSSL) algorithm. Probability transition matrix (PTM) is the key for LP to propagate label information among samples. Conventionally, PTM is calculated based on the graph constructed in advance, and graph construction independent of PTM calculation. It leads to complex steps for acquiring PTM, and more importantly, brings about the lack of correlation between graph construction and inference. Based on adaptive neighbors-based method, probabilistic nearest neighbors (PNN) based graph construction algorithm is proposed for effective ℓ2 norm optimization, and the solving process of the objective function is optimized by incorporating min-max normalization. The derived PNN matrix is more discriminative and directly serve as PTM for LP. It makes PTM computation more conveniently and more applicable for classification task. In addition, number of neighbors is adaptively determined on the premise of its preset value. Experimental results show that the proposed PNN algorithm specializes in reflecting probability differences of neighboring nodes in a graph, and positive results are achieved in semi-supervised classification. The average classification accuracy on synthetic data sets is 84.24%, and that on image data sets achieves 89.08%.</description><identifier>ISSN: 0167-8655</identifier><identifier>EISSN: 1872-7344</identifier><identifier>DOI: 10.1016/j.patrec.2020.01.021</identifier><language>eng</language><publisher>Amsterdam: Elsevier B.V</publisher><subject>Algorithms ; Classification ; Datasets ; Graph construction ; Machine learning ; Mathematical analysis ; Optimization ; Probabilistic inference ; Probabilistic methods ; Probabilistic nearest neighbors ; Probability learning ; Probability transition matrix ; Semi-supervised classification ; Statistical analysis</subject><ispartof>Pattern recognition letters, 2020-05, Vol.133, p.94-101</ispartof><rights>2020 Elsevier B.V.</rights><rights>Copyright Elsevier Science Ltd. May 2020</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c334t-38f23c6f408d3af666c262f4a802b3466b4a4bf83a4ba387700961dcbc7660d03</citedby><cites>FETCH-LOGICAL-c334t-38f23c6f408d3af666c262f4a802b3466b4a4bf83a4ba387700961dcbc7660d03</cites><orcidid>0000-0003-2620-3247 ; 0000-0003-3249-735X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.patrec.2020.01.021$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids></links><search><creatorcontrib>Ma, Junliang</creatorcontrib><creatorcontrib>Xiao, Bing</creatorcontrib><creatorcontrib>Deng, Cheng</creatorcontrib><title>Graph based semi-supervised classification with probabilistic nearest neighbors</title><title>Pattern recognition letters</title><description>•PNN jointly learns graph structure and probability transition matrix for inference.•PNN explore complex data structure preferably, with low computation complexity.•PNN enhances relevance between graph construction and inference.•PNN is optimized according to min-max normalization for discriminate data.•PNN is more conducive to classification accuracy and efficiency. Label propagation (LP) is one of the state-of-the-art graph based semi-supervised learning (GSSL) algorithm. Probability transition matrix (PTM) is the key for LP to propagate label information among samples. Conventionally, PTM is calculated based on the graph constructed in advance, and graph construction independent of PTM calculation. It leads to complex steps for acquiring PTM, and more importantly, brings about the lack of correlation between graph construction and inference. Based on adaptive neighbors-based method, probabilistic nearest neighbors (PNN) based graph construction algorithm is proposed for effective ℓ2 norm optimization, and the solving process of the objective function is optimized by incorporating min-max normalization. The derived PNN matrix is more discriminative and directly serve as PTM for LP. It makes PTM computation more conveniently and more applicable for classification task. In addition, number of neighbors is adaptively determined on the premise of its preset value. Experimental results show that the proposed PNN algorithm specializes in reflecting probability differences of neighboring nodes in a graph, and positive results are achieved in semi-supervised classification. The average classification accuracy on synthetic data sets is 84.24%, and that on image data sets achieves 89.08%.</description><subject>Algorithms</subject><subject>Classification</subject><subject>Datasets</subject><subject>Graph construction</subject><subject>Machine learning</subject><subject>Mathematical analysis</subject><subject>Optimization</subject><subject>Probabilistic inference</subject><subject>Probabilistic methods</subject><subject>Probabilistic nearest neighbors</subject><subject>Probability learning</subject><subject>Probability transition matrix</subject><subject>Semi-supervised classification</subject><subject>Statistical analysis</subject><issn>0167-8655</issn><issn>1872-7344</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><recordid>eNp9UE1LAzEUDKJgrf4DDwued335aDa9CFK0CoVe9BySbGLf0u6uyVbx35uynr284cHMvHlDyC2FigKV9201mDF6VzFgUAGtgNEzMqOqZmXNhTgns0yrSyUXi0tylVILAJIv1Yxs19EMu8Ka5Jsi-QOW6Tj4-IWn3e1NShjQmRH7rvjGcVcMsbfG4h7TiK7ovIk-jRnxY2f7mK7JRTD75G_-cE7en5_eVi_lZrt-XT1uSse5GEuuAuNOBgGq4SZIKR2TLAijgFkupLTCCBsUz9NwVdcAS0kbZ10tJTTA5-Ru8s15Po85gm77Y-zySc2EALGkoFhmiYnlYp9S9EEPEQ8m_mgK-lSdbvVUnT5Vp4HqXF2WPUwynz_4Qh91cug75xvM1FE3Pf5v8AtRcnm6</recordid><startdate>202005</startdate><enddate>202005</enddate><creator>Ma, Junliang</creator><creator>Xiao, Bing</creator><creator>Deng, Cheng</creator><general>Elsevier B.V</general><general>Elsevier Science Ltd</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7TK</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0003-2620-3247</orcidid><orcidid>https://orcid.org/0000-0003-3249-735X</orcidid></search><sort><creationdate>202005</creationdate><title>Graph based semi-supervised classification with probabilistic nearest neighbors</title><author>Ma, Junliang ; Xiao, Bing ; Deng, Cheng</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c334t-38f23c6f408d3af666c262f4a802b3466b4a4bf83a4ba387700961dcbc7660d03</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Algorithms</topic><topic>Classification</topic><topic>Datasets</topic><topic>Graph construction</topic><topic>Machine learning</topic><topic>Mathematical analysis</topic><topic>Optimization</topic><topic>Probabilistic inference</topic><topic>Probabilistic methods</topic><topic>Probabilistic nearest neighbors</topic><topic>Probability learning</topic><topic>Probability transition matrix</topic><topic>Semi-supervised classification</topic><topic>Statistical analysis</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Ma, Junliang</creatorcontrib><creatorcontrib>Xiao, Bing</creatorcontrib><creatorcontrib>Deng, Cheng</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Neurosciences Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Pattern recognition letters</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Ma, Junliang</au><au>Xiao, Bing</au><au>Deng, Cheng</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Graph based semi-supervised classification with probabilistic nearest neighbors</atitle><jtitle>Pattern recognition letters</jtitle><date>2020-05</date><risdate>2020</risdate><volume>133</volume><spage>94</spage><epage>101</epage><pages>94-101</pages><issn>0167-8655</issn><eissn>1872-7344</eissn><abstract>•PNN jointly learns graph structure and probability transition matrix for inference.•PNN explore complex data structure preferably, with low computation complexity.•PNN enhances relevance between graph construction and inference.•PNN is optimized according to min-max normalization for discriminate data.•PNN is more conducive to classification accuracy and efficiency. Label propagation (LP) is one of the state-of-the-art graph based semi-supervised learning (GSSL) algorithm. Probability transition matrix (PTM) is the key for LP to propagate label information among samples. Conventionally, PTM is calculated based on the graph constructed in advance, and graph construction independent of PTM calculation. It leads to complex steps for acquiring PTM, and more importantly, brings about the lack of correlation between graph construction and inference. Based on adaptive neighbors-based method, probabilistic nearest neighbors (PNN) based graph construction algorithm is proposed for effective ℓ2 norm optimization, and the solving process of the objective function is optimized by incorporating min-max normalization. The derived PNN matrix is more discriminative and directly serve as PTM for LP. It makes PTM computation more conveniently and more applicable for classification task. In addition, number of neighbors is adaptively determined on the premise of its preset value. Experimental results show that the proposed PNN algorithm specializes in reflecting probability differences of neighboring nodes in a graph, and positive results are achieved in semi-supervised classification. The average classification accuracy on synthetic data sets is 84.24%, and that on image data sets achieves 89.08%.</abstract><cop>Amsterdam</cop><pub>Elsevier B.V</pub><doi>10.1016/j.patrec.2020.01.021</doi><tpages>8</tpages><orcidid>https://orcid.org/0000-0003-2620-3247</orcidid><orcidid>https://orcid.org/0000-0003-3249-735X</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0167-8655
ispartof Pattern recognition letters, 2020-05, Vol.133, p.94-101
issn 0167-8655
1872-7344
language eng
recordid cdi_proquest_journals_2440491082
source Elsevier ScienceDirect Journals Complete
subjects Algorithms
Classification
Datasets
Graph construction
Machine learning
Mathematical analysis
Optimization
Probabilistic inference
Probabilistic methods
Probabilistic nearest neighbors
Probability learning
Probability transition matrix
Semi-supervised classification
Statistical analysis
title Graph based semi-supervised classification with probabilistic nearest neighbors
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T00%3A50%3A46IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Graph%20based%20semi-supervised%20classification%20with%20probabilistic%20nearest%20neighbors&rft.jtitle=Pattern%20recognition%20letters&rft.au=Ma,%20Junliang&rft.date=2020-05&rft.volume=133&rft.spage=94&rft.epage=101&rft.pages=94-101&rft.issn=0167-8655&rft.eissn=1872-7344&rft_id=info:doi/10.1016/j.patrec.2020.01.021&rft_dat=%3Cproquest_cross%3E2440491082%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2440491082&rft_id=info:pmid/&rft_els_id=S0167865520300337&rfr_iscdi=true