Graph based semi-supervised classification with probabilistic nearest neighbors
•PNN jointly learns graph structure and probability transition matrix for inference.•PNN explore complex data structure preferably, with low computation complexity.•PNN enhances relevance between graph construction and inference.•PNN is optimized according to min-max normalization for discriminate d...
Gespeichert in:
Veröffentlicht in: | Pattern recognition letters 2020-05, Vol.133, p.94-101 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 101 |
---|---|
container_issue | |
container_start_page | 94 |
container_title | Pattern recognition letters |
container_volume | 133 |
creator | Ma, Junliang Xiao, Bing Deng, Cheng |
description | •PNN jointly learns graph structure and probability transition matrix for inference.•PNN explore complex data structure preferably, with low computation complexity.•PNN enhances relevance between graph construction and inference.•PNN is optimized according to min-max normalization for discriminate data.•PNN is more conducive to classification accuracy and efficiency.
Label propagation (LP) is one of the state-of-the-art graph based semi-supervised learning (GSSL) algorithm. Probability transition matrix (PTM) is the key for LP to propagate label information among samples. Conventionally, PTM is calculated based on the graph constructed in advance, and graph construction independent of PTM calculation. It leads to complex steps for acquiring PTM, and more importantly, brings about the lack of correlation between graph construction and inference. Based on adaptive neighbors-based method, probabilistic nearest neighbors (PNN) based graph construction algorithm is proposed for effective ℓ2 norm optimization, and the solving process of the objective function is optimized by incorporating min-max normalization. The derived PNN matrix is more discriminative and directly serve as PTM for LP. It makes PTM computation more conveniently and more applicable for classification task. In addition, number of neighbors is adaptively determined on the premise of its preset value. Experimental results show that the proposed PNN algorithm specializes in reflecting probability differences of neighboring nodes in a graph, and positive results are achieved in semi-supervised classification. The average classification accuracy on synthetic data sets is 84.24%, and that on image data sets achieves 89.08%. |
doi_str_mv | 10.1016/j.patrec.2020.01.021 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2440491082</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0167865520300337</els_id><sourcerecordid>2440491082</sourcerecordid><originalsourceid>FETCH-LOGICAL-c334t-38f23c6f408d3af666c262f4a802b3466b4a4bf83a4ba387700961dcbc7660d03</originalsourceid><addsrcrecordid>eNp9UE1LAzEUDKJgrf4DDwued335aDa9CFK0CoVe9BySbGLf0u6uyVbx35uynr284cHMvHlDyC2FigKV9201mDF6VzFgUAGtgNEzMqOqZmXNhTgns0yrSyUXi0tylVILAJIv1Yxs19EMu8Ka5Jsi-QOW6Tj4-IWn3e1NShjQmRH7rvjGcVcMsbfG4h7TiK7ovIk-jRnxY2f7mK7JRTD75G_-cE7en5_eVi_lZrt-XT1uSse5GEuuAuNOBgGq4SZIKR2TLAijgFkupLTCCBsUz9NwVdcAS0kbZ10tJTTA5-Ru8s15Po85gm77Y-zySc2EALGkoFhmiYnlYp9S9EEPEQ8m_mgK-lSdbvVUnT5Vp4HqXF2WPUwynz_4Qh91cug75xvM1FE3Pf5v8AtRcnm6</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2440491082</pqid></control><display><type>article</type><title>Graph based semi-supervised classification with probabilistic nearest neighbors</title><source>Elsevier ScienceDirect Journals Complete</source><creator>Ma, Junliang ; Xiao, Bing ; Deng, Cheng</creator><creatorcontrib>Ma, Junliang ; Xiao, Bing ; Deng, Cheng</creatorcontrib><description>•PNN jointly learns graph structure and probability transition matrix for inference.•PNN explore complex data structure preferably, with low computation complexity.•PNN enhances relevance between graph construction and inference.•PNN is optimized according to min-max normalization for discriminate data.•PNN is more conducive to classification accuracy and efficiency.
Label propagation (LP) is one of the state-of-the-art graph based semi-supervised learning (GSSL) algorithm. Probability transition matrix (PTM) is the key for LP to propagate label information among samples. Conventionally, PTM is calculated based on the graph constructed in advance, and graph construction independent of PTM calculation. It leads to complex steps for acquiring PTM, and more importantly, brings about the lack of correlation between graph construction and inference. Based on adaptive neighbors-based method, probabilistic nearest neighbors (PNN) based graph construction algorithm is proposed for effective ℓ2 norm optimization, and the solving process of the objective function is optimized by incorporating min-max normalization. The derived PNN matrix is more discriminative and directly serve as PTM for LP. It makes PTM computation more conveniently and more applicable for classification task. In addition, number of neighbors is adaptively determined on the premise of its preset value. Experimental results show that the proposed PNN algorithm specializes in reflecting probability differences of neighboring nodes in a graph, and positive results are achieved in semi-supervised classification. The average classification accuracy on synthetic data sets is 84.24%, and that on image data sets achieves 89.08%.</description><identifier>ISSN: 0167-8655</identifier><identifier>EISSN: 1872-7344</identifier><identifier>DOI: 10.1016/j.patrec.2020.01.021</identifier><language>eng</language><publisher>Amsterdam: Elsevier B.V</publisher><subject>Algorithms ; Classification ; Datasets ; Graph construction ; Machine learning ; Mathematical analysis ; Optimization ; Probabilistic inference ; Probabilistic methods ; Probabilistic nearest neighbors ; Probability learning ; Probability transition matrix ; Semi-supervised classification ; Statistical analysis</subject><ispartof>Pattern recognition letters, 2020-05, Vol.133, p.94-101</ispartof><rights>2020 Elsevier B.V.</rights><rights>Copyright Elsevier Science Ltd. May 2020</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c334t-38f23c6f408d3af666c262f4a802b3466b4a4bf83a4ba387700961dcbc7660d03</citedby><cites>FETCH-LOGICAL-c334t-38f23c6f408d3af666c262f4a802b3466b4a4bf83a4ba387700961dcbc7660d03</cites><orcidid>0000-0003-2620-3247 ; 0000-0003-3249-735X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.patrec.2020.01.021$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids></links><search><creatorcontrib>Ma, Junliang</creatorcontrib><creatorcontrib>Xiao, Bing</creatorcontrib><creatorcontrib>Deng, Cheng</creatorcontrib><title>Graph based semi-supervised classification with probabilistic nearest neighbors</title><title>Pattern recognition letters</title><description>•PNN jointly learns graph structure and probability transition matrix for inference.•PNN explore complex data structure preferably, with low computation complexity.•PNN enhances relevance between graph construction and inference.•PNN is optimized according to min-max normalization for discriminate data.•PNN is more conducive to classification accuracy and efficiency.
Label propagation (LP) is one of the state-of-the-art graph based semi-supervised learning (GSSL) algorithm. Probability transition matrix (PTM) is the key for LP to propagate label information among samples. Conventionally, PTM is calculated based on the graph constructed in advance, and graph construction independent of PTM calculation. It leads to complex steps for acquiring PTM, and more importantly, brings about the lack of correlation between graph construction and inference. Based on adaptive neighbors-based method, probabilistic nearest neighbors (PNN) based graph construction algorithm is proposed for effective ℓ2 norm optimization, and the solving process of the objective function is optimized by incorporating min-max normalization. The derived PNN matrix is more discriminative and directly serve as PTM for LP. It makes PTM computation more conveniently and more applicable for classification task. In addition, number of neighbors is adaptively determined on the premise of its preset value. Experimental results show that the proposed PNN algorithm specializes in reflecting probability differences of neighboring nodes in a graph, and positive results are achieved in semi-supervised classification. The average classification accuracy on synthetic data sets is 84.24%, and that on image data sets achieves 89.08%.</description><subject>Algorithms</subject><subject>Classification</subject><subject>Datasets</subject><subject>Graph construction</subject><subject>Machine learning</subject><subject>Mathematical analysis</subject><subject>Optimization</subject><subject>Probabilistic inference</subject><subject>Probabilistic methods</subject><subject>Probabilistic nearest neighbors</subject><subject>Probability learning</subject><subject>Probability transition matrix</subject><subject>Semi-supervised classification</subject><subject>Statistical analysis</subject><issn>0167-8655</issn><issn>1872-7344</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><recordid>eNp9UE1LAzEUDKJgrf4DDwued335aDa9CFK0CoVe9BySbGLf0u6uyVbx35uynr284cHMvHlDyC2FigKV9201mDF6VzFgUAGtgNEzMqOqZmXNhTgns0yrSyUXi0tylVILAJIv1Yxs19EMu8Ka5Jsi-QOW6Tj4-IWn3e1NShjQmRH7rvjGcVcMsbfG4h7TiK7ovIk-jRnxY2f7mK7JRTD75G_-cE7en5_eVi_lZrt-XT1uSse5GEuuAuNOBgGq4SZIKR2TLAijgFkupLTCCBsUz9NwVdcAS0kbZ10tJTTA5-Ru8s15Po85gm77Y-zySc2EALGkoFhmiYnlYp9S9EEPEQ8m_mgK-lSdbvVUnT5Vp4HqXF2WPUwynz_4Qh91cug75xvM1FE3Pf5v8AtRcnm6</recordid><startdate>202005</startdate><enddate>202005</enddate><creator>Ma, Junliang</creator><creator>Xiao, Bing</creator><creator>Deng, Cheng</creator><general>Elsevier B.V</general><general>Elsevier Science Ltd</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7TK</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0003-2620-3247</orcidid><orcidid>https://orcid.org/0000-0003-3249-735X</orcidid></search><sort><creationdate>202005</creationdate><title>Graph based semi-supervised classification with probabilistic nearest neighbors</title><author>Ma, Junliang ; Xiao, Bing ; Deng, Cheng</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c334t-38f23c6f408d3af666c262f4a802b3466b4a4bf83a4ba387700961dcbc7660d03</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Algorithms</topic><topic>Classification</topic><topic>Datasets</topic><topic>Graph construction</topic><topic>Machine learning</topic><topic>Mathematical analysis</topic><topic>Optimization</topic><topic>Probabilistic inference</topic><topic>Probabilistic methods</topic><topic>Probabilistic nearest neighbors</topic><topic>Probability learning</topic><topic>Probability transition matrix</topic><topic>Semi-supervised classification</topic><topic>Statistical analysis</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Ma, Junliang</creatorcontrib><creatorcontrib>Xiao, Bing</creatorcontrib><creatorcontrib>Deng, Cheng</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Neurosciences Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Pattern recognition letters</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Ma, Junliang</au><au>Xiao, Bing</au><au>Deng, Cheng</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Graph based semi-supervised classification with probabilistic nearest neighbors</atitle><jtitle>Pattern recognition letters</jtitle><date>2020-05</date><risdate>2020</risdate><volume>133</volume><spage>94</spage><epage>101</epage><pages>94-101</pages><issn>0167-8655</issn><eissn>1872-7344</eissn><abstract>•PNN jointly learns graph structure and probability transition matrix for inference.•PNN explore complex data structure preferably, with low computation complexity.•PNN enhances relevance between graph construction and inference.•PNN is optimized according to min-max normalization for discriminate data.•PNN is more conducive to classification accuracy and efficiency.
Label propagation (LP) is one of the state-of-the-art graph based semi-supervised learning (GSSL) algorithm. Probability transition matrix (PTM) is the key for LP to propagate label information among samples. Conventionally, PTM is calculated based on the graph constructed in advance, and graph construction independent of PTM calculation. It leads to complex steps for acquiring PTM, and more importantly, brings about the lack of correlation between graph construction and inference. Based on adaptive neighbors-based method, probabilistic nearest neighbors (PNN) based graph construction algorithm is proposed for effective ℓ2 norm optimization, and the solving process of the objective function is optimized by incorporating min-max normalization. The derived PNN matrix is more discriminative and directly serve as PTM for LP. It makes PTM computation more conveniently and more applicable for classification task. In addition, number of neighbors is adaptively determined on the premise of its preset value. Experimental results show that the proposed PNN algorithm specializes in reflecting probability differences of neighboring nodes in a graph, and positive results are achieved in semi-supervised classification. The average classification accuracy on synthetic data sets is 84.24%, and that on image data sets achieves 89.08%.</abstract><cop>Amsterdam</cop><pub>Elsevier B.V</pub><doi>10.1016/j.patrec.2020.01.021</doi><tpages>8</tpages><orcidid>https://orcid.org/0000-0003-2620-3247</orcidid><orcidid>https://orcid.org/0000-0003-3249-735X</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0167-8655 |
ispartof | Pattern recognition letters, 2020-05, Vol.133, p.94-101 |
issn | 0167-8655 1872-7344 |
language | eng |
recordid | cdi_proquest_journals_2440491082 |
source | Elsevier ScienceDirect Journals Complete |
subjects | Algorithms Classification Datasets Graph construction Machine learning Mathematical analysis Optimization Probabilistic inference Probabilistic methods Probabilistic nearest neighbors Probability learning Probability transition matrix Semi-supervised classification Statistical analysis |
title | Graph based semi-supervised classification with probabilistic nearest neighbors |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T00%3A50%3A46IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Graph%20based%20semi-supervised%20classification%20with%20probabilistic%20nearest%20neighbors&rft.jtitle=Pattern%20recognition%20letters&rft.au=Ma,%20Junliang&rft.date=2020-05&rft.volume=133&rft.spage=94&rft.epage=101&rft.pages=94-101&rft.issn=0167-8655&rft.eissn=1872-7344&rft_id=info:doi/10.1016/j.patrec.2020.01.021&rft_dat=%3Cproquest_cross%3E2440491082%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2440491082&rft_id=info:pmid/&rft_els_id=S0167865520300337&rfr_iscdi=true |