Deterministic Multi-kernel based extreme learning machine for pattern classification

•Integration of deterministic and multiple kernel learning approach.•Feature vectors are determined based on holistic and local appearance.•Hidden layer parameters are analytically designed rather than random selection.•Resultant Kernel function is linear combination of pre-specified kernels.•Applic...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Expert systems with applications 2021-11, Vol.183, p.115308, Article 115308
Hauptverfasser: Ahuja, Bhawna, Vishwakarma, Virendra P.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page 115308
container_title Expert systems with applications
container_volume 183
creator Ahuja, Bhawna
Vishwakarma, Virendra P.
description •Integration of deterministic and multiple kernel learning approach.•Feature vectors are determined based on holistic and local appearance.•Hidden layer parameters are analytically designed rather than random selection.•Resultant Kernel function is linear combination of pre-specified kernels.•Applicable for classification problems containing heterogeneous data. The Extreme learning machine (ELM) designed by Huang et al. is proved to be a fast and good classifier over a decade, but existing ELM is non-deterministic in nature as well as kernel dependent and needs attention to optimize the selection of kernels. In ELM feature space is obtained with the help of single kernel function. The choice of kernel depends on perceptiveness of classification problem. So a generalized framework with deterministic nature along with optimized kernel is ought to be designed that can be applied to large domain of real world heterogeneous pattern classification problems. This paper presents a deterministic extreme learning machine for neural network with feedforward architecture which is formulated with multiple kernel learning. We further enhance this approach by incorporating Gray level co-occurrence matrix (GLCM) for multi-modal feature extraction. Two formulation of kernel extreme learning machine are introduced, with target kernel function as a linear combination of different base kernels. The first one is based on deterministic multiple kernel learning while the second one uses deterministic multiple kernel learning along with GLCM for extracting the invariant feature vectors. The performance of proposed algorithms are analyzed on pattern recognition problem for face recognition by changing the number of training set, types of kernel used and coefficients used for combining base kernels. The superior recognition rate is achieved for prominent multi-class face databases, when compared with contemporary methods that prove the efficacy of proposed algorithms.
doi_str_mv 10.1016/j.eswa.2021.115308
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2579415018</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0957417421007375</els_id><sourcerecordid>2579415018</sourcerecordid><originalsourceid>FETCH-LOGICAL-c258t-8024cd4c2cdf53cdf7acbbc60017c896ae295cae22d3ba217100903f1c8fa6483</originalsourceid><addsrcrecordid>eNp9kLtOxDAQRS0EEmHhB6gsUSfYzsOJRIOWp7SIZqktZzIBh8RZbC-PvydRqGnuNPfMjA4h55wlnPHiskvQf-lEMMETzvOUlQck4qVM40JW6SGJWJXLOOMyOyYn3neMccmYjMj2BgO6wVjjgwH6tO-Did_RWexprT02FL-DwwFpj9pZY1_poOHNWKTt6OhOhwm3FHrtvWkN6GBGe0qOWt17PPubK_Jyd7tdP8Sb5_vH9fUmBpGXIS6ZyKDJQEDT5ukUUkNdQzE_B2VVaBRVDlOKJq214JIzVrG05VC2usjKdEUulr07N37s0QfVjXtnp5NK5LLKeM743BJLC9zovcNW7ZwZtPtRnKnZnurUbE_N9tRib4KuFgin_z8NOuXBoAVsjEMIqhnNf_gvY295qQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2579415018</pqid></control><display><type>article</type><title>Deterministic Multi-kernel based extreme learning machine for pattern classification</title><source>Access via ScienceDirect (Elsevier)</source><creator>Ahuja, Bhawna ; Vishwakarma, Virendra P.</creator><creatorcontrib>Ahuja, Bhawna ; Vishwakarma, Virendra P.</creatorcontrib><description>•Integration of deterministic and multiple kernel learning approach.•Feature vectors are determined based on holistic and local appearance.•Hidden layer parameters are analytically designed rather than random selection.•Resultant Kernel function is linear combination of pre-specified kernels.•Applicable for classification problems containing heterogeneous data. The Extreme learning machine (ELM) designed by Huang et al. is proved to be a fast and good classifier over a decade, but existing ELM is non-deterministic in nature as well as kernel dependent and needs attention to optimize the selection of kernels. In ELM feature space is obtained with the help of single kernel function. The choice of kernel depends on perceptiveness of classification problem. So a generalized framework with deterministic nature along with optimized kernel is ought to be designed that can be applied to large domain of real world heterogeneous pattern classification problems. This paper presents a deterministic extreme learning machine for neural network with feedforward architecture which is formulated with multiple kernel learning. We further enhance this approach by incorporating Gray level co-occurrence matrix (GLCM) for multi-modal feature extraction. Two formulation of kernel extreme learning machine are introduced, with target kernel function as a linear combination of different base kernels. The first one is based on deterministic multiple kernel learning while the second one uses deterministic multiple kernel learning along with GLCM for extracting the invariant feature vectors. The performance of proposed algorithms are analyzed on pattern recognition problem for face recognition by changing the number of training set, types of kernel used and coefficients used for combining base kernels. The superior recognition rate is achieved for prominent multi-class face databases, when compared with contemporary methods that prove the efficacy of proposed algorithms.</description><identifier>ISSN: 0957-4174</identifier><identifier>EISSN: 1873-6793</identifier><identifier>DOI: 10.1016/j.eswa.2021.115308</identifier><language>eng</language><publisher>New York: Elsevier Ltd</publisher><subject>Algorithms ; Artificial neural networks ; Deterministic learning ; Face recognition ; Feature extraction ; GLCM ; Kernel functions ; Machine learning ; Multi-kernel ; Neural networks ; Pattern analysis ; Pattern classification ; Pattern recognition</subject><ispartof>Expert systems with applications, 2021-11, Vol.183, p.115308, Article 115308</ispartof><rights>2021 Elsevier Ltd</rights><rights>Copyright Elsevier BV Nov 30, 2021</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c258t-8024cd4c2cdf53cdf7acbbc60017c896ae295cae22d3ba217100903f1c8fa6483</citedby><cites>FETCH-LOGICAL-c258t-8024cd4c2cdf53cdf7acbbc60017c896ae295cae22d3ba217100903f1c8fa6483</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.eswa.2021.115308$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids></links><search><creatorcontrib>Ahuja, Bhawna</creatorcontrib><creatorcontrib>Vishwakarma, Virendra P.</creatorcontrib><title>Deterministic Multi-kernel based extreme learning machine for pattern classification</title><title>Expert systems with applications</title><description>•Integration of deterministic and multiple kernel learning approach.•Feature vectors are determined based on holistic and local appearance.•Hidden layer parameters are analytically designed rather than random selection.•Resultant Kernel function is linear combination of pre-specified kernels.•Applicable for classification problems containing heterogeneous data. The Extreme learning machine (ELM) designed by Huang et al. is proved to be a fast and good classifier over a decade, but existing ELM is non-deterministic in nature as well as kernel dependent and needs attention to optimize the selection of kernels. In ELM feature space is obtained with the help of single kernel function. The choice of kernel depends on perceptiveness of classification problem. So a generalized framework with deterministic nature along with optimized kernel is ought to be designed that can be applied to large domain of real world heterogeneous pattern classification problems. This paper presents a deterministic extreme learning machine for neural network with feedforward architecture which is formulated with multiple kernel learning. We further enhance this approach by incorporating Gray level co-occurrence matrix (GLCM) for multi-modal feature extraction. Two formulation of kernel extreme learning machine are introduced, with target kernel function as a linear combination of different base kernels. The first one is based on deterministic multiple kernel learning while the second one uses deterministic multiple kernel learning along with GLCM for extracting the invariant feature vectors. The performance of proposed algorithms are analyzed on pattern recognition problem for face recognition by changing the number of training set, types of kernel used and coefficients used for combining base kernels. The superior recognition rate is achieved for prominent multi-class face databases, when compared with contemporary methods that prove the efficacy of proposed algorithms.</description><subject>Algorithms</subject><subject>Artificial neural networks</subject><subject>Deterministic learning</subject><subject>Face recognition</subject><subject>Feature extraction</subject><subject>GLCM</subject><subject>Kernel functions</subject><subject>Machine learning</subject><subject>Multi-kernel</subject><subject>Neural networks</subject><subject>Pattern analysis</subject><subject>Pattern classification</subject><subject>Pattern recognition</subject><issn>0957-4174</issn><issn>1873-6793</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><recordid>eNp9kLtOxDAQRS0EEmHhB6gsUSfYzsOJRIOWp7SIZqktZzIBh8RZbC-PvydRqGnuNPfMjA4h55wlnPHiskvQf-lEMMETzvOUlQck4qVM40JW6SGJWJXLOOMyOyYn3neMccmYjMj2BgO6wVjjgwH6tO-Did_RWexprT02FL-DwwFpj9pZY1_poOHNWKTt6OhOhwm3FHrtvWkN6GBGe0qOWt17PPubK_Jyd7tdP8Sb5_vH9fUmBpGXIS6ZyKDJQEDT5ukUUkNdQzE_B2VVaBRVDlOKJq214JIzVrG05VC2usjKdEUulr07N37s0QfVjXtnp5NK5LLKeM743BJLC9zovcNW7ZwZtPtRnKnZnurUbE_N9tRib4KuFgin_z8NOuXBoAVsjEMIqhnNf_gvY295qQ</recordid><startdate>20211130</startdate><enddate>20211130</enddate><creator>Ahuja, Bhawna</creator><creator>Vishwakarma, Virendra P.</creator><general>Elsevier Ltd</general><general>Elsevier BV</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope></search><sort><creationdate>20211130</creationdate><title>Deterministic Multi-kernel based extreme learning machine for pattern classification</title><author>Ahuja, Bhawna ; Vishwakarma, Virendra P.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c258t-8024cd4c2cdf53cdf7acbbc60017c896ae295cae22d3ba217100903f1c8fa6483</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Algorithms</topic><topic>Artificial neural networks</topic><topic>Deterministic learning</topic><topic>Face recognition</topic><topic>Feature extraction</topic><topic>GLCM</topic><topic>Kernel functions</topic><topic>Machine learning</topic><topic>Multi-kernel</topic><topic>Neural networks</topic><topic>Pattern analysis</topic><topic>Pattern classification</topic><topic>Pattern recognition</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Ahuja, Bhawna</creatorcontrib><creatorcontrib>Vishwakarma, Virendra P.</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Expert systems with applications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Ahuja, Bhawna</au><au>Vishwakarma, Virendra P.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Deterministic Multi-kernel based extreme learning machine for pattern classification</atitle><jtitle>Expert systems with applications</jtitle><date>2021-11-30</date><risdate>2021</risdate><volume>183</volume><spage>115308</spage><pages>115308-</pages><artnum>115308</artnum><issn>0957-4174</issn><eissn>1873-6793</eissn><abstract>•Integration of deterministic and multiple kernel learning approach.•Feature vectors are determined based on holistic and local appearance.•Hidden layer parameters are analytically designed rather than random selection.•Resultant Kernel function is linear combination of pre-specified kernels.•Applicable for classification problems containing heterogeneous data. The Extreme learning machine (ELM) designed by Huang et al. is proved to be a fast and good classifier over a decade, but existing ELM is non-deterministic in nature as well as kernel dependent and needs attention to optimize the selection of kernels. In ELM feature space is obtained with the help of single kernel function. The choice of kernel depends on perceptiveness of classification problem. So a generalized framework with deterministic nature along with optimized kernel is ought to be designed that can be applied to large domain of real world heterogeneous pattern classification problems. This paper presents a deterministic extreme learning machine for neural network with feedforward architecture which is formulated with multiple kernel learning. We further enhance this approach by incorporating Gray level co-occurrence matrix (GLCM) for multi-modal feature extraction. Two formulation of kernel extreme learning machine are introduced, with target kernel function as a linear combination of different base kernels. The first one is based on deterministic multiple kernel learning while the second one uses deterministic multiple kernel learning along with GLCM for extracting the invariant feature vectors. The performance of proposed algorithms are analyzed on pattern recognition problem for face recognition by changing the number of training set, types of kernel used and coefficients used for combining base kernels. The superior recognition rate is achieved for prominent multi-class face databases, when compared with contemporary methods that prove the efficacy of proposed algorithms.</abstract><cop>New York</cop><pub>Elsevier Ltd</pub><doi>10.1016/j.eswa.2021.115308</doi></addata></record>
fulltext fulltext
identifier ISSN: 0957-4174
ispartof Expert systems with applications, 2021-11, Vol.183, p.115308, Article 115308
issn 0957-4174
1873-6793
language eng
recordid cdi_proquest_journals_2579415018
source Access via ScienceDirect (Elsevier)
subjects Algorithms
Artificial neural networks
Deterministic learning
Face recognition
Feature extraction
GLCM
Kernel functions
Machine learning
Multi-kernel
Neural networks
Pattern analysis
Pattern classification
Pattern recognition
title Deterministic Multi-kernel based extreme learning machine for pattern classification
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T14%3A26%3A44IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Deterministic%20Multi-kernel%20based%20extreme%20learning%20machine%20for%20pattern%20classification&rft.jtitle=Expert%20systems%20with%20applications&rft.au=Ahuja,%20Bhawna&rft.date=2021-11-30&rft.volume=183&rft.spage=115308&rft.pages=115308-&rft.artnum=115308&rft.issn=0957-4174&rft.eissn=1873-6793&rft_id=info:doi/10.1016/j.eswa.2021.115308&rft_dat=%3Cproquest_cross%3E2579415018%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2579415018&rft_id=info:pmid/&rft_els_id=S0957417421007375&rfr_iscdi=true