Deterministic Multi-kernel based extreme learning machine for pattern classification
•Integration of deterministic and multiple kernel learning approach.•Feature vectors are determined based on holistic and local appearance.•Hidden layer parameters are analytically designed rather than random selection.•Resultant Kernel function is linear combination of pre-specified kernels.•Applic...
Gespeichert in:
Veröffentlicht in: | Expert systems with applications 2021-11, Vol.183, p.115308, Article 115308 |
---|---|
Hauptverfasser: | , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | 115308 |
container_title | Expert systems with applications |
container_volume | 183 |
creator | Ahuja, Bhawna Vishwakarma, Virendra P. |
description | •Integration of deterministic and multiple kernel learning approach.•Feature vectors are determined based on holistic and local appearance.•Hidden layer parameters are analytically designed rather than random selection.•Resultant Kernel function is linear combination of pre-specified kernels.•Applicable for classification problems containing heterogeneous data.
The Extreme learning machine (ELM) designed by Huang et al. is proved to be a fast and good classifier over a decade, but existing ELM is non-deterministic in nature as well as kernel dependent and needs attention to optimize the selection of kernels. In ELM feature space is obtained with the help of single kernel function. The choice of kernel depends on perceptiveness of classification problem. So a generalized framework with deterministic nature along with optimized kernel is ought to be designed that can be applied to large domain of real world heterogeneous pattern classification problems. This paper presents a deterministic extreme learning machine for neural network with feedforward architecture which is formulated with multiple kernel learning. We further enhance this approach by incorporating Gray level co-occurrence matrix (GLCM) for multi-modal feature extraction. Two formulation of kernel extreme learning machine are introduced, with target kernel function as a linear combination of different base kernels. The first one is based on deterministic multiple kernel learning while the second one uses deterministic multiple kernel learning along with GLCM for extracting the invariant feature vectors. The performance of proposed algorithms are analyzed on pattern recognition problem for face recognition by changing the number of training set, types of kernel used and coefficients used for combining base kernels. The superior recognition rate is achieved for prominent multi-class face databases, when compared with contemporary methods that prove the efficacy of proposed algorithms. |
doi_str_mv | 10.1016/j.eswa.2021.115308 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2579415018</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0957417421007375</els_id><sourcerecordid>2579415018</sourcerecordid><originalsourceid>FETCH-LOGICAL-c258t-8024cd4c2cdf53cdf7acbbc60017c896ae295cae22d3ba217100903f1c8fa6483</originalsourceid><addsrcrecordid>eNp9kLtOxDAQRS0EEmHhB6gsUSfYzsOJRIOWp7SIZqktZzIBh8RZbC-PvydRqGnuNPfMjA4h55wlnPHiskvQf-lEMMETzvOUlQck4qVM40JW6SGJWJXLOOMyOyYn3neMccmYjMj2BgO6wVjjgwH6tO-Did_RWexprT02FL-DwwFpj9pZY1_poOHNWKTt6OhOhwm3FHrtvWkN6GBGe0qOWt17PPubK_Jyd7tdP8Sb5_vH9fUmBpGXIS6ZyKDJQEDT5ukUUkNdQzE_B2VVaBRVDlOKJq214JIzVrG05VC2usjKdEUulr07N37s0QfVjXtnp5NK5LLKeM743BJLC9zovcNW7ZwZtPtRnKnZnurUbE_N9tRib4KuFgin_z8NOuXBoAVsjEMIqhnNf_gvY295qQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2579415018</pqid></control><display><type>article</type><title>Deterministic Multi-kernel based extreme learning machine for pattern classification</title><source>Access via ScienceDirect (Elsevier)</source><creator>Ahuja, Bhawna ; Vishwakarma, Virendra P.</creator><creatorcontrib>Ahuja, Bhawna ; Vishwakarma, Virendra P.</creatorcontrib><description>•Integration of deterministic and multiple kernel learning approach.•Feature vectors are determined based on holistic and local appearance.•Hidden layer parameters are analytically designed rather than random selection.•Resultant Kernel function is linear combination of pre-specified kernels.•Applicable for classification problems containing heterogeneous data.
The Extreme learning machine (ELM) designed by Huang et al. is proved to be a fast and good classifier over a decade, but existing ELM is non-deterministic in nature as well as kernel dependent and needs attention to optimize the selection of kernels. In ELM feature space is obtained with the help of single kernel function. The choice of kernel depends on perceptiveness of classification problem. So a generalized framework with deterministic nature along with optimized kernel is ought to be designed that can be applied to large domain of real world heterogeneous pattern classification problems. This paper presents a deterministic extreme learning machine for neural network with feedforward architecture which is formulated with multiple kernel learning. We further enhance this approach by incorporating Gray level co-occurrence matrix (GLCM) for multi-modal feature extraction. Two formulation of kernel extreme learning machine are introduced, with target kernel function as a linear combination of different base kernels. The first one is based on deterministic multiple kernel learning while the second one uses deterministic multiple kernel learning along with GLCM for extracting the invariant feature vectors. The performance of proposed algorithms are analyzed on pattern recognition problem for face recognition by changing the number of training set, types of kernel used and coefficients used for combining base kernels. The superior recognition rate is achieved for prominent multi-class face databases, when compared with contemporary methods that prove the efficacy of proposed algorithms.</description><identifier>ISSN: 0957-4174</identifier><identifier>EISSN: 1873-6793</identifier><identifier>DOI: 10.1016/j.eswa.2021.115308</identifier><language>eng</language><publisher>New York: Elsevier Ltd</publisher><subject>Algorithms ; Artificial neural networks ; Deterministic learning ; Face recognition ; Feature extraction ; GLCM ; Kernel functions ; Machine learning ; Multi-kernel ; Neural networks ; Pattern analysis ; Pattern classification ; Pattern recognition</subject><ispartof>Expert systems with applications, 2021-11, Vol.183, p.115308, Article 115308</ispartof><rights>2021 Elsevier Ltd</rights><rights>Copyright Elsevier BV Nov 30, 2021</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c258t-8024cd4c2cdf53cdf7acbbc60017c896ae295cae22d3ba217100903f1c8fa6483</citedby><cites>FETCH-LOGICAL-c258t-8024cd4c2cdf53cdf7acbbc60017c896ae295cae22d3ba217100903f1c8fa6483</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.eswa.2021.115308$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids></links><search><creatorcontrib>Ahuja, Bhawna</creatorcontrib><creatorcontrib>Vishwakarma, Virendra P.</creatorcontrib><title>Deterministic Multi-kernel based extreme learning machine for pattern classification</title><title>Expert systems with applications</title><description>•Integration of deterministic and multiple kernel learning approach.•Feature vectors are determined based on holistic and local appearance.•Hidden layer parameters are analytically designed rather than random selection.•Resultant Kernel function is linear combination of pre-specified kernels.•Applicable for classification problems containing heterogeneous data.
The Extreme learning machine (ELM) designed by Huang et al. is proved to be a fast and good classifier over a decade, but existing ELM is non-deterministic in nature as well as kernel dependent and needs attention to optimize the selection of kernels. In ELM feature space is obtained with the help of single kernel function. The choice of kernel depends on perceptiveness of classification problem. So a generalized framework with deterministic nature along with optimized kernel is ought to be designed that can be applied to large domain of real world heterogeneous pattern classification problems. This paper presents a deterministic extreme learning machine for neural network with feedforward architecture which is formulated with multiple kernel learning. We further enhance this approach by incorporating Gray level co-occurrence matrix (GLCM) for multi-modal feature extraction. Two formulation of kernel extreme learning machine are introduced, with target kernel function as a linear combination of different base kernels. The first one is based on deterministic multiple kernel learning while the second one uses deterministic multiple kernel learning along with GLCM for extracting the invariant feature vectors. The performance of proposed algorithms are analyzed on pattern recognition problem for face recognition by changing the number of training set, types of kernel used and coefficients used for combining base kernels. The superior recognition rate is achieved for prominent multi-class face databases, when compared with contemporary methods that prove the efficacy of proposed algorithms.</description><subject>Algorithms</subject><subject>Artificial neural networks</subject><subject>Deterministic learning</subject><subject>Face recognition</subject><subject>Feature extraction</subject><subject>GLCM</subject><subject>Kernel functions</subject><subject>Machine learning</subject><subject>Multi-kernel</subject><subject>Neural networks</subject><subject>Pattern analysis</subject><subject>Pattern classification</subject><subject>Pattern recognition</subject><issn>0957-4174</issn><issn>1873-6793</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><recordid>eNp9kLtOxDAQRS0EEmHhB6gsUSfYzsOJRIOWp7SIZqktZzIBh8RZbC-PvydRqGnuNPfMjA4h55wlnPHiskvQf-lEMMETzvOUlQck4qVM40JW6SGJWJXLOOMyOyYn3neMccmYjMj2BgO6wVjjgwH6tO-Did_RWexprT02FL-DwwFpj9pZY1_poOHNWKTt6OhOhwm3FHrtvWkN6GBGe0qOWt17PPubK_Jyd7tdP8Sb5_vH9fUmBpGXIS6ZyKDJQEDT5ukUUkNdQzE_B2VVaBRVDlOKJq214JIzVrG05VC2usjKdEUulr07N37s0QfVjXtnp5NK5LLKeM743BJLC9zovcNW7ZwZtPtRnKnZnurUbE_N9tRib4KuFgin_z8NOuXBoAVsjEMIqhnNf_gvY295qQ</recordid><startdate>20211130</startdate><enddate>20211130</enddate><creator>Ahuja, Bhawna</creator><creator>Vishwakarma, Virendra P.</creator><general>Elsevier Ltd</general><general>Elsevier BV</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope></search><sort><creationdate>20211130</creationdate><title>Deterministic Multi-kernel based extreme learning machine for pattern classification</title><author>Ahuja, Bhawna ; Vishwakarma, Virendra P.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c258t-8024cd4c2cdf53cdf7acbbc60017c896ae295cae22d3ba217100903f1c8fa6483</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Algorithms</topic><topic>Artificial neural networks</topic><topic>Deterministic learning</topic><topic>Face recognition</topic><topic>Feature extraction</topic><topic>GLCM</topic><topic>Kernel functions</topic><topic>Machine learning</topic><topic>Multi-kernel</topic><topic>Neural networks</topic><topic>Pattern analysis</topic><topic>Pattern classification</topic><topic>Pattern recognition</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Ahuja, Bhawna</creatorcontrib><creatorcontrib>Vishwakarma, Virendra P.</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Expert systems with applications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Ahuja, Bhawna</au><au>Vishwakarma, Virendra P.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Deterministic Multi-kernel based extreme learning machine for pattern classification</atitle><jtitle>Expert systems with applications</jtitle><date>2021-11-30</date><risdate>2021</risdate><volume>183</volume><spage>115308</spage><pages>115308-</pages><artnum>115308</artnum><issn>0957-4174</issn><eissn>1873-6793</eissn><abstract>•Integration of deterministic and multiple kernel learning approach.•Feature vectors are determined based on holistic and local appearance.•Hidden layer parameters are analytically designed rather than random selection.•Resultant Kernel function is linear combination of pre-specified kernels.•Applicable for classification problems containing heterogeneous data.
The Extreme learning machine (ELM) designed by Huang et al. is proved to be a fast and good classifier over a decade, but existing ELM is non-deterministic in nature as well as kernel dependent and needs attention to optimize the selection of kernels. In ELM feature space is obtained with the help of single kernel function. The choice of kernel depends on perceptiveness of classification problem. So a generalized framework with deterministic nature along with optimized kernel is ought to be designed that can be applied to large domain of real world heterogeneous pattern classification problems. This paper presents a deterministic extreme learning machine for neural network with feedforward architecture which is formulated with multiple kernel learning. We further enhance this approach by incorporating Gray level co-occurrence matrix (GLCM) for multi-modal feature extraction. Two formulation of kernel extreme learning machine are introduced, with target kernel function as a linear combination of different base kernels. The first one is based on deterministic multiple kernel learning while the second one uses deterministic multiple kernel learning along with GLCM for extracting the invariant feature vectors. The performance of proposed algorithms are analyzed on pattern recognition problem for face recognition by changing the number of training set, types of kernel used and coefficients used for combining base kernels. The superior recognition rate is achieved for prominent multi-class face databases, when compared with contemporary methods that prove the efficacy of proposed algorithms.</abstract><cop>New York</cop><pub>Elsevier Ltd</pub><doi>10.1016/j.eswa.2021.115308</doi></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0957-4174 |
ispartof | Expert systems with applications, 2021-11, Vol.183, p.115308, Article 115308 |
issn | 0957-4174 1873-6793 |
language | eng |
recordid | cdi_proquest_journals_2579415018 |
source | Access via ScienceDirect (Elsevier) |
subjects | Algorithms Artificial neural networks Deterministic learning Face recognition Feature extraction GLCM Kernel functions Machine learning Multi-kernel Neural networks Pattern analysis Pattern classification Pattern recognition |
title | Deterministic Multi-kernel based extreme learning machine for pattern classification |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T14%3A26%3A44IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Deterministic%20Multi-kernel%20based%20extreme%20learning%20machine%20for%20pattern%20classification&rft.jtitle=Expert%20systems%20with%20applications&rft.au=Ahuja,%20Bhawna&rft.date=2021-11-30&rft.volume=183&rft.spage=115308&rft.pages=115308-&rft.artnum=115308&rft.issn=0957-4174&rft.eissn=1873-6793&rft_id=info:doi/10.1016/j.eswa.2021.115308&rft_dat=%3Cproquest_cross%3E2579415018%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2579415018&rft_id=info:pmid/&rft_els_id=S0957417421007375&rfr_iscdi=true |