MCES: A Novel Monte Carlo Evaluative Selection Approach for Objective Feature Selections
Most recent research efforts on feature selection have focused mainly on classification task due to its popularity in the data-mining community. However, feature selection research in nonlinear system estimations has been very limited. Hence, it is reasonable to devise a feature selection approach t...
Gespeichert in:
Veröffentlicht in: | IEEE transaction on neural networks and learning systems 2007-03, Vol.18 (2), p.431-448 |
---|---|
Hauptverfasser: | , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 448 |
---|---|
container_issue | 2 |
container_start_page | 431 |
container_title | IEEE transaction on neural networks and learning systems |
container_volume | 18 |
creator | Kian Hong Quah Quek, C. |
description | Most recent research efforts on feature selection have focused mainly on classification task due to its popularity in the data-mining community. However, feature selection research in nonlinear system estimations has been very limited. Hence, it is reasonable to devise a feature selection approach that is computationally efficient on nonlinear system estimations context. A novel feature selection approach, the Monte Carlo evaluative selection (MCES), is proposed in this paper. MCES is an objective sampling method that derives a better estimation of the relevancy measure. The algorithm is objectively designed to be applicable to both classification and nonlinear regressive tasks. The MCES method has been demonstrated to perform well with four sets of experiments, consisting of two classification and two regressive tasks. The results demonstrate that the MCES method has following strong advantages: 1) ability to identify correlated and irrelevant features based on weight ranking, 2) application to both nonlinear system estimation and classification tasks, and 3) independence of the underlying induction algorithms used to derive the performance measures |
doi_str_mv | 10.1109/TNN.2006.887555 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_pubmed_primary_17385630</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>4118276</ieee_id><sourcerecordid>70309597</sourcerecordid><originalsourceid>FETCH-LOGICAL-c374t-e27b5216c46e84021d874af711da6435cf0ba9c423c8df7d1fc5ff045029ee4a3</originalsourceid><addsrcrecordid>eNp90b1rGzEYBnBRGprE6dyhUESHdDpH3x_djHHaQuIMSaGbkHWv6Jmz5Up3hvz3kbFpS4dOEtJPL3p4EHpHyZRSYm-elsspI0RNjdFSylfoglpBG0Isf133RMjGMqbP0WUpa0KokES9QedUcyMVJxfox_188fgZz_Ay7aHH92k7AJ773Ce82Pt-9EO3B_wIPYShS1s82-1y8uEnjinjh9X6cFzBLfhhzH_BcoXOou8LvD2tE_T9dvE0_9rcPXz5Np_dNYFrMTTA9EoyqoJQYARhtDVa-Kgpbb0SXIZIVt4GwXgwbdQtjUHGWHMRZgGE5xP06Ti3_uvXCGVwm64E6Hu_hTQWZwxRVtmadoKu_ys14cRKqyv8-A9cpzFvawpnKWNUMMYqujmikFMpGaLb5W7j87OjxB26cbUbd-jGHbupLz6cxo6rDbR__KmMCt4fQQcAv68FpYZpxV8A4eOQvA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>912214222</pqid></control><display><type>article</type><title>MCES: A Novel Monte Carlo Evaluative Selection Approach for Objective Feature Selections</title><source>IEEE Electronic Library (IEL)</source><creator>Kian Hong Quah ; Quek, C.</creator><creatorcontrib>Kian Hong Quah ; Quek, C.</creatorcontrib><description>Most recent research efforts on feature selection have focused mainly on classification task due to its popularity in the data-mining community. However, feature selection research in nonlinear system estimations has been very limited. Hence, it is reasonable to devise a feature selection approach that is computationally efficient on nonlinear system estimations context. A novel feature selection approach, the Monte Carlo evaluative selection (MCES), is proposed in this paper. MCES is an objective sampling method that derives a better estimation of the relevancy measure. The algorithm is objectively designed to be applicable to both classification and nonlinear regressive tasks. The MCES method has been demonstrated to perform well with four sets of experiments, consisting of two classification and two regressive tasks. The results demonstrate that the MCES method has following strong advantages: 1) ability to identify correlated and irrelevant features based on weight ranking, 2) application to both nonlinear system estimation and classification tasks, and 3) independence of the underlying induction algorithms used to derive the performance measures</description><identifier>ISSN: 1045-9227</identifier><identifier>ISSN: 2162-237X</identifier><identifier>EISSN: 1941-0093</identifier><identifier>EISSN: 2162-2388</identifier><identifier>DOI: 10.1109/TNN.2006.887555</identifier><identifier>PMID: 17385630</identifier><identifier>CODEN: ITNNEP</identifier><language>eng</language><publisher>United States: IEEE</publisher><subject>Accuracy measure ; adaptive neurofuzzy inference systems (ANFISs) ; Adaptive systems ; Algorithm design and analysis ; Algorithms ; Artificial Intelligence ; audio signal classification ; automobile miles per gallon (MPG) prediction ; Automobiles ; Classification ; Computational efficiency ; Computer Simulation ; Data mining ; Decision trees ; Dynamical systems ; Filters ; financial data modeling ; induction algorithm ; Inference algorithms ; Information Storage and Retrieval - methods ; low computational cost ; Models, Statistical ; Monte Carlo evaluative feature selection ; Monte Carlo evaluative selection (MCES) ; Monte Carlo Method ; Monte Carlo methods ; multilayer perceptron (MLP) ; Neural networks ; Neural Networks (Computer) ; Nonlinear dynamics ; Nonlinear systems ; Pattern classification ; Pattern Recognition, Automated - methods ; regressive series ; reinforcement learning ; Sampling methods ; Studies ; Tasks</subject><ispartof>IEEE transaction on neural networks and learning systems, 2007-03, Vol.18 (2), p.431-448</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2007</rights><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c374t-e27b5216c46e84021d874af711da6435cf0ba9c423c8df7d1fc5ff045029ee4a3</citedby><cites>FETCH-LOGICAL-c374t-e27b5216c46e84021d874af711da6435cf0ba9c423c8df7d1fc5ff045029ee4a3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/4118276$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,778,782,794,27911,27912,54745</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/4118276$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/17385630$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Kian Hong Quah</creatorcontrib><creatorcontrib>Quek, C.</creatorcontrib><title>MCES: A Novel Monte Carlo Evaluative Selection Approach for Objective Feature Selections</title><title>IEEE transaction on neural networks and learning systems</title><addtitle>TNN</addtitle><addtitle>IEEE Trans Neural Netw</addtitle><description>Most recent research efforts on feature selection have focused mainly on classification task due to its popularity in the data-mining community. However, feature selection research in nonlinear system estimations has been very limited. Hence, it is reasonable to devise a feature selection approach that is computationally efficient on nonlinear system estimations context. A novel feature selection approach, the Monte Carlo evaluative selection (MCES), is proposed in this paper. MCES is an objective sampling method that derives a better estimation of the relevancy measure. The algorithm is objectively designed to be applicable to both classification and nonlinear regressive tasks. The MCES method has been demonstrated to perform well with four sets of experiments, consisting of two classification and two regressive tasks. The results demonstrate that the MCES method has following strong advantages: 1) ability to identify correlated and irrelevant features based on weight ranking, 2) application to both nonlinear system estimation and classification tasks, and 3) independence of the underlying induction algorithms used to derive the performance measures</description><subject>Accuracy measure</subject><subject>adaptive neurofuzzy inference systems (ANFISs)</subject><subject>Adaptive systems</subject><subject>Algorithm design and analysis</subject><subject>Algorithms</subject><subject>Artificial Intelligence</subject><subject>audio signal classification</subject><subject>automobile miles per gallon (MPG) prediction</subject><subject>Automobiles</subject><subject>Classification</subject><subject>Computational efficiency</subject><subject>Computer Simulation</subject><subject>Data mining</subject><subject>Decision trees</subject><subject>Dynamical systems</subject><subject>Filters</subject><subject>financial data modeling</subject><subject>induction algorithm</subject><subject>Inference algorithms</subject><subject>Information Storage and Retrieval - methods</subject><subject>low computational cost</subject><subject>Models, Statistical</subject><subject>Monte Carlo evaluative feature selection</subject><subject>Monte Carlo evaluative selection (MCES)</subject><subject>Monte Carlo Method</subject><subject>Monte Carlo methods</subject><subject>multilayer perceptron (MLP)</subject><subject>Neural networks</subject><subject>Neural Networks (Computer)</subject><subject>Nonlinear dynamics</subject><subject>Nonlinear systems</subject><subject>Pattern classification</subject><subject>Pattern Recognition, Automated - methods</subject><subject>regressive series</subject><subject>reinforcement learning</subject><subject>Sampling methods</subject><subject>Studies</subject><subject>Tasks</subject><issn>1045-9227</issn><issn>2162-237X</issn><issn>1941-0093</issn><issn>2162-2388</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2007</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><sourceid>EIF</sourceid><recordid>eNp90b1rGzEYBnBRGprE6dyhUESHdDpH3x_djHHaQuIMSaGbkHWv6Jmz5Up3hvz3kbFpS4dOEtJPL3p4EHpHyZRSYm-elsspI0RNjdFSylfoglpBG0Isf133RMjGMqbP0WUpa0KokES9QedUcyMVJxfox_188fgZz_Ay7aHH92k7AJ773Ce82Pt-9EO3B_wIPYShS1s82-1y8uEnjinjh9X6cFzBLfhhzH_BcoXOou8LvD2tE_T9dvE0_9rcPXz5Np_dNYFrMTTA9EoyqoJQYARhtDVa-Kgpbb0SXIZIVt4GwXgwbdQtjUHGWHMRZgGE5xP06Ti3_uvXCGVwm64E6Hu_hTQWZwxRVtmadoKu_ys14cRKqyv8-A9cpzFvawpnKWNUMMYqujmikFMpGaLb5W7j87OjxB26cbUbd-jGHbupLz6cxo6rDbR__KmMCt4fQQcAv68FpYZpxV8A4eOQvA</recordid><startdate>20070301</startdate><enddate>20070301</enddate><creator>Kian Hong Quah</creator><creator>Quek, C.</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QF</scope><scope>7QO</scope><scope>7QP</scope><scope>7QQ</scope><scope>7QR</scope><scope>7SC</scope><scope>7SE</scope><scope>7SP</scope><scope>7SR</scope><scope>7TA</scope><scope>7TB</scope><scope>7TK</scope><scope>7U5</scope><scope>8BQ</scope><scope>8FD</scope><scope>F28</scope><scope>FR3</scope><scope>H8D</scope><scope>JG9</scope><scope>JQ2</scope><scope>KR7</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>P64</scope><scope>7X8</scope></search><sort><creationdate>20070301</creationdate><title>MCES: A Novel Monte Carlo Evaluative Selection Approach for Objective Feature Selections</title><author>Kian Hong Quah ; Quek, C.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c374t-e27b5216c46e84021d874af711da6435cf0ba9c423c8df7d1fc5ff045029ee4a3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2007</creationdate><topic>Accuracy measure</topic><topic>adaptive neurofuzzy inference systems (ANFISs)</topic><topic>Adaptive systems</topic><topic>Algorithm design and analysis</topic><topic>Algorithms</topic><topic>Artificial Intelligence</topic><topic>audio signal classification</topic><topic>automobile miles per gallon (MPG) prediction</topic><topic>Automobiles</topic><topic>Classification</topic><topic>Computational efficiency</topic><topic>Computer Simulation</topic><topic>Data mining</topic><topic>Decision trees</topic><topic>Dynamical systems</topic><topic>Filters</topic><topic>financial data modeling</topic><topic>induction algorithm</topic><topic>Inference algorithms</topic><topic>Information Storage and Retrieval - methods</topic><topic>low computational cost</topic><topic>Models, Statistical</topic><topic>Monte Carlo evaluative feature selection</topic><topic>Monte Carlo evaluative selection (MCES)</topic><topic>Monte Carlo Method</topic><topic>Monte Carlo methods</topic><topic>multilayer perceptron (MLP)</topic><topic>Neural networks</topic><topic>Neural Networks (Computer)</topic><topic>Nonlinear dynamics</topic><topic>Nonlinear systems</topic><topic>Pattern classification</topic><topic>Pattern Recognition, Automated - methods</topic><topic>regressive series</topic><topic>reinforcement learning</topic><topic>Sampling methods</topic><topic>Studies</topic><topic>Tasks</topic><toplevel>online_resources</toplevel><creatorcontrib>Kian Hong Quah</creatorcontrib><creatorcontrib>Quek, C.</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Aluminium Industry Abstracts</collection><collection>Biotechnology Research Abstracts</collection><collection>Calcium & Calcified Tissue Abstracts</collection><collection>Ceramic Abstracts</collection><collection>Chemoreception Abstracts</collection><collection>Computer and Information Systems Abstracts</collection><collection>Corrosion Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>Materials Business File</collection><collection>Mechanical & Transportation Engineering Abstracts</collection><collection>Neurosciences Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>ANTE: Abstracts in New Technology & Engineering</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>MEDLINE - Academic</collection><jtitle>IEEE transaction on neural networks and learning systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Kian Hong Quah</au><au>Quek, C.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>MCES: A Novel Monte Carlo Evaluative Selection Approach for Objective Feature Selections</atitle><jtitle>IEEE transaction on neural networks and learning systems</jtitle><stitle>TNN</stitle><addtitle>IEEE Trans Neural Netw</addtitle><date>2007-03-01</date><risdate>2007</risdate><volume>18</volume><issue>2</issue><spage>431</spage><epage>448</epage><pages>431-448</pages><issn>1045-9227</issn><issn>2162-237X</issn><eissn>1941-0093</eissn><eissn>2162-2388</eissn><coden>ITNNEP</coden><abstract>Most recent research efforts on feature selection have focused mainly on classification task due to its popularity in the data-mining community. However, feature selection research in nonlinear system estimations has been very limited. Hence, it is reasonable to devise a feature selection approach that is computationally efficient on nonlinear system estimations context. A novel feature selection approach, the Monte Carlo evaluative selection (MCES), is proposed in this paper. MCES is an objective sampling method that derives a better estimation of the relevancy measure. The algorithm is objectively designed to be applicable to both classification and nonlinear regressive tasks. The MCES method has been demonstrated to perform well with four sets of experiments, consisting of two classification and two regressive tasks. The results demonstrate that the MCES method has following strong advantages: 1) ability to identify correlated and irrelevant features based on weight ranking, 2) application to both nonlinear system estimation and classification tasks, and 3) independence of the underlying induction algorithms used to derive the performance measures</abstract><cop>United States</cop><pub>IEEE</pub><pmid>17385630</pmid><doi>10.1109/TNN.2006.887555</doi><tpages>18</tpages></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 1045-9227 |
ispartof | IEEE transaction on neural networks and learning systems, 2007-03, Vol.18 (2), p.431-448 |
issn | 1045-9227 2162-237X 1941-0093 2162-2388 |
language | eng |
recordid | cdi_pubmed_primary_17385630 |
source | IEEE Electronic Library (IEL) |
subjects | Accuracy measure adaptive neurofuzzy inference systems (ANFISs) Adaptive systems Algorithm design and analysis Algorithms Artificial Intelligence audio signal classification automobile miles per gallon (MPG) prediction Automobiles Classification Computational efficiency Computer Simulation Data mining Decision trees Dynamical systems Filters financial data modeling induction algorithm Inference algorithms Information Storage and Retrieval - methods low computational cost Models, Statistical Monte Carlo evaluative feature selection Monte Carlo evaluative selection (MCES) Monte Carlo Method Monte Carlo methods multilayer perceptron (MLP) Neural networks Neural Networks (Computer) Nonlinear dynamics Nonlinear systems Pattern classification Pattern Recognition, Automated - methods regressive series reinforcement learning Sampling methods Studies Tasks |
title | MCES: A Novel Monte Carlo Evaluative Selection Approach for Objective Feature Selections |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-15T15%3A28%3A24IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=MCES:%20A%20Novel%20Monte%20Carlo%20Evaluative%20Selection%20Approach%20for%20Objective%20Feature%20Selections&rft.jtitle=IEEE%20transaction%20on%20neural%20networks%20and%20learning%20systems&rft.au=Kian%20Hong%20Quah&rft.date=2007-03-01&rft.volume=18&rft.issue=2&rft.spage=431&rft.epage=448&rft.pages=431-448&rft.issn=1045-9227&rft.eissn=1941-0093&rft.coden=ITNNEP&rft_id=info:doi/10.1109/TNN.2006.887555&rft_dat=%3Cproquest_RIE%3E70309597%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=912214222&rft_id=info:pmid/17385630&rft_ieee_id=4118276&rfr_iscdi=true |