MINAS: multiclass learning algorithm for novelty detection in data streams
Data stream mining is an emergent research area that aims at extracting knowledge from large amounts of continuously generated data. Novelty detection (ND) is a classification task that assesses if one or a set of examples differ significantly from the previously seen examples. This is an important...
Gespeichert in:
Veröffentlicht in: | Data mining and knowledge discovery 2016-05, Vol.30 (3), p.640-680 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 680 |
---|---|
container_issue | 3 |
container_start_page | 640 |
container_title | Data mining and knowledge discovery |
container_volume | 30 |
creator | de Faria, Elaine Ribeiro Ponce de Leon Ferreira Carvalho, André Carlos Gama, João |
description | Data stream mining is an emergent research area that aims at extracting knowledge from large amounts of continuously generated data. Novelty detection (ND) is a classification task that assesses if one or a set of examples differ significantly from the previously seen examples. This is an important task for data stream, as new concepts may appear, disappear or evolve over time. Most of the works found in the ND literature presents it as a binary classification task. In several data stream real life problems, ND must be treated as a multiclass task, in which, the known concept is composed by one or more classes and different new classes may appear. This work proposes MINAS, an algorithm for ND in data streams. MINAS deals with ND as a multiclass task. In the initial training phase, MINAS builds a decision model based on a labeled data set. In the online phase, new examples are classified using this model, or marked as
unknown
. Groups of unknown examples can be used later to create valid novelty patterns (NP), which are added to the current model. The decision model is updated as new data come over the stream in order to reflect changes in the known classes and allow the addition of NP. This work also presents a set of experiments carried out comparing MINAS and the main novelty detection algorithms found in the literature, using artificial and real data sets. The experimental results show the potential of the proposed algorithm. |
doi_str_mv | 10.1007/s10618-015-0433-y |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1808058119</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1808058119</sourcerecordid><originalsourceid>FETCH-LOGICAL-c458t-b7e6971e578332d1fb33dd367e587e3cd3590dbae019f553becc364ec0a05de33</originalsourceid><addsrcrecordid>eNp1kE1LxDAQhoMouK7-AG8BL16qk6ZpUm_L4seKHwcVvIU0na5d-rEmqdB_b5d6EMHTzOF5X2YeQk4ZXDAAeekZpExFwEQECefRsEdmTEgeSZG-7487V0kkFINDcuT9BgBEzGFG7h9XT4uXK9r0dahsbbynNRrXVu2amnrduSp8NLTsHG27L6zDQAsMaEPVtbRqaWGCoT44NI0_JgelqT2e_Mw5ebu5fl3eRQ_Pt6vl4iGyiVAhyiWmmWQopOI8LliZc14UPJUolERuCy4yKHKDwLJSCJ6jtTxN0IIBUSDnc3I-9W5d99mjD7qpvMW6Ni12vddMgYLxVZaN6NkfdNP1rh2v00zKRMZKpDBSbKKs67x3WOqtqxrjBs1A7-zqya4e7eqdXT2MmXjK-JFt1-h-Nf8b-ga69H0B</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1774728560</pqid></control><display><type>article</type><title>MINAS: multiclass learning algorithm for novelty detection in data streams</title><source>SpringerLink Journals - AutoHoldings</source><creator>de Faria, Elaine Ribeiro ; Ponce de Leon Ferreira Carvalho, André Carlos ; Gama, João</creator><creatorcontrib>de Faria, Elaine Ribeiro ; Ponce de Leon Ferreira Carvalho, André Carlos ; Gama, João</creatorcontrib><description>Data stream mining is an emergent research area that aims at extracting knowledge from large amounts of continuously generated data. Novelty detection (ND) is a classification task that assesses if one or a set of examples differ significantly from the previously seen examples. This is an important task for data stream, as new concepts may appear, disappear or evolve over time. Most of the works found in the ND literature presents it as a binary classification task. In several data stream real life problems, ND must be treated as a multiclass task, in which, the known concept is composed by one or more classes and different new classes may appear. This work proposes MINAS, an algorithm for ND in data streams. MINAS deals with ND as a multiclass task. In the initial training phase, MINAS builds a decision model based on a labeled data set. In the online phase, new examples are classified using this model, or marked as
unknown
. Groups of unknown examples can be used later to create valid novelty patterns (NP), which are added to the current model. The decision model is updated as new data come over the stream in order to reflect changes in the known classes and allow the addition of NP. This work also presents a set of experiments carried out comparing MINAS and the main novelty detection algorithms found in the literature, using artificial and real data sets. The experimental results show the potential of the proposed algorithm.</description><identifier>ISSN: 1384-5810</identifier><identifier>EISSN: 1573-756X</identifier><identifier>DOI: 10.1007/s10618-015-0433-y</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Active learning ; Algorithms ; Artificial Intelligence ; Chemistry and Earth Sciences ; Classification ; Computer Science ; Construction ; Consumer goods ; Data mining ; Data Mining and Knowledge Discovery ; Data transmission ; Datasets ; Evolution ; Experiments ; Information Storage and Retrieval ; Physics ; Statistics for Engineering ; Tasks</subject><ispartof>Data mining and knowledge discovery, 2016-05, Vol.30 (3), p.640-680</ispartof><rights>The Author(s) 2015</rights><rights>The Author(s) 2016</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c458t-b7e6971e578332d1fb33dd367e587e3cd3590dbae019f553becc364ec0a05de33</citedby><cites>FETCH-LOGICAL-c458t-b7e6971e578332d1fb33dd367e587e3cd3590dbae019f553becc364ec0a05de33</cites><orcidid>0000-0001-5242-9026</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s10618-015-0433-y$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s10618-015-0433-y$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,41488,42557,51319</link.rule.ids></links><search><creatorcontrib>de Faria, Elaine Ribeiro</creatorcontrib><creatorcontrib>Ponce de Leon Ferreira Carvalho, André Carlos</creatorcontrib><creatorcontrib>Gama, João</creatorcontrib><title>MINAS: multiclass learning algorithm for novelty detection in data streams</title><title>Data mining and knowledge discovery</title><addtitle>Data Min Knowl Disc</addtitle><description>Data stream mining is an emergent research area that aims at extracting knowledge from large amounts of continuously generated data. Novelty detection (ND) is a classification task that assesses if one or a set of examples differ significantly from the previously seen examples. This is an important task for data stream, as new concepts may appear, disappear or evolve over time. Most of the works found in the ND literature presents it as a binary classification task. In several data stream real life problems, ND must be treated as a multiclass task, in which, the known concept is composed by one or more classes and different new classes may appear. This work proposes MINAS, an algorithm for ND in data streams. MINAS deals with ND as a multiclass task. In the initial training phase, MINAS builds a decision model based on a labeled data set. In the online phase, new examples are classified using this model, or marked as
unknown
. Groups of unknown examples can be used later to create valid novelty patterns (NP), which are added to the current model. The decision model is updated as new data come over the stream in order to reflect changes in the known classes and allow the addition of NP. This work also presents a set of experiments carried out comparing MINAS and the main novelty detection algorithms found in the literature, using artificial and real data sets. The experimental results show the potential of the proposed algorithm.</description><subject>Active learning</subject><subject>Algorithms</subject><subject>Artificial Intelligence</subject><subject>Chemistry and Earth Sciences</subject><subject>Classification</subject><subject>Computer Science</subject><subject>Construction</subject><subject>Consumer goods</subject><subject>Data mining</subject><subject>Data Mining and Knowledge Discovery</subject><subject>Data transmission</subject><subject>Datasets</subject><subject>Evolution</subject><subject>Experiments</subject><subject>Information Storage and Retrieval</subject><subject>Physics</subject><subject>Statistics for Engineering</subject><subject>Tasks</subject><issn>1384-5810</issn><issn>1573-756X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2016</creationdate><recordtype>article</recordtype><sourceid>8G5</sourceid><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><sourceid>GUQSH</sourceid><sourceid>M2O</sourceid><recordid>eNp1kE1LxDAQhoMouK7-AG8BL16qk6ZpUm_L4seKHwcVvIU0na5d-rEmqdB_b5d6EMHTzOF5X2YeQk4ZXDAAeekZpExFwEQECefRsEdmTEgeSZG-7487V0kkFINDcuT9BgBEzGFG7h9XT4uXK9r0dahsbbynNRrXVu2amnrduSp8NLTsHG27L6zDQAsMaEPVtbRqaWGCoT44NI0_JgelqT2e_Mw5ebu5fl3eRQ_Pt6vl4iGyiVAhyiWmmWQopOI8LliZc14UPJUolERuCy4yKHKDwLJSCJ6jtTxN0IIBUSDnc3I-9W5d99mjD7qpvMW6Ni12vddMgYLxVZaN6NkfdNP1rh2v00zKRMZKpDBSbKKs67x3WOqtqxrjBs1A7-zqya4e7eqdXT2MmXjK-JFt1-h-Nf8b-ga69H0B</recordid><startdate>20160501</startdate><enddate>20160501</enddate><creator>de Faria, Elaine Ribeiro</creator><creator>Ponce de Leon Ferreira Carvalho, André Carlos</creator><creator>Gama, João</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7SC</scope><scope>7WY</scope><scope>7WZ</scope><scope>7XB</scope><scope>87Z</scope><scope>8AL</scope><scope>8AO</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>8FL</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BEZIV</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FRNLG</scope><scope>F~G</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K60</scope><scope>K6~</scope><scope>K7-</scope><scope>L.-</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>M0C</scope><scope>M0N</scope><scope>M2O</scope><scope>MBDVC</scope><scope>P5Z</scope><scope>P62</scope><scope>PQBIZ</scope><scope>PQBZA</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>Q9U</scope><orcidid>https://orcid.org/0000-0001-5242-9026</orcidid></search><sort><creationdate>20160501</creationdate><title>MINAS: multiclass learning algorithm for novelty detection in data streams</title><author>de Faria, Elaine Ribeiro ; Ponce de Leon Ferreira Carvalho, André Carlos ; Gama, João</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c458t-b7e6971e578332d1fb33dd367e587e3cd3590dbae019f553becc364ec0a05de33</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2016</creationdate><topic>Active learning</topic><topic>Algorithms</topic><topic>Artificial Intelligence</topic><topic>Chemistry and Earth Sciences</topic><topic>Classification</topic><topic>Computer Science</topic><topic>Construction</topic><topic>Consumer goods</topic><topic>Data mining</topic><topic>Data Mining and Knowledge Discovery</topic><topic>Data transmission</topic><topic>Datasets</topic><topic>Evolution</topic><topic>Experiments</topic><topic>Information Storage and Retrieval</topic><topic>Physics</topic><topic>Statistics for Engineering</topic><topic>Tasks</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>de Faria, Elaine Ribeiro</creatorcontrib><creatorcontrib>Ponce de Leon Ferreira Carvalho, André Carlos</creatorcontrib><creatorcontrib>Gama, João</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Computer and Information Systems Abstracts</collection><collection>Access via ABI/INFORM (ProQuest)</collection><collection>ABI/INFORM Global (PDF only)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>ABI/INFORM Global (Alumni Edition)</collection><collection>Computing Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ABI/INFORM Collection (Alumni Edition)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Business Premium Collection</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Business Premium Collection (Alumni)</collection><collection>ABI/INFORM Global (Corporate)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>ProQuest Business Collection (Alumni Edition)</collection><collection>ProQuest Business Collection</collection><collection>Computer Science Database</collection><collection>ABI/INFORM Professional Advanced</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>ABI/INFORM Global</collection><collection>Computing Database</collection><collection>Research Library</collection><collection>Research Library (Corporate)</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>ProQuest One Business</collection><collection>ProQuest One Business (Alumni)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central Basic</collection><jtitle>Data mining and knowledge discovery</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>de Faria, Elaine Ribeiro</au><au>Ponce de Leon Ferreira Carvalho, André Carlos</au><au>Gama, João</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>MINAS: multiclass learning algorithm for novelty detection in data streams</atitle><jtitle>Data mining and knowledge discovery</jtitle><stitle>Data Min Knowl Disc</stitle><date>2016-05-01</date><risdate>2016</risdate><volume>30</volume><issue>3</issue><spage>640</spage><epage>680</epage><pages>640-680</pages><issn>1384-5810</issn><eissn>1573-756X</eissn><abstract>Data stream mining is an emergent research area that aims at extracting knowledge from large amounts of continuously generated data. Novelty detection (ND) is a classification task that assesses if one or a set of examples differ significantly from the previously seen examples. This is an important task for data stream, as new concepts may appear, disappear or evolve over time. Most of the works found in the ND literature presents it as a binary classification task. In several data stream real life problems, ND must be treated as a multiclass task, in which, the known concept is composed by one or more classes and different new classes may appear. This work proposes MINAS, an algorithm for ND in data streams. MINAS deals with ND as a multiclass task. In the initial training phase, MINAS builds a decision model based on a labeled data set. In the online phase, new examples are classified using this model, or marked as
unknown
. Groups of unknown examples can be used later to create valid novelty patterns (NP), which are added to the current model. The decision model is updated as new data come over the stream in order to reflect changes in the known classes and allow the addition of NP. This work also presents a set of experiments carried out comparing MINAS and the main novelty detection algorithms found in the literature, using artificial and real data sets. The experimental results show the potential of the proposed algorithm.</abstract><cop>New York</cop><pub>Springer US</pub><doi>10.1007/s10618-015-0433-y</doi><tpages>41</tpages><orcidid>https://orcid.org/0000-0001-5242-9026</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1384-5810 |
ispartof | Data mining and knowledge discovery, 2016-05, Vol.30 (3), p.640-680 |
issn | 1384-5810 1573-756X |
language | eng |
recordid | cdi_proquest_miscellaneous_1808058119 |
source | SpringerLink Journals - AutoHoldings |
subjects | Active learning Algorithms Artificial Intelligence Chemistry and Earth Sciences Classification Computer Science Construction Consumer goods Data mining Data Mining and Knowledge Discovery Data transmission Datasets Evolution Experiments Information Storage and Retrieval Physics Statistics for Engineering Tasks |
title | MINAS: multiclass learning algorithm for novelty detection in data streams |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-19T09%3A36%3A44IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=MINAS:%20multiclass%20learning%20algorithm%20for%20novelty%20detection%20in%20data%20streams&rft.jtitle=Data%20mining%20and%20knowledge%20discovery&rft.au=de%20Faria,%20Elaine%20Ribeiro&rft.date=2016-05-01&rft.volume=30&rft.issue=3&rft.spage=640&rft.epage=680&rft.pages=640-680&rft.issn=1384-5810&rft.eissn=1573-756X&rft_id=info:doi/10.1007/s10618-015-0433-y&rft_dat=%3Cproquest_cross%3E1808058119%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1774728560&rft_id=info:pmid/&rfr_iscdi=true |