Learning under Concept Drift: A Review

Concept drift describes unforeseeable changes in the underlying distribution of streaming data overtime. Concept drift research involves the development of methodologies and techniques for drift detection, understanding, and adaptation. Data analysis has revealed that machine learning in a concept d...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on knowledge and data engineering 2019-12, Vol.31 (12), p.2346-2363
Hauptverfasser: Lu, Jie, Liu, Anjin, Dong, Fan, Gu, Feng, Gama, Joao, Zhang, Guangquan
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 2363
container_issue 12
container_start_page 2346
container_title IEEE transactions on knowledge and data engineering
container_volume 31
creator Lu, Jie
Liu, Anjin
Dong, Fan
Gu, Feng
Gama, Joao
Zhang, Guangquan
description Concept drift describes unforeseeable changes in the underlying distribution of streaming data overtime. Concept drift research involves the development of methodologies and techniques for drift detection, understanding, and adaptation. Data analysis has revealed that machine learning in a concept drift environment will result in poor learning results if the drift is not addressed. To help researchers identify which research topics are significant and how to apply related techniques in data analysis tasks, it is necessary that a high quality, instructive review of current research developments and trends in the concept drift field is conducted. In addition, due to the rapid development of concept drift in recent years, the methodologies of learning under concept drift have become noticeably systematic, unveiling a framework which has not been mentioned in literature. This paper reviews over 130 high quality publications in concept drift related research areas, analyzes up-to-date developments in methodologies and techniques, and establishes a framework of learning under concept drift including three main components: concept drift detection, concept drift understanding, and concept drift adaptation. This paper lists and discusses 10 popular synthetic datasets and 14 publicly available benchmark datasets used for evaluating the performance of learning algorithms aiming at handling concept drift. Also, concept drift related research directions are covered and discussed. By providing state-of-the-art knowledge, this survey will directly support researchers in their understanding of research developments in the field of learning under concept drift.
doi_str_mv 10.1109/TKDE.2018.2876857
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_ieee_primary_8496795</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>8496795</ieee_id><sourcerecordid>2313658103</sourcerecordid><originalsourceid>FETCH-LOGICAL-c341t-d337a93ce7f43e37b1b7c71ec9230eec072f8cf399d61433517a8f91ae68ff9a3</originalsourceid><addsrcrecordid>eNo9kE1LxDAURYMoOI7-AHFTENy15vWlTeJumBk_sCDIuA6Z9EU6aFvTVvHf2zKDq3cX594Hh7FL4AkA17eb59U6STmoJFUyV5k8YjPIMhWnoOF4zFxALFDIU3bWdTvOuZIKZuymIBvqqn6PhrqkEC2b2lHbR6tQ-f4uWkSv9F3Rzzk78fajo4vDnbO3-_Vm-RgXLw9Py0UROxTQxyWitBodSS-QUG5hK50EcjpFTuS4TL1yHrUucxCIGUirvAZLufJeW5yz6_1uG5qvgbre7Joh1ONLkyJgningOFKwp1xoui6QN22oPm34NcDNpMNMOsykwxx0jJ2rfacion9eCZ1LneEfQHdZWg</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2313658103</pqid></control><display><type>article</type><title>Learning under Concept Drift: A Review</title><source>IEEE Electronic Library (IEL)</source><creator>Lu, Jie ; Liu, Anjin ; Dong, Fan ; Gu, Feng ; Gama, Joao ; Zhang, Guangquan</creator><creatorcontrib>Lu, Jie ; Liu, Anjin ; Dong, Fan ; Gu, Feng ; Gama, Joao ; Zhang, Guangquan</creatorcontrib><description>Concept drift describes unforeseeable changes in the underlying distribution of streaming data overtime. Concept drift research involves the development of methodologies and techniques for drift detection, understanding, and adaptation. Data analysis has revealed that machine learning in a concept drift environment will result in poor learning results if the drift is not addressed. To help researchers identify which research topics are significant and how to apply related techniques in data analysis tasks, it is necessary that a high quality, instructive review of current research developments and trends in the concept drift field is conducted. In addition, due to the rapid development of concept drift in recent years, the methodologies of learning under concept drift have become noticeably systematic, unveiling a framework which has not been mentioned in literature. This paper reviews over 130 high quality publications in concept drift related research areas, analyzes up-to-date developments in methodologies and techniques, and establishes a framework of learning under concept drift including three main components: concept drift detection, concept drift understanding, and concept drift adaptation. This paper lists and discusses 10 popular synthetic datasets and 14 publicly available benchmark datasets used for evaluating the performance of learning algorithms aiming at handling concept drift. Also, concept drift related research directions are covered and discussed. By providing state-of-the-art knowledge, this survey will directly support researchers in their understanding of research developments in the field of learning under concept drift.</description><identifier>ISSN: 1041-4347</identifier><identifier>EISSN: 1558-2191</identifier><identifier>DOI: 10.1109/TKDE.2018.2876857</identifier><identifier>CODEN: ITKEEH</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Adaptation ; adaptive learning ; Algorithms ; Big Data ; Cameras ; change detection ; Concept drift ; Data analysis ; Data models ; data streams ; Datasets ; Drift ; Machine learning ; Mobile handsets ; Researchers</subject><ispartof>IEEE transactions on knowledge and data engineering, 2019-12, Vol.31 (12), p.2346-2363</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2019</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c341t-d337a93ce7f43e37b1b7c71ec9230eec072f8cf399d61433517a8f91ae68ff9a3</citedby><cites>FETCH-LOGICAL-c341t-d337a93ce7f43e37b1b7c71ec9230eec072f8cf399d61433517a8f91ae68ff9a3</cites><orcidid>0000-0002-0733-7138 ; 0000-0003-3357-1195 ; 0000-0003-3960-0583</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/8496795$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/8496795$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Lu, Jie</creatorcontrib><creatorcontrib>Liu, Anjin</creatorcontrib><creatorcontrib>Dong, Fan</creatorcontrib><creatorcontrib>Gu, Feng</creatorcontrib><creatorcontrib>Gama, Joao</creatorcontrib><creatorcontrib>Zhang, Guangquan</creatorcontrib><title>Learning under Concept Drift: A Review</title><title>IEEE transactions on knowledge and data engineering</title><addtitle>TKDE</addtitle><description>Concept drift describes unforeseeable changes in the underlying distribution of streaming data overtime. Concept drift research involves the development of methodologies and techniques for drift detection, understanding, and adaptation. Data analysis has revealed that machine learning in a concept drift environment will result in poor learning results if the drift is not addressed. To help researchers identify which research topics are significant and how to apply related techniques in data analysis tasks, it is necessary that a high quality, instructive review of current research developments and trends in the concept drift field is conducted. In addition, due to the rapid development of concept drift in recent years, the methodologies of learning under concept drift have become noticeably systematic, unveiling a framework which has not been mentioned in literature. This paper reviews over 130 high quality publications in concept drift related research areas, analyzes up-to-date developments in methodologies and techniques, and establishes a framework of learning under concept drift including three main components: concept drift detection, concept drift understanding, and concept drift adaptation. This paper lists and discusses 10 popular synthetic datasets and 14 publicly available benchmark datasets used for evaluating the performance of learning algorithms aiming at handling concept drift. Also, concept drift related research directions are covered and discussed. By providing state-of-the-art knowledge, this survey will directly support researchers in their understanding of research developments in the field of learning under concept drift.</description><subject>Adaptation</subject><subject>adaptive learning</subject><subject>Algorithms</subject><subject>Big Data</subject><subject>Cameras</subject><subject>change detection</subject><subject>Concept drift</subject><subject>Data analysis</subject><subject>Data models</subject><subject>data streams</subject><subject>Datasets</subject><subject>Drift</subject><subject>Machine learning</subject><subject>Mobile handsets</subject><subject>Researchers</subject><issn>1041-4347</issn><issn>1558-2191</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kE1LxDAURYMoOI7-AHFTENy15vWlTeJumBk_sCDIuA6Z9EU6aFvTVvHf2zKDq3cX594Hh7FL4AkA17eb59U6STmoJFUyV5k8YjPIMhWnoOF4zFxALFDIU3bWdTvOuZIKZuymIBvqqn6PhrqkEC2b2lHbR6tQ-f4uWkSv9F3Rzzk78fajo4vDnbO3-_Vm-RgXLw9Py0UROxTQxyWitBodSS-QUG5hK50EcjpFTuS4TL1yHrUucxCIGUirvAZLufJeW5yz6_1uG5qvgbre7Joh1ONLkyJgningOFKwp1xoui6QN22oPm34NcDNpMNMOsykwxx0jJ2rfacion9eCZ1LneEfQHdZWg</recordid><startdate>20191201</startdate><enddate>20191201</enddate><creator>Lu, Jie</creator><creator>Liu, Anjin</creator><creator>Dong, Fan</creator><creator>Gu, Feng</creator><creator>Gama, Joao</creator><creator>Zhang, Guangquan</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-0733-7138</orcidid><orcidid>https://orcid.org/0000-0003-3357-1195</orcidid><orcidid>https://orcid.org/0000-0003-3960-0583</orcidid></search><sort><creationdate>20191201</creationdate><title>Learning under Concept Drift: A Review</title><author>Lu, Jie ; Liu, Anjin ; Dong, Fan ; Gu, Feng ; Gama, Joao ; Zhang, Guangquan</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c341t-d337a93ce7f43e37b1b7c71ec9230eec072f8cf399d61433517a8f91ae68ff9a3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Adaptation</topic><topic>adaptive learning</topic><topic>Algorithms</topic><topic>Big Data</topic><topic>Cameras</topic><topic>change detection</topic><topic>Concept drift</topic><topic>Data analysis</topic><topic>Data models</topic><topic>data streams</topic><topic>Datasets</topic><topic>Drift</topic><topic>Machine learning</topic><topic>Mobile handsets</topic><topic>Researchers</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Lu, Jie</creatorcontrib><creatorcontrib>Liu, Anjin</creatorcontrib><creatorcontrib>Dong, Fan</creatorcontrib><creatorcontrib>Gu, Feng</creatorcontrib><creatorcontrib>Gama, Joao</creatorcontrib><creatorcontrib>Zhang, Guangquan</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on knowledge and data engineering</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Lu, Jie</au><au>Liu, Anjin</au><au>Dong, Fan</au><au>Gu, Feng</au><au>Gama, Joao</au><au>Zhang, Guangquan</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Learning under Concept Drift: A Review</atitle><jtitle>IEEE transactions on knowledge and data engineering</jtitle><stitle>TKDE</stitle><date>2019-12-01</date><risdate>2019</risdate><volume>31</volume><issue>12</issue><spage>2346</spage><epage>2363</epage><pages>2346-2363</pages><issn>1041-4347</issn><eissn>1558-2191</eissn><coden>ITKEEH</coden><abstract>Concept drift describes unforeseeable changes in the underlying distribution of streaming data overtime. Concept drift research involves the development of methodologies and techniques for drift detection, understanding, and adaptation. Data analysis has revealed that machine learning in a concept drift environment will result in poor learning results if the drift is not addressed. To help researchers identify which research topics are significant and how to apply related techniques in data analysis tasks, it is necessary that a high quality, instructive review of current research developments and trends in the concept drift field is conducted. In addition, due to the rapid development of concept drift in recent years, the methodologies of learning under concept drift have become noticeably systematic, unveiling a framework which has not been mentioned in literature. This paper reviews over 130 high quality publications in concept drift related research areas, analyzes up-to-date developments in methodologies and techniques, and establishes a framework of learning under concept drift including three main components: concept drift detection, concept drift understanding, and concept drift adaptation. This paper lists and discusses 10 popular synthetic datasets and 14 publicly available benchmark datasets used for evaluating the performance of learning algorithms aiming at handling concept drift. Also, concept drift related research directions are covered and discussed. By providing state-of-the-art knowledge, this survey will directly support researchers in their understanding of research developments in the field of learning under concept drift.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TKDE.2018.2876857</doi><tpages>18</tpages><orcidid>https://orcid.org/0000-0002-0733-7138</orcidid><orcidid>https://orcid.org/0000-0003-3357-1195</orcidid><orcidid>https://orcid.org/0000-0003-3960-0583</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1041-4347
ispartof IEEE transactions on knowledge and data engineering, 2019-12, Vol.31 (12), p.2346-2363
issn 1041-4347
1558-2191
language eng
recordid cdi_ieee_primary_8496795
source IEEE Electronic Library (IEL)
subjects Adaptation
adaptive learning
Algorithms
Big Data
Cameras
change detection
Concept drift
Data analysis
Data models
data streams
Datasets
Drift
Machine learning
Mobile handsets
Researchers
title Learning under Concept Drift: A Review
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-07T04%3A55%3A48IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Learning%20under%20Concept%20Drift:%20A%20Review&rft.jtitle=IEEE%20transactions%20on%20knowledge%20and%20data%20engineering&rft.au=Lu,%20Jie&rft.date=2019-12-01&rft.volume=31&rft.issue=12&rft.spage=2346&rft.epage=2363&rft.pages=2346-2363&rft.issn=1041-4347&rft.eissn=1558-2191&rft.coden=ITKEEH&rft_id=info:doi/10.1109/TKDE.2018.2876857&rft_dat=%3Cproquest_RIE%3E2313658103%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2313658103&rft_id=info:pmid/&rft_ieee_id=8496795&rfr_iscdi=true