SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary

The Synthetic Minority Oversampling Technique (SMOTE) preprocessing algorithm is considered "de facto" standard in the framework of learning from imbalanced data. This is due to its simplicity in the design of the procedure, as well as its robustness when applied to different type of probl...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:The Journal of artificial intelligence research 2018-04, Vol.61, p.863-905
Hauptverfasser: Fernandez, Alberto, Garcia, Salvador, Herrera, Francisco, Chawla, Nitesh V.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 905
container_issue
container_start_page 863
container_title The Journal of artificial intelligence research
container_volume 61
creator Fernandez, Alberto
Garcia, Salvador
Herrera, Francisco
Chawla, Nitesh V.
description The Synthetic Minority Oversampling Technique (SMOTE) preprocessing algorithm is considered "de facto" standard in the framework of learning from imbalanced data. This is due to its simplicity in the design of the procedure, as well as its robustness when applied to different type of problems. Since its publication in 2002, SMOTE has proven successful in a variety of applications from several different domains. SMOTE has also inspired several approaches to counter the issue of class imbalance, and has also significantly contributed to new supervised learning paradigms, including multilabel classification, incremental learning, semi-supervised learning, multi-instance learning, among others. It is standard benchmark for learning from imbalanced data. It is also featured in a number of different software packages - from open source to commercial. In this paper, marking the fifteen year anniversary of SMOTE, we reflect on the SMOTE journey, discuss the current state of affairs with SMOTE, its applications, and also identify the next set of challenges to extend SMOTE for Big Data problems.
doi_str_mv 10.1613/jair.1.11192
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2554081553</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2554081553</sourcerecordid><originalsourceid>FETCH-LOGICAL-c410t-38c7df492572aef5663a93c62e69654322762f7cc8eef9bb5e246ad17a4671503</originalsourceid><addsrcrecordid>eNpNkE9PAjEUxBujiYje_ABNvLLY127bXW8E8U8CwUQ8N4_dFhaXLraLCd_eRTx4mneYmTf5EXILbAgKxP0GqzCEIQDk_Iz0gGmV5Frq83_3JbmKccMY5CnPegTfZ_PFhLom0KnF4Cu_oi40W_q6XWKNvrAlfcQWH-hbaFbBxkjRl3S8xrq2fmXjgM4wfB5j7dpSkMmhq6Ej76tvGyKGwzW5cFhHe_OnffLxNFmMX5Lp_Pl1PJomRQqsTURW6NKlOZeao3VSKYG5KBS3KlcyFZxrxZ0uisxaly-X0vJUYQkaU6VBMtEnd6feXWi-9ja2ZtPsg-9eGi5lyjKQUnSuwclVhCbGYJ3ZhWrbzTTAzBGiOUI0YH4hih9pp2Oi</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2554081553</pqid></control><display><type>article</type><title>SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary</title><source>DOAJ Directory of Open Access Journals</source><source>Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals</source><source>Free E- Journals</source><creator>Fernandez, Alberto ; Garcia, Salvador ; Herrera, Francisco ; Chawla, Nitesh V.</creator><creatorcontrib>Fernandez, Alberto ; Garcia, Salvador ; Herrera, Francisco ; Chawla, Nitesh V.</creatorcontrib><description>The Synthetic Minority Oversampling Technique (SMOTE) preprocessing algorithm is considered "de facto" standard in the framework of learning from imbalanced data. This is due to its simplicity in the design of the procedure, as well as its robustness when applied to different type of problems. Since its publication in 2002, SMOTE has proven successful in a variety of applications from several different domains. SMOTE has also inspired several approaches to counter the issue of class imbalance, and has also significantly contributed to new supervised learning paradigms, including multilabel classification, incremental learning, semi-supervised learning, multi-instance learning, among others. It is standard benchmark for learning from imbalanced data. It is also featured in a number of different software packages - from open source to commercial. In this paper, marking the fifteen year anniversary of SMOTE, we reflect on the SMOTE journey, discuss the current state of affairs with SMOTE, its applications, and also identify the next set of challenges to extend SMOTE for Big Data problems.</description><identifier>ISSN: 1076-9757</identifier><identifier>EISSN: 1076-9757</identifier><identifier>EISSN: 1943-5037</identifier><identifier>DOI: 10.1613/jair.1.11192</identifier><language>eng</language><publisher>San Francisco: AI Access Foundation</publisher><subject>Algorithms ; Artificial intelligence ; Machine learning ; Marking ; Oversampling</subject><ispartof>The Journal of artificial intelligence research, 2018-04, Vol.61, p.863-905</ispartof><rights>2018. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the associated terms available at https://www.jair.org/index.php/jair/about</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c410t-38c7df492572aef5663a93c62e69654322762f7cc8eef9bb5e246ad17a4671503</citedby></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,860,27901,27902</link.rule.ids></links><search><creatorcontrib>Fernandez, Alberto</creatorcontrib><creatorcontrib>Garcia, Salvador</creatorcontrib><creatorcontrib>Herrera, Francisco</creatorcontrib><creatorcontrib>Chawla, Nitesh V.</creatorcontrib><title>SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary</title><title>The Journal of artificial intelligence research</title><description>The Synthetic Minority Oversampling Technique (SMOTE) preprocessing algorithm is considered "de facto" standard in the framework of learning from imbalanced data. This is due to its simplicity in the design of the procedure, as well as its robustness when applied to different type of problems. Since its publication in 2002, SMOTE has proven successful in a variety of applications from several different domains. SMOTE has also inspired several approaches to counter the issue of class imbalance, and has also significantly contributed to new supervised learning paradigms, including multilabel classification, incremental learning, semi-supervised learning, multi-instance learning, among others. It is standard benchmark for learning from imbalanced data. It is also featured in a number of different software packages - from open source to commercial. In this paper, marking the fifteen year anniversary of SMOTE, we reflect on the SMOTE journey, discuss the current state of affairs with SMOTE, its applications, and also identify the next set of challenges to extend SMOTE for Big Data problems.</description><subject>Algorithms</subject><subject>Artificial intelligence</subject><subject>Machine learning</subject><subject>Marking</subject><subject>Oversampling</subject><issn>1076-9757</issn><issn>1076-9757</issn><issn>1943-5037</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><recordid>eNpNkE9PAjEUxBujiYje_ABNvLLY127bXW8E8U8CwUQ8N4_dFhaXLraLCd_eRTx4mneYmTf5EXILbAgKxP0GqzCEIQDk_Iz0gGmV5Frq83_3JbmKccMY5CnPegTfZ_PFhLom0KnF4Cu_oi40W_q6XWKNvrAlfcQWH-hbaFbBxkjRl3S8xrq2fmXjgM4wfB5j7dpSkMmhq6Ej76tvGyKGwzW5cFhHe_OnffLxNFmMX5Lp_Pl1PJomRQqsTURW6NKlOZeao3VSKYG5KBS3KlcyFZxrxZ0uisxaly-X0vJUYQkaU6VBMtEnd6feXWi-9ja2ZtPsg-9eGi5lyjKQUnSuwclVhCbGYJ3ZhWrbzTTAzBGiOUI0YH4hih9pp2Oi</recordid><startdate>20180420</startdate><enddate>20180420</enddate><creator>Fernandez, Alberto</creator><creator>Garcia, Salvador</creator><creator>Herrera, Francisco</creator><creator>Chawla, Nitesh V.</creator><general>AI Access Foundation</general><scope>AAYXX</scope><scope>CITATION</scope><scope>8FE</scope><scope>8FG</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K7-</scope><scope>P62</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope></search><sort><creationdate>20180420</creationdate><title>SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary</title><author>Fernandez, Alberto ; Garcia, Salvador ; Herrera, Francisco ; Chawla, Nitesh V.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c410t-38c7df492572aef5663a93c62e69654322762f7cc8eef9bb5e246ad17a4671503</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Algorithms</topic><topic>Artificial intelligence</topic><topic>Machine learning</topic><topic>Marking</topic><topic>Oversampling</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Fernandez, Alberto</creatorcontrib><creatorcontrib>Garcia, Salvador</creatorcontrib><creatorcontrib>Herrera, Francisco</creatorcontrib><creatorcontrib>Chawla, Nitesh V.</creatorcontrib><collection>CrossRef</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>Computer Science Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><jtitle>The Journal of artificial intelligence research</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Fernandez, Alberto</au><au>Garcia, Salvador</au><au>Herrera, Francisco</au><au>Chawla, Nitesh V.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary</atitle><jtitle>The Journal of artificial intelligence research</jtitle><date>2018-04-20</date><risdate>2018</risdate><volume>61</volume><spage>863</spage><epage>905</epage><pages>863-905</pages><issn>1076-9757</issn><eissn>1076-9757</eissn><eissn>1943-5037</eissn><abstract>The Synthetic Minority Oversampling Technique (SMOTE) preprocessing algorithm is considered "de facto" standard in the framework of learning from imbalanced data. This is due to its simplicity in the design of the procedure, as well as its robustness when applied to different type of problems. Since its publication in 2002, SMOTE has proven successful in a variety of applications from several different domains. SMOTE has also inspired several approaches to counter the issue of class imbalance, and has also significantly contributed to new supervised learning paradigms, including multilabel classification, incremental learning, semi-supervised learning, multi-instance learning, among others. It is standard benchmark for learning from imbalanced data. It is also featured in a number of different software packages - from open source to commercial. In this paper, marking the fifteen year anniversary of SMOTE, we reflect on the SMOTE journey, discuss the current state of affairs with SMOTE, its applications, and also identify the next set of challenges to extend SMOTE for Big Data problems.</abstract><cop>San Francisco</cop><pub>AI Access Foundation</pub><doi>10.1613/jair.1.11192</doi><tpages>43</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1076-9757
ispartof The Journal of artificial intelligence research, 2018-04, Vol.61, p.863-905
issn 1076-9757
1076-9757
1943-5037
language eng
recordid cdi_proquest_journals_2554081553
source DOAJ Directory of Open Access Journals; Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals; Free E- Journals
subjects Algorithms
Artificial intelligence
Machine learning
Marking
Oversampling
title SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-01T16%3A12%3A13IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=SMOTE%20for%20Learning%20from%20Imbalanced%20Data:%20Progress%20and%20Challenges,%20Marking%20the%2015-year%20Anniversary&rft.jtitle=The%20Journal%20of%20artificial%20intelligence%20research&rft.au=Fernandez,%20Alberto&rft.date=2018-04-20&rft.volume=61&rft.spage=863&rft.epage=905&rft.pages=863-905&rft.issn=1076-9757&rft.eissn=1076-9757&rft_id=info:doi/10.1613/jair.1.11192&rft_dat=%3Cproquest_cross%3E2554081553%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2554081553&rft_id=info:pmid/&rfr_iscdi=true