SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary
The Synthetic Minority Oversampling Technique (SMOTE) preprocessing algorithm is considered "de facto" standard in the framework of learning from imbalanced data. This is due to its simplicity in the design of the procedure, as well as its robustness when applied to different type of probl...
Gespeichert in:
Veröffentlicht in: | The Journal of artificial intelligence research 2018-04, Vol.61, p.863-905 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 905 |
---|---|
container_issue | |
container_start_page | 863 |
container_title | The Journal of artificial intelligence research |
container_volume | 61 |
creator | Fernandez, Alberto Garcia, Salvador Herrera, Francisco Chawla, Nitesh V. |
description | The Synthetic Minority Oversampling Technique (SMOTE) preprocessing algorithm is considered "de facto" standard in the framework of learning from imbalanced data. This is due to its simplicity in the design of the procedure, as well as its robustness when applied to different type of problems. Since its publication in 2002, SMOTE has proven successful in a variety of applications from several different domains. SMOTE has also inspired several approaches to counter the issue of class imbalance, and has also significantly contributed to new supervised learning paradigms, including multilabel classification, incremental learning, semi-supervised learning, multi-instance learning, among others. It is standard benchmark for learning from imbalanced data. It is also featured in a number of different software packages - from open source to commercial. In this paper, marking the fifteen year anniversary of SMOTE, we reflect on the SMOTE journey, discuss the current state of affairs with SMOTE, its applications, and also identify the next set of challenges to extend SMOTE for Big Data problems. |
doi_str_mv | 10.1613/jair.1.11192 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2554081553</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2554081553</sourcerecordid><originalsourceid>FETCH-LOGICAL-c410t-38c7df492572aef5663a93c62e69654322762f7cc8eef9bb5e246ad17a4671503</originalsourceid><addsrcrecordid>eNpNkE9PAjEUxBujiYje_ABNvLLY127bXW8E8U8CwUQ8N4_dFhaXLraLCd_eRTx4mneYmTf5EXILbAgKxP0GqzCEIQDk_Iz0gGmV5Frq83_3JbmKccMY5CnPegTfZ_PFhLom0KnF4Cu_oi40W_q6XWKNvrAlfcQWH-hbaFbBxkjRl3S8xrq2fmXjgM4wfB5j7dpSkMmhq6Ej76tvGyKGwzW5cFhHe_OnffLxNFmMX5Lp_Pl1PJomRQqsTURW6NKlOZeao3VSKYG5KBS3KlcyFZxrxZ0uisxaly-X0vJUYQkaU6VBMtEnd6feXWi-9ja2ZtPsg-9eGi5lyjKQUnSuwclVhCbGYJ3ZhWrbzTTAzBGiOUI0YH4hih9pp2Oi</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2554081553</pqid></control><display><type>article</type><title>SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary</title><source>DOAJ Directory of Open Access Journals</source><source>Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals</source><source>Free E- Journals</source><creator>Fernandez, Alberto ; Garcia, Salvador ; Herrera, Francisco ; Chawla, Nitesh V.</creator><creatorcontrib>Fernandez, Alberto ; Garcia, Salvador ; Herrera, Francisco ; Chawla, Nitesh V.</creatorcontrib><description>The Synthetic Minority Oversampling Technique (SMOTE) preprocessing algorithm is considered "de facto" standard in the framework of learning from imbalanced data. This is due to its simplicity in the design of the procedure, as well as its robustness when applied to different type of problems. Since its publication in 2002, SMOTE has proven successful in a variety of applications from several different domains. SMOTE has also inspired several approaches to counter the issue of class imbalance, and has also significantly contributed to new supervised learning paradigms, including multilabel classification, incremental learning, semi-supervised learning, multi-instance learning, among others. It is standard benchmark for learning from imbalanced data. It is also featured in a number of different software packages - from open source to commercial. In this paper, marking the fifteen year anniversary of SMOTE, we reflect on the SMOTE journey, discuss the current state of affairs with SMOTE, its applications, and also identify the next set of challenges to extend SMOTE for Big Data problems.</description><identifier>ISSN: 1076-9757</identifier><identifier>EISSN: 1076-9757</identifier><identifier>EISSN: 1943-5037</identifier><identifier>DOI: 10.1613/jair.1.11192</identifier><language>eng</language><publisher>San Francisco: AI Access Foundation</publisher><subject>Algorithms ; Artificial intelligence ; Machine learning ; Marking ; Oversampling</subject><ispartof>The Journal of artificial intelligence research, 2018-04, Vol.61, p.863-905</ispartof><rights>2018. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the associated terms available at https://www.jair.org/index.php/jair/about</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c410t-38c7df492572aef5663a93c62e69654322762f7cc8eef9bb5e246ad17a4671503</citedby></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,860,27901,27902</link.rule.ids></links><search><creatorcontrib>Fernandez, Alberto</creatorcontrib><creatorcontrib>Garcia, Salvador</creatorcontrib><creatorcontrib>Herrera, Francisco</creatorcontrib><creatorcontrib>Chawla, Nitesh V.</creatorcontrib><title>SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary</title><title>The Journal of artificial intelligence research</title><description>The Synthetic Minority Oversampling Technique (SMOTE) preprocessing algorithm is considered "de facto" standard in the framework of learning from imbalanced data. This is due to its simplicity in the design of the procedure, as well as its robustness when applied to different type of problems. Since its publication in 2002, SMOTE has proven successful in a variety of applications from several different domains. SMOTE has also inspired several approaches to counter the issue of class imbalance, and has also significantly contributed to new supervised learning paradigms, including multilabel classification, incremental learning, semi-supervised learning, multi-instance learning, among others. It is standard benchmark for learning from imbalanced data. It is also featured in a number of different software packages - from open source to commercial. In this paper, marking the fifteen year anniversary of SMOTE, we reflect on the SMOTE journey, discuss the current state of affairs with SMOTE, its applications, and also identify the next set of challenges to extend SMOTE for Big Data problems.</description><subject>Algorithms</subject><subject>Artificial intelligence</subject><subject>Machine learning</subject><subject>Marking</subject><subject>Oversampling</subject><issn>1076-9757</issn><issn>1076-9757</issn><issn>1943-5037</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><recordid>eNpNkE9PAjEUxBujiYje_ABNvLLY127bXW8E8U8CwUQ8N4_dFhaXLraLCd_eRTx4mneYmTf5EXILbAgKxP0GqzCEIQDk_Iz0gGmV5Frq83_3JbmKccMY5CnPegTfZ_PFhLom0KnF4Cu_oi40W_q6XWKNvrAlfcQWH-hbaFbBxkjRl3S8xrq2fmXjgM4wfB5j7dpSkMmhq6Ej76tvGyKGwzW5cFhHe_OnffLxNFmMX5Lp_Pl1PJomRQqsTURW6NKlOZeao3VSKYG5KBS3KlcyFZxrxZ0uisxaly-X0vJUYQkaU6VBMtEnd6feXWi-9ja2ZtPsg-9eGi5lyjKQUnSuwclVhCbGYJ3ZhWrbzTTAzBGiOUI0YH4hih9pp2Oi</recordid><startdate>20180420</startdate><enddate>20180420</enddate><creator>Fernandez, Alberto</creator><creator>Garcia, Salvador</creator><creator>Herrera, Francisco</creator><creator>Chawla, Nitesh V.</creator><general>AI Access Foundation</general><scope>AAYXX</scope><scope>CITATION</scope><scope>8FE</scope><scope>8FG</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K7-</scope><scope>P62</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope></search><sort><creationdate>20180420</creationdate><title>SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary</title><author>Fernandez, Alberto ; Garcia, Salvador ; Herrera, Francisco ; Chawla, Nitesh V.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c410t-38c7df492572aef5663a93c62e69654322762f7cc8eef9bb5e246ad17a4671503</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Algorithms</topic><topic>Artificial intelligence</topic><topic>Machine learning</topic><topic>Marking</topic><topic>Oversampling</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Fernandez, Alberto</creatorcontrib><creatorcontrib>Garcia, Salvador</creatorcontrib><creatorcontrib>Herrera, Francisco</creatorcontrib><creatorcontrib>Chawla, Nitesh V.</creatorcontrib><collection>CrossRef</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>Computer Science Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><jtitle>The Journal of artificial intelligence research</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Fernandez, Alberto</au><au>Garcia, Salvador</au><au>Herrera, Francisco</au><au>Chawla, Nitesh V.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary</atitle><jtitle>The Journal of artificial intelligence research</jtitle><date>2018-04-20</date><risdate>2018</risdate><volume>61</volume><spage>863</spage><epage>905</epage><pages>863-905</pages><issn>1076-9757</issn><eissn>1076-9757</eissn><eissn>1943-5037</eissn><abstract>The Synthetic Minority Oversampling Technique (SMOTE) preprocessing algorithm is considered "de facto" standard in the framework of learning from imbalanced data. This is due to its simplicity in the design of the procedure, as well as its robustness when applied to different type of problems. Since its publication in 2002, SMOTE has proven successful in a variety of applications from several different domains. SMOTE has also inspired several approaches to counter the issue of class imbalance, and has also significantly contributed to new supervised learning paradigms, including multilabel classification, incremental learning, semi-supervised learning, multi-instance learning, among others. It is standard benchmark for learning from imbalanced data. It is also featured in a number of different software packages - from open source to commercial. In this paper, marking the fifteen year anniversary of SMOTE, we reflect on the SMOTE journey, discuss the current state of affairs with SMOTE, its applications, and also identify the next set of challenges to extend SMOTE for Big Data problems.</abstract><cop>San Francisco</cop><pub>AI Access Foundation</pub><doi>10.1613/jair.1.11192</doi><tpages>43</tpages><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1076-9757 |
ispartof | The Journal of artificial intelligence research, 2018-04, Vol.61, p.863-905 |
issn | 1076-9757 1076-9757 1943-5037 |
language | eng |
recordid | cdi_proquest_journals_2554081553 |
source | DOAJ Directory of Open Access Journals; Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals; Free E- Journals |
subjects | Algorithms Artificial intelligence Machine learning Marking Oversampling |
title | SMOTE for Learning from Imbalanced Data: Progress and Challenges, Marking the 15-year Anniversary |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-01T16%3A12%3A13IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=SMOTE%20for%20Learning%20from%20Imbalanced%20Data:%20Progress%20and%20Challenges,%20Marking%20the%2015-year%20Anniversary&rft.jtitle=The%20Journal%20of%20artificial%20intelligence%20research&rft.au=Fernandez,%20Alberto&rft.date=2018-04-20&rft.volume=61&rft.spage=863&rft.epage=905&rft.pages=863-905&rft.issn=1076-9757&rft.eissn=1076-9757&rft_id=info:doi/10.1613/jair.1.11192&rft_dat=%3Cproquest_cross%3E2554081553%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2554081553&rft_id=info:pmid/&rfr_iscdi=true |