Position: Embracing Negative Results in Machine Learning

Publications proposing novel machine learning methods are often primarily rated by exhibited predictive performance on selected problems. In this position paper we argue that predictive performance alone is not a good indicator for the worth of a publication. Using it as such even fosters problems l...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Karl, Florian, Kemeter, Lukas Malte, Dax, Gabriel, Sierak, Paulina
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Karl, Florian
Kemeter, Lukas Malte
Dax, Gabriel
Sierak, Paulina
description Publications proposing novel machine learning methods are often primarily rated by exhibited predictive performance on selected problems. In this position paper we argue that predictive performance alone is not a good indicator for the worth of a publication. Using it as such even fosters problems like inefficiencies of the machine learning research community as a whole and setting wrong incentives for researchers. We therefore put out a call for the publication of "negative" results, which can help alleviate some of these problems and improve the scientific output of the machine learning research community. To substantiate our position, we present the advantages of publishing negative results and provide concrete measures for the community to move towards a paradigm where their publication is normalized.
doi_str_mv 10.48550/arxiv.2406.03980
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2406_03980</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2406_03980</sourcerecordid><originalsourceid>FETCH-arxiv_primary_2406_039803</originalsourceid><addsrcrecordid>eNpjYJA0NNAzsTA1NdBPLKrILNMzMjEw0zMwtrQw4GSwCMgvzizJzM-zUnDNTSpKTM7MS1fwS01PLMksS1UISi0uzSkpVsjMU_BNTM7IzEtV8ElNLMoDKuJhYE1LzClO5YXS3Azybq4hzh66YDviC4oycxOLKuNBdsWD7TImrAIA-twzhA</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Position: Embracing Negative Results in Machine Learning</title><source>arXiv.org</source><creator>Karl, Florian ; Kemeter, Lukas Malte ; Dax, Gabriel ; Sierak, Paulina</creator><creatorcontrib>Karl, Florian ; Kemeter, Lukas Malte ; Dax, Gabriel ; Sierak, Paulina</creatorcontrib><description>Publications proposing novel machine learning methods are often primarily rated by exhibited predictive performance on selected problems. In this position paper we argue that predictive performance alone is not a good indicator for the worth of a publication. Using it as such even fosters problems like inefficiencies of the machine learning research community as a whole and setting wrong incentives for researchers. We therefore put out a call for the publication of "negative" results, which can help alleviate some of these problems and improve the scientific output of the machine learning research community. To substantiate our position, we present the advantages of publishing negative results and provide concrete measures for the community to move towards a paradigm where their publication is normalized.</description><identifier>DOI: 10.48550/arxiv.2406.03980</identifier><language>eng</language><subject>Computer Science - Learning</subject><creationdate>2024-06</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2406.03980$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2406.03980$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Karl, Florian</creatorcontrib><creatorcontrib>Kemeter, Lukas Malte</creatorcontrib><creatorcontrib>Dax, Gabriel</creatorcontrib><creatorcontrib>Sierak, Paulina</creatorcontrib><title>Position: Embracing Negative Results in Machine Learning</title><description>Publications proposing novel machine learning methods are often primarily rated by exhibited predictive performance on selected problems. In this position paper we argue that predictive performance alone is not a good indicator for the worth of a publication. Using it as such even fosters problems like inefficiencies of the machine learning research community as a whole and setting wrong incentives for researchers. We therefore put out a call for the publication of "negative" results, which can help alleviate some of these problems and improve the scientific output of the machine learning research community. To substantiate our position, we present the advantages of publishing negative results and provide concrete measures for the community to move towards a paradigm where their publication is normalized.</description><subject>Computer Science - Learning</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNpjYJA0NNAzsTA1NdBPLKrILNMzMjEw0zMwtrQw4GSwCMgvzizJzM-zUnDNTSpKTM7MS1fwS01PLMksS1UISi0uzSkpVsjMU_BNTM7IzEtV8ElNLMoDKuJhYE1LzClO5YXS3Azybq4hzh66YDviC4oycxOLKuNBdsWD7TImrAIA-twzhA</recordid><startdate>20240606</startdate><enddate>20240606</enddate><creator>Karl, Florian</creator><creator>Kemeter, Lukas Malte</creator><creator>Dax, Gabriel</creator><creator>Sierak, Paulina</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20240606</creationdate><title>Position: Embracing Negative Results in Machine Learning</title><author>Karl, Florian ; Kemeter, Lukas Malte ; Dax, Gabriel ; Sierak, Paulina</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-arxiv_primary_2406_039803</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Learning</topic><toplevel>online_resources</toplevel><creatorcontrib>Karl, Florian</creatorcontrib><creatorcontrib>Kemeter, Lukas Malte</creatorcontrib><creatorcontrib>Dax, Gabriel</creatorcontrib><creatorcontrib>Sierak, Paulina</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Karl, Florian</au><au>Kemeter, Lukas Malte</au><au>Dax, Gabriel</au><au>Sierak, Paulina</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Position: Embracing Negative Results in Machine Learning</atitle><date>2024-06-06</date><risdate>2024</risdate><abstract>Publications proposing novel machine learning methods are often primarily rated by exhibited predictive performance on selected problems. In this position paper we argue that predictive performance alone is not a good indicator for the worth of a publication. Using it as such even fosters problems like inefficiencies of the machine learning research community as a whole and setting wrong incentives for researchers. We therefore put out a call for the publication of "negative" results, which can help alleviate some of these problems and improve the scientific output of the machine learning research community. To substantiate our position, we present the advantages of publishing negative results and provide concrete measures for the community to move towards a paradigm where their publication is normalized.</abstract><doi>10.48550/arxiv.2406.03980</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2406.03980
ispartof
issn
language eng
recordid cdi_arxiv_primary_2406_03980
source arXiv.org
subjects Computer Science - Learning
title Position: Embracing Negative Results in Machine Learning
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T18%3A02%3A54IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Position:%20Embracing%20Negative%20Results%20in%20Machine%20Learning&rft.au=Karl,%20Florian&rft.date=2024-06-06&rft_id=info:doi/10.48550/arxiv.2406.03980&rft_dat=%3Carxiv_GOX%3E2406_03980%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true