Position: Embracing Negative Results in Machine Learning
Publications proposing novel machine learning methods are often primarily rated by exhibited predictive performance on selected problems. In this position paper we argue that predictive performance alone is not a good indicator for the worth of a publication. Using it as such even fosters problems l...
Gespeichert in:
Hauptverfasser: | , , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | |
container_volume | |
creator | Karl, Florian Kemeter, Lukas Malte Dax, Gabriel Sierak, Paulina |
description | Publications proposing novel machine learning methods are often primarily
rated by exhibited predictive performance on selected problems. In this
position paper we argue that predictive performance alone is not a good
indicator for the worth of a publication. Using it as such even fosters
problems like inefficiencies of the machine learning research community as a
whole and setting wrong incentives for researchers. We therefore put out a call
for the publication of "negative" results, which can help alleviate some of
these problems and improve the scientific output of the machine learning
research community. To substantiate our position, we present the advantages of
publishing negative results and provide concrete measures for the community to
move towards a paradigm where their publication is normalized. |
doi_str_mv | 10.48550/arxiv.2406.03980 |
format | Article |
fullrecord | <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2406_03980</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2406_03980</sourcerecordid><originalsourceid>FETCH-arxiv_primary_2406_039803</originalsourceid><addsrcrecordid>eNpjYJA0NNAzsTA1NdBPLKrILNMzMjEw0zMwtrQw4GSwCMgvzizJzM-zUnDNTSpKTM7MS1fwS01PLMksS1UISi0uzSkpVsjMU_BNTM7IzEtV8ElNLMoDKuJhYE1LzClO5YXS3Azybq4hzh66YDviC4oycxOLKuNBdsWD7TImrAIA-twzhA</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Position: Embracing Negative Results in Machine Learning</title><source>arXiv.org</source><creator>Karl, Florian ; Kemeter, Lukas Malte ; Dax, Gabriel ; Sierak, Paulina</creator><creatorcontrib>Karl, Florian ; Kemeter, Lukas Malte ; Dax, Gabriel ; Sierak, Paulina</creatorcontrib><description>Publications proposing novel machine learning methods are often primarily
rated by exhibited predictive performance on selected problems. In this
position paper we argue that predictive performance alone is not a good
indicator for the worth of a publication. Using it as such even fosters
problems like inefficiencies of the machine learning research community as a
whole and setting wrong incentives for researchers. We therefore put out a call
for the publication of "negative" results, which can help alleviate some of
these problems and improve the scientific output of the machine learning
research community. To substantiate our position, we present the advantages of
publishing negative results and provide concrete measures for the community to
move towards a paradigm where their publication is normalized.</description><identifier>DOI: 10.48550/arxiv.2406.03980</identifier><language>eng</language><subject>Computer Science - Learning</subject><creationdate>2024-06</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2406.03980$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2406.03980$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Karl, Florian</creatorcontrib><creatorcontrib>Kemeter, Lukas Malte</creatorcontrib><creatorcontrib>Dax, Gabriel</creatorcontrib><creatorcontrib>Sierak, Paulina</creatorcontrib><title>Position: Embracing Negative Results in Machine Learning</title><description>Publications proposing novel machine learning methods are often primarily
rated by exhibited predictive performance on selected problems. In this
position paper we argue that predictive performance alone is not a good
indicator for the worth of a publication. Using it as such even fosters
problems like inefficiencies of the machine learning research community as a
whole and setting wrong incentives for researchers. We therefore put out a call
for the publication of "negative" results, which can help alleviate some of
these problems and improve the scientific output of the machine learning
research community. To substantiate our position, we present the advantages of
publishing negative results and provide concrete measures for the community to
move towards a paradigm where their publication is normalized.</description><subject>Computer Science - Learning</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNpjYJA0NNAzsTA1NdBPLKrILNMzMjEw0zMwtrQw4GSwCMgvzizJzM-zUnDNTSpKTM7MS1fwS01PLMksS1UISi0uzSkpVsjMU_BNTM7IzEtV8ElNLMoDKuJhYE1LzClO5YXS3Azybq4hzh66YDviC4oycxOLKuNBdsWD7TImrAIA-twzhA</recordid><startdate>20240606</startdate><enddate>20240606</enddate><creator>Karl, Florian</creator><creator>Kemeter, Lukas Malte</creator><creator>Dax, Gabriel</creator><creator>Sierak, Paulina</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20240606</creationdate><title>Position: Embracing Negative Results in Machine Learning</title><author>Karl, Florian ; Kemeter, Lukas Malte ; Dax, Gabriel ; Sierak, Paulina</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-arxiv_primary_2406_039803</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Learning</topic><toplevel>online_resources</toplevel><creatorcontrib>Karl, Florian</creatorcontrib><creatorcontrib>Kemeter, Lukas Malte</creatorcontrib><creatorcontrib>Dax, Gabriel</creatorcontrib><creatorcontrib>Sierak, Paulina</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Karl, Florian</au><au>Kemeter, Lukas Malte</au><au>Dax, Gabriel</au><au>Sierak, Paulina</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Position: Embracing Negative Results in Machine Learning</atitle><date>2024-06-06</date><risdate>2024</risdate><abstract>Publications proposing novel machine learning methods are often primarily
rated by exhibited predictive performance on selected problems. In this
position paper we argue that predictive performance alone is not a good
indicator for the worth of a publication. Using it as such even fosters
problems like inefficiencies of the machine learning research community as a
whole and setting wrong incentives for researchers. We therefore put out a call
for the publication of "negative" results, which can help alleviate some of
these problems and improve the scientific output of the machine learning
research community. To substantiate our position, we present the advantages of
publishing negative results and provide concrete measures for the community to
move towards a paradigm where their publication is normalized.</abstract><doi>10.48550/arxiv.2406.03980</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | DOI: 10.48550/arxiv.2406.03980 |
ispartof | |
issn | |
language | eng |
recordid | cdi_arxiv_primary_2406_03980 |
source | arXiv.org |
subjects | Computer Science - Learning |
title | Position: Embracing Negative Results in Machine Learning |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T18%3A02%3A54IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Position:%20Embracing%20Negative%20Results%20in%20Machine%20Learning&rft.au=Karl,%20Florian&rft.date=2024-06-06&rft_id=info:doi/10.48550/arxiv.2406.03980&rft_dat=%3Carxiv_GOX%3E2406_03980%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |