Better GP benchmarks: community survey results and proposals
We present the results of a community survey regarding genetic programming benchmark practices. Analysis shows broad consensus that improvement is needed in problem selection and experimental rigor. While views expressed in the survey dissuade us from proposing a large-scale benchmark suite, we find...
Gespeichert in:
| Veröffentlicht in: | Genetic programming and evolvable machines 2013-03, Vol.14 (1), p.3-29 |
|---|---|
| Hauptverfasser: | , , , , , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 29 |
|---|---|
| container_issue | 1 |
| container_start_page | 3 |
| container_title | Genetic programming and evolvable machines |
| container_volume | 14 |
| creator | White, David R. McDermott, James Castelli, Mauro Manzoni, Luca Goldman, Brian W. Kronberger, Gabriel Jaśkowski, Wojciech O’Reilly, Una-May Luke, Sean |
| description | We present the results of a community survey regarding genetic programming benchmark practices. Analysis shows broad consensus that improvement is needed in problem selection and experimental rigor. While views expressed in the survey dissuade us from proposing a large-scale benchmark suite, we find community support for creating a “blacklist” of problems which are in common use but have important flaws, and whose use should therefore be discouraged. We propose a set of possible replacement problems. |
| doi_str_mv | 10.1007/s10710-012-9177-2 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1439757411</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1439757411</sourcerecordid><originalsourceid>FETCH-LOGICAL-c364t-9c34398985ddc233c4830fac7c564dfa0d9ae76bf93e9a1ca88bbc3b6470efff3</originalsourceid><addsrcrecordid>eNp9kD9PwzAUxC0EEqXwAdgyshj87MSOEQtUpSBVggFmy3FsaMmf4pcg9dvjKsxM94a7e7ofIZfAroExdYPAFDDKgFMNSlF-RGZQKEGVFPw43aLUlBdKnpIzxC1jIHmhZ-TuwQ-Dj9nqNat85z5bG7_wNnN9247dZthnOMYfv8-ix7EZMLNdne1iv-vRNnhOTkISf_Gnc_L-uHxbPNH1y-p5cb-mTsh8oNqJXOhSl0VdOy6Ey0vBgnXKFTKvg2W1tl7JKmjhtQVny7KqnKhkrpgPIYg5uZp60-fv0eNg2g063zS28_2IBlK9KlQOkKwwWV3sEaMPZhc3adTeADMHUmYiZRIpcyBleMrwKYPJ2334aLb9GLu06J_QLwMebEU</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1439757411</pqid></control><display><type>article</type><title>Better GP benchmarks: community survey results and proposals</title><source>SpringerLink Journals - AutoHoldings</source><creator>White, David R. ; McDermott, James ; Castelli, Mauro ; Manzoni, Luca ; Goldman, Brian W. ; Kronberger, Gabriel ; Jaśkowski, Wojciech ; O’Reilly, Una-May ; Luke, Sean</creator><creatorcontrib>White, David R. ; McDermott, James ; Castelli, Mauro ; Manzoni, Luca ; Goldman, Brian W. ; Kronberger, Gabriel ; Jaśkowski, Wojciech ; O’Reilly, Una-May ; Luke, Sean</creatorcontrib><description>We present the results of a community survey regarding genetic programming benchmark practices. Analysis shows broad consensus that improvement is needed in problem selection and experimental rigor. While views expressed in the survey dissuade us from proposing a large-scale benchmark suite, we find community support for creating a “blacklist” of problems which are in common use but have important flaws, and whose use should therefore be discouraged. We propose a set of possible replacement problems.</description><identifier>ISSN: 1389-2576</identifier><identifier>EISSN: 1573-7632</identifier><identifier>DOI: 10.1007/s10710-012-9177-2</identifier><language>eng</language><publisher>Boston: Springer US</publisher><subject>Artificial Intelligence ; Benchmarks ; Biomedical Engineering and Bioengineering ; Communities ; Compilers ; Computer Science ; Defects ; Electrical Engineering ; Genetics ; Interpreters ; Programming ; Programming Languages ; Programming Techniques ; Proposals ; Software Engineering/Programming and Operating Systems</subject><ispartof>Genetic programming and evolvable machines, 2013-03, Vol.14 (1), p.3-29</ispartof><rights>Springer Science+Business Media New York 2012</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c364t-9c34398985ddc233c4830fac7c564dfa0d9ae76bf93e9a1ca88bbc3b6470efff3</citedby><cites>FETCH-LOGICAL-c364t-9c34398985ddc233c4830fac7c564dfa0d9ae76bf93e9a1ca88bbc3b6470efff3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s10710-012-9177-2$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s10710-012-9177-2$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,776,780,27901,27902,41464,42533,51294</link.rule.ids></links><search><creatorcontrib>White, David R.</creatorcontrib><creatorcontrib>McDermott, James</creatorcontrib><creatorcontrib>Castelli, Mauro</creatorcontrib><creatorcontrib>Manzoni, Luca</creatorcontrib><creatorcontrib>Goldman, Brian W.</creatorcontrib><creatorcontrib>Kronberger, Gabriel</creatorcontrib><creatorcontrib>Jaśkowski, Wojciech</creatorcontrib><creatorcontrib>O’Reilly, Una-May</creatorcontrib><creatorcontrib>Luke, Sean</creatorcontrib><title>Better GP benchmarks: community survey results and proposals</title><title>Genetic programming and evolvable machines</title><addtitle>Genet Program Evolvable Mach</addtitle><description>We present the results of a community survey regarding genetic programming benchmark practices. Analysis shows broad consensus that improvement is needed in problem selection and experimental rigor. While views expressed in the survey dissuade us from proposing a large-scale benchmark suite, we find community support for creating a “blacklist” of problems which are in common use but have important flaws, and whose use should therefore be discouraged. We propose a set of possible replacement problems.</description><subject>Artificial Intelligence</subject><subject>Benchmarks</subject><subject>Biomedical Engineering and Bioengineering</subject><subject>Communities</subject><subject>Compilers</subject><subject>Computer Science</subject><subject>Defects</subject><subject>Electrical Engineering</subject><subject>Genetics</subject><subject>Interpreters</subject><subject>Programming</subject><subject>Programming Languages</subject><subject>Programming Techniques</subject><subject>Proposals</subject><subject>Software Engineering/Programming and Operating Systems</subject><issn>1389-2576</issn><issn>1573-7632</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2013</creationdate><recordtype>article</recordtype><recordid>eNp9kD9PwzAUxC0EEqXwAdgyshj87MSOEQtUpSBVggFmy3FsaMmf4pcg9dvjKsxM94a7e7ofIZfAroExdYPAFDDKgFMNSlF-RGZQKEGVFPw43aLUlBdKnpIzxC1jIHmhZ-TuwQ-Dj9nqNat85z5bG7_wNnN9247dZthnOMYfv8-ix7EZMLNdne1iv-vRNnhOTkISf_Gnc_L-uHxbPNH1y-p5cb-mTsh8oNqJXOhSl0VdOy6Ey0vBgnXKFTKvg2W1tl7JKmjhtQVny7KqnKhkrpgPIYg5uZp60-fv0eNg2g063zS28_2IBlK9KlQOkKwwWV3sEaMPZhc3adTeADMHUmYiZRIpcyBleMrwKYPJ2334aLb9GLu06J_QLwMebEU</recordid><startdate>20130301</startdate><enddate>20130301</enddate><creator>White, David R.</creator><creator>McDermott, James</creator><creator>Castelli, Mauro</creator><creator>Manzoni, Luca</creator><creator>Goldman, Brian W.</creator><creator>Kronberger, Gabriel</creator><creator>Jaśkowski, Wojciech</creator><creator>O’Reilly, Una-May</creator><creator>Luke, Sean</creator><general>Springer US</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope></search><sort><creationdate>20130301</creationdate><title>Better GP benchmarks: community survey results and proposals</title><author>White, David R. ; McDermott, James ; Castelli, Mauro ; Manzoni, Luca ; Goldman, Brian W. ; Kronberger, Gabriel ; Jaśkowski, Wojciech ; O’Reilly, Una-May ; Luke, Sean</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c364t-9c34398985ddc233c4830fac7c564dfa0d9ae76bf93e9a1ca88bbc3b6470efff3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2013</creationdate><topic>Artificial Intelligence</topic><topic>Benchmarks</topic><topic>Biomedical Engineering and Bioengineering</topic><topic>Communities</topic><topic>Compilers</topic><topic>Computer Science</topic><topic>Defects</topic><topic>Electrical Engineering</topic><topic>Genetics</topic><topic>Interpreters</topic><topic>Programming</topic><topic>Programming Languages</topic><topic>Programming Techniques</topic><topic>Proposals</topic><topic>Software Engineering/Programming and Operating Systems</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>White, David R.</creatorcontrib><creatorcontrib>McDermott, James</creatorcontrib><creatorcontrib>Castelli, Mauro</creatorcontrib><creatorcontrib>Manzoni, Luca</creatorcontrib><creatorcontrib>Goldman, Brian W.</creatorcontrib><creatorcontrib>Kronberger, Gabriel</creatorcontrib><creatorcontrib>Jaśkowski, Wojciech</creatorcontrib><creatorcontrib>O’Reilly, Una-May</creatorcontrib><creatorcontrib>Luke, Sean</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Genetic programming and evolvable machines</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>White, David R.</au><au>McDermott, James</au><au>Castelli, Mauro</au><au>Manzoni, Luca</au><au>Goldman, Brian W.</au><au>Kronberger, Gabriel</au><au>Jaśkowski, Wojciech</au><au>O’Reilly, Una-May</au><au>Luke, Sean</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Better GP benchmarks: community survey results and proposals</atitle><jtitle>Genetic programming and evolvable machines</jtitle><stitle>Genet Program Evolvable Mach</stitle><date>2013-03-01</date><risdate>2013</risdate><volume>14</volume><issue>1</issue><spage>3</spage><epage>29</epage><pages>3-29</pages><issn>1389-2576</issn><eissn>1573-7632</eissn><abstract>We present the results of a community survey regarding genetic programming benchmark practices. Analysis shows broad consensus that improvement is needed in problem selection and experimental rigor. While views expressed in the survey dissuade us from proposing a large-scale benchmark suite, we find community support for creating a “blacklist” of problems which are in common use but have important flaws, and whose use should therefore be discouraged. We propose a set of possible replacement problems.</abstract><cop>Boston</cop><pub>Springer US</pub><doi>10.1007/s10710-012-9177-2</doi><tpages>27</tpages><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 1389-2576 |
| ispartof | Genetic programming and evolvable machines, 2013-03, Vol.14 (1), p.3-29 |
| issn | 1389-2576 1573-7632 |
| language | eng |
| recordid | cdi_proquest_miscellaneous_1439757411 |
| source | SpringerLink Journals - AutoHoldings |
| subjects | Artificial Intelligence Benchmarks Biomedical Engineering and Bioengineering Communities Compilers Computer Science Defects Electrical Engineering Genetics Interpreters Programming Programming Languages Programming Techniques Proposals Software Engineering/Programming and Operating Systems |
| title | Better GP benchmarks: community survey results and proposals |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-09T09%3A25%3A26IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Better%20GP%20benchmarks:%20community%20survey%20results%20and%20proposals&rft.jtitle=Genetic%20programming%20and%20evolvable%20machines&rft.au=White,%20David%20R.&rft.date=2013-03-01&rft.volume=14&rft.issue=1&rft.spage=3&rft.epage=29&rft.pages=3-29&rft.issn=1389-2576&rft.eissn=1573-7632&rft_id=info:doi/10.1007/s10710-012-9177-2&rft_dat=%3Cproquest_cross%3E1439757411%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1439757411&rft_id=info:pmid/&rfr_iscdi=true |