Insect Identification in the Wild: The AMI Dataset
Insects represent half of all global biodiversity, yet many of the world's insects are disappearing, with severe implications for ecosystems and agriculture. Despite this crisis, data on insect diversity and abundance remain woefully inadequate, due to the scarcity of human experts and the lack...
Gespeichert in:
Hauptverfasser: | , , , , , , , , , , , , , , , , , , , , , , , , , , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | |
container_volume | |
creator | Jain, Aditya Cunha, Fagner Bunsen, Michael James Cañas, Juan Sebastián Pasi, Léonard Pinoy, Nathan Helsing, Flemming Russo, JoAnne Botham, Marc Sabourin, Michael Fréchette, Jonathan Anctil, Alexandre Lopez, Yacksecari Navarro, Eduardo Pimentel, Filonila Perez Zamora, Ana Cecilia Silva, José Alejandro Ramirez Gagnon, Jonathan August, Tom Bjerge, Kim Segura, Alba Gomez Bélisle, Marc Basset, Yves McFarland, Kent P Roy, David Høye, Toke Thomas Larrivée, Maxim Rolnick, David |
description | Insects represent half of all global biodiversity, yet many of the world's
insects are disappearing, with severe implications for ecosystems and
agriculture. Despite this crisis, data on insect diversity and abundance remain
woefully inadequate, due to the scarcity of human experts and the lack of
scalable tools for monitoring. Ecologists have started to adopt camera traps to
record and study insects, and have proposed computer vision algorithms as an
answer for scalable data processing. However, insect monitoring in the wild
poses unique challenges that have not yet been addressed within computer
vision, including the combination of long-tailed data, extremely similar
classes, and significant distribution shifts. We provide the first large-scale
machine learning benchmarks for fine-grained insect recognition, designed to
match real-world tasks faced by ecologists. Our contributions include a curated
dataset of images from citizen science platforms and museums, and an
expert-annotated dataset drawn from automated camera traps across multiple
continents, designed to test out-of-distribution generalization under field
conditions. We train and evaluate a variety of baseline algorithms and
introduce a combination of data augmentation techniques that enhance
generalization across geographies and hardware setups. |
doi_str_mv | 10.48550/arxiv.2406.12452 |
format | Article |
fullrecord | <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2406_12452</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2406_12452</sourcerecordid><originalsourceid>FETCH-LOGICAL-a672-fd2c03770167ec08a545002d8bb74cd0e65df254164047ce5bd902b6aa2ab1c83</originalsourceid><addsrcrecordid>eNotzrtuwkAQheFtKCLgAVKxL2BndrwXh84ykFgC0VhKac1erKxETGSvELw9CUl1_uroY-xZQC5LpeCFxmu85ChB5wKlwieGzTAFl3jjw5BiHx2leB54HHj6DPwjnvyatz9VHRq-oURTSAs26-k0heX_zlm727b1e7Y_vjV1tc9IG8x6jw4KY0BoExyUpKQCQF9aa6TzELTyPSoptARpXFDWvwJaTYRkhSuLOVv93T7Q3fcYv2i8db_47oEv7u0hPR4</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Insect Identification in the Wild: The AMI Dataset</title><source>arXiv.org</source><creator>Jain, Aditya ; Cunha, Fagner ; Bunsen, Michael James ; Cañas, Juan Sebastián ; Pasi, Léonard ; Pinoy, Nathan ; Helsing, Flemming ; Russo, JoAnne ; Botham, Marc ; Sabourin, Michael ; Fréchette, Jonathan ; Anctil, Alexandre ; Lopez, Yacksecari ; Navarro, Eduardo ; Pimentel, Filonila Perez ; Zamora, Ana Cecilia ; Silva, José Alejandro Ramirez ; Gagnon, Jonathan ; August, Tom ; Bjerge, Kim ; Segura, Alba Gomez ; Bélisle, Marc ; Basset, Yves ; McFarland, Kent P ; Roy, David ; Høye, Toke Thomas ; Larrivée, Maxim ; Rolnick, David</creator><creatorcontrib>Jain, Aditya ; Cunha, Fagner ; Bunsen, Michael James ; Cañas, Juan Sebastián ; Pasi, Léonard ; Pinoy, Nathan ; Helsing, Flemming ; Russo, JoAnne ; Botham, Marc ; Sabourin, Michael ; Fréchette, Jonathan ; Anctil, Alexandre ; Lopez, Yacksecari ; Navarro, Eduardo ; Pimentel, Filonila Perez ; Zamora, Ana Cecilia ; Silva, José Alejandro Ramirez ; Gagnon, Jonathan ; August, Tom ; Bjerge, Kim ; Segura, Alba Gomez ; Bélisle, Marc ; Basset, Yves ; McFarland, Kent P ; Roy, David ; Høye, Toke Thomas ; Larrivée, Maxim ; Rolnick, David</creatorcontrib><description>Insects represent half of all global biodiversity, yet many of the world's
insects are disappearing, with severe implications for ecosystems and
agriculture. Despite this crisis, data on insect diversity and abundance remain
woefully inadequate, due to the scarcity of human experts and the lack of
scalable tools for monitoring. Ecologists have started to adopt camera traps to
record and study insects, and have proposed computer vision algorithms as an
answer for scalable data processing. However, insect monitoring in the wild
poses unique challenges that have not yet been addressed within computer
vision, including the combination of long-tailed data, extremely similar
classes, and significant distribution shifts. We provide the first large-scale
machine learning benchmarks for fine-grained insect recognition, designed to
match real-world tasks faced by ecologists. Our contributions include a curated
dataset of images from citizen science platforms and museums, and an
expert-annotated dataset drawn from automated camera traps across multiple
continents, designed to test out-of-distribution generalization under field
conditions. We train and evaluate a variety of baseline algorithms and
introduce a combination of data augmentation techniques that enhance
generalization across geographies and hardware setups.</description><identifier>DOI: 10.48550/arxiv.2406.12452</identifier><language>eng</language><subject>Computer Science - Artificial Intelligence ; Computer Science - Computer Vision and Pattern Recognition ; Computer Science - Learning</subject><creationdate>2024-06</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2406.12452$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2406.12452$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Jain, Aditya</creatorcontrib><creatorcontrib>Cunha, Fagner</creatorcontrib><creatorcontrib>Bunsen, Michael James</creatorcontrib><creatorcontrib>Cañas, Juan Sebastián</creatorcontrib><creatorcontrib>Pasi, Léonard</creatorcontrib><creatorcontrib>Pinoy, Nathan</creatorcontrib><creatorcontrib>Helsing, Flemming</creatorcontrib><creatorcontrib>Russo, JoAnne</creatorcontrib><creatorcontrib>Botham, Marc</creatorcontrib><creatorcontrib>Sabourin, Michael</creatorcontrib><creatorcontrib>Fréchette, Jonathan</creatorcontrib><creatorcontrib>Anctil, Alexandre</creatorcontrib><creatorcontrib>Lopez, Yacksecari</creatorcontrib><creatorcontrib>Navarro, Eduardo</creatorcontrib><creatorcontrib>Pimentel, Filonila Perez</creatorcontrib><creatorcontrib>Zamora, Ana Cecilia</creatorcontrib><creatorcontrib>Silva, José Alejandro Ramirez</creatorcontrib><creatorcontrib>Gagnon, Jonathan</creatorcontrib><creatorcontrib>August, Tom</creatorcontrib><creatorcontrib>Bjerge, Kim</creatorcontrib><creatorcontrib>Segura, Alba Gomez</creatorcontrib><creatorcontrib>Bélisle, Marc</creatorcontrib><creatorcontrib>Basset, Yves</creatorcontrib><creatorcontrib>McFarland, Kent P</creatorcontrib><creatorcontrib>Roy, David</creatorcontrib><creatorcontrib>Høye, Toke Thomas</creatorcontrib><creatorcontrib>Larrivée, Maxim</creatorcontrib><creatorcontrib>Rolnick, David</creatorcontrib><title>Insect Identification in the Wild: The AMI Dataset</title><description>Insects represent half of all global biodiversity, yet many of the world's
insects are disappearing, with severe implications for ecosystems and
agriculture. Despite this crisis, data on insect diversity and abundance remain
woefully inadequate, due to the scarcity of human experts and the lack of
scalable tools for monitoring. Ecologists have started to adopt camera traps to
record and study insects, and have proposed computer vision algorithms as an
answer for scalable data processing. However, insect monitoring in the wild
poses unique challenges that have not yet been addressed within computer
vision, including the combination of long-tailed data, extremely similar
classes, and significant distribution shifts. We provide the first large-scale
machine learning benchmarks for fine-grained insect recognition, designed to
match real-world tasks faced by ecologists. Our contributions include a curated
dataset of images from citizen science platforms and museums, and an
expert-annotated dataset drawn from automated camera traps across multiple
continents, designed to test out-of-distribution generalization under field
conditions. We train and evaluate a variety of baseline algorithms and
introduce a combination of data augmentation techniques that enhance
generalization across geographies and hardware setups.</description><subject>Computer Science - Artificial Intelligence</subject><subject>Computer Science - Computer Vision and Pattern Recognition</subject><subject>Computer Science - Learning</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotzrtuwkAQheFtKCLgAVKxL2BndrwXh84ykFgC0VhKac1erKxETGSvELw9CUl1_uroY-xZQC5LpeCFxmu85ChB5wKlwieGzTAFl3jjw5BiHx2leB54HHj6DPwjnvyatz9VHRq-oURTSAs26-k0heX_zlm727b1e7Y_vjV1tc9IG8x6jw4KY0BoExyUpKQCQF9aa6TzELTyPSoptARpXFDWvwJaTYRkhSuLOVv93T7Q3fcYv2i8db_47oEv7u0hPR4</recordid><startdate>20240618</startdate><enddate>20240618</enddate><creator>Jain, Aditya</creator><creator>Cunha, Fagner</creator><creator>Bunsen, Michael James</creator><creator>Cañas, Juan Sebastián</creator><creator>Pasi, Léonard</creator><creator>Pinoy, Nathan</creator><creator>Helsing, Flemming</creator><creator>Russo, JoAnne</creator><creator>Botham, Marc</creator><creator>Sabourin, Michael</creator><creator>Fréchette, Jonathan</creator><creator>Anctil, Alexandre</creator><creator>Lopez, Yacksecari</creator><creator>Navarro, Eduardo</creator><creator>Pimentel, Filonila Perez</creator><creator>Zamora, Ana Cecilia</creator><creator>Silva, José Alejandro Ramirez</creator><creator>Gagnon, Jonathan</creator><creator>August, Tom</creator><creator>Bjerge, Kim</creator><creator>Segura, Alba Gomez</creator><creator>Bélisle, Marc</creator><creator>Basset, Yves</creator><creator>McFarland, Kent P</creator><creator>Roy, David</creator><creator>Høye, Toke Thomas</creator><creator>Larrivée, Maxim</creator><creator>Rolnick, David</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20240618</creationdate><title>Insect Identification in the Wild: The AMI Dataset</title><author>Jain, Aditya ; Cunha, Fagner ; Bunsen, Michael James ; Cañas, Juan Sebastián ; Pasi, Léonard ; Pinoy, Nathan ; Helsing, Flemming ; Russo, JoAnne ; Botham, Marc ; Sabourin, Michael ; Fréchette, Jonathan ; Anctil, Alexandre ; Lopez, Yacksecari ; Navarro, Eduardo ; Pimentel, Filonila Perez ; Zamora, Ana Cecilia ; Silva, José Alejandro Ramirez ; Gagnon, Jonathan ; August, Tom ; Bjerge, Kim ; Segura, Alba Gomez ; Bélisle, Marc ; Basset, Yves ; McFarland, Kent P ; Roy, David ; Høye, Toke Thomas ; Larrivée, Maxim ; Rolnick, David</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a672-fd2c03770167ec08a545002d8bb74cd0e65df254164047ce5bd902b6aa2ab1c83</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Artificial Intelligence</topic><topic>Computer Science - Computer Vision and Pattern Recognition</topic><topic>Computer Science - Learning</topic><toplevel>online_resources</toplevel><creatorcontrib>Jain, Aditya</creatorcontrib><creatorcontrib>Cunha, Fagner</creatorcontrib><creatorcontrib>Bunsen, Michael James</creatorcontrib><creatorcontrib>Cañas, Juan Sebastián</creatorcontrib><creatorcontrib>Pasi, Léonard</creatorcontrib><creatorcontrib>Pinoy, Nathan</creatorcontrib><creatorcontrib>Helsing, Flemming</creatorcontrib><creatorcontrib>Russo, JoAnne</creatorcontrib><creatorcontrib>Botham, Marc</creatorcontrib><creatorcontrib>Sabourin, Michael</creatorcontrib><creatorcontrib>Fréchette, Jonathan</creatorcontrib><creatorcontrib>Anctil, Alexandre</creatorcontrib><creatorcontrib>Lopez, Yacksecari</creatorcontrib><creatorcontrib>Navarro, Eduardo</creatorcontrib><creatorcontrib>Pimentel, Filonila Perez</creatorcontrib><creatorcontrib>Zamora, Ana Cecilia</creatorcontrib><creatorcontrib>Silva, José Alejandro Ramirez</creatorcontrib><creatorcontrib>Gagnon, Jonathan</creatorcontrib><creatorcontrib>August, Tom</creatorcontrib><creatorcontrib>Bjerge, Kim</creatorcontrib><creatorcontrib>Segura, Alba Gomez</creatorcontrib><creatorcontrib>Bélisle, Marc</creatorcontrib><creatorcontrib>Basset, Yves</creatorcontrib><creatorcontrib>McFarland, Kent P</creatorcontrib><creatorcontrib>Roy, David</creatorcontrib><creatorcontrib>Høye, Toke Thomas</creatorcontrib><creatorcontrib>Larrivée, Maxim</creatorcontrib><creatorcontrib>Rolnick, David</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Jain, Aditya</au><au>Cunha, Fagner</au><au>Bunsen, Michael James</au><au>Cañas, Juan Sebastián</au><au>Pasi, Léonard</au><au>Pinoy, Nathan</au><au>Helsing, Flemming</au><au>Russo, JoAnne</au><au>Botham, Marc</au><au>Sabourin, Michael</au><au>Fréchette, Jonathan</au><au>Anctil, Alexandre</au><au>Lopez, Yacksecari</au><au>Navarro, Eduardo</au><au>Pimentel, Filonila Perez</au><au>Zamora, Ana Cecilia</au><au>Silva, José Alejandro Ramirez</au><au>Gagnon, Jonathan</au><au>August, Tom</au><au>Bjerge, Kim</au><au>Segura, Alba Gomez</au><au>Bélisle, Marc</au><au>Basset, Yves</au><au>McFarland, Kent P</au><au>Roy, David</au><au>Høye, Toke Thomas</au><au>Larrivée, Maxim</au><au>Rolnick, David</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Insect Identification in the Wild: The AMI Dataset</atitle><date>2024-06-18</date><risdate>2024</risdate><abstract>Insects represent half of all global biodiversity, yet many of the world's
insects are disappearing, with severe implications for ecosystems and
agriculture. Despite this crisis, data on insect diversity and abundance remain
woefully inadequate, due to the scarcity of human experts and the lack of
scalable tools for monitoring. Ecologists have started to adopt camera traps to
record and study insects, and have proposed computer vision algorithms as an
answer for scalable data processing. However, insect monitoring in the wild
poses unique challenges that have not yet been addressed within computer
vision, including the combination of long-tailed data, extremely similar
classes, and significant distribution shifts. We provide the first large-scale
machine learning benchmarks for fine-grained insect recognition, designed to
match real-world tasks faced by ecologists. Our contributions include a curated
dataset of images from citizen science platforms and museums, and an
expert-annotated dataset drawn from automated camera traps across multiple
continents, designed to test out-of-distribution generalization under field
conditions. We train and evaluate a variety of baseline algorithms and
introduce a combination of data augmentation techniques that enhance
generalization across geographies and hardware setups.</abstract><doi>10.48550/arxiv.2406.12452</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | DOI: 10.48550/arxiv.2406.12452 |
ispartof | |
issn | |
language | eng |
recordid | cdi_arxiv_primary_2406_12452 |
source | arXiv.org |
subjects | Computer Science - Artificial Intelligence Computer Science - Computer Vision and Pattern Recognition Computer Science - Learning |
title | Insect Identification in the Wild: The AMI Dataset |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-01T08%3A10%3A58IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Insect%20Identification%20in%20the%20Wild:%20The%20AMI%20Dataset&rft.au=Jain,%20Aditya&rft.date=2024-06-18&rft_id=info:doi/10.48550/arxiv.2406.12452&rft_dat=%3Carxiv_GOX%3E2406_12452%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |