Insect Identification in the Wild: The AMI Dataset

Insects represent half of all global biodiversity, yet many of the world's insects are disappearing, with severe implications for ecosystems and agriculture. Despite this crisis, data on insect diversity and abundance remain woefully inadequate, due to the scarcity of human experts and the lack...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Jain, Aditya, Cunha, Fagner, Bunsen, Michael James, Cañas, Juan Sebastián, Pasi, Léonard, Pinoy, Nathan, Helsing, Flemming, Russo, JoAnne, Botham, Marc, Sabourin, Michael, Fréchette, Jonathan, Anctil, Alexandre, Lopez, Yacksecari, Navarro, Eduardo, Pimentel, Filonila Perez, Zamora, Ana Cecilia, Silva, José Alejandro Ramirez, Gagnon, Jonathan, August, Tom, Bjerge, Kim, Segura, Alba Gomez, Bélisle, Marc, Basset, Yves, McFarland, Kent P, Roy, David, Høye, Toke Thomas, Larrivée, Maxim, Rolnick, David
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Jain, Aditya
Cunha, Fagner
Bunsen, Michael James
Cañas, Juan Sebastián
Pasi, Léonard
Pinoy, Nathan
Helsing, Flemming
Russo, JoAnne
Botham, Marc
Sabourin, Michael
Fréchette, Jonathan
Anctil, Alexandre
Lopez, Yacksecari
Navarro, Eduardo
Pimentel, Filonila Perez
Zamora, Ana Cecilia
Silva, José Alejandro Ramirez
Gagnon, Jonathan
August, Tom
Bjerge, Kim
Segura, Alba Gomez
Bélisle, Marc
Basset, Yves
McFarland, Kent P
Roy, David
Høye, Toke Thomas
Larrivée, Maxim
Rolnick, David
description Insects represent half of all global biodiversity, yet many of the world's insects are disappearing, with severe implications for ecosystems and agriculture. Despite this crisis, data on insect diversity and abundance remain woefully inadequate, due to the scarcity of human experts and the lack of scalable tools for monitoring. Ecologists have started to adopt camera traps to record and study insects, and have proposed computer vision algorithms as an answer for scalable data processing. However, insect monitoring in the wild poses unique challenges that have not yet been addressed within computer vision, including the combination of long-tailed data, extremely similar classes, and significant distribution shifts. We provide the first large-scale machine learning benchmarks for fine-grained insect recognition, designed to match real-world tasks faced by ecologists. Our contributions include a curated dataset of images from citizen science platforms and museums, and an expert-annotated dataset drawn from automated camera traps across multiple continents, designed to test out-of-distribution generalization under field conditions. We train and evaluate a variety of baseline algorithms and introduce a combination of data augmentation techniques that enhance generalization across geographies and hardware setups.
doi_str_mv 10.48550/arxiv.2406.12452
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2406_12452</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2406_12452</sourcerecordid><originalsourceid>FETCH-LOGICAL-a672-fd2c03770167ec08a545002d8bb74cd0e65df254164047ce5bd902b6aa2ab1c83</originalsourceid><addsrcrecordid>eNotzrtuwkAQheFtKCLgAVKxL2BndrwXh84ykFgC0VhKac1erKxETGSvELw9CUl1_uroY-xZQC5LpeCFxmu85ChB5wKlwieGzTAFl3jjw5BiHx2leB54HHj6DPwjnvyatz9VHRq-oURTSAs26-k0heX_zlm727b1e7Y_vjV1tc9IG8x6jw4KY0BoExyUpKQCQF9aa6TzELTyPSoptARpXFDWvwJaTYRkhSuLOVv93T7Q3fcYv2i8db_47oEv7u0hPR4</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Insect Identification in the Wild: The AMI Dataset</title><source>arXiv.org</source><creator>Jain, Aditya ; Cunha, Fagner ; Bunsen, Michael James ; Cañas, Juan Sebastián ; Pasi, Léonard ; Pinoy, Nathan ; Helsing, Flemming ; Russo, JoAnne ; Botham, Marc ; Sabourin, Michael ; Fréchette, Jonathan ; Anctil, Alexandre ; Lopez, Yacksecari ; Navarro, Eduardo ; Pimentel, Filonila Perez ; Zamora, Ana Cecilia ; Silva, José Alejandro Ramirez ; Gagnon, Jonathan ; August, Tom ; Bjerge, Kim ; Segura, Alba Gomez ; Bélisle, Marc ; Basset, Yves ; McFarland, Kent P ; Roy, David ; Høye, Toke Thomas ; Larrivée, Maxim ; Rolnick, David</creator><creatorcontrib>Jain, Aditya ; Cunha, Fagner ; Bunsen, Michael James ; Cañas, Juan Sebastián ; Pasi, Léonard ; Pinoy, Nathan ; Helsing, Flemming ; Russo, JoAnne ; Botham, Marc ; Sabourin, Michael ; Fréchette, Jonathan ; Anctil, Alexandre ; Lopez, Yacksecari ; Navarro, Eduardo ; Pimentel, Filonila Perez ; Zamora, Ana Cecilia ; Silva, José Alejandro Ramirez ; Gagnon, Jonathan ; August, Tom ; Bjerge, Kim ; Segura, Alba Gomez ; Bélisle, Marc ; Basset, Yves ; McFarland, Kent P ; Roy, David ; Høye, Toke Thomas ; Larrivée, Maxim ; Rolnick, David</creatorcontrib><description>Insects represent half of all global biodiversity, yet many of the world's insects are disappearing, with severe implications for ecosystems and agriculture. Despite this crisis, data on insect diversity and abundance remain woefully inadequate, due to the scarcity of human experts and the lack of scalable tools for monitoring. Ecologists have started to adopt camera traps to record and study insects, and have proposed computer vision algorithms as an answer for scalable data processing. However, insect monitoring in the wild poses unique challenges that have not yet been addressed within computer vision, including the combination of long-tailed data, extremely similar classes, and significant distribution shifts. We provide the first large-scale machine learning benchmarks for fine-grained insect recognition, designed to match real-world tasks faced by ecologists. Our contributions include a curated dataset of images from citizen science platforms and museums, and an expert-annotated dataset drawn from automated camera traps across multiple continents, designed to test out-of-distribution generalization under field conditions. We train and evaluate a variety of baseline algorithms and introduce a combination of data augmentation techniques that enhance generalization across geographies and hardware setups.</description><identifier>DOI: 10.48550/arxiv.2406.12452</identifier><language>eng</language><subject>Computer Science - Artificial Intelligence ; Computer Science - Computer Vision and Pattern Recognition ; Computer Science - Learning</subject><creationdate>2024-06</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2406.12452$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2406.12452$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Jain, Aditya</creatorcontrib><creatorcontrib>Cunha, Fagner</creatorcontrib><creatorcontrib>Bunsen, Michael James</creatorcontrib><creatorcontrib>Cañas, Juan Sebastián</creatorcontrib><creatorcontrib>Pasi, Léonard</creatorcontrib><creatorcontrib>Pinoy, Nathan</creatorcontrib><creatorcontrib>Helsing, Flemming</creatorcontrib><creatorcontrib>Russo, JoAnne</creatorcontrib><creatorcontrib>Botham, Marc</creatorcontrib><creatorcontrib>Sabourin, Michael</creatorcontrib><creatorcontrib>Fréchette, Jonathan</creatorcontrib><creatorcontrib>Anctil, Alexandre</creatorcontrib><creatorcontrib>Lopez, Yacksecari</creatorcontrib><creatorcontrib>Navarro, Eduardo</creatorcontrib><creatorcontrib>Pimentel, Filonila Perez</creatorcontrib><creatorcontrib>Zamora, Ana Cecilia</creatorcontrib><creatorcontrib>Silva, José Alejandro Ramirez</creatorcontrib><creatorcontrib>Gagnon, Jonathan</creatorcontrib><creatorcontrib>August, Tom</creatorcontrib><creatorcontrib>Bjerge, Kim</creatorcontrib><creatorcontrib>Segura, Alba Gomez</creatorcontrib><creatorcontrib>Bélisle, Marc</creatorcontrib><creatorcontrib>Basset, Yves</creatorcontrib><creatorcontrib>McFarland, Kent P</creatorcontrib><creatorcontrib>Roy, David</creatorcontrib><creatorcontrib>Høye, Toke Thomas</creatorcontrib><creatorcontrib>Larrivée, Maxim</creatorcontrib><creatorcontrib>Rolnick, David</creatorcontrib><title>Insect Identification in the Wild: The AMI Dataset</title><description>Insects represent half of all global biodiversity, yet many of the world's insects are disappearing, with severe implications for ecosystems and agriculture. Despite this crisis, data on insect diversity and abundance remain woefully inadequate, due to the scarcity of human experts and the lack of scalable tools for monitoring. Ecologists have started to adopt camera traps to record and study insects, and have proposed computer vision algorithms as an answer for scalable data processing. However, insect monitoring in the wild poses unique challenges that have not yet been addressed within computer vision, including the combination of long-tailed data, extremely similar classes, and significant distribution shifts. We provide the first large-scale machine learning benchmarks for fine-grained insect recognition, designed to match real-world tasks faced by ecologists. Our contributions include a curated dataset of images from citizen science platforms and museums, and an expert-annotated dataset drawn from automated camera traps across multiple continents, designed to test out-of-distribution generalization under field conditions. We train and evaluate a variety of baseline algorithms and introduce a combination of data augmentation techniques that enhance generalization across geographies and hardware setups.</description><subject>Computer Science - Artificial Intelligence</subject><subject>Computer Science - Computer Vision and Pattern Recognition</subject><subject>Computer Science - Learning</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotzrtuwkAQheFtKCLgAVKxL2BndrwXh84ykFgC0VhKac1erKxETGSvELw9CUl1_uroY-xZQC5LpeCFxmu85ChB5wKlwieGzTAFl3jjw5BiHx2leB54HHj6DPwjnvyatz9VHRq-oURTSAs26-k0heX_zlm727b1e7Y_vjV1tc9IG8x6jw4KY0BoExyUpKQCQF9aa6TzELTyPSoptARpXFDWvwJaTYRkhSuLOVv93T7Q3fcYv2i8db_47oEv7u0hPR4</recordid><startdate>20240618</startdate><enddate>20240618</enddate><creator>Jain, Aditya</creator><creator>Cunha, Fagner</creator><creator>Bunsen, Michael James</creator><creator>Cañas, Juan Sebastián</creator><creator>Pasi, Léonard</creator><creator>Pinoy, Nathan</creator><creator>Helsing, Flemming</creator><creator>Russo, JoAnne</creator><creator>Botham, Marc</creator><creator>Sabourin, Michael</creator><creator>Fréchette, Jonathan</creator><creator>Anctil, Alexandre</creator><creator>Lopez, Yacksecari</creator><creator>Navarro, Eduardo</creator><creator>Pimentel, Filonila Perez</creator><creator>Zamora, Ana Cecilia</creator><creator>Silva, José Alejandro Ramirez</creator><creator>Gagnon, Jonathan</creator><creator>August, Tom</creator><creator>Bjerge, Kim</creator><creator>Segura, Alba Gomez</creator><creator>Bélisle, Marc</creator><creator>Basset, Yves</creator><creator>McFarland, Kent P</creator><creator>Roy, David</creator><creator>Høye, Toke Thomas</creator><creator>Larrivée, Maxim</creator><creator>Rolnick, David</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20240618</creationdate><title>Insect Identification in the Wild: The AMI Dataset</title><author>Jain, Aditya ; Cunha, Fagner ; Bunsen, Michael James ; Cañas, Juan Sebastián ; Pasi, Léonard ; Pinoy, Nathan ; Helsing, Flemming ; Russo, JoAnne ; Botham, Marc ; Sabourin, Michael ; Fréchette, Jonathan ; Anctil, Alexandre ; Lopez, Yacksecari ; Navarro, Eduardo ; Pimentel, Filonila Perez ; Zamora, Ana Cecilia ; Silva, José Alejandro Ramirez ; Gagnon, Jonathan ; August, Tom ; Bjerge, Kim ; Segura, Alba Gomez ; Bélisle, Marc ; Basset, Yves ; McFarland, Kent P ; Roy, David ; Høye, Toke Thomas ; Larrivée, Maxim ; Rolnick, David</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a672-fd2c03770167ec08a545002d8bb74cd0e65df254164047ce5bd902b6aa2ab1c83</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Artificial Intelligence</topic><topic>Computer Science - Computer Vision and Pattern Recognition</topic><topic>Computer Science - Learning</topic><toplevel>online_resources</toplevel><creatorcontrib>Jain, Aditya</creatorcontrib><creatorcontrib>Cunha, Fagner</creatorcontrib><creatorcontrib>Bunsen, Michael James</creatorcontrib><creatorcontrib>Cañas, Juan Sebastián</creatorcontrib><creatorcontrib>Pasi, Léonard</creatorcontrib><creatorcontrib>Pinoy, Nathan</creatorcontrib><creatorcontrib>Helsing, Flemming</creatorcontrib><creatorcontrib>Russo, JoAnne</creatorcontrib><creatorcontrib>Botham, Marc</creatorcontrib><creatorcontrib>Sabourin, Michael</creatorcontrib><creatorcontrib>Fréchette, Jonathan</creatorcontrib><creatorcontrib>Anctil, Alexandre</creatorcontrib><creatorcontrib>Lopez, Yacksecari</creatorcontrib><creatorcontrib>Navarro, Eduardo</creatorcontrib><creatorcontrib>Pimentel, Filonila Perez</creatorcontrib><creatorcontrib>Zamora, Ana Cecilia</creatorcontrib><creatorcontrib>Silva, José Alejandro Ramirez</creatorcontrib><creatorcontrib>Gagnon, Jonathan</creatorcontrib><creatorcontrib>August, Tom</creatorcontrib><creatorcontrib>Bjerge, Kim</creatorcontrib><creatorcontrib>Segura, Alba Gomez</creatorcontrib><creatorcontrib>Bélisle, Marc</creatorcontrib><creatorcontrib>Basset, Yves</creatorcontrib><creatorcontrib>McFarland, Kent P</creatorcontrib><creatorcontrib>Roy, David</creatorcontrib><creatorcontrib>Høye, Toke Thomas</creatorcontrib><creatorcontrib>Larrivée, Maxim</creatorcontrib><creatorcontrib>Rolnick, David</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Jain, Aditya</au><au>Cunha, Fagner</au><au>Bunsen, Michael James</au><au>Cañas, Juan Sebastián</au><au>Pasi, Léonard</au><au>Pinoy, Nathan</au><au>Helsing, Flemming</au><au>Russo, JoAnne</au><au>Botham, Marc</au><au>Sabourin, Michael</au><au>Fréchette, Jonathan</au><au>Anctil, Alexandre</au><au>Lopez, Yacksecari</au><au>Navarro, Eduardo</au><au>Pimentel, Filonila Perez</au><au>Zamora, Ana Cecilia</au><au>Silva, José Alejandro Ramirez</au><au>Gagnon, Jonathan</au><au>August, Tom</au><au>Bjerge, Kim</au><au>Segura, Alba Gomez</au><au>Bélisle, Marc</au><au>Basset, Yves</au><au>McFarland, Kent P</au><au>Roy, David</au><au>Høye, Toke Thomas</au><au>Larrivée, Maxim</au><au>Rolnick, David</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Insect Identification in the Wild: The AMI Dataset</atitle><date>2024-06-18</date><risdate>2024</risdate><abstract>Insects represent half of all global biodiversity, yet many of the world's insects are disappearing, with severe implications for ecosystems and agriculture. Despite this crisis, data on insect diversity and abundance remain woefully inadequate, due to the scarcity of human experts and the lack of scalable tools for monitoring. Ecologists have started to adopt camera traps to record and study insects, and have proposed computer vision algorithms as an answer for scalable data processing. However, insect monitoring in the wild poses unique challenges that have not yet been addressed within computer vision, including the combination of long-tailed data, extremely similar classes, and significant distribution shifts. We provide the first large-scale machine learning benchmarks for fine-grained insect recognition, designed to match real-world tasks faced by ecologists. Our contributions include a curated dataset of images from citizen science platforms and museums, and an expert-annotated dataset drawn from automated camera traps across multiple continents, designed to test out-of-distribution generalization under field conditions. We train and evaluate a variety of baseline algorithms and introduce a combination of data augmentation techniques that enhance generalization across geographies and hardware setups.</abstract><doi>10.48550/arxiv.2406.12452</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2406.12452
ispartof
issn
language eng
recordid cdi_arxiv_primary_2406_12452
source arXiv.org
subjects Computer Science - Artificial Intelligence
Computer Science - Computer Vision and Pattern Recognition
Computer Science - Learning
title Insect Identification in the Wild: The AMI Dataset
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-01T08%3A10%3A58IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Insect%20Identification%20in%20the%20Wild:%20The%20AMI%20Dataset&rft.au=Jain,%20Aditya&rft.date=2024-06-18&rft_id=info:doi/10.48550/arxiv.2406.12452&rft_dat=%3Carxiv_GOX%3E2406_12452%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true