Benchmarking YOLOv5 and YOLOv7 models with DeepSORT for droplet tracking applications

Tracking droplets in microfluidics is a challenging task. The difficulty arises in choosing a tool to analyze general microfluidic videos to infer physical quantities. The state-of-the-art object detector algorithm You Only Look Once (YOLO) and the object tracking algorithm Simple Online and Realtim...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Durve, Mihir, Orsini, Sibilla, Tiribocchi, Adriano, Montessori, Andrea, Tucny, Jean-Michel, Lauricella, Marco, Camposeo, Andrea, Pisignano, Dario, Succi, Sauro
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Durve, Mihir
Orsini, Sibilla
Tiribocchi, Adriano
Montessori, Andrea
Tucny, Jean-Michel
Lauricella, Marco
Camposeo, Andrea
Pisignano, Dario
Succi, Sauro
description Tracking droplets in microfluidics is a challenging task. The difficulty arises in choosing a tool to analyze general microfluidic videos to infer physical quantities. The state-of-the-art object detector algorithm You Only Look Once (YOLO) and the object tracking algorithm Simple Online and Realtime Tracking with a Deep Association Metric (DeepSORT) are customizable for droplet identification and tracking. The customization includes training YOLO and DeepSORT networks to identify and track the objects of interest. We trained several YOLOv5 and YOLOv7 models and the DeepSORT network for droplet identification and tracking from microfluidic experimental videos. We compare the performance of the droplet tracking applications with YOLOv5 and YOLOv7 in terms of training time and time to analyze a given video across various hardware configurations. Despite the latest YOLOv7 being 10% faster, the real-time tracking is only achieved by lighter YOLO models on RTX 3070 Ti GPU machine due to additional significant droplet tracking costs arising from the DeepSORT algorithm. This work is a benchmark study for the YOLOv5 and YOLOv7 networks with DeepSORT in terms of the training time and inference time for a custom dataset of microfluidic droplets.
doi_str_mv 10.48550/arxiv.2301.08189
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2301_08189</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2301_08189</sourcerecordid><originalsourceid>FETCH-LOGICAL-a679-cdb52886d182ab2faf637329ffa91105698e78bfbe2185d1b41e35474726623e3</originalsourceid><addsrcrecordid>eNotz7lOxDAYBGA3FGjhAajwCyT4iK8SllOKFAlCQRX9jm3WIptYTrTA2wNZqplmRvoQuqCkrLQQ5AryVzyUjBNaEk21OUWvN37sd3vIH3F8x29N3RwEhtEdq8L7yflhxp9x2eFb79NL89ziMGXs8pQGv-AlQ79uIaUh9rDEaZzP0EmAYfbn_7lB7f1du30s6ubhaXtdFyCVKXpnBdNaOqoZWBYgSK44MyGAoZQIabRX2gbrGdXCUVtRz0WlKsWkZNzzDbo83q6uLuX4C_nu_nzd6uM_O_hKHQ</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Benchmarking YOLOv5 and YOLOv7 models with DeepSORT for droplet tracking applications</title><source>arXiv.org</source><creator>Durve, Mihir ; Orsini, Sibilla ; Tiribocchi, Adriano ; Montessori, Andrea ; Tucny, Jean-Michel ; Lauricella, Marco ; Camposeo, Andrea ; Pisignano, Dario ; Succi, Sauro</creator><creatorcontrib>Durve, Mihir ; Orsini, Sibilla ; Tiribocchi, Adriano ; Montessori, Andrea ; Tucny, Jean-Michel ; Lauricella, Marco ; Camposeo, Andrea ; Pisignano, Dario ; Succi, Sauro</creatorcontrib><description>Tracking droplets in microfluidics is a challenging task. The difficulty arises in choosing a tool to analyze general microfluidic videos to infer physical quantities. The state-of-the-art object detector algorithm You Only Look Once (YOLO) and the object tracking algorithm Simple Online and Realtime Tracking with a Deep Association Metric (DeepSORT) are customizable for droplet identification and tracking. The customization includes training YOLO and DeepSORT networks to identify and track the objects of interest. We trained several YOLOv5 and YOLOv7 models and the DeepSORT network for droplet identification and tracking from microfluidic experimental videos. We compare the performance of the droplet tracking applications with YOLOv5 and YOLOv7 in terms of training time and time to analyze a given video across various hardware configurations. Despite the latest YOLOv7 being 10% faster, the real-time tracking is only achieved by lighter YOLO models on RTX 3070 Ti GPU machine due to additional significant droplet tracking costs arising from the DeepSORT algorithm. This work is a benchmark study for the YOLOv5 and YOLOv7 networks with DeepSORT in terms of the training time and inference time for a custom dataset of microfluidic droplets.</description><identifier>DOI: 10.48550/arxiv.2301.08189</identifier><language>eng</language><subject>Computer Science - Computer Vision and Pattern Recognition ; Physics - Fluid Dynamics</subject><creationdate>2023-01</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,881</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2301.08189$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2301.08189$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Durve, Mihir</creatorcontrib><creatorcontrib>Orsini, Sibilla</creatorcontrib><creatorcontrib>Tiribocchi, Adriano</creatorcontrib><creatorcontrib>Montessori, Andrea</creatorcontrib><creatorcontrib>Tucny, Jean-Michel</creatorcontrib><creatorcontrib>Lauricella, Marco</creatorcontrib><creatorcontrib>Camposeo, Andrea</creatorcontrib><creatorcontrib>Pisignano, Dario</creatorcontrib><creatorcontrib>Succi, Sauro</creatorcontrib><title>Benchmarking YOLOv5 and YOLOv7 models with DeepSORT for droplet tracking applications</title><description>Tracking droplets in microfluidics is a challenging task. The difficulty arises in choosing a tool to analyze general microfluidic videos to infer physical quantities. The state-of-the-art object detector algorithm You Only Look Once (YOLO) and the object tracking algorithm Simple Online and Realtime Tracking with a Deep Association Metric (DeepSORT) are customizable for droplet identification and tracking. The customization includes training YOLO and DeepSORT networks to identify and track the objects of interest. We trained several YOLOv5 and YOLOv7 models and the DeepSORT network for droplet identification and tracking from microfluidic experimental videos. We compare the performance of the droplet tracking applications with YOLOv5 and YOLOv7 in terms of training time and time to analyze a given video across various hardware configurations. Despite the latest YOLOv7 being 10% faster, the real-time tracking is only achieved by lighter YOLO models on RTX 3070 Ti GPU machine due to additional significant droplet tracking costs arising from the DeepSORT algorithm. This work is a benchmark study for the YOLOv5 and YOLOv7 networks with DeepSORT in terms of the training time and inference time for a custom dataset of microfluidic droplets.</description><subject>Computer Science - Computer Vision and Pattern Recognition</subject><subject>Physics - Fluid Dynamics</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotz7lOxDAYBGA3FGjhAajwCyT4iK8SllOKFAlCQRX9jm3WIptYTrTA2wNZqplmRvoQuqCkrLQQ5AryVzyUjBNaEk21OUWvN37sd3vIH3F8x29N3RwEhtEdq8L7yflhxp9x2eFb79NL89ziMGXs8pQGv-AlQ79uIaUh9rDEaZzP0EmAYfbn_7lB7f1du30s6ubhaXtdFyCVKXpnBdNaOqoZWBYgSK44MyGAoZQIabRX2gbrGdXCUVtRz0WlKsWkZNzzDbo83q6uLuX4C_nu_nzd6uM_O_hKHQ</recordid><startdate>20230119</startdate><enddate>20230119</enddate><creator>Durve, Mihir</creator><creator>Orsini, Sibilla</creator><creator>Tiribocchi, Adriano</creator><creator>Montessori, Andrea</creator><creator>Tucny, Jean-Michel</creator><creator>Lauricella, Marco</creator><creator>Camposeo, Andrea</creator><creator>Pisignano, Dario</creator><creator>Succi, Sauro</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20230119</creationdate><title>Benchmarking YOLOv5 and YOLOv7 models with DeepSORT for droplet tracking applications</title><author>Durve, Mihir ; Orsini, Sibilla ; Tiribocchi, Adriano ; Montessori, Andrea ; Tucny, Jean-Michel ; Lauricella, Marco ; Camposeo, Andrea ; Pisignano, Dario ; Succi, Sauro</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a679-cdb52886d182ab2faf637329ffa91105698e78bfbe2185d1b41e35474726623e3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Computer Science - Computer Vision and Pattern Recognition</topic><topic>Physics - Fluid Dynamics</topic><toplevel>online_resources</toplevel><creatorcontrib>Durve, Mihir</creatorcontrib><creatorcontrib>Orsini, Sibilla</creatorcontrib><creatorcontrib>Tiribocchi, Adriano</creatorcontrib><creatorcontrib>Montessori, Andrea</creatorcontrib><creatorcontrib>Tucny, Jean-Michel</creatorcontrib><creatorcontrib>Lauricella, Marco</creatorcontrib><creatorcontrib>Camposeo, Andrea</creatorcontrib><creatorcontrib>Pisignano, Dario</creatorcontrib><creatorcontrib>Succi, Sauro</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Durve, Mihir</au><au>Orsini, Sibilla</au><au>Tiribocchi, Adriano</au><au>Montessori, Andrea</au><au>Tucny, Jean-Michel</au><au>Lauricella, Marco</au><au>Camposeo, Andrea</au><au>Pisignano, Dario</au><au>Succi, Sauro</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Benchmarking YOLOv5 and YOLOv7 models with DeepSORT for droplet tracking applications</atitle><date>2023-01-19</date><risdate>2023</risdate><abstract>Tracking droplets in microfluidics is a challenging task. The difficulty arises in choosing a tool to analyze general microfluidic videos to infer physical quantities. The state-of-the-art object detector algorithm You Only Look Once (YOLO) and the object tracking algorithm Simple Online and Realtime Tracking with a Deep Association Metric (DeepSORT) are customizable for droplet identification and tracking. The customization includes training YOLO and DeepSORT networks to identify and track the objects of interest. We trained several YOLOv5 and YOLOv7 models and the DeepSORT network for droplet identification and tracking from microfluidic experimental videos. We compare the performance of the droplet tracking applications with YOLOv5 and YOLOv7 in terms of training time and time to analyze a given video across various hardware configurations. Despite the latest YOLOv7 being 10% faster, the real-time tracking is only achieved by lighter YOLO models on RTX 3070 Ti GPU machine due to additional significant droplet tracking costs arising from the DeepSORT algorithm. This work is a benchmark study for the YOLOv5 and YOLOv7 networks with DeepSORT in terms of the training time and inference time for a custom dataset of microfluidic droplets.</abstract><doi>10.48550/arxiv.2301.08189</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2301.08189
ispartof
issn
language eng
recordid cdi_arxiv_primary_2301_08189
source arXiv.org
subjects Computer Science - Computer Vision and Pattern Recognition
Physics - Fluid Dynamics
title Benchmarking YOLOv5 and YOLOv7 models with DeepSORT for droplet tracking applications
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-21T17%3A01%3A53IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Benchmarking%20YOLOv5%20and%20YOLOv7%20models%20with%20DeepSORT%20for%20droplet%20tracking%20applications&rft.au=Durve,%20Mihir&rft.date=2023-01-19&rft_id=info:doi/10.48550/arxiv.2301.08189&rft_dat=%3Carxiv_GOX%3E2301_08189%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true