Adaptive Data Transport Mechanism for UAV Surveillance Missions in Lossy Environments
Unmanned Aerial Vehicles (UAVs) play an increasingly critical role in Intelligence, Surveillance, and Reconnaissance (ISR) missions such as border patrolling and criminal detection, thanks to their ability to access remote areas and transmit real-time imagery to processing servers. However, UAVs are...
Gespeichert in:
Hauptverfasser: | , , , , , , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | |
container_volume | |
creator | Mehrabi, Niloufar Boroujeni, Sayed Pedram Haeri Hofseth, Jenna Razi, Abolfazl Cheng, Long Kaur, Manveen Martin, James Amin, Rahul |
description | Unmanned Aerial Vehicles (UAVs) play an increasingly critical role in
Intelligence, Surveillance, and Reconnaissance (ISR) missions such as border
patrolling and criminal detection, thanks to their ability to access remote
areas and transmit real-time imagery to processing servers. However, UAVs are
highly constrained by payload size, power limits, and communication bandwidth,
necessitating the development of highly selective and efficient data
transmission strategies. This has driven the development of various compression
and optimal transmission technologies for UAVs. Nevertheless, most methods
strive to preserve maximal information in transferred video frames, missing the
fact that only certain parts of images/video frames might offer meaningful
contributions to the ultimate mission objectives in the ISR scenarios involving
moving object detection and tracking (OD/OT). This paper adopts a different
perspective, and offers an alternative AI-driven scheduling policy that
prioritizes selecting regions of the image that significantly contributes to
the mission objective. The key idea is tiling the image into small patches and
developing a deep reinforcement learning (DRL) framework that assigns higher
transmission probabilities to patches that present higher overlaps with the
detected object of interest, while penalizing sharp transitions over
consecutive frames to promote smooth scheduling shifts. Although we used
Yolov-8 object detection and UDP transmission protocols as a benchmark testing
scenario the idea is general and applicable to different transmission protocols
and OD/OT methods. To further boost the system's performance and avoid OD
errors for cluttered image patches, we integrate it with interframe
interpolations. |
doi_str_mv | 10.48550/arxiv.2410.10843 |
format | Article |
fullrecord | <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2410_10843</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2410_10843</sourcerecordid><originalsourceid>FETCH-arxiv_primary_2410_108433</originalsourceid><addsrcrecordid>eNqFzjEOgkAQheFtLIx6ACvnAiIIJLREMRZSCbZkgkucBHbJzErk9iqxt3rJn1d8Sq0D34uSOPZ3yC8avH30CYGfROFclekde0eDhiM6hILRSG_ZQa7rBxqSDhrLUKY3uD550NS2aGoNOYmQNQJk4GJFRsjMQGxNp42TpZo12Ipe_XahNqesOJy3E6DqmTrksfpCqgkS_n-8AUz8PoY</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Adaptive Data Transport Mechanism for UAV Surveillance Missions in Lossy Environments</title><source>arXiv.org</source><creator>Mehrabi, Niloufar ; Boroujeni, Sayed Pedram Haeri ; Hofseth, Jenna ; Razi, Abolfazl ; Cheng, Long ; Kaur, Manveen ; Martin, James ; Amin, Rahul</creator><creatorcontrib>Mehrabi, Niloufar ; Boroujeni, Sayed Pedram Haeri ; Hofseth, Jenna ; Razi, Abolfazl ; Cheng, Long ; Kaur, Manveen ; Martin, James ; Amin, Rahul</creatorcontrib><description>Unmanned Aerial Vehicles (UAVs) play an increasingly critical role in
Intelligence, Surveillance, and Reconnaissance (ISR) missions such as border
patrolling and criminal detection, thanks to their ability to access remote
areas and transmit real-time imagery to processing servers. However, UAVs are
highly constrained by payload size, power limits, and communication bandwidth,
necessitating the development of highly selective and efficient data
transmission strategies. This has driven the development of various compression
and optimal transmission technologies for UAVs. Nevertheless, most methods
strive to preserve maximal information in transferred video frames, missing the
fact that only certain parts of images/video frames might offer meaningful
contributions to the ultimate mission objectives in the ISR scenarios involving
moving object detection and tracking (OD/OT). This paper adopts a different
perspective, and offers an alternative AI-driven scheduling policy that
prioritizes selecting regions of the image that significantly contributes to
the mission objective. The key idea is tiling the image into small patches and
developing a deep reinforcement learning (DRL) framework that assigns higher
transmission probabilities to patches that present higher overlaps with the
detected object of interest, while penalizing sharp transitions over
consecutive frames to promote smooth scheduling shifts. Although we used
Yolov-8 object detection and UDP transmission protocols as a benchmark testing
scenario the idea is general and applicable to different transmission protocols
and OD/OT methods. To further boost the system's performance and avoid OD
errors for cluttered image patches, we integrate it with interframe
interpolations.</description><identifier>DOI: 10.48550/arxiv.2410.10843</identifier><language>eng</language><subject>Computer Science - Computer Vision and Pattern Recognition</subject><creationdate>2024-09</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,881</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2410.10843$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2410.10843$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Mehrabi, Niloufar</creatorcontrib><creatorcontrib>Boroujeni, Sayed Pedram Haeri</creatorcontrib><creatorcontrib>Hofseth, Jenna</creatorcontrib><creatorcontrib>Razi, Abolfazl</creatorcontrib><creatorcontrib>Cheng, Long</creatorcontrib><creatorcontrib>Kaur, Manveen</creatorcontrib><creatorcontrib>Martin, James</creatorcontrib><creatorcontrib>Amin, Rahul</creatorcontrib><title>Adaptive Data Transport Mechanism for UAV Surveillance Missions in Lossy Environments</title><description>Unmanned Aerial Vehicles (UAVs) play an increasingly critical role in
Intelligence, Surveillance, and Reconnaissance (ISR) missions such as border
patrolling and criminal detection, thanks to their ability to access remote
areas and transmit real-time imagery to processing servers. However, UAVs are
highly constrained by payload size, power limits, and communication bandwidth,
necessitating the development of highly selective and efficient data
transmission strategies. This has driven the development of various compression
and optimal transmission technologies for UAVs. Nevertheless, most methods
strive to preserve maximal information in transferred video frames, missing the
fact that only certain parts of images/video frames might offer meaningful
contributions to the ultimate mission objectives in the ISR scenarios involving
moving object detection and tracking (OD/OT). This paper adopts a different
perspective, and offers an alternative AI-driven scheduling policy that
prioritizes selecting regions of the image that significantly contributes to
the mission objective. The key idea is tiling the image into small patches and
developing a deep reinforcement learning (DRL) framework that assigns higher
transmission probabilities to patches that present higher overlaps with the
detected object of interest, while penalizing sharp transitions over
consecutive frames to promote smooth scheduling shifts. Although we used
Yolov-8 object detection and UDP transmission protocols as a benchmark testing
scenario the idea is general and applicable to different transmission protocols
and OD/OT methods. To further boost the system's performance and avoid OD
errors for cluttered image patches, we integrate it with interframe
interpolations.</description><subject>Computer Science - Computer Vision and Pattern Recognition</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNqFzjEOgkAQheFtLIx6ACvnAiIIJLREMRZSCbZkgkucBHbJzErk9iqxt3rJn1d8Sq0D34uSOPZ3yC8avH30CYGfROFclekde0eDhiM6hILRSG_ZQa7rBxqSDhrLUKY3uD550NS2aGoNOYmQNQJk4GJFRsjMQGxNp42TpZo12Ipe_XahNqesOJy3E6DqmTrksfpCqgkS_n-8AUz8PoY</recordid><startdate>20240930</startdate><enddate>20240930</enddate><creator>Mehrabi, Niloufar</creator><creator>Boroujeni, Sayed Pedram Haeri</creator><creator>Hofseth, Jenna</creator><creator>Razi, Abolfazl</creator><creator>Cheng, Long</creator><creator>Kaur, Manveen</creator><creator>Martin, James</creator><creator>Amin, Rahul</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20240930</creationdate><title>Adaptive Data Transport Mechanism for UAV Surveillance Missions in Lossy Environments</title><author>Mehrabi, Niloufar ; Boroujeni, Sayed Pedram Haeri ; Hofseth, Jenna ; Razi, Abolfazl ; Cheng, Long ; Kaur, Manveen ; Martin, James ; Amin, Rahul</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-arxiv_primary_2410_108433</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Computer Vision and Pattern Recognition</topic><toplevel>online_resources</toplevel><creatorcontrib>Mehrabi, Niloufar</creatorcontrib><creatorcontrib>Boroujeni, Sayed Pedram Haeri</creatorcontrib><creatorcontrib>Hofseth, Jenna</creatorcontrib><creatorcontrib>Razi, Abolfazl</creatorcontrib><creatorcontrib>Cheng, Long</creatorcontrib><creatorcontrib>Kaur, Manveen</creatorcontrib><creatorcontrib>Martin, James</creatorcontrib><creatorcontrib>Amin, Rahul</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Mehrabi, Niloufar</au><au>Boroujeni, Sayed Pedram Haeri</au><au>Hofseth, Jenna</au><au>Razi, Abolfazl</au><au>Cheng, Long</au><au>Kaur, Manveen</au><au>Martin, James</au><au>Amin, Rahul</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Adaptive Data Transport Mechanism for UAV Surveillance Missions in Lossy Environments</atitle><date>2024-09-30</date><risdate>2024</risdate><abstract>Unmanned Aerial Vehicles (UAVs) play an increasingly critical role in
Intelligence, Surveillance, and Reconnaissance (ISR) missions such as border
patrolling and criminal detection, thanks to their ability to access remote
areas and transmit real-time imagery to processing servers. However, UAVs are
highly constrained by payload size, power limits, and communication bandwidth,
necessitating the development of highly selective and efficient data
transmission strategies. This has driven the development of various compression
and optimal transmission technologies for UAVs. Nevertheless, most methods
strive to preserve maximal information in transferred video frames, missing the
fact that only certain parts of images/video frames might offer meaningful
contributions to the ultimate mission objectives in the ISR scenarios involving
moving object detection and tracking (OD/OT). This paper adopts a different
perspective, and offers an alternative AI-driven scheduling policy that
prioritizes selecting regions of the image that significantly contributes to
the mission objective. The key idea is tiling the image into small patches and
developing a deep reinforcement learning (DRL) framework that assigns higher
transmission probabilities to patches that present higher overlaps with the
detected object of interest, while penalizing sharp transitions over
consecutive frames to promote smooth scheduling shifts. Although we used
Yolov-8 object detection and UDP transmission protocols as a benchmark testing
scenario the idea is general and applicable to different transmission protocols
and OD/OT methods. To further boost the system's performance and avoid OD
errors for cluttered image patches, we integrate it with interframe
interpolations.</abstract><doi>10.48550/arxiv.2410.10843</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | DOI: 10.48550/arxiv.2410.10843 |
ispartof | |
issn | |
language | eng |
recordid | cdi_arxiv_primary_2410_10843 |
source | arXiv.org |
subjects | Computer Science - Computer Vision and Pattern Recognition |
title | Adaptive Data Transport Mechanism for UAV Surveillance Missions in Lossy Environments |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-15T01%3A25%3A24IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Adaptive%20Data%20Transport%20Mechanism%20for%20UAV%20Surveillance%20Missions%20in%20Lossy%20Environments&rft.au=Mehrabi,%20Niloufar&rft.date=2024-09-30&rft_id=info:doi/10.48550/arxiv.2410.10843&rft_dat=%3Carxiv_GOX%3E2410_10843%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |