HODet: A New Detector for Arbitrary-Oriented Rectangular Object in Optical Remote Sensing Imagery

Object detection from remote sensing images is a key technology for Earth observation applications, which has important scientific research value. Ground objects in remote sensing images appear at arbitrary angles. However, object detection based on horizontal bounding boxes (HBBs) would cause mutua...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE journal of selected topics in applied earth observations and remote sensing 2024, Vol.17, p.2918-2926
Hauptverfasser: Xu, Lu, Yu, Jiawei, Ming, Dongping
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 2926
container_issue
container_start_page 2918
container_title IEEE journal of selected topics in applied earth observations and remote sensing
container_volume 17
creator Xu, Lu
Yu, Jiawei
Ming, Dongping
description Object detection from remote sensing images is a key technology for Earth observation applications, which has important scientific research value. Ground objects in remote sensing images appear at arbitrary angles. However, object detection based on horizontal bounding boxes (HBBs) would cause mutual coverage among targets, while the ground objects were densely distributed or with a large aspect ratio. The oriented object detection methods could solve the problem by predicting the rotation angle. But the currently used methods were time-consuming in labeling and require complex loss functions of networks. Thus, this article combined HBB and oriented object detection to achieve rectangular object detection. First, an object detection network with HBBs is trained and the model predicts results in the original remote sensing image. Second, the rotation angles are derived from the line detection with linear Hough transform on the cropped region of targets obtained by the first step. Then, the original image is rotated according to the rotation angles and detects the object with HBBs again. Finally, new bounding boxes are mapped to the original image to get the detection results with oriented bounding boxes (OBBs). Experiments on public remote sensing datasets demonstrate that the proposed method is highly flexible and can be combined with any HBBs object detection network. The idea of original image rotation does not use the OBB labels to retrain the network, which reduces the workload of object annotations. In addition, the method can be used to automatically generate OBBs to label rectangular objects since the public datasets are commonly annotated by HBBs.
doi_str_mv 10.1109/JSTARS.2024.3349596
format Article
fullrecord <record><control><sourceid>proquest_ieee_</sourceid><recordid>TN_cdi_proquest_journals_2916480380</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10380703</ieee_id><doaj_id>oai_doaj_org_article_80db6aaba61e4b17b7be27e14869b072</doaj_id><sourcerecordid>2916480380</sourcerecordid><originalsourceid>FETCH-LOGICAL-c359t-dca4ef4851ef8d54c4897c41fcffe18ef50bbfd5af59c19de2032e2ae424c08e3</originalsourceid><addsrcrecordid>eNpNUV2L2zAQFKUHl-b6C64Pgnt2TqsP27q3cL02KaGGJH0WkrwKDomdyg5H_n2VOpTCLqvd1cwODCGPwGYATD__2Gzn682MMy5nQkitdP6BTDgoyEAJ9ZFMQAudgWTynnzq-z1jOS-0mBC7qL7i8ELn9Ce-0_REP3SRhpTz6Joh2njJqthgO2BN12lr2935YCOt3D51tGlpdRoabw9pe-wGpBts-6bd0eXR7jBeHshdsIceP9_qlPz69rZ9XWSr6vvydb7KvFB6yGpvJQZZKsBQ1kp6WerCSwg-BIQSg2LOhVrZoLQHXSNngiO3KLn0rEQxJcuRt-7s3pxic0zSTWcb83fQxZ2xMQk9oClZ7XJrnc0BpYPCFQ55gSDLXDtW8MT1NHKdYvf7jP1g9t05tkm-4RpyWTKRYkrE-MvHru8jhn9XgZmrL2b0xVx9MTdfEurLiGoQ8T9EYiyYEH8ARFeKXg</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2916480380</pqid></control><display><type>article</type><title>HODet: A New Detector for Arbitrary-Oriented Rectangular Object in Optical Remote Sensing Imagery</title><source>DOAJ Directory of Open Access Journals</source><source>EZB-FREE-00999 freely available EZB journals</source><creator>Xu, Lu ; Yu, Jiawei ; Ming, Dongping</creator><creatorcontrib>Xu, Lu ; Yu, Jiawei ; Ming, Dongping</creatorcontrib><description>Object detection from remote sensing images is a key technology for Earth observation applications, which has important scientific research value. Ground objects in remote sensing images appear at arbitrary angles. However, object detection based on horizontal bounding boxes (HBBs) would cause mutual coverage among targets, while the ground objects were densely distributed or with a large aspect ratio. The oriented object detection methods could solve the problem by predicting the rotation angle. But the currently used methods were time-consuming in labeling and require complex loss functions of networks. Thus, this article combined HBB and oriented object detection to achieve rectangular object detection. First, an object detection network with HBBs is trained and the model predicts results in the original remote sensing image. Second, the rotation angles are derived from the line detection with linear Hough transform on the cropped region of targets obtained by the first step. Then, the original image is rotated according to the rotation angles and detects the object with HBBs again. Finally, new bounding boxes are mapped to the original image to get the detection results with oriented bounding boxes (OBBs). Experiments on public remote sensing datasets demonstrate that the proposed method is highly flexible and can be combined with any HBBs object detection network. The idea of original image rotation does not use the OBB labels to retrain the network, which reduces the workload of object annotations. In addition, the method can be used to automatically generate OBBs to label rectangular objects since the public datasets are commonly annotated by HBBs.</description><identifier>ISSN: 1939-1404</identifier><identifier>EISSN: 2151-1535</identifier><identifier>DOI: 10.1109/JSTARS.2024.3349596</identifier><identifier>CODEN: IJSTHZ</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Annotations ; Aspect ratio ; Boxes ; Datasets ; Deep learning ; Detection ; Detectors ; Feature extraction ; Hough transformation ; Image rotation ; Labels ; line detection ; Object detection ; Object recognition ; oriented bounding boxes (OBBs) ; Remote observing ; Remote sensing ; Rotation ; Task analysis ; Transforms</subject><ispartof>IEEE journal of selected topics in applied earth observations and remote sensing, 2024, Vol.17, p.2918-2926</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c359t-dca4ef4851ef8d54c4897c41fcffe18ef50bbfd5af59c19de2032e2ae424c08e3</cites><orcidid>0000-0002-3422-7399 ; 0009-0003-5905-5196 ; 0000-0003-3944-2175</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,860,2096,4010,27900,27901,27902</link.rule.ids></links><search><creatorcontrib>Xu, Lu</creatorcontrib><creatorcontrib>Yu, Jiawei</creatorcontrib><creatorcontrib>Ming, Dongping</creatorcontrib><title>HODet: A New Detector for Arbitrary-Oriented Rectangular Object in Optical Remote Sensing Imagery</title><title>IEEE journal of selected topics in applied earth observations and remote sensing</title><addtitle>JSTARS</addtitle><description>Object detection from remote sensing images is a key technology for Earth observation applications, which has important scientific research value. Ground objects in remote sensing images appear at arbitrary angles. However, object detection based on horizontal bounding boxes (HBBs) would cause mutual coverage among targets, while the ground objects were densely distributed or with a large aspect ratio. The oriented object detection methods could solve the problem by predicting the rotation angle. But the currently used methods were time-consuming in labeling and require complex loss functions of networks. Thus, this article combined HBB and oriented object detection to achieve rectangular object detection. First, an object detection network with HBBs is trained and the model predicts results in the original remote sensing image. Second, the rotation angles are derived from the line detection with linear Hough transform on the cropped region of targets obtained by the first step. Then, the original image is rotated according to the rotation angles and detects the object with HBBs again. Finally, new bounding boxes are mapped to the original image to get the detection results with oriented bounding boxes (OBBs). Experiments on public remote sensing datasets demonstrate that the proposed method is highly flexible and can be combined with any HBBs object detection network. The idea of original image rotation does not use the OBB labels to retrain the network, which reduces the workload of object annotations. In addition, the method can be used to automatically generate OBBs to label rectangular objects since the public datasets are commonly annotated by HBBs.</description><subject>Annotations</subject><subject>Aspect ratio</subject><subject>Boxes</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Detection</subject><subject>Detectors</subject><subject>Feature extraction</subject><subject>Hough transformation</subject><subject>Image rotation</subject><subject>Labels</subject><subject>line detection</subject><subject>Object detection</subject><subject>Object recognition</subject><subject>oriented bounding boxes (OBBs)</subject><subject>Remote observing</subject><subject>Remote sensing</subject><subject>Rotation</subject><subject>Task analysis</subject><subject>Transforms</subject><issn>1939-1404</issn><issn>2151-1535</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><sourceid>DOA</sourceid><recordid>eNpNUV2L2zAQFKUHl-b6C64Pgnt2TqsP27q3cL02KaGGJH0WkrwKDomdyg5H_n2VOpTCLqvd1cwODCGPwGYATD__2Gzn682MMy5nQkitdP6BTDgoyEAJ9ZFMQAudgWTynnzq-z1jOS-0mBC7qL7i8ELn9Ce-0_REP3SRhpTz6Joh2njJqthgO2BN12lr2935YCOt3D51tGlpdRoabw9pe-wGpBts-6bd0eXR7jBeHshdsIceP9_qlPz69rZ9XWSr6vvydb7KvFB6yGpvJQZZKsBQ1kp6WerCSwg-BIQSg2LOhVrZoLQHXSNngiO3KLn0rEQxJcuRt-7s3pxic0zSTWcb83fQxZ2xMQk9oClZ7XJrnc0BpYPCFQ55gSDLXDtW8MT1NHKdYvf7jP1g9t05tkm-4RpyWTKRYkrE-MvHru8jhn9XgZmrL2b0xVx9MTdfEurLiGoQ8T9EYiyYEH8ARFeKXg</recordid><startdate>2024</startdate><enddate>2024</enddate><creator>Xu, Lu</creator><creator>Yu, Jiawei</creator><creator>Ming, Dongping</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7UA</scope><scope>8FD</scope><scope>C1K</scope><scope>F1W</scope><scope>FR3</scope><scope>H8D</scope><scope>H96</scope><scope>KR7</scope><scope>L.G</scope><scope>L7M</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-3422-7399</orcidid><orcidid>https://orcid.org/0009-0003-5905-5196</orcidid><orcidid>https://orcid.org/0000-0003-3944-2175</orcidid></search><sort><creationdate>2024</creationdate><title>HODet: A New Detector for Arbitrary-Oriented Rectangular Object in Optical Remote Sensing Imagery</title><author>Xu, Lu ; Yu, Jiawei ; Ming, Dongping</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c359t-dca4ef4851ef8d54c4897c41fcffe18ef50bbfd5af59c19de2032e2ae424c08e3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Annotations</topic><topic>Aspect ratio</topic><topic>Boxes</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Detection</topic><topic>Detectors</topic><topic>Feature extraction</topic><topic>Hough transformation</topic><topic>Image rotation</topic><topic>Labels</topic><topic>line detection</topic><topic>Object detection</topic><topic>Object recognition</topic><topic>oriented bounding boxes (OBBs)</topic><topic>Remote observing</topic><topic>Remote sensing</topic><topic>Rotation</topic><topic>Task analysis</topic><topic>Transforms</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Xu, Lu</creatorcontrib><creatorcontrib>Yu, Jiawei</creatorcontrib><creatorcontrib>Ming, Dongping</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Water Resources Abstracts</collection><collection>Technology Research Database</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ASFA: Aquatic Sciences and Fisheries Abstracts</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>Aquatic Science &amp; Fisheries Abstracts (ASFA) 2: Ocean Technology, Policy &amp; Non-Living Resources</collection><collection>Civil Engineering Abstracts</collection><collection>Aquatic Science &amp; Fisheries Abstracts (ASFA) Professional</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE journal of selected topics in applied earth observations and remote sensing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Xu, Lu</au><au>Yu, Jiawei</au><au>Ming, Dongping</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>HODet: A New Detector for Arbitrary-Oriented Rectangular Object in Optical Remote Sensing Imagery</atitle><jtitle>IEEE journal of selected topics in applied earth observations and remote sensing</jtitle><stitle>JSTARS</stitle><date>2024</date><risdate>2024</risdate><volume>17</volume><spage>2918</spage><epage>2926</epage><pages>2918-2926</pages><issn>1939-1404</issn><eissn>2151-1535</eissn><coden>IJSTHZ</coden><abstract>Object detection from remote sensing images is a key technology for Earth observation applications, which has important scientific research value. Ground objects in remote sensing images appear at arbitrary angles. However, object detection based on horizontal bounding boxes (HBBs) would cause mutual coverage among targets, while the ground objects were densely distributed or with a large aspect ratio. The oriented object detection methods could solve the problem by predicting the rotation angle. But the currently used methods were time-consuming in labeling and require complex loss functions of networks. Thus, this article combined HBB and oriented object detection to achieve rectangular object detection. First, an object detection network with HBBs is trained and the model predicts results in the original remote sensing image. Second, the rotation angles are derived from the line detection with linear Hough transform on the cropped region of targets obtained by the first step. Then, the original image is rotated according to the rotation angles and detects the object with HBBs again. Finally, new bounding boxes are mapped to the original image to get the detection results with oriented bounding boxes (OBBs). Experiments on public remote sensing datasets demonstrate that the proposed method is highly flexible and can be combined with any HBBs object detection network. The idea of original image rotation does not use the OBB labels to retrain the network, which reduces the workload of object annotations. In addition, the method can be used to automatically generate OBBs to label rectangular objects since the public datasets are commonly annotated by HBBs.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/JSTARS.2024.3349596</doi><tpages>9</tpages><orcidid>https://orcid.org/0000-0002-3422-7399</orcidid><orcidid>https://orcid.org/0009-0003-5905-5196</orcidid><orcidid>https://orcid.org/0000-0003-3944-2175</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1939-1404
ispartof IEEE journal of selected topics in applied earth observations and remote sensing, 2024, Vol.17, p.2918-2926
issn 1939-1404
2151-1535
language eng
recordid cdi_proquest_journals_2916480380
source DOAJ Directory of Open Access Journals; EZB-FREE-00999 freely available EZB journals
subjects Annotations
Aspect ratio
Boxes
Datasets
Deep learning
Detection
Detectors
Feature extraction
Hough transformation
Image rotation
Labels
line detection
Object detection
Object recognition
oriented bounding boxes (OBBs)
Remote observing
Remote sensing
Rotation
Task analysis
Transforms
title HODet: A New Detector for Arbitrary-Oriented Rectangular Object in Optical Remote Sensing Imagery
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-07T22%3A03%3A03IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_ieee_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=HODet:%20A%20New%20Detector%20for%20Arbitrary-Oriented%20Rectangular%20Object%20in%20Optical%20Remote%20Sensing%20Imagery&rft.jtitle=IEEE%20journal%20of%20selected%20topics%20in%20applied%20earth%20observations%20and%20remote%20sensing&rft.au=Xu,%20Lu&rft.date=2024&rft.volume=17&rft.spage=2918&rft.epage=2926&rft.pages=2918-2926&rft.issn=1939-1404&rft.eissn=2151-1535&rft.coden=IJSTHZ&rft_id=info:doi/10.1109/JSTARS.2024.3349596&rft_dat=%3Cproquest_ieee_%3E2916480380%3C/proquest_ieee_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2916480380&rft_id=info:pmid/&rft_ieee_id=10380703&rft_doaj_id=oai_doaj_org_article_80db6aaba61e4b17b7be27e14869b072&rfr_iscdi=true