HODet: A New Detector for Arbitrary-Oriented Rectangular Object in Optical Remote Sensing Imagery
Object detection from remote sensing images is a key technology for Earth observation applications, which has important scientific research value. Ground objects in remote sensing images appear at arbitrary angles. However, object detection based on horizontal bounding boxes (HBBs) would cause mutua...
Gespeichert in:
Veröffentlicht in: | IEEE journal of selected topics in applied earth observations and remote sensing 2024, Vol.17, p.2918-2926 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 2926 |
---|---|
container_issue | |
container_start_page | 2918 |
container_title | IEEE journal of selected topics in applied earth observations and remote sensing |
container_volume | 17 |
creator | Xu, Lu Yu, Jiawei Ming, Dongping |
description | Object detection from remote sensing images is a key technology for Earth observation applications, which has important scientific research value. Ground objects in remote sensing images appear at arbitrary angles. However, object detection based on horizontal bounding boxes (HBBs) would cause mutual coverage among targets, while the ground objects were densely distributed or with a large aspect ratio. The oriented object detection methods could solve the problem by predicting the rotation angle. But the currently used methods were time-consuming in labeling and require complex loss functions of networks. Thus, this article combined HBB and oriented object detection to achieve rectangular object detection. First, an object detection network with HBBs is trained and the model predicts results in the original remote sensing image. Second, the rotation angles are derived from the line detection with linear Hough transform on the cropped region of targets obtained by the first step. Then, the original image is rotated according to the rotation angles and detects the object with HBBs again. Finally, new bounding boxes are mapped to the original image to get the detection results with oriented bounding boxes (OBBs). Experiments on public remote sensing datasets demonstrate that the proposed method is highly flexible and can be combined with any HBBs object detection network. The idea of original image rotation does not use the OBB labels to retrain the network, which reduces the workload of object annotations. In addition, the method can be used to automatically generate OBBs to label rectangular objects since the public datasets are commonly annotated by HBBs. |
doi_str_mv | 10.1109/JSTARS.2024.3349596 |
format | Article |
fullrecord | <record><control><sourceid>proquest_ieee_</sourceid><recordid>TN_cdi_proquest_journals_2916480380</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10380703</ieee_id><doaj_id>oai_doaj_org_article_80db6aaba61e4b17b7be27e14869b072</doaj_id><sourcerecordid>2916480380</sourcerecordid><originalsourceid>FETCH-LOGICAL-c359t-dca4ef4851ef8d54c4897c41fcffe18ef50bbfd5af59c19de2032e2ae424c08e3</originalsourceid><addsrcrecordid>eNpNUV2L2zAQFKUHl-b6C64Pgnt2TqsP27q3cL02KaGGJH0WkrwKDomdyg5H_n2VOpTCLqvd1cwODCGPwGYATD__2Gzn682MMy5nQkitdP6BTDgoyEAJ9ZFMQAudgWTynnzq-z1jOS-0mBC7qL7i8ELn9Ce-0_REP3SRhpTz6Joh2njJqthgO2BN12lr2935YCOt3D51tGlpdRoabw9pe-wGpBts-6bd0eXR7jBeHshdsIceP9_qlPz69rZ9XWSr6vvydb7KvFB6yGpvJQZZKsBQ1kp6WerCSwg-BIQSg2LOhVrZoLQHXSNngiO3KLn0rEQxJcuRt-7s3pxic0zSTWcb83fQxZ2xMQk9oClZ7XJrnc0BpYPCFQ55gSDLXDtW8MT1NHKdYvf7jP1g9t05tkm-4RpyWTKRYkrE-MvHru8jhn9XgZmrL2b0xVx9MTdfEurLiGoQ8T9EYiyYEH8ARFeKXg</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2916480380</pqid></control><display><type>article</type><title>HODet: A New Detector for Arbitrary-Oriented Rectangular Object in Optical Remote Sensing Imagery</title><source>DOAJ Directory of Open Access Journals</source><source>EZB-FREE-00999 freely available EZB journals</source><creator>Xu, Lu ; Yu, Jiawei ; Ming, Dongping</creator><creatorcontrib>Xu, Lu ; Yu, Jiawei ; Ming, Dongping</creatorcontrib><description>Object detection from remote sensing images is a key technology for Earth observation applications, which has important scientific research value. Ground objects in remote sensing images appear at arbitrary angles. However, object detection based on horizontal bounding boxes (HBBs) would cause mutual coverage among targets, while the ground objects were densely distributed or with a large aspect ratio. The oriented object detection methods could solve the problem by predicting the rotation angle. But the currently used methods were time-consuming in labeling and require complex loss functions of networks. Thus, this article combined HBB and oriented object detection to achieve rectangular object detection. First, an object detection network with HBBs is trained and the model predicts results in the original remote sensing image. Second, the rotation angles are derived from the line detection with linear Hough transform on the cropped region of targets obtained by the first step. Then, the original image is rotated according to the rotation angles and detects the object with HBBs again. Finally, new bounding boxes are mapped to the original image to get the detection results with oriented bounding boxes (OBBs). Experiments on public remote sensing datasets demonstrate that the proposed method is highly flexible and can be combined with any HBBs object detection network. The idea of original image rotation does not use the OBB labels to retrain the network, which reduces the workload of object annotations. In addition, the method can be used to automatically generate OBBs to label rectangular objects since the public datasets are commonly annotated by HBBs.</description><identifier>ISSN: 1939-1404</identifier><identifier>EISSN: 2151-1535</identifier><identifier>DOI: 10.1109/JSTARS.2024.3349596</identifier><identifier>CODEN: IJSTHZ</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Annotations ; Aspect ratio ; Boxes ; Datasets ; Deep learning ; Detection ; Detectors ; Feature extraction ; Hough transformation ; Image rotation ; Labels ; line detection ; Object detection ; Object recognition ; oriented bounding boxes (OBBs) ; Remote observing ; Remote sensing ; Rotation ; Task analysis ; Transforms</subject><ispartof>IEEE journal of selected topics in applied earth observations and remote sensing, 2024, Vol.17, p.2918-2926</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c359t-dca4ef4851ef8d54c4897c41fcffe18ef50bbfd5af59c19de2032e2ae424c08e3</cites><orcidid>0000-0002-3422-7399 ; 0009-0003-5905-5196 ; 0000-0003-3944-2175</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,860,2096,4010,27900,27901,27902</link.rule.ids></links><search><creatorcontrib>Xu, Lu</creatorcontrib><creatorcontrib>Yu, Jiawei</creatorcontrib><creatorcontrib>Ming, Dongping</creatorcontrib><title>HODet: A New Detector for Arbitrary-Oriented Rectangular Object in Optical Remote Sensing Imagery</title><title>IEEE journal of selected topics in applied earth observations and remote sensing</title><addtitle>JSTARS</addtitle><description>Object detection from remote sensing images is a key technology for Earth observation applications, which has important scientific research value. Ground objects in remote sensing images appear at arbitrary angles. However, object detection based on horizontal bounding boxes (HBBs) would cause mutual coverage among targets, while the ground objects were densely distributed or with a large aspect ratio. The oriented object detection methods could solve the problem by predicting the rotation angle. But the currently used methods were time-consuming in labeling and require complex loss functions of networks. Thus, this article combined HBB and oriented object detection to achieve rectangular object detection. First, an object detection network with HBBs is trained and the model predicts results in the original remote sensing image. Second, the rotation angles are derived from the line detection with linear Hough transform on the cropped region of targets obtained by the first step. Then, the original image is rotated according to the rotation angles and detects the object with HBBs again. Finally, new bounding boxes are mapped to the original image to get the detection results with oriented bounding boxes (OBBs). Experiments on public remote sensing datasets demonstrate that the proposed method is highly flexible and can be combined with any HBBs object detection network. The idea of original image rotation does not use the OBB labels to retrain the network, which reduces the workload of object annotations. In addition, the method can be used to automatically generate OBBs to label rectangular objects since the public datasets are commonly annotated by HBBs.</description><subject>Annotations</subject><subject>Aspect ratio</subject><subject>Boxes</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Detection</subject><subject>Detectors</subject><subject>Feature extraction</subject><subject>Hough transformation</subject><subject>Image rotation</subject><subject>Labels</subject><subject>line detection</subject><subject>Object detection</subject><subject>Object recognition</subject><subject>oriented bounding boxes (OBBs)</subject><subject>Remote observing</subject><subject>Remote sensing</subject><subject>Rotation</subject><subject>Task analysis</subject><subject>Transforms</subject><issn>1939-1404</issn><issn>2151-1535</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><sourceid>DOA</sourceid><recordid>eNpNUV2L2zAQFKUHl-b6C64Pgnt2TqsP27q3cL02KaGGJH0WkrwKDomdyg5H_n2VOpTCLqvd1cwODCGPwGYATD__2Gzn682MMy5nQkitdP6BTDgoyEAJ9ZFMQAudgWTynnzq-z1jOS-0mBC7qL7i8ELn9Ce-0_REP3SRhpTz6Joh2njJqthgO2BN12lr2935YCOt3D51tGlpdRoabw9pe-wGpBts-6bd0eXR7jBeHshdsIceP9_qlPz69rZ9XWSr6vvydb7KvFB6yGpvJQZZKsBQ1kp6WerCSwg-BIQSg2LOhVrZoLQHXSNngiO3KLn0rEQxJcuRt-7s3pxic0zSTWcb83fQxZ2xMQk9oClZ7XJrnc0BpYPCFQ55gSDLXDtW8MT1NHKdYvf7jP1g9t05tkm-4RpyWTKRYkrE-MvHru8jhn9XgZmrL2b0xVx9MTdfEurLiGoQ8T9EYiyYEH8ARFeKXg</recordid><startdate>2024</startdate><enddate>2024</enddate><creator>Xu, Lu</creator><creator>Yu, Jiawei</creator><creator>Ming, Dongping</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7UA</scope><scope>8FD</scope><scope>C1K</scope><scope>F1W</scope><scope>FR3</scope><scope>H8D</scope><scope>H96</scope><scope>KR7</scope><scope>L.G</scope><scope>L7M</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-3422-7399</orcidid><orcidid>https://orcid.org/0009-0003-5905-5196</orcidid><orcidid>https://orcid.org/0000-0003-3944-2175</orcidid></search><sort><creationdate>2024</creationdate><title>HODet: A New Detector for Arbitrary-Oriented Rectangular Object in Optical Remote Sensing Imagery</title><author>Xu, Lu ; Yu, Jiawei ; Ming, Dongping</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c359t-dca4ef4851ef8d54c4897c41fcffe18ef50bbfd5af59c19de2032e2ae424c08e3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Annotations</topic><topic>Aspect ratio</topic><topic>Boxes</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Detection</topic><topic>Detectors</topic><topic>Feature extraction</topic><topic>Hough transformation</topic><topic>Image rotation</topic><topic>Labels</topic><topic>line detection</topic><topic>Object detection</topic><topic>Object recognition</topic><topic>oriented bounding boxes (OBBs)</topic><topic>Remote observing</topic><topic>Remote sensing</topic><topic>Rotation</topic><topic>Task analysis</topic><topic>Transforms</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Xu, Lu</creatorcontrib><creatorcontrib>Yu, Jiawei</creatorcontrib><creatorcontrib>Ming, Dongping</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Water Resources Abstracts</collection><collection>Technology Research Database</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ASFA: Aquatic Sciences and Fisheries Abstracts</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>Aquatic Science & Fisheries Abstracts (ASFA) 2: Ocean Technology, Policy & Non-Living Resources</collection><collection>Civil Engineering Abstracts</collection><collection>Aquatic Science & Fisheries Abstracts (ASFA) Professional</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE journal of selected topics in applied earth observations and remote sensing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Xu, Lu</au><au>Yu, Jiawei</au><au>Ming, Dongping</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>HODet: A New Detector for Arbitrary-Oriented Rectangular Object in Optical Remote Sensing Imagery</atitle><jtitle>IEEE journal of selected topics in applied earth observations and remote sensing</jtitle><stitle>JSTARS</stitle><date>2024</date><risdate>2024</risdate><volume>17</volume><spage>2918</spage><epage>2926</epage><pages>2918-2926</pages><issn>1939-1404</issn><eissn>2151-1535</eissn><coden>IJSTHZ</coden><abstract>Object detection from remote sensing images is a key technology for Earth observation applications, which has important scientific research value. Ground objects in remote sensing images appear at arbitrary angles. However, object detection based on horizontal bounding boxes (HBBs) would cause mutual coverage among targets, while the ground objects were densely distributed or with a large aspect ratio. The oriented object detection methods could solve the problem by predicting the rotation angle. But the currently used methods were time-consuming in labeling and require complex loss functions of networks. Thus, this article combined HBB and oriented object detection to achieve rectangular object detection. First, an object detection network with HBBs is trained and the model predicts results in the original remote sensing image. Second, the rotation angles are derived from the line detection with linear Hough transform on the cropped region of targets obtained by the first step. Then, the original image is rotated according to the rotation angles and detects the object with HBBs again. Finally, new bounding boxes are mapped to the original image to get the detection results with oriented bounding boxes (OBBs). Experiments on public remote sensing datasets demonstrate that the proposed method is highly flexible and can be combined with any HBBs object detection network. The idea of original image rotation does not use the OBB labels to retrain the network, which reduces the workload of object annotations. In addition, the method can be used to automatically generate OBBs to label rectangular objects since the public datasets are commonly annotated by HBBs.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/JSTARS.2024.3349596</doi><tpages>9</tpages><orcidid>https://orcid.org/0000-0002-3422-7399</orcidid><orcidid>https://orcid.org/0009-0003-5905-5196</orcidid><orcidid>https://orcid.org/0000-0003-3944-2175</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1939-1404 |
ispartof | IEEE journal of selected topics in applied earth observations and remote sensing, 2024, Vol.17, p.2918-2926 |
issn | 1939-1404 2151-1535 |
language | eng |
recordid | cdi_proquest_journals_2916480380 |
source | DOAJ Directory of Open Access Journals; EZB-FREE-00999 freely available EZB journals |
subjects | Annotations Aspect ratio Boxes Datasets Deep learning Detection Detectors Feature extraction Hough transformation Image rotation Labels line detection Object detection Object recognition oriented bounding boxes (OBBs) Remote observing Remote sensing Rotation Task analysis Transforms |
title | HODet: A New Detector for Arbitrary-Oriented Rectangular Object in Optical Remote Sensing Imagery |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-07T22%3A03%3A03IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_ieee_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=HODet:%20A%20New%20Detector%20for%20Arbitrary-Oriented%20Rectangular%20Object%20in%20Optical%20Remote%20Sensing%20Imagery&rft.jtitle=IEEE%20journal%20of%20selected%20topics%20in%20applied%20earth%20observations%20and%20remote%20sensing&rft.au=Xu,%20Lu&rft.date=2024&rft.volume=17&rft.spage=2918&rft.epage=2926&rft.pages=2918-2926&rft.issn=1939-1404&rft.eissn=2151-1535&rft.coden=IJSTHZ&rft_id=info:doi/10.1109/JSTARS.2024.3349596&rft_dat=%3Cproquest_ieee_%3E2916480380%3C/proquest_ieee_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2916480380&rft_id=info:pmid/&rft_ieee_id=10380703&rft_doaj_id=oai_doaj_org_article_80db6aaba61e4b17b7be27e14869b072&rfr_iscdi=true |