500-Fps Omnidirectional Visual Tracking Using Three-Axis Active Vision System

This study proposes a visual tracking system with 500-fps image processing that can detect and track a fast-moving appearance-varying target in a 360-degree-field of view (FOV) from high-spatial-resolution images. The system consists of a high-speed camera, a pan-tilt Galvano-mirror system, and a mi...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on instrumentation and measurement 2021, Vol.70, p.1-11
Hauptverfasser: Jiang, Mingjun, Sogabe, Ryo, Shimasaki, Kohei, Hu, Shaopeng, Senoo, Taku, Ishii, Idaku
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 11
container_issue
container_start_page 1
container_title IEEE transactions on instrumentation and measurement
container_volume 70
creator Jiang, Mingjun
Sogabe, Ryo
Shimasaki, Kohei
Hu, Shaopeng
Senoo, Taku
Ishii, Idaku
description This study proposes a visual tracking system with 500-fps image processing that can detect and track a fast-moving appearance-varying target in a 360-degree-field of view (FOV) from high-spatial-resolution images. The system consists of a high-speed camera, a pan-tilt Galvano-mirror system, and a mirror-drive high-speed pan control system with 360-degree-rotational capacity. Omnidirectional visual tracking of a remote object using complex visual features becomes possible due to the acquisition of high-spatial-resolution images of the target object via the system. We introduce an intelligent high frame rate (HFR) target-tracking algorithm that can simultaneously detect and track an appearance-varying object against a complex background for high-speed visual feedback control. Furthermore, the proposed surveillance system enables robust visual tracking under low-light conditions using a 3-D light detection and ranging (LiDAR) sensor system and a simultaneously controlled active spotlight projection system. The effectiveness of the proposed omnidirectional visual tracking system was demonstrated by conducting several omnidirectional detecting and tracking experiments on persons dozens of meters away using a 25-mm focal length lens under both daytime and night-time conditions.
doi_str_mv 10.1109/TIM.2021.3053971
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_2487437032</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9335293</ieee_id><sourcerecordid>2487437032</sourcerecordid><originalsourceid>FETCH-LOGICAL-c404t-aa7b2dceec54328e920cd829afb27ab7783628bc6d6af40b56824b2260bd10273</originalsourceid><addsrcrecordid>eNo9kMFPwjAUxhujiYjeTbws8Tx8fe3a7UiIKAmEg8Nr03WdFoFhO4z893aBePm-y-97efkRck9hRCkUT-VsMUJAOmKQsULSCzKgWSbTQgi8JAMAmqcFz8Q1uQlhDQBScDkgiwwgne5DstzuXO28NZ1rd3qTvLtwiFV6bb7c7iNZhT7LT29tOv51IRlH8sf2XBwkb8fQ2e0tuWr0Jti7cw_JavpcTl7T-fJlNhnPU8OBd6nWssLaWGsyzjC3BYKpcyx0U6HUlZQ5E5hXRtRCNxyqTOTIK0QBVU0BJRuSx9PdvW-_DzZ0at0efHw7KOS55EwCw0jBiTK-DcHbRu2922p_VBRUL01FaaqXps7S4uThNHHW2n-8YCzDGH__VGbq</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2487437032</pqid></control><display><type>article</type><title>500-Fps Omnidirectional Visual Tracking Using Three-Axis Active Vision System</title><source>IEEE Electronic Library (IEL)</source><creator>Jiang, Mingjun ; Sogabe, Ryo ; Shimasaki, Kohei ; Hu, Shaopeng ; Senoo, Taku ; Ishii, Idaku</creator><creatorcontrib>Jiang, Mingjun ; Sogabe, Ryo ; Shimasaki, Kohei ; Hu, Shaopeng ; Senoo, Taku ; Ishii, Idaku</creatorcontrib><description>This study proposes a visual tracking system with 500-fps image processing that can detect and track a fast-moving appearance-varying target in a 360-degree-field of view (FOV) from high-spatial-resolution images. The system consists of a high-speed camera, a pan-tilt Galvano-mirror system, and a mirror-drive high-speed pan control system with 360-degree-rotational capacity. Omnidirectional visual tracking of a remote object using complex visual features becomes possible due to the acquisition of high-spatial-resolution images of the target object via the system. We introduce an intelligent high frame rate (HFR) target-tracking algorithm that can simultaneously detect and track an appearance-varying object against a complex background for high-speed visual feedback control. Furthermore, the proposed surveillance system enables robust visual tracking under low-light conditions using a 3-D light detection and ranging (LiDAR) sensor system and a simultaneously controlled active spotlight projection system. The effectiveness of the proposed omnidirectional visual tracking system was demonstrated by conducting several omnidirectional detecting and tracking experiments on persons dozens of meters away using a 25-mm focal length lens under both daytime and night-time conditions.</description><identifier>ISSN: 0018-9456</identifier><identifier>EISSN: 1557-9662</identifier><identifier>DOI: 10.1109/TIM.2021.3053971</identifier><identifier>CODEN: IEIMAO</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Active control ; Algorithms ; Cameras ; Control systems ; Convolutional neural network (CNN) ; Feedback control ; Field of view ; High speed cameras ; high-speed vision ; Image acquisition ; Image processing ; Laser radar ; Lidar ; light detection and ranging (LiDAR) ; mechanical tracking ; Mirrors ; omnidirectional tracking ; Optical tracking ; Surveillance ; Target recognition ; Target tracking ; Three axis ; Three-dimensional displays ; Tracking systems ; Vision systems ; visual feedback ; Visualization</subject><ispartof>IEEE transactions on instrumentation and measurement, 2021, Vol.70, p.1-11</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c404t-aa7b2dceec54328e920cd829afb27ab7783628bc6d6af40b56824b2260bd10273</citedby><cites>FETCH-LOGICAL-c404t-aa7b2dceec54328e920cd829afb27ab7783628bc6d6af40b56824b2260bd10273</cites><orcidid>0000-0002-7728-2363 ; 0000-0003-2419-2126 ; 0000-0002-9176-3606 ; 0000-0003-4773-1575 ; 0000-0002-8531-1590 ; 0000-0003-3826-5488</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9335293$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,778,782,794,4012,27910,27911,27912,54745</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9335293$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Jiang, Mingjun</creatorcontrib><creatorcontrib>Sogabe, Ryo</creatorcontrib><creatorcontrib>Shimasaki, Kohei</creatorcontrib><creatorcontrib>Hu, Shaopeng</creatorcontrib><creatorcontrib>Senoo, Taku</creatorcontrib><creatorcontrib>Ishii, Idaku</creatorcontrib><title>500-Fps Omnidirectional Visual Tracking Using Three-Axis Active Vision System</title><title>IEEE transactions on instrumentation and measurement</title><addtitle>TIM</addtitle><description>This study proposes a visual tracking system with 500-fps image processing that can detect and track a fast-moving appearance-varying target in a 360-degree-field of view (FOV) from high-spatial-resolution images. The system consists of a high-speed camera, a pan-tilt Galvano-mirror system, and a mirror-drive high-speed pan control system with 360-degree-rotational capacity. Omnidirectional visual tracking of a remote object using complex visual features becomes possible due to the acquisition of high-spatial-resolution images of the target object via the system. We introduce an intelligent high frame rate (HFR) target-tracking algorithm that can simultaneously detect and track an appearance-varying object against a complex background for high-speed visual feedback control. Furthermore, the proposed surveillance system enables robust visual tracking under low-light conditions using a 3-D light detection and ranging (LiDAR) sensor system and a simultaneously controlled active spotlight projection system. The effectiveness of the proposed omnidirectional visual tracking system was demonstrated by conducting several omnidirectional detecting and tracking experiments on persons dozens of meters away using a 25-mm focal length lens under both daytime and night-time conditions.</description><subject>Active control</subject><subject>Algorithms</subject><subject>Cameras</subject><subject>Control systems</subject><subject>Convolutional neural network (CNN)</subject><subject>Feedback control</subject><subject>Field of view</subject><subject>High speed cameras</subject><subject>high-speed vision</subject><subject>Image acquisition</subject><subject>Image processing</subject><subject>Laser radar</subject><subject>Lidar</subject><subject>light detection and ranging (LiDAR)</subject><subject>mechanical tracking</subject><subject>Mirrors</subject><subject>omnidirectional tracking</subject><subject>Optical tracking</subject><subject>Surveillance</subject><subject>Target recognition</subject><subject>Target tracking</subject><subject>Three axis</subject><subject>Three-dimensional displays</subject><subject>Tracking systems</subject><subject>Vision systems</subject><subject>visual feedback</subject><subject>Visualization</subject><issn>0018-9456</issn><issn>1557-9662</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kMFPwjAUxhujiYjeTbws8Tx8fe3a7UiIKAmEg8Nr03WdFoFhO4z893aBePm-y-97efkRck9hRCkUT-VsMUJAOmKQsULSCzKgWSbTQgi8JAMAmqcFz8Q1uQlhDQBScDkgiwwgne5DstzuXO28NZ1rd3qTvLtwiFV6bb7c7iNZhT7LT29tOv51IRlH8sf2XBwkb8fQ2e0tuWr0Jti7cw_JavpcTl7T-fJlNhnPU8OBd6nWssLaWGsyzjC3BYKpcyx0U6HUlZQ5E5hXRtRCNxyqTOTIK0QBVU0BJRuSx9PdvW-_DzZ0at0efHw7KOS55EwCw0jBiTK-DcHbRu2922p_VBRUL01FaaqXps7S4uThNHHW2n-8YCzDGH__VGbq</recordid><startdate>2021</startdate><enddate>2021</enddate><creator>Jiang, Mingjun</creator><creator>Sogabe, Ryo</creator><creator>Shimasaki, Kohei</creator><creator>Hu, Shaopeng</creator><creator>Senoo, Taku</creator><creator>Ishii, Idaku</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>7U5</scope><scope>8FD</scope><scope>L7M</scope><orcidid>https://orcid.org/0000-0002-7728-2363</orcidid><orcidid>https://orcid.org/0000-0003-2419-2126</orcidid><orcidid>https://orcid.org/0000-0002-9176-3606</orcidid><orcidid>https://orcid.org/0000-0003-4773-1575</orcidid><orcidid>https://orcid.org/0000-0002-8531-1590</orcidid><orcidid>https://orcid.org/0000-0003-3826-5488</orcidid></search><sort><creationdate>2021</creationdate><title>500-Fps Omnidirectional Visual Tracking Using Three-Axis Active Vision System</title><author>Jiang, Mingjun ; Sogabe, Ryo ; Shimasaki, Kohei ; Hu, Shaopeng ; Senoo, Taku ; Ishii, Idaku</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c404t-aa7b2dceec54328e920cd829afb27ab7783628bc6d6af40b56824b2260bd10273</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Active control</topic><topic>Algorithms</topic><topic>Cameras</topic><topic>Control systems</topic><topic>Convolutional neural network (CNN)</topic><topic>Feedback control</topic><topic>Field of view</topic><topic>High speed cameras</topic><topic>high-speed vision</topic><topic>Image acquisition</topic><topic>Image processing</topic><topic>Laser radar</topic><topic>Lidar</topic><topic>light detection and ranging (LiDAR)</topic><topic>mechanical tracking</topic><topic>Mirrors</topic><topic>omnidirectional tracking</topic><topic>Optical tracking</topic><topic>Surveillance</topic><topic>Target recognition</topic><topic>Target tracking</topic><topic>Three axis</topic><topic>Three-dimensional displays</topic><topic>Tracking systems</topic><topic>Vision systems</topic><topic>visual feedback</topic><topic>Visualization</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Jiang, Mingjun</creatorcontrib><creatorcontrib>Sogabe, Ryo</creatorcontrib><creatorcontrib>Shimasaki, Kohei</creatorcontrib><creatorcontrib>Hu, Shaopeng</creatorcontrib><creatorcontrib>Senoo, Taku</creatorcontrib><creatorcontrib>Ishii, Idaku</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>Technology Research Database</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>IEEE transactions on instrumentation and measurement</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Jiang, Mingjun</au><au>Sogabe, Ryo</au><au>Shimasaki, Kohei</au><au>Hu, Shaopeng</au><au>Senoo, Taku</au><au>Ishii, Idaku</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>500-Fps Omnidirectional Visual Tracking Using Three-Axis Active Vision System</atitle><jtitle>IEEE transactions on instrumentation and measurement</jtitle><stitle>TIM</stitle><date>2021</date><risdate>2021</risdate><volume>70</volume><spage>1</spage><epage>11</epage><pages>1-11</pages><issn>0018-9456</issn><eissn>1557-9662</eissn><coden>IEIMAO</coden><abstract>This study proposes a visual tracking system with 500-fps image processing that can detect and track a fast-moving appearance-varying target in a 360-degree-field of view (FOV) from high-spatial-resolution images. The system consists of a high-speed camera, a pan-tilt Galvano-mirror system, and a mirror-drive high-speed pan control system with 360-degree-rotational capacity. Omnidirectional visual tracking of a remote object using complex visual features becomes possible due to the acquisition of high-spatial-resolution images of the target object via the system. We introduce an intelligent high frame rate (HFR) target-tracking algorithm that can simultaneously detect and track an appearance-varying object against a complex background for high-speed visual feedback control. Furthermore, the proposed surveillance system enables robust visual tracking under low-light conditions using a 3-D light detection and ranging (LiDAR) sensor system and a simultaneously controlled active spotlight projection system. The effectiveness of the proposed omnidirectional visual tracking system was demonstrated by conducting several omnidirectional detecting and tracking experiments on persons dozens of meters away using a 25-mm focal length lens under both daytime and night-time conditions.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TIM.2021.3053971</doi><tpages>11</tpages><orcidid>https://orcid.org/0000-0002-7728-2363</orcidid><orcidid>https://orcid.org/0000-0003-2419-2126</orcidid><orcidid>https://orcid.org/0000-0002-9176-3606</orcidid><orcidid>https://orcid.org/0000-0003-4773-1575</orcidid><orcidid>https://orcid.org/0000-0002-8531-1590</orcidid><orcidid>https://orcid.org/0000-0003-3826-5488</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 0018-9456
ispartof IEEE transactions on instrumentation and measurement, 2021, Vol.70, p.1-11
issn 0018-9456
1557-9662
language eng
recordid cdi_proquest_journals_2487437032
source IEEE Electronic Library (IEL)
subjects Active control
Algorithms
Cameras
Control systems
Convolutional neural network (CNN)
Feedback control
Field of view
High speed cameras
high-speed vision
Image acquisition
Image processing
Laser radar
Lidar
light detection and ranging (LiDAR)
mechanical tracking
Mirrors
omnidirectional tracking
Optical tracking
Surveillance
Target recognition
Target tracking
Three axis
Three-dimensional displays
Tracking systems
Vision systems
visual feedback
Visualization
title 500-Fps Omnidirectional Visual Tracking Using Three-Axis Active Vision System
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-16T03%3A36%3A28IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=500-Fps%20Omnidirectional%20Visual%20Tracking%20Using%20Three-Axis%20Active%20Vision%20System&rft.jtitle=IEEE%20transactions%20on%20instrumentation%20and%20measurement&rft.au=Jiang,%20Mingjun&rft.date=2021&rft.volume=70&rft.spage=1&rft.epage=11&rft.pages=1-11&rft.issn=0018-9456&rft.eissn=1557-9662&rft.coden=IEIMAO&rft_id=info:doi/10.1109/TIM.2021.3053971&rft_dat=%3Cproquest_RIE%3E2487437032%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2487437032&rft_id=info:pmid/&rft_ieee_id=9335293&rfr_iscdi=true