500-Fps Omnidirectional Visual Tracking Using Three-Axis Active Vision System
This study proposes a visual tracking system with 500-fps image processing that can detect and track a fast-moving appearance-varying target in a 360-degree-field of view (FOV) from high-spatial-resolution images. The system consists of a high-speed camera, a pan-tilt Galvano-mirror system, and a mi...
Gespeichert in:
Veröffentlicht in: | IEEE transactions on instrumentation and measurement 2021, Vol.70, p.1-11 |
---|---|
Hauptverfasser: | , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 11 |
---|---|
container_issue | |
container_start_page | 1 |
container_title | IEEE transactions on instrumentation and measurement |
container_volume | 70 |
creator | Jiang, Mingjun Sogabe, Ryo Shimasaki, Kohei Hu, Shaopeng Senoo, Taku Ishii, Idaku |
description | This study proposes a visual tracking system with 500-fps image processing that can detect and track a fast-moving appearance-varying target in a 360-degree-field of view (FOV) from high-spatial-resolution images. The system consists of a high-speed camera, a pan-tilt Galvano-mirror system, and a mirror-drive high-speed pan control system with 360-degree-rotational capacity. Omnidirectional visual tracking of a remote object using complex visual features becomes possible due to the acquisition of high-spatial-resolution images of the target object via the system. We introduce an intelligent high frame rate (HFR) target-tracking algorithm that can simultaneously detect and track an appearance-varying object against a complex background for high-speed visual feedback control. Furthermore, the proposed surveillance system enables robust visual tracking under low-light conditions using a 3-D light detection and ranging (LiDAR) sensor system and a simultaneously controlled active spotlight projection system. The effectiveness of the proposed omnidirectional visual tracking system was demonstrated by conducting several omnidirectional detecting and tracking experiments on persons dozens of meters away using a 25-mm focal length lens under both daytime and night-time conditions. |
doi_str_mv | 10.1109/TIM.2021.3053971 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_2487437032</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9335293</ieee_id><sourcerecordid>2487437032</sourcerecordid><originalsourceid>FETCH-LOGICAL-c404t-aa7b2dceec54328e920cd829afb27ab7783628bc6d6af40b56824b2260bd10273</originalsourceid><addsrcrecordid>eNo9kMFPwjAUxhujiYjeTbws8Tx8fe3a7UiIKAmEg8Nr03WdFoFhO4z893aBePm-y-97efkRck9hRCkUT-VsMUJAOmKQsULSCzKgWSbTQgi8JAMAmqcFz8Q1uQlhDQBScDkgiwwgne5DstzuXO28NZ1rd3qTvLtwiFV6bb7c7iNZhT7LT29tOv51IRlH8sf2XBwkb8fQ2e0tuWr0Jti7cw_JavpcTl7T-fJlNhnPU8OBd6nWssLaWGsyzjC3BYKpcyx0U6HUlZQ5E5hXRtRCNxyqTOTIK0QBVU0BJRuSx9PdvW-_DzZ0at0efHw7KOS55EwCw0jBiTK-DcHbRu2922p_VBRUL01FaaqXps7S4uThNHHW2n-8YCzDGH__VGbq</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2487437032</pqid></control><display><type>article</type><title>500-Fps Omnidirectional Visual Tracking Using Three-Axis Active Vision System</title><source>IEEE Electronic Library (IEL)</source><creator>Jiang, Mingjun ; Sogabe, Ryo ; Shimasaki, Kohei ; Hu, Shaopeng ; Senoo, Taku ; Ishii, Idaku</creator><creatorcontrib>Jiang, Mingjun ; Sogabe, Ryo ; Shimasaki, Kohei ; Hu, Shaopeng ; Senoo, Taku ; Ishii, Idaku</creatorcontrib><description>This study proposes a visual tracking system with 500-fps image processing that can detect and track a fast-moving appearance-varying target in a 360-degree-field of view (FOV) from high-spatial-resolution images. The system consists of a high-speed camera, a pan-tilt Galvano-mirror system, and a mirror-drive high-speed pan control system with 360-degree-rotational capacity. Omnidirectional visual tracking of a remote object using complex visual features becomes possible due to the acquisition of high-spatial-resolution images of the target object via the system. We introduce an intelligent high frame rate (HFR) target-tracking algorithm that can simultaneously detect and track an appearance-varying object against a complex background for high-speed visual feedback control. Furthermore, the proposed surveillance system enables robust visual tracking under low-light conditions using a 3-D light detection and ranging (LiDAR) sensor system and a simultaneously controlled active spotlight projection system. The effectiveness of the proposed omnidirectional visual tracking system was demonstrated by conducting several omnidirectional detecting and tracking experiments on persons dozens of meters away using a 25-mm focal length lens under both daytime and night-time conditions.</description><identifier>ISSN: 0018-9456</identifier><identifier>EISSN: 1557-9662</identifier><identifier>DOI: 10.1109/TIM.2021.3053971</identifier><identifier>CODEN: IEIMAO</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Active control ; Algorithms ; Cameras ; Control systems ; Convolutional neural network (CNN) ; Feedback control ; Field of view ; High speed cameras ; high-speed vision ; Image acquisition ; Image processing ; Laser radar ; Lidar ; light detection and ranging (LiDAR) ; mechanical tracking ; Mirrors ; omnidirectional tracking ; Optical tracking ; Surveillance ; Target recognition ; Target tracking ; Three axis ; Three-dimensional displays ; Tracking systems ; Vision systems ; visual feedback ; Visualization</subject><ispartof>IEEE transactions on instrumentation and measurement, 2021, Vol.70, p.1-11</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c404t-aa7b2dceec54328e920cd829afb27ab7783628bc6d6af40b56824b2260bd10273</citedby><cites>FETCH-LOGICAL-c404t-aa7b2dceec54328e920cd829afb27ab7783628bc6d6af40b56824b2260bd10273</cites><orcidid>0000-0002-7728-2363 ; 0000-0003-2419-2126 ; 0000-0002-9176-3606 ; 0000-0003-4773-1575 ; 0000-0002-8531-1590 ; 0000-0003-3826-5488</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9335293$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,778,782,794,4012,27910,27911,27912,54745</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9335293$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Jiang, Mingjun</creatorcontrib><creatorcontrib>Sogabe, Ryo</creatorcontrib><creatorcontrib>Shimasaki, Kohei</creatorcontrib><creatorcontrib>Hu, Shaopeng</creatorcontrib><creatorcontrib>Senoo, Taku</creatorcontrib><creatorcontrib>Ishii, Idaku</creatorcontrib><title>500-Fps Omnidirectional Visual Tracking Using Three-Axis Active Vision System</title><title>IEEE transactions on instrumentation and measurement</title><addtitle>TIM</addtitle><description>This study proposes a visual tracking system with 500-fps image processing that can detect and track a fast-moving appearance-varying target in a 360-degree-field of view (FOV) from high-spatial-resolution images. The system consists of a high-speed camera, a pan-tilt Galvano-mirror system, and a mirror-drive high-speed pan control system with 360-degree-rotational capacity. Omnidirectional visual tracking of a remote object using complex visual features becomes possible due to the acquisition of high-spatial-resolution images of the target object via the system. We introduce an intelligent high frame rate (HFR) target-tracking algorithm that can simultaneously detect and track an appearance-varying object against a complex background for high-speed visual feedback control. Furthermore, the proposed surveillance system enables robust visual tracking under low-light conditions using a 3-D light detection and ranging (LiDAR) sensor system and a simultaneously controlled active spotlight projection system. The effectiveness of the proposed omnidirectional visual tracking system was demonstrated by conducting several omnidirectional detecting and tracking experiments on persons dozens of meters away using a 25-mm focal length lens under both daytime and night-time conditions.</description><subject>Active control</subject><subject>Algorithms</subject><subject>Cameras</subject><subject>Control systems</subject><subject>Convolutional neural network (CNN)</subject><subject>Feedback control</subject><subject>Field of view</subject><subject>High speed cameras</subject><subject>high-speed vision</subject><subject>Image acquisition</subject><subject>Image processing</subject><subject>Laser radar</subject><subject>Lidar</subject><subject>light detection and ranging (LiDAR)</subject><subject>mechanical tracking</subject><subject>Mirrors</subject><subject>omnidirectional tracking</subject><subject>Optical tracking</subject><subject>Surveillance</subject><subject>Target recognition</subject><subject>Target tracking</subject><subject>Three axis</subject><subject>Three-dimensional displays</subject><subject>Tracking systems</subject><subject>Vision systems</subject><subject>visual feedback</subject><subject>Visualization</subject><issn>0018-9456</issn><issn>1557-9662</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kMFPwjAUxhujiYjeTbws8Tx8fe3a7UiIKAmEg8Nr03WdFoFhO4z893aBePm-y-97efkRck9hRCkUT-VsMUJAOmKQsULSCzKgWSbTQgi8JAMAmqcFz8Q1uQlhDQBScDkgiwwgne5DstzuXO28NZ1rd3qTvLtwiFV6bb7c7iNZhT7LT29tOv51IRlH8sf2XBwkb8fQ2e0tuWr0Jti7cw_JavpcTl7T-fJlNhnPU8OBd6nWssLaWGsyzjC3BYKpcyx0U6HUlZQ5E5hXRtRCNxyqTOTIK0QBVU0BJRuSx9PdvW-_DzZ0at0efHw7KOS55EwCw0jBiTK-DcHbRu2922p_VBRUL01FaaqXps7S4uThNHHW2n-8YCzDGH__VGbq</recordid><startdate>2021</startdate><enddate>2021</enddate><creator>Jiang, Mingjun</creator><creator>Sogabe, Ryo</creator><creator>Shimasaki, Kohei</creator><creator>Hu, Shaopeng</creator><creator>Senoo, Taku</creator><creator>Ishii, Idaku</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>7U5</scope><scope>8FD</scope><scope>L7M</scope><orcidid>https://orcid.org/0000-0002-7728-2363</orcidid><orcidid>https://orcid.org/0000-0003-2419-2126</orcidid><orcidid>https://orcid.org/0000-0002-9176-3606</orcidid><orcidid>https://orcid.org/0000-0003-4773-1575</orcidid><orcidid>https://orcid.org/0000-0002-8531-1590</orcidid><orcidid>https://orcid.org/0000-0003-3826-5488</orcidid></search><sort><creationdate>2021</creationdate><title>500-Fps Omnidirectional Visual Tracking Using Three-Axis Active Vision System</title><author>Jiang, Mingjun ; Sogabe, Ryo ; Shimasaki, Kohei ; Hu, Shaopeng ; Senoo, Taku ; Ishii, Idaku</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c404t-aa7b2dceec54328e920cd829afb27ab7783628bc6d6af40b56824b2260bd10273</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Active control</topic><topic>Algorithms</topic><topic>Cameras</topic><topic>Control systems</topic><topic>Convolutional neural network (CNN)</topic><topic>Feedback control</topic><topic>Field of view</topic><topic>High speed cameras</topic><topic>high-speed vision</topic><topic>Image acquisition</topic><topic>Image processing</topic><topic>Laser radar</topic><topic>Lidar</topic><topic>light detection and ranging (LiDAR)</topic><topic>mechanical tracking</topic><topic>Mirrors</topic><topic>omnidirectional tracking</topic><topic>Optical tracking</topic><topic>Surveillance</topic><topic>Target recognition</topic><topic>Target tracking</topic><topic>Three axis</topic><topic>Three-dimensional displays</topic><topic>Tracking systems</topic><topic>Vision systems</topic><topic>visual feedback</topic><topic>Visualization</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Jiang, Mingjun</creatorcontrib><creatorcontrib>Sogabe, Ryo</creatorcontrib><creatorcontrib>Shimasaki, Kohei</creatorcontrib><creatorcontrib>Hu, Shaopeng</creatorcontrib><creatorcontrib>Senoo, Taku</creatorcontrib><creatorcontrib>Ishii, Idaku</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Electronics & Communications Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>Technology Research Database</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>IEEE transactions on instrumentation and measurement</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Jiang, Mingjun</au><au>Sogabe, Ryo</au><au>Shimasaki, Kohei</au><au>Hu, Shaopeng</au><au>Senoo, Taku</au><au>Ishii, Idaku</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>500-Fps Omnidirectional Visual Tracking Using Three-Axis Active Vision System</atitle><jtitle>IEEE transactions on instrumentation and measurement</jtitle><stitle>TIM</stitle><date>2021</date><risdate>2021</risdate><volume>70</volume><spage>1</spage><epage>11</epage><pages>1-11</pages><issn>0018-9456</issn><eissn>1557-9662</eissn><coden>IEIMAO</coden><abstract>This study proposes a visual tracking system with 500-fps image processing that can detect and track a fast-moving appearance-varying target in a 360-degree-field of view (FOV) from high-spatial-resolution images. The system consists of a high-speed camera, a pan-tilt Galvano-mirror system, and a mirror-drive high-speed pan control system with 360-degree-rotational capacity. Omnidirectional visual tracking of a remote object using complex visual features becomes possible due to the acquisition of high-spatial-resolution images of the target object via the system. We introduce an intelligent high frame rate (HFR) target-tracking algorithm that can simultaneously detect and track an appearance-varying object against a complex background for high-speed visual feedback control. Furthermore, the proposed surveillance system enables robust visual tracking under low-light conditions using a 3-D light detection and ranging (LiDAR) sensor system and a simultaneously controlled active spotlight projection system. The effectiveness of the proposed omnidirectional visual tracking system was demonstrated by conducting several omnidirectional detecting and tracking experiments on persons dozens of meters away using a 25-mm focal length lens under both daytime and night-time conditions.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TIM.2021.3053971</doi><tpages>11</tpages><orcidid>https://orcid.org/0000-0002-7728-2363</orcidid><orcidid>https://orcid.org/0000-0003-2419-2126</orcidid><orcidid>https://orcid.org/0000-0002-9176-3606</orcidid><orcidid>https://orcid.org/0000-0003-4773-1575</orcidid><orcidid>https://orcid.org/0000-0002-8531-1590</orcidid><orcidid>https://orcid.org/0000-0003-3826-5488</orcidid></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 0018-9456 |
ispartof | IEEE transactions on instrumentation and measurement, 2021, Vol.70, p.1-11 |
issn | 0018-9456 1557-9662 |
language | eng |
recordid | cdi_proquest_journals_2487437032 |
source | IEEE Electronic Library (IEL) |
subjects | Active control Algorithms Cameras Control systems Convolutional neural network (CNN) Feedback control Field of view High speed cameras high-speed vision Image acquisition Image processing Laser radar Lidar light detection and ranging (LiDAR) mechanical tracking Mirrors omnidirectional tracking Optical tracking Surveillance Target recognition Target tracking Three axis Three-dimensional displays Tracking systems Vision systems visual feedback Visualization |
title | 500-Fps Omnidirectional Visual Tracking Using Three-Axis Active Vision System |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-16T03%3A36%3A28IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=500-Fps%20Omnidirectional%20Visual%20Tracking%20Using%20Three-Axis%20Active%20Vision%20System&rft.jtitle=IEEE%20transactions%20on%20instrumentation%20and%20measurement&rft.au=Jiang,%20Mingjun&rft.date=2021&rft.volume=70&rft.spage=1&rft.epage=11&rft.pages=1-11&rft.issn=0018-9456&rft.eissn=1557-9662&rft.coden=IEIMAO&rft_id=info:doi/10.1109/TIM.2021.3053971&rft_dat=%3Cproquest_RIE%3E2487437032%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2487437032&rft_id=info:pmid/&rft_ieee_id=9335293&rfr_iscdi=true |