Robust Object Tracking With Discrete Graph-Based Multiple Experts

Variations of target appearances due to illumination changes, heavy occlusions, and target deformations are the major factors for tracking drift. In this paper, we show that the tracking drift can be effectively corrected by exploiting the relationship between the current tracker and its historical...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on image processing 2017-06, Vol.26 (6), p.2736-2750
Hauptverfasser: Jiatong Li, Chenwei Deng, Da Xu, Richard Yi, Dacheng Tao, Baojun Zhao
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 2750
container_issue 6
container_start_page 2736
container_title IEEE transactions on image processing
container_volume 26
creator Jiatong Li
Chenwei Deng
Da Xu, Richard Yi
Dacheng Tao
Baojun Zhao
description Variations of target appearances due to illumination changes, heavy occlusions, and target deformations are the major factors for tracking drift. In this paper, we show that the tracking drift can be effectively corrected by exploiting the relationship between the current tracker and its historical tracker snapshots. Here, a multi-expert framework is established by the current tracker and its historical trained tracker snapshots. The proposed scheme is formulated into a unified discrete graph optimization framework, whose nodes are modeled by the hypotheses of the multiple experts. Furthermore, an exact solution of the discrete graph exists giving the object state estimation at each time step. With the unary and binary compatibility graph scores defined properly, the proposed framework corrects the tracker drift via selecting the best expert hypothesis, which implicitly analyzes the recent performance of the multi-expert by only evaluating graph scores at the current frame. Three base trackers are integrated into the proposed framework to validate its effectiveness. We first integrate the online SVM on a budget algorithm into the framework with significant improvement. Then, the regression correlation filters with hand-crafted features and deep convolutional neural network features are introduced, respectively, to further boost the tracking performance. The proposed three trackers are extensively evaluated on three data sets: TB-50, TB-100, and VOT2015. The experimental results demonstrate the excellent performance of the proposed approaches against the state-of-the-art methods.
doi_str_mv 10.1109/TIP.2017.2686601
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_miscellaneous_1883176421</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>7885500</ieee_id><sourcerecordid>1883176421</sourcerecordid><originalsourceid>FETCH-LOGICAL-c319t-c8d1720028b9c27b885e0c9ff716897d54eee63d861ed7886f28a299e7aa22a63</originalsourceid><addsrcrecordid>eNo9kE1Lw0AQhhdRbK3eBUFy9JK6s0n241hrrYVKRSoel00ysalpE3cT0H_vltaeZmCed3h5CLkGOgSg6n45ex0yCmLIuOScwgnpg4ohpDRmp36niQgFxKpHLpxbUwpxAvyc9JiMEsll1CejtzrtXBss0jVmbbC0Jvsqt5_BR9mugsfSZRZbDKbWNKvwwTjMg5euasumwmDy06Bt3SU5K0zl8OowB-T9abIcP4fzxXQ2Hs3DLALVhpnMQTBKmUxVxkQqZYI0U0UhgEsl8iRGRB7lkgPmQkpeMGmYUiiMYczwaEDu9n8bW3936Fq98fWwqswW685pkDICwWMGHqV7NLO1cxYL3dhyY-yvBqp34rQXp3fi9EGcj9wevnfpBvNj4N-UB272QOl7Hs--aJJQGv0BIQZwSA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1883176421</pqid></control><display><type>article</type><title>Robust Object Tracking With Discrete Graph-Based Multiple Experts</title><source>IEEE Electronic Library (IEL)</source><creator>Jiatong Li ; Chenwei Deng ; Da Xu, Richard Yi ; Dacheng Tao ; Baojun Zhao</creator><creatorcontrib>Jiatong Li ; Chenwei Deng ; Da Xu, Richard Yi ; Dacheng Tao ; Baojun Zhao</creatorcontrib><description>Variations of target appearances due to illumination changes, heavy occlusions, and target deformations are the major factors for tracking drift. In this paper, we show that the tracking drift can be effectively corrected by exploiting the relationship between the current tracker and its historical tracker snapshots. Here, a multi-expert framework is established by the current tracker and its historical trained tracker snapshots. The proposed scheme is formulated into a unified discrete graph optimization framework, whose nodes are modeled by the hypotheses of the multiple experts. Furthermore, an exact solution of the discrete graph exists giving the object state estimation at each time step. With the unary and binary compatibility graph scores defined properly, the proposed framework corrects the tracker drift via selecting the best expert hypothesis, which implicitly analyzes the recent performance of the multi-expert by only evaluating graph scores at the current frame. Three base trackers are integrated into the proposed framework to validate its effectiveness. We first integrate the online SVM on a budget algorithm into the framework with significant improvement. Then, the regression correlation filters with hand-crafted features and deep convolutional neural network features are introduced, respectively, to further boost the tracking performance. The proposed three trackers are extensively evaluated on three data sets: TB-50, TB-100, and VOT2015. The experimental results demonstrate the excellent performance of the proposed approaches against the state-of-the-art methods.</description><identifier>ISSN: 1057-7149</identifier><identifier>EISSN: 1941-0042</identifier><identifier>DOI: 10.1109/TIP.2017.2686601</identifier><identifier>PMID: 28358683</identifier><identifier>CODEN: IIPRE4</identifier><language>eng</language><publisher>United States: IEEE</publisher><subject>Computational modeling ; convolutional neural network ; Correlation ; correlation filter ; discrete graph ; dynamic programming ; Object tracking ; Robustness ; support vector machine ; Support vector machines ; Target tracking ; Visualization</subject><ispartof>IEEE transactions on image processing, 2017-06, Vol.26 (6), p.2736-2750</ispartof><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c319t-c8d1720028b9c27b885e0c9ff716897d54eee63d861ed7886f28a299e7aa22a63</citedby><cites>FETCH-LOGICAL-c319t-c8d1720028b9c27b885e0c9ff716897d54eee63d861ed7886f28a299e7aa22a63</cites><orcidid>0000-0002-3747-5128</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/7885500$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27901,27902,54733</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/7885500$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/28358683$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Jiatong Li</creatorcontrib><creatorcontrib>Chenwei Deng</creatorcontrib><creatorcontrib>Da Xu, Richard Yi</creatorcontrib><creatorcontrib>Dacheng Tao</creatorcontrib><creatorcontrib>Baojun Zhao</creatorcontrib><title>Robust Object Tracking With Discrete Graph-Based Multiple Experts</title><title>IEEE transactions on image processing</title><addtitle>TIP</addtitle><addtitle>IEEE Trans Image Process</addtitle><description>Variations of target appearances due to illumination changes, heavy occlusions, and target deformations are the major factors for tracking drift. In this paper, we show that the tracking drift can be effectively corrected by exploiting the relationship between the current tracker and its historical tracker snapshots. Here, a multi-expert framework is established by the current tracker and its historical trained tracker snapshots. The proposed scheme is formulated into a unified discrete graph optimization framework, whose nodes are modeled by the hypotheses of the multiple experts. Furthermore, an exact solution of the discrete graph exists giving the object state estimation at each time step. With the unary and binary compatibility graph scores defined properly, the proposed framework corrects the tracker drift via selecting the best expert hypothesis, which implicitly analyzes the recent performance of the multi-expert by only evaluating graph scores at the current frame. Three base trackers are integrated into the proposed framework to validate its effectiveness. We first integrate the online SVM on a budget algorithm into the framework with significant improvement. Then, the regression correlation filters with hand-crafted features and deep convolutional neural network features are introduced, respectively, to further boost the tracking performance. The proposed three trackers are extensively evaluated on three data sets: TB-50, TB-100, and VOT2015. The experimental results demonstrate the excellent performance of the proposed approaches against the state-of-the-art methods.</description><subject>Computational modeling</subject><subject>convolutional neural network</subject><subject>Correlation</subject><subject>correlation filter</subject><subject>discrete graph</subject><subject>dynamic programming</subject><subject>Object tracking</subject><subject>Robustness</subject><subject>support vector machine</subject><subject>Support vector machines</subject><subject>Target tracking</subject><subject>Visualization</subject><issn>1057-7149</issn><issn>1941-0042</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2017</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kE1Lw0AQhhdRbK3eBUFy9JK6s0n241hrrYVKRSoel00ysalpE3cT0H_vltaeZmCed3h5CLkGOgSg6n45ex0yCmLIuOScwgnpg4ohpDRmp36niQgFxKpHLpxbUwpxAvyc9JiMEsll1CejtzrtXBss0jVmbbC0Jvsqt5_BR9mugsfSZRZbDKbWNKvwwTjMg5euasumwmDy06Bt3SU5K0zl8OowB-T9abIcP4fzxXQ2Hs3DLALVhpnMQTBKmUxVxkQqZYI0U0UhgEsl8iRGRB7lkgPmQkpeMGmYUiiMYczwaEDu9n8bW3936Fq98fWwqswW685pkDICwWMGHqV7NLO1cxYL3dhyY-yvBqp34rQXp3fi9EGcj9wevnfpBvNj4N-UB272QOl7Hs--aJJQGv0BIQZwSA</recordid><startdate>201706</startdate><enddate>201706</enddate><creator>Jiatong Li</creator><creator>Chenwei Deng</creator><creator>Da Xu, Richard Yi</creator><creator>Dacheng Tao</creator><creator>Baojun Zhao</creator><general>IEEE</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-3747-5128</orcidid></search><sort><creationdate>201706</creationdate><title>Robust Object Tracking With Discrete Graph-Based Multiple Experts</title><author>Jiatong Li ; Chenwei Deng ; Da Xu, Richard Yi ; Dacheng Tao ; Baojun Zhao</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c319t-c8d1720028b9c27b885e0c9ff716897d54eee63d861ed7886f28a299e7aa22a63</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2017</creationdate><topic>Computational modeling</topic><topic>convolutional neural network</topic><topic>Correlation</topic><topic>correlation filter</topic><topic>discrete graph</topic><topic>dynamic programming</topic><topic>Object tracking</topic><topic>Robustness</topic><topic>support vector machine</topic><topic>Support vector machines</topic><topic>Target tracking</topic><topic>Visualization</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Jiatong Li</creatorcontrib><creatorcontrib>Chenwei Deng</creatorcontrib><creatorcontrib>Da Xu, Richard Yi</creatorcontrib><creatorcontrib>Dacheng Tao</creatorcontrib><creatorcontrib>Baojun Zhao</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>IEEE transactions on image processing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Jiatong Li</au><au>Chenwei Deng</au><au>Da Xu, Richard Yi</au><au>Dacheng Tao</au><au>Baojun Zhao</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Robust Object Tracking With Discrete Graph-Based Multiple Experts</atitle><jtitle>IEEE transactions on image processing</jtitle><stitle>TIP</stitle><addtitle>IEEE Trans Image Process</addtitle><date>2017-06</date><risdate>2017</risdate><volume>26</volume><issue>6</issue><spage>2736</spage><epage>2750</epage><pages>2736-2750</pages><issn>1057-7149</issn><eissn>1941-0042</eissn><coden>IIPRE4</coden><abstract>Variations of target appearances due to illumination changes, heavy occlusions, and target deformations are the major factors for tracking drift. In this paper, we show that the tracking drift can be effectively corrected by exploiting the relationship between the current tracker and its historical tracker snapshots. Here, a multi-expert framework is established by the current tracker and its historical trained tracker snapshots. The proposed scheme is formulated into a unified discrete graph optimization framework, whose nodes are modeled by the hypotheses of the multiple experts. Furthermore, an exact solution of the discrete graph exists giving the object state estimation at each time step. With the unary and binary compatibility graph scores defined properly, the proposed framework corrects the tracker drift via selecting the best expert hypothesis, which implicitly analyzes the recent performance of the multi-expert by only evaluating graph scores at the current frame. Three base trackers are integrated into the proposed framework to validate its effectiveness. We first integrate the online SVM on a budget algorithm into the framework with significant improvement. Then, the regression correlation filters with hand-crafted features and deep convolutional neural network features are introduced, respectively, to further boost the tracking performance. The proposed three trackers are extensively evaluated on three data sets: TB-50, TB-100, and VOT2015. The experimental results demonstrate the excellent performance of the proposed approaches against the state-of-the-art methods.</abstract><cop>United States</cop><pub>IEEE</pub><pmid>28358683</pmid><doi>10.1109/TIP.2017.2686601</doi><tpages>15</tpages><orcidid>https://orcid.org/0000-0002-3747-5128</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1057-7149
ispartof IEEE transactions on image processing, 2017-06, Vol.26 (6), p.2736-2750
issn 1057-7149
1941-0042
language eng
recordid cdi_proquest_miscellaneous_1883176421
source IEEE Electronic Library (IEL)
subjects Computational modeling
convolutional neural network
Correlation
correlation filter
discrete graph
dynamic programming
Object tracking
Robustness
support vector machine
Support vector machines
Target tracking
Visualization
title Robust Object Tracking With Discrete Graph-Based Multiple Experts
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-07T23%3A36%3A06IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Robust%20Object%20Tracking%20With%20Discrete%20Graph-Based%20Multiple%20Experts&rft.jtitle=IEEE%20transactions%20on%20image%20processing&rft.au=Jiatong%20Li&rft.date=2017-06&rft.volume=26&rft.issue=6&rft.spage=2736&rft.epage=2750&rft.pages=2736-2750&rft.issn=1057-7149&rft.eissn=1941-0042&rft.coden=IIPRE4&rft_id=info:doi/10.1109/TIP.2017.2686601&rft_dat=%3Cproquest_RIE%3E1883176421%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1883176421&rft_id=info:pmid/28358683&rft_ieee_id=7885500&rfr_iscdi=true