InsightVideo: toward hierarchical video content organization for efficient browsing, summarization and retrieval
Hierarchical video browsing and feature-based video retrieval are two standard methods for accessing video content. Very little research, however, has addressed the benefits of integrating these two methods for more effective and efficient video content access. In this paper, we introduce InsightVid...
Gespeichert in:
| Veröffentlicht in: | IEEE transactions on multimedia 2005-08, Vol.7 (4), p.648-666 |
|---|---|
| Hauptverfasser: | , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 666 |
|---|---|
| container_issue | 4 |
| container_start_page | 648 |
| container_title | IEEE transactions on multimedia |
| container_volume | 7 |
| creator | Xingquan Zhu Elmagarmid, A.K. Xiangyang Xue Lide Wu Catlin, A.C. |
| description | Hierarchical video browsing and feature-based video retrieval are two standard methods for accessing video content. Very little research, however, has addressed the benefits of integrating these two methods for more effective and efficient video content access. In this paper, we introduce InsightVideo, a video analysis and retrieval system, which joins video content hierarchy, hierarchical browsing and retrieval for efficient video access. We propose several video processing techniques to organize the content hierarchy of the video. We first apply a camera motion classification and key-frame extraction strategy that operates in the compressed domain to extract video features. Then, shot grouping, scene detection and pairwise scene clustering strategies are applied to construct the video content hierarchy. We introduce a video similarity evaluation scheme at different levels (key-frame, shot, group, scene, and video.) By integrating the video content hierarchy and the video similarity evaluation scheme, hierarchical video browsing and retrieval are seamlessly integrated for efficient content access. We construct a progressive video retrieval scheme to refine user queries through the interactions of browsing and retrieval. Experimental results and comparisons of camera motion classification, key-frame extraction, scene detection, and video retrieval are presented to validate the effectiveness and efficiency of the proposed algorithms and the performance of the system. |
| doi_str_mv | 10.1109/TMM.2005.850977 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_miscellaneous_896182932</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>1468151</ieee_id><sourcerecordid>896182932</sourcerecordid><originalsourceid>FETCH-LOGICAL-c362t-ae1428eaa5d299b9594b502a897d9ec1e36ff18434612f5e3bd63a978ad9150c3</originalsourceid><addsrcrecordid>eNp9kcFLXDEQxh9SoVZ77qGXUGh78a1JXpKX9FakVUHpRb2G2bzJbuRtsk3eKvWvb5ZVBA-eZuD7zTDzfU3zidEZY9ScXF9dzTilcqYlNX2_1xwwI1hLad-_q73ktDWc0ffNh1LuKGVC0v6gWV_EEhbL6TYMmH6QKT1AHsgyYIbslsHBSO63EnEpThgnkvICYniEKaRIfMoEvQ8ubKV5Tg8lxMUxKZvVCvIzBXEgGacc8B7Go2bfw1jw41M9bG5-_7o-PW8v_5xdnP68bF2n-NQCMsE1AsiBGzM30oi5pBy06QeDjmGnvGdadEIx7iV280F1YHoNg2GSuu6w-b7bu87p7wbLZFehOBxHiJg2xWqjmOam45X89ibJNVXVUFbBL6_Au7TJsX5htTK03qhkhU52kMuplIzernOoZvyzjNptULYGZbdB2V1QdeLr01oo1W-fIbpQXsaUEb1RonKfd1xAxBdZKM0k6_4DNsqdQQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>869095965</pqid></control><display><type>article</type><title>InsightVideo: toward hierarchical video content organization for efficient browsing, summarization and retrieval</title><source>IEEE Electronic Library (IEL)</source><creator>Xingquan Zhu ; Elmagarmid, A.K. ; Xiangyang Xue ; Lide Wu ; Catlin, A.C.</creator><creatorcontrib>Xingquan Zhu ; Elmagarmid, A.K. ; Xiangyang Xue ; Lide Wu ; Catlin, A.C.</creatorcontrib><description>Hierarchical video browsing and feature-based video retrieval are two standard methods for accessing video content. Very little research, however, has addressed the benefits of integrating these two methods for more effective and efficient video content access. In this paper, we introduce InsightVideo, a video analysis and retrieval system, which joins video content hierarchy, hierarchical browsing and retrieval for efficient video access. We propose several video processing techniques to organize the content hierarchy of the video. We first apply a camera motion classification and key-frame extraction strategy that operates in the compressed domain to extract video features. Then, shot grouping, scene detection and pairwise scene clustering strategies are applied to construct the video content hierarchy. We introduce a video similarity evaluation scheme at different levels (key-frame, shot, group, scene, and video.) By integrating the video content hierarchy and the video similarity evaluation scheme, hierarchical video browsing and retrieval are seamlessly integrated for efficient content access. We construct a progressive video retrieval scheme to refine user queries through the interactions of browsing and retrieval. Experimental results and comparisons of camera motion classification, key-frame extraction, scene detection, and video retrieval are presented to validate the effectiveness and efficiency of the proposed algorithms and the performance of the system.</description><identifier>ISSN: 1520-9210</identifier><identifier>EISSN: 1941-0077</identifier><identifier>DOI: 10.1109/TMM.2005.850977</identifier><identifier>CODEN: ITMUF8</identifier><language>eng</language><publisher>New York, NY: IEEE</publisher><subject>Applied sciences ; Artificial intelligence ; Browsing ; Cameras ; Classification ; Computer networks ; Computer science ; Computer science; control theory; systems ; Content based retrieval ; Electronics ; Exact sciences and technology ; Feature extraction ; Gunshot detection systems ; Hierarchies ; Layout ; Motion detection ; Pattern recognition. Digital image processing. Computational geometry ; Recording and replay of audio and video signals ; Retrieval ; Shot ; Similarity ; Standards organizations ; Storage and reproduction of information ; Strategy ; Studies ; Video browsing ; Video compression ; video content organization ; video retrieval ; video similarity assessment</subject><ispartof>IEEE transactions on multimedia, 2005-08, Vol.7 (4), p.648-666</ispartof><rights>2005 INIST-CNRS</rights><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2005</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c362t-ae1428eaa5d299b9594b502a897d9ec1e36ff18434612f5e3bd63a978ad9150c3</citedby><cites>FETCH-LOGICAL-c362t-ae1428eaa5d299b9594b502a897d9ec1e36ff18434612f5e3bd63a978ad9150c3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/1468151$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27903,27904,54736</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/1468151$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=16947964$$DView record in Pascal Francis$$Hfree_for_read</backlink></links><search><creatorcontrib>Xingquan Zhu</creatorcontrib><creatorcontrib>Elmagarmid, A.K.</creatorcontrib><creatorcontrib>Xiangyang Xue</creatorcontrib><creatorcontrib>Lide Wu</creatorcontrib><creatorcontrib>Catlin, A.C.</creatorcontrib><title>InsightVideo: toward hierarchical video content organization for efficient browsing, summarization and retrieval</title><title>IEEE transactions on multimedia</title><addtitle>TMM</addtitle><description>Hierarchical video browsing and feature-based video retrieval are two standard methods for accessing video content. Very little research, however, has addressed the benefits of integrating these two methods for more effective and efficient video content access. In this paper, we introduce InsightVideo, a video analysis and retrieval system, which joins video content hierarchy, hierarchical browsing and retrieval for efficient video access. We propose several video processing techniques to organize the content hierarchy of the video. We first apply a camera motion classification and key-frame extraction strategy that operates in the compressed domain to extract video features. Then, shot grouping, scene detection and pairwise scene clustering strategies are applied to construct the video content hierarchy. We introduce a video similarity evaluation scheme at different levels (key-frame, shot, group, scene, and video.) By integrating the video content hierarchy and the video similarity evaluation scheme, hierarchical video browsing and retrieval are seamlessly integrated for efficient content access. We construct a progressive video retrieval scheme to refine user queries through the interactions of browsing and retrieval. Experimental results and comparisons of camera motion classification, key-frame extraction, scene detection, and video retrieval are presented to validate the effectiveness and efficiency of the proposed algorithms and the performance of the system.</description><subject>Applied sciences</subject><subject>Artificial intelligence</subject><subject>Browsing</subject><subject>Cameras</subject><subject>Classification</subject><subject>Computer networks</subject><subject>Computer science</subject><subject>Computer science; control theory; systems</subject><subject>Content based retrieval</subject><subject>Electronics</subject><subject>Exact sciences and technology</subject><subject>Feature extraction</subject><subject>Gunshot detection systems</subject><subject>Hierarchies</subject><subject>Layout</subject><subject>Motion detection</subject><subject>Pattern recognition. Digital image processing. Computational geometry</subject><subject>Recording and replay of audio and video signals</subject><subject>Retrieval</subject><subject>Shot</subject><subject>Similarity</subject><subject>Standards organizations</subject><subject>Storage and reproduction of information</subject><subject>Strategy</subject><subject>Studies</subject><subject>Video browsing</subject><subject>Video compression</subject><subject>video content organization</subject><subject>video retrieval</subject><subject>video similarity assessment</subject><issn>1520-9210</issn><issn>1941-0077</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2005</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNp9kcFLXDEQxh9SoVZ77qGXUGh78a1JXpKX9FakVUHpRb2G2bzJbuRtsk3eKvWvb5ZVBA-eZuD7zTDzfU3zidEZY9ScXF9dzTilcqYlNX2_1xwwI1hLad-_q73ktDWc0ffNh1LuKGVC0v6gWV_EEhbL6TYMmH6QKT1AHsgyYIbslsHBSO63EnEpThgnkvICYniEKaRIfMoEvQ8ubKV5Tg8lxMUxKZvVCvIzBXEgGacc8B7Go2bfw1jw41M9bG5-_7o-PW8v_5xdnP68bF2n-NQCMsE1AsiBGzM30oi5pBy06QeDjmGnvGdadEIx7iV280F1YHoNg2GSuu6w-b7bu87p7wbLZFehOBxHiJg2xWqjmOam45X89ibJNVXVUFbBL6_Au7TJsX5htTK03qhkhU52kMuplIzernOoZvyzjNptULYGZbdB2V1QdeLr01oo1W-fIbpQXsaUEb1RonKfd1xAxBdZKM0k6_4DNsqdQQ</recordid><startdate>200508</startdate><enddate>200508</enddate><creator>Xingquan Zhu</creator><creator>Elmagarmid, A.K.</creator><creator>Xiangyang Xue</creator><creator>Lide Wu</creator><creator>Catlin, A.C.</creator><general>IEEE</general><general>Institute of Electrical and Electronic Engineers</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>IQODW</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>F28</scope><scope>FR3</scope></search><sort><creationdate>200508</creationdate><title>InsightVideo: toward hierarchical video content organization for efficient browsing, summarization and retrieval</title><author>Xingquan Zhu ; Elmagarmid, A.K. ; Xiangyang Xue ; Lide Wu ; Catlin, A.C.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c362t-ae1428eaa5d299b9594b502a897d9ec1e36ff18434612f5e3bd63a978ad9150c3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2005</creationdate><topic>Applied sciences</topic><topic>Artificial intelligence</topic><topic>Browsing</topic><topic>Cameras</topic><topic>Classification</topic><topic>Computer networks</topic><topic>Computer science</topic><topic>Computer science; control theory; systems</topic><topic>Content based retrieval</topic><topic>Electronics</topic><topic>Exact sciences and technology</topic><topic>Feature extraction</topic><topic>Gunshot detection systems</topic><topic>Hierarchies</topic><topic>Layout</topic><topic>Motion detection</topic><topic>Pattern recognition. Digital image processing. Computational geometry</topic><topic>Recording and replay of audio and video signals</topic><topic>Retrieval</topic><topic>Shot</topic><topic>Similarity</topic><topic>Standards organizations</topic><topic>Storage and reproduction of information</topic><topic>Strategy</topic><topic>Studies</topic><topic>Video browsing</topic><topic>Video compression</topic><topic>video content organization</topic><topic>video retrieval</topic><topic>video similarity assessment</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Xingquan Zhu</creatorcontrib><creatorcontrib>Elmagarmid, A.K.</creatorcontrib><creatorcontrib>Xiangyang Xue</creatorcontrib><creatorcontrib>Lide Wu</creatorcontrib><creatorcontrib>Catlin, A.C.</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>Pascal-Francis</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>ANTE: Abstracts in New Technology & Engineering</collection><collection>Engineering Research Database</collection><jtitle>IEEE transactions on multimedia</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Xingquan Zhu</au><au>Elmagarmid, A.K.</au><au>Xiangyang Xue</au><au>Lide Wu</au><au>Catlin, A.C.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>InsightVideo: toward hierarchical video content organization for efficient browsing, summarization and retrieval</atitle><jtitle>IEEE transactions on multimedia</jtitle><stitle>TMM</stitle><date>2005-08</date><risdate>2005</risdate><volume>7</volume><issue>4</issue><spage>648</spage><epage>666</epage><pages>648-666</pages><issn>1520-9210</issn><eissn>1941-0077</eissn><coden>ITMUF8</coden><abstract>Hierarchical video browsing and feature-based video retrieval are two standard methods for accessing video content. Very little research, however, has addressed the benefits of integrating these two methods for more effective and efficient video content access. In this paper, we introduce InsightVideo, a video analysis and retrieval system, which joins video content hierarchy, hierarchical browsing and retrieval for efficient video access. We propose several video processing techniques to organize the content hierarchy of the video. We first apply a camera motion classification and key-frame extraction strategy that operates in the compressed domain to extract video features. Then, shot grouping, scene detection and pairwise scene clustering strategies are applied to construct the video content hierarchy. We introduce a video similarity evaluation scheme at different levels (key-frame, shot, group, scene, and video.) By integrating the video content hierarchy and the video similarity evaluation scheme, hierarchical video browsing and retrieval are seamlessly integrated for efficient content access. We construct a progressive video retrieval scheme to refine user queries through the interactions of browsing and retrieval. Experimental results and comparisons of camera motion classification, key-frame extraction, scene detection, and video retrieval are presented to validate the effectiveness and efficiency of the proposed algorithms and the performance of the system.</abstract><cop>New York, NY</cop><pub>IEEE</pub><doi>10.1109/TMM.2005.850977</doi><tpages>19</tpages></addata></record> |
| fulltext | fulltext_linktorsrc |
| identifier | ISSN: 1520-9210 |
| ispartof | IEEE transactions on multimedia, 2005-08, Vol.7 (4), p.648-666 |
| issn | 1520-9210 1941-0077 |
| language | eng |
| recordid | cdi_proquest_miscellaneous_896182932 |
| source | IEEE Electronic Library (IEL) |
| subjects | Applied sciences Artificial intelligence Browsing Cameras Classification Computer networks Computer science Computer science control theory systems Content based retrieval Electronics Exact sciences and technology Feature extraction Gunshot detection systems Hierarchies Layout Motion detection Pattern recognition. Digital image processing. Computational geometry Recording and replay of audio and video signals Retrieval Shot Similarity Standards organizations Storage and reproduction of information Strategy Studies Video browsing Video compression video content organization video retrieval video similarity assessment |
| title | InsightVideo: toward hierarchical video content organization for efficient browsing, summarization and retrieval |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-28T04%3A03%3A46IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=InsightVideo:%20toward%20hierarchical%20video%20content%20organization%20for%20efficient%20browsing,%20summarization%20and%20retrieval&rft.jtitle=IEEE%20transactions%20on%20multimedia&rft.au=Xingquan%20Zhu&rft.date=2005-08&rft.volume=7&rft.issue=4&rft.spage=648&rft.epage=666&rft.pages=648-666&rft.issn=1520-9210&rft.eissn=1941-0077&rft.coden=ITMUF8&rft_id=info:doi/10.1109/TMM.2005.850977&rft_dat=%3Cproquest_RIE%3E896182932%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=869095965&rft_id=info:pmid/&rft_ieee_id=1468151&rfr_iscdi=true |