METHOD AND APPARATUS FOR SUMMARIZATION OF UNSUPERVISED VIDEO WITH EFFICIENT KEY FRAME SELECTION REWARD FUNCTIONS

To provide a method and apparatus for summarization of unsupervised video with efficient key frame selection reward functions.SOLUTION: An attention-based video summarization method according to the present disclosure includes the steps of: generating a video summary by selecting a corresponding key...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: JO GEUN SIK, HONG MYUNG DUK, YOON UI NYOUNG
Format: Patent
Sprache:eng ; jpn
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator JO GEUN SIK
HONG MYUNG DUK
YOON UI NYOUNG
description To provide a method and apparatus for summarization of unsupervised video with efficient key frame selection reward functions.SOLUTION: An attention-based video summarization method according to the present disclosure includes the steps of: generating a video summary by selecting a corresponding key frame according to a predicted importance score, evaluating quality of the generated video summary, and executing policy gradient learning on an attention-based video summarization network by means of a learning module based on a policy gradient algorithm; calculating a normalization and reconstruction loss to control a probability of selecting a key frame by the video summarization network module using the importance score of the selected key frame; and generating a video summary by the video summary generation module on the basis of the calculated normalization and reconstruction loss.SELECTED DRAWING: Figure 2 【課題】効率的なキーフレーム選択報酬関数を備えた教師なし動画要約方法および装置を提供する。【解決手段】本開示のアテンション基盤の映像要約方法は、予測された重要度点数によって該当のキーフレームを選択して映像要約を生成し、生成された映像要約の品質を評価し、方策勾配アルゴリズム基盤の学習モジュールによってアテンション基盤の映像要約ネットワークに対する方策勾配(Policy Gradient)学習を実行する段階、選択されたキーフレームの重要度点数を用いて映像要約ネットワークモジュールによってキーフレームを選択する確率を制御するための正規化および再構成損失を計算する段階、および、計算された正規化および再構成損失に基づいて映像要約生成モジュールによって映像要約を生成する段階を含む。【選択図】図2
format Patent
fullrecord <record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_JP2023129179A</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>JP2023129179A</sourcerecordid><originalsourceid>FETCH-epo_espacenet_JP2023129179A3</originalsourceid><addsrcrecordid>eNqNi70KwjAURrs4iPoOF3fBtoN0vDQ3NGp-uEladClF4iRaqO-PUnwAh4_DgfMts1FTaKwANN85h4whepCWwUetkdUVg7IGrIRofHTErfIkoFWCLHQqNEBSqlqRCXCiC0hGTeDpTPV8ZOqQBchoZvfrbHEfHlPa_LjKtpJC3ezS-OrTNA639Ezv_uiKfVHmRZUfKiz_ij56zzis</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>METHOD AND APPARATUS FOR SUMMARIZATION OF UNSUPERVISED VIDEO WITH EFFICIENT KEY FRAME SELECTION REWARD FUNCTIONS</title><source>esp@cenet</source><creator>JO GEUN SIK ; HONG MYUNG DUK ; YOON UI NYOUNG</creator><creatorcontrib>JO GEUN SIK ; HONG MYUNG DUK ; YOON UI NYOUNG</creatorcontrib><description>To provide a method and apparatus for summarization of unsupervised video with efficient key frame selection reward functions.SOLUTION: An attention-based video summarization method according to the present disclosure includes the steps of: generating a video summary by selecting a corresponding key frame according to a predicted importance score, evaluating quality of the generated video summary, and executing policy gradient learning on an attention-based video summarization network by means of a learning module based on a policy gradient algorithm; calculating a normalization and reconstruction loss to control a probability of selecting a key frame by the video summarization network module using the importance score of the selected key frame; and generating a video summary by the video summary generation module on the basis of the calculated normalization and reconstruction loss.SELECTED DRAWING: Figure 2 【課題】効率的なキーフレーム選択報酬関数を備えた教師なし動画要約方法および装置を提供する。【解決手段】本開示のアテンション基盤の映像要約方法は、予測された重要度点数によって該当のキーフレームを選択して映像要約を生成し、生成された映像要約の品質を評価し、方策勾配アルゴリズム基盤の学習モジュールによってアテンション基盤の映像要約ネットワークに対する方策勾配(Policy Gradient)学習を実行する段階、選択されたキーフレームの重要度点数を用いて映像要約ネットワークモジュールによってキーフレームを選択する確率を制御するための正規化および再構成損失を計算する段階、および、計算された正規化および再構成損失に基づいて映像要約生成モジュールによって映像要約を生成する段階を含む。【選択図】図2</description><language>eng ; jpn</language><subject>CALCULATING ; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS ; COMPUTING ; COUNTING ; ELECTRIC COMMUNICATION TECHNIQUE ; ELECTRICITY ; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ; PHYSICS ; PICTORIAL COMMUNICATION, e.g. TELEVISION</subject><creationdate>2023</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20230914&amp;DB=EPODOC&amp;CC=JP&amp;NR=2023129179A$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,308,778,883,25547,76298</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20230914&amp;DB=EPODOC&amp;CC=JP&amp;NR=2023129179A$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>JO GEUN SIK</creatorcontrib><creatorcontrib>HONG MYUNG DUK</creatorcontrib><creatorcontrib>YOON UI NYOUNG</creatorcontrib><title>METHOD AND APPARATUS FOR SUMMARIZATION OF UNSUPERVISED VIDEO WITH EFFICIENT KEY FRAME SELECTION REWARD FUNCTIONS</title><description>To provide a method and apparatus for summarization of unsupervised video with efficient key frame selection reward functions.SOLUTION: An attention-based video summarization method according to the present disclosure includes the steps of: generating a video summary by selecting a corresponding key frame according to a predicted importance score, evaluating quality of the generated video summary, and executing policy gradient learning on an attention-based video summarization network by means of a learning module based on a policy gradient algorithm; calculating a normalization and reconstruction loss to control a probability of selecting a key frame by the video summarization network module using the importance score of the selected key frame; and generating a video summary by the video summary generation module on the basis of the calculated normalization and reconstruction loss.SELECTED DRAWING: Figure 2 【課題】効率的なキーフレーム選択報酬関数を備えた教師なし動画要約方法および装置を提供する。【解決手段】本開示のアテンション基盤の映像要約方法は、予測された重要度点数によって該当のキーフレームを選択して映像要約を生成し、生成された映像要約の品質を評価し、方策勾配アルゴリズム基盤の学習モジュールによってアテンション基盤の映像要約ネットワークに対する方策勾配(Policy Gradient)学習を実行する段階、選択されたキーフレームの重要度点数を用いて映像要約ネットワークモジュールによってキーフレームを選択する確率を制御するための正規化および再構成損失を計算する段階、および、計算された正規化および再構成損失に基づいて映像要約生成モジュールによって映像要約を生成する段階を含む。【選択図】図2</description><subject>CALCULATING</subject><subject>COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS</subject><subject>COMPUTING</subject><subject>COUNTING</subject><subject>ELECTRIC COMMUNICATION TECHNIQUE</subject><subject>ELECTRICITY</subject><subject>IMAGE DATA PROCESSING OR GENERATION, IN GENERAL</subject><subject>PHYSICS</subject><subject>PICTORIAL COMMUNICATION, e.g. TELEVISION</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2023</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNqNi70KwjAURrs4iPoOF3fBtoN0vDQ3NGp-uEladClF4iRaqO-PUnwAh4_DgfMts1FTaKwANN85h4whepCWwUetkdUVg7IGrIRofHTErfIkoFWCLHQqNEBSqlqRCXCiC0hGTeDpTPV8ZOqQBchoZvfrbHEfHlPa_LjKtpJC3ezS-OrTNA639Ezv_uiKfVHmRZUfKiz_ij56zzis</recordid><startdate>20230914</startdate><enddate>20230914</enddate><creator>JO GEUN SIK</creator><creator>HONG MYUNG DUK</creator><creator>YOON UI NYOUNG</creator><scope>EVB</scope></search><sort><creationdate>20230914</creationdate><title>METHOD AND APPARATUS FOR SUMMARIZATION OF UNSUPERVISED VIDEO WITH EFFICIENT KEY FRAME SELECTION REWARD FUNCTIONS</title><author>JO GEUN SIK ; HONG MYUNG DUK ; YOON UI NYOUNG</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_JP2023129179A3</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>eng ; jpn</language><creationdate>2023</creationdate><topic>CALCULATING</topic><topic>COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS</topic><topic>COMPUTING</topic><topic>COUNTING</topic><topic>ELECTRIC COMMUNICATION TECHNIQUE</topic><topic>ELECTRICITY</topic><topic>IMAGE DATA PROCESSING OR GENERATION, IN GENERAL</topic><topic>PHYSICS</topic><topic>PICTORIAL COMMUNICATION, e.g. TELEVISION</topic><toplevel>online_resources</toplevel><creatorcontrib>JO GEUN SIK</creatorcontrib><creatorcontrib>HONG MYUNG DUK</creatorcontrib><creatorcontrib>YOON UI NYOUNG</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>JO GEUN SIK</au><au>HONG MYUNG DUK</au><au>YOON UI NYOUNG</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>METHOD AND APPARATUS FOR SUMMARIZATION OF UNSUPERVISED VIDEO WITH EFFICIENT KEY FRAME SELECTION REWARD FUNCTIONS</title><date>2023-09-14</date><risdate>2023</risdate><abstract>To provide a method and apparatus for summarization of unsupervised video with efficient key frame selection reward functions.SOLUTION: An attention-based video summarization method according to the present disclosure includes the steps of: generating a video summary by selecting a corresponding key frame according to a predicted importance score, evaluating quality of the generated video summary, and executing policy gradient learning on an attention-based video summarization network by means of a learning module based on a policy gradient algorithm; calculating a normalization and reconstruction loss to control a probability of selecting a key frame by the video summarization network module using the importance score of the selected key frame; and generating a video summary by the video summary generation module on the basis of the calculated normalization and reconstruction loss.SELECTED DRAWING: Figure 2 【課題】効率的なキーフレーム選択報酬関数を備えた教師なし動画要約方法および装置を提供する。【解決手段】本開示のアテンション基盤の映像要約方法は、予測された重要度点数によって該当のキーフレームを選択して映像要約を生成し、生成された映像要約の品質を評価し、方策勾配アルゴリズム基盤の学習モジュールによってアテンション基盤の映像要約ネットワークに対する方策勾配(Policy Gradient)学習を実行する段階、選択されたキーフレームの重要度点数を用いて映像要約ネットワークモジュールによってキーフレームを選択する確率を制御するための正規化および再構成損失を計算する段階、および、計算された正規化および再構成損失に基づいて映像要約生成モジュールによって映像要約を生成する段階を含む。【選択図】図2</abstract><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier
ispartof
issn
language eng ; jpn
recordid cdi_epo_espacenet_JP2023129179A
source esp@cenet
subjects CALCULATING
COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
COMPUTING
COUNTING
ELECTRIC COMMUNICATION TECHNIQUE
ELECTRICITY
IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
PHYSICS
PICTORIAL COMMUNICATION, e.g. TELEVISION
title METHOD AND APPARATUS FOR SUMMARIZATION OF UNSUPERVISED VIDEO WITH EFFICIENT KEY FRAME SELECTION REWARD FUNCTIONS
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-16T16%3A03%3A14IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=JO%20GEUN%20SIK&rft.date=2023-09-14&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3EJP2023129179A%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true