VIDEO SUMMARY DEVICE, VIDEO SUMMARY METHOD, AND VIDEO SUMMARY PROGRAM

PROBLEM TO BE SOLVED: To obtain a high quality summary video by suppressing the occurrence of an information loss.SOLUTION: A video summary device comprises: means for dividing a video into a plurality of video sections for each video modal; means for extracting a feature amount about each of the video sections; means for constructing a similarity matrix for each modal on the basis of the feature amount, the similarity matrix having, as an element, a similarity between the video section and other video section; means for constructing a relation matrix for a relation between the video sections by using a co-occurrence relation between the video section for one modal and the video section for the other modal; means for generating, by performing propagation processing on similarity between modals using the similarity matrix and the relation matrix, the similarity matrix in a main modal in which the similarity between the video sections for each of the modals is reflected; a clustering unit for performing clustering with the similarity matrix of the main modal and classifying into a plurality of clusters; and means for extracting a representative video section from each of the clusters, combining the obtained representative video sections to generate a summary video, and outputting the generated summary video.