PROGRAM, DEVICE AND METHOD FOR ESTIMATING CAUSAL RELATION WORD FROM IMAGE

To provide a program, device and method for estimating the causal relation word of cause and result words from an image.SOLUTION: The present invention is made to function, regarding a training stage, as a causal relation learning engine for inputting the feature vector of a caption sentence as teaching data in which an image and a caption sentence inked to the image are correlated to each other and estimating a cause and a result word from the caption sentence estimated as having a causal relation, and made to function as an image learning engine for inputting the feature vector of the image and being trained so as to output the cause and the result words estimated by the causal relation learning engine. Furthermore, the image learning engine is made to function, regarding an estimation stage, so as to input an image as relevant data and output a cause and a result word.SELECTED DRAWING: Figure 1 【課題】画像から原因語及び結果語の因果関係語を推定するプログラム、装置及び方法【解決手段】教師データとして、画像と、当該画像に紐付く字幕文とが対応付けられており、訓練段階について、字幕文の特徴ベクトルを入力し、因果関係有りと推定された字幕文から原因語及び結果語を推定する因果関係学習エンジンと、画像の特徴ベクトルを入力し、因果関係学習エンジンによって推定された原因語及び結果語を出力するように訓練する画像学習エンジンとして機能させる。また、推定段階について、画像学習エンジンは、対象データとしての画像を入力し、原因語及び結果語を出力するように機能させる。【選択図】図１