Gastrointestinal endoscope video key frame extraction method and system based on reinforcement learning and reward mechanism

The invention discloses a gastrointestinal endoscope video key frame extraction method and system based on reinforcement learning and a reward mechanism. The method comprises the following steps: 1, acquiring and preprocessing gastrointestinal endoscope video data; 2, decomposing the video frame int...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: HE BISHI, XU ZHE, LIU ENTONG, YAN JIAJIE, YE WANGWANG
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses a gastrointestinal endoscope video key frame extraction method and system based on reinforcement learning and a reward mechanism. The method comprises the following steps: 1, acquiring and preprocessing gastrointestinal endoscope video data; 2, decomposing the video frame into a sequence containing key characteristics based on MobileNet; 3, embedding a reward feedback mechanism adaptive to special conditions of the gastrointestinal endoscope based on Sequence; and 4, loading the obtained optimization model parameters, carrying out segmentation and de-noising operation on a video to be processed, unifying the sizes of video frames, freezing all optimized reward mechanisms and decision behaviors to obtain a key frame set, and if the accuracy rate exceeds a set value, verifying that the video is qualified. According to the method, deep feature representation extracted by MobileNet is utilized, good balance is achieved between balance model precision and calculation complexity, a receptive