METHOD AND APPARATUS FOR EVALUATING TEMPORAL CHARACTERISTICS OF SEMANTIC IMAGE SEGMENTATION

The present invention is related to a method, a computer program, and an apparatus for evaluating temporal characteristics of semantic image segmentation, in particular for detecting perception instabilities on temporally sequential images of a video sequence. The invention is further related to an in-car control unit or a backend system, which make use of such a method or apparatus, and to a vehicle comprising such an in-car control unit. In a first step, image data of two sequential image frames are received (10). Then semantic segmentation predictions for each of the two sequential image frames are determined (11). Displacements between the image data of the two sequential image frames are estimated (12). The estimated displacements are applied (13) to the semantic segmentation prediction of the first of the two sequential image frames to generate an expected semantic segmentation prediction for the second of the two sequential image frames. The semantic segmentation prediction of the second of the two sequential image frames is evaluated (14) based on the expected semantic segmentation prediction for the second of the two sequential image frames.