HYBRID VIDEO AND FEATURE CODING AND DECODING

The present disclosure relates to hybrid video and feature encoding and decoding, with the encoding and decoding of the image feature being performed independently or differentially. The video and feature are encoded and decoded in separate layers, e.g., base layer and enhancement layer. The feature is extracted for a frame of the video, providing a frame-based feature-video association. A feature is extracted from an uncompressed video encoded in an enhancement layer into a feature bitstream. The video is encoded into a video bitstream, with the feature bitstream being embedded into the video bitstream by multiplexing both streams into an output bitstream. The image feature, which may be a differential image feature, is included in a sequence enhancement information SEI message of a frame header information of the video. The output bitstream is provided as input bitstream to a decoder, which de-multiplexes the input bitstream into a video bitstream and feature bitstream, using the SEI message of the frame header. Both bitstreams are decoded in their respective layers, and the image feature is located in the video using the frame-based feature-video association.