Perception-oriented video coding based on image analysis and completion: A review

Perception-oriented video coding based on image analysis and completion (IAC) has received increasing attention over recent years. Several approaches have been proposed that follow diverging strategies: from full compatibility to hybrid block transform coding to alternative codec designs. In this paper, we review the most significant issues in IAC coding and their relevance for future codec designs. The most promising pathways will be analyzed along with limitations and open issues. The challenges in IAC-based video coding will be summarized using methods developed by the authors and others for block-based and region-based IAC coding. ► Perception-oriented video coding. ► Image analysis and completion (IAC). ► Overview methods fully compatible with hybrid block transform coding. ► Overview on alternative codec designs. ► Elaboration of challenges in IAC-based video coding.