Design and assessment of a vision computing-based multimedia interaction system for hybrid teaching

Hybrid teaching is a novel education mode that combines both online activities and offline activities. The main technical point is to facilitate the interaction between online and offline scenarios. The vision computing acts as the most intuitive way for this purpose. As a consequence, this paper designs a vision computing-based multimedia interaction system for hybrid teaching, and makes some empirical evaluation. It is composed of two parts: design and evaluation. For the former, macroscopic architecture of the interaction system is presented, and fundamental protocol for video transmission and analysis is defined. On this basis, an optimal scheduling algorithm that coordinates collaborative work of several modules is designed. For the latter, a prototype system is developed for experimental simulation to test abilities of both visual information processing and interactive scheduling. The results show that the designed multimedia interaction system can well implement hybrid teaching affairs under the guarantee of remote interaction performance.