Interactive augmented reality system using projector-camera system and smart phone

This paper proposes a user immersive augmented reality (AR) system which utilizes three kinds of computer vision technology: projector-camera-based spatial AR, hand-gesture-based user interaction, and mobile AR. The proposed system augments 2D virtual contents on a tabletop using the projector-camera-based AR, and a user can interact with the augmented 2D contents by using natural hand gestures and a physical object by using smart phone. Also, the proposed system further enhances user-immersion by adopting the mobile AR, which augments 3D virtual contents on the physical object when user sees the object through smart phone's camera. This paper verifies the effectiveness of the proposed AR system through implementing a car driving application.