Utilization of Volumetric Data in Stage performance1

In recent years, it has become common in the entertainment industry to use 3D and 4D data (data with time- sequential information added to 3D data) of performers for live stage production. The emergence of various application and devices in addition to the establishment of various methods for acquisition of 4D data with color information such as Photogrammetry, Grid Pattern Projection, and Time of Flight (TOF) makes it easier for those creators without special engineering skills to use those dataset, which leads to more frequent encounter with video works made with those technologies than before.On the other hand, real time manipulation of the 4D data with different coordinate systems and formats requires development of the special software or it needs calibration. Due to those technical difficulties, we still cannot say that it is prevailing to the broader public.Rhizomatiks has been doing research and development of the use of the 3D and 4D data made in different methods for the stage performance since 2010.This paper introduces practical examples of implementation and gives our future prospects as a conclusion.