Virtual world control system using sensed information and adaptation engine

The sensed information (e.g., temperature, humidity, light intensity, gas intensity) obtained from a user's vicinity plays an important role in the generation of environmental changes, the main character's reactions, and in storyline changes in the virtual world. In this paper, a method is proposed to transform sensed information from real world to standardized XML instances and to control virtual world objects. The sensed information from the real world is transformed into XML instances standardized by MPEG-V Part 5 (Data formats for Interaction Device) schemes and then delivered to a Real-to-Virtual (RV) adaptation engine. The engine generates another XML instance standardized by MPEG-V Part 4 (Virtual world object characteristics) that describes the control information of avatars and objects in the virtual world. The system is demonstrated by a real-world mock-up equipped with a sensor set and a virtual space realized in Second Life. [Display omitted] . ► We introduce a virtual-world control system using MPEG-V standard descriptions. ► Virtual-world control system is composed of three modules, SICM, AEM, and VWCM. ► SICM generates sensed information metadata acquired from sensors. ► AEM converts received sensed information into virtual world object metadata. ► VWCM controls the virtual world based on the virtual world object metadata.