A Digitized You in My Eye: A Perceptually Driven Spatial Communication Prototype for XR

Amid the proliferation of immersive extended reality (XR), three key challenges are identified: the transmission and synthesis of intensive volumetric streams, the need for personalized XR experiences, and the availability of a comprehensive 3D data capturing system. To overcome these challenges, we propose a "Digitized You in My Eye" (DYME) spatial communication prototype, which leverages 5G, distributed computing, and artificial intelligence (AI) to address challenges in XR. DYME proposes a 3D live volumetric chat procedure that eliminates real-time image capture by utilizing pre-existing digitized 3D models stored in the cloud. It further embraces a distributed methodology for volumetric streaming, encompassing the utilization of cloud, edge, and local devices, capitalizing on the proximity of user infrastructure, and employing expeditious transmission facilitated by AI generative models. Additionally, a user-specific management module (DYME manager) is integrated to personalize XR experiences based on user behaviors and preferences. By combining these technologies, DYME aims to provide efficient, tailored, and immersive XR experiences. The prototype demonstrates the potential of AI and 5G-driven solutions in addressing challenges and enhancing user experiences in XR environments.