Mixture reality-based assistive system for visually impaired people

Individuals with visual impairments often face challenges in their daily lives, particularly in terms of independent mobility. To address this issue, we present a mixed reality-based assistive system for visually impaired individuals, which comprises a Microsoft Hololens2 device and a website and utilizes a simultaneous localization and mapping (SLAM) algorithm to capture various large indoor scenes in real-time. This system incorporates remote multi-person assistance technology and navigation technology to aid visually impaired individuals. To evaluate the effectiveness of our system, we conducted an experiment in which several participants completed a large indoor scene maintenance task. Our experimental results demonstrate that the system is robust and can be utilized in a wide range of indoor environments. Additionally, the system enhances environmental perception and enables visually impaired individuals to navigate independently, thus facilitating successful task completion. •Individuals with visual impairments often face challenges in their daily lives, particularly in terms of independent mobility.•To address this issue, we first present a mixed reality-based assistive system for visually impaired individuals, which comprises a Microsoft Hololens2 device and a website.•Second, remote multi-person assistance and navigation technologies are integrated together to aid visually impaired individuals.