Audio-visual auxiliary method, system and device, electronic equipment and storage medium

The invention discloses an audio-visual auxiliary method, system and device, electronic equipment and a storage medium. The audio-visual auxiliary method comprises the following steps: acquiring an image signal and a voice signal in an environment; converting the voice signal into text information; recognizing the image signal, and determining a sound source coordinate of the voice signal in combination with the voice signal; and displaying text information based on the sound source coordinates. According to the method provided by the invention, the voice signal can be converted into the character information to be matched with the image signal, so that the character information can be projected into the environment, the visual sense of a user can be stimulated, the user can concentrate more easily, and the speech understanding degree is improved. 本申请公开了一种视听辅助方法、系统、装置、电子设备及存储介质，包括：获取环境中的图像信号和语音信号；将语音信号转换为文字信息；对图像信号进行识别，结合语音信号确定语音信号的声源坐标；基于声源坐标显示文字信息。本申请提供的方法能够将语音信号转为文字信息与图像信号进行匹配从而使得文字信息能够投射到环境中，可以刺激使用者的视觉感官，