TWO-WAY IN-VEHICLE VIRTUAL PERSONAL ASSISTANT

Embodiments include a computer-implemented method for interacting with a user. The method comprises utilizing a processor associated with a virtual personal assistance system. The processor is configured to perform the steps of obtaining first sensor data from a first sensor included in a plurality of sensors. The first sensor data comprises audio speech input. The steps further comprise analyzing the audio speech input using a first deep learning model to generate an intended meaning, selecting second sensor data to obtain based on the intended meaning, obtaining the second sensor data from a second sensor included in the plurality of sensors, analyzing the second sensor data and the intended meaning to generate a prediction value, applying a second deep learning model to the prediction value to generate a text segment, and converting the text segment into a natural language audio output; and outputting the natural language audio output to the user.