MULTIMODAL INTENT ENTITY RESOLVER

A method comprises receiving from an input device, a capture of user action as an initial command; interpreting the initial command into an interpreted command; generating a first set of modified commands that are based on the interpreted command, including: a first modified command that has a phonetic similarity to the interpreted command within a certain threshold, and a second modified command that is semantically related to an earlier command; transmitting, to an output device, the first set of modified commands; receiving a response to a group of commands including the first set of modified commands; recording an identifier of an input device from which the response was received and a type of the response in a log; when the response includes acknowledging a specific command of the group of commands as an accepted command, executing, the accepted command; otherwise, generating a second set of modified commands.