ARTIFICIAL INTELLIGENCE DEVICE FOR ATTENTION OVER DETECTION BASED OBJECT SELECTION AND CONTROL METHOD THEREOF

A method for controlling an artificial intelligence (AI) device can include obtaining an input query, an input image, bounding boxes for objects detected in the input image, object labels corresponding to the bounding boxes, and at least one topic label for a word in the input query, generating at least one word embedding for the at least one topic label, and generating a plurality of word embeddings for the object labels corresponding to the bounding boxes. The method can further include generating output attention maps corresponding to scaled dot product attention matrices based on the at least one word embedding for the at least one topic label from the input query and each of the plurality of word embeddings for the object labels, and combining the output attention maps to generate a final attention map corresponding to the at least one topic label from the input query.