ARTIFICIAL INTELLIGENCE DEVICE FOR HARVESTING DATA FROM UNLABELED SOURCES AND CONTROL METHOD THEREOF

A method for controlling an artificial intelligence (AI) device can include receiving, via a processor, a base dataset, and receiving, via the processor, an image that is unlabeled. Also, the method can include inputting the image to at least one of a caption-based pipeline and a data programming pipeline to generate a labeled image training data sample including triplet information, the caption-based pipeline including a matching model configured to receive textual scene graph information for the image and bounding box information for the image, and the data programming pipeline including a feature extraction model configured to output three vectors and a label generator configured to receive the three vectors. The method can further include in response to the predicate matching a same predicate in a tail distribution of the base dataset, merging the labeled image training data sample with the base dataset to generate an enhanced dataset.