FORMULATING NATURAL LANGUAGE DESCRIPTIONS BASED ON TEMPORAL SEQUENCES OF IMAGES

Implementations are described herein for formulating natural language descriptions based on temporal sequences of digital images. In various implementations, a natural language input may be analyzed. Based on the analysis, a semantic scope to be imposed on a natural language description that is to be formulated based on a temporal sequence of digital images may be determined. The temporal sequence of digital images may be processed based on one or more machine learning models to identify one or more candidate features that fall within the semantic scope. One or more other features that fall outside of the semantic scope may be disregarded. The natural language description may be formulated to describe one or more of the candidate features.