Chart question answering

A method, apparatus, and non-transitory computer readable medium for chart question answering are described. The method, apparatus, and non-transitory computer readable medium may receive a text query about a chart, identify a plurality of chart elements in the chart, associate a text string from the text query with corresponding chart elements from the plurality of chart elements, replace the text string in the text query with arbitrary rare words based on the association to produce an encoded query, generate an embedded query based on the encoded query, generate an image feature vector based on the chart, combine the embedded query and the image feature vector to produce a combined feature vector, compute an answer probability vector based on the combined feature vector, and provide an answer to the text query based on the answer probability vector.