Systems and Methods for Automatically Classifying Businesses from Images

Computer-implemented methods and systems for automatically classifying businesses from imagery can include providing one or more images of a location entity as input to a statistical model that can be applied to each image. A plurality of classification labels for the location entity in the one or more images can be generated and provided as an output of the statistical model. The plurality of classification labels can be generated by selecting from an ontology that identifies predetermined relationships between location entities and categories associated with corresponding classification labels at multiple levels of granularity. Confidence scores for the plurality of classification labels can be generated to indicate a likelihood level that each generated classification label is accurate for its corresponding location entity. Associations based on the classification labels generated for each image can be stored in a database and used to help retrieve relevant business information requested by a user.