SYSTEMS AND METHODS FOR EVALUATING NAVIGATION APPLICATION PERFORMANCE

To evaluate the performance of a navigation application, a navigation performance evaluation system receives indications of several routes generated by a navigation application operating on client devices of several users upon completion of the routes. The navigation performance evaluation system then provides a hindsight analysis of the routes to determine whether faster routes could have been generated. The hindsight analysis is performed by generating a hindsight route for each route based on actual traversal times for road segments in the same geographic area as the route. The actual traversal times are determined based on vehicles traveling on the road segments around the time that a user requested navigation directions corresponding to the route. Based on the hindsight analysis, the navigation performance evaluation system generates an overall performance metric for the routes indicating the ability of the navigation application to identify the fastest routes.