Determining Performance of Autonomy Decision-Making Engines

An example method for simulation testing an autonomy software is provided. The example method may include receiving, at processing circuitry, mission parameters indicative of a test mission, environmental parameters, and vehicle parameters. The method may further include performing, by the processing circuitry, an adaptive search using a surrogate model of the autonomy software under test to selectively generate test scenarios for simulation, and clustering the plurality of test scenarios based on performance score metric values to determine performance boundaries for the autonomy software under test. The method may further include ranking the plurality of test scenarios based on a respective distance to a performance boundary to identify test scenarios of interest for modification of the autonomy software or real-world field testing of an autonomous vehicle.