BENCHMARKING PROGRESSIVE SYSTEMS FOR SOLVING COMBINATORIAL PROBLEMS

A system is provided for benchmarking a progressive combinatorial solver. The system may initialize a parametric model collector, and perform a plurality of parametric trials associated with respective numbers of sub-part iterations of the progressive combinatorial solver. For each of the plurality of parametric trials, the system may initialize a statistical data collector. The system may perform a plurality of randomized executions of the progressive combinatorial solver, and add data including metric values for respective solutions of the executions to the statistical data collector. The system may then determine statistical parameter(s) of data in the statistical data collector, and add data including an indication of the respective number of sub-part iterations, a cost of finding the metric values for the respective solutions, and the statistical parameters of the trial to the parametric data collector. And the system may determine a best-fit model from data in the parametric data collector.