Feature set optimization in vision-based positioning

In one embodiment, a method for optimizing a set of matched features is provided. The method includes matching features between an optical image and a geo-referenced orthoimage to produce an initial set of matched features. An initial position solution is then determined for the optical image using the initial set of N matched features. The initial set of N matched features are then optimized based on a set of N sub-solutions and the initial position solution, wherein each of the N sub-solutions is a position solution using a different set of (N−1) matched features. A refined position solution is then calculated for the optical image using the optimized set of matched features.