Adaptive aggregation methods for infinite horizon dynamic programming

A class of iterative aggregation algorithms for solving infinite horizon dynamic programming problems is proposed. The idea is to interject aggregation iterations in the course of the usual successive approximation method. An important feature that sets this method apart from earlier ones is that the aggregate groups of states change adaptively from one aggregation iteration to the next, depending on the progress of the computation. This allows acceleration of convergence in difficult problems involving multiple-ergodic classes for which methods using fixed groups of aggregate states are ineffective. No knowledge of special problem structure is utilized by the algorithms.< >