A Numerical Method for Solving Singular Stochastic Control Problems

Singular stochastic control has found diverse applications in operations management, economics, and finance. However, in all but the simplest of cases, singular stochastic control problems cannot be solved analytically. In this paper, we propose a method for numerically solving a class of singular s...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Operations research 2004-07, Vol.52 (4), p.563-582
Hauptverfasser: Kumar, Sunil, Muthuraman, Kumar
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Singular stochastic control has found diverse applications in operations management, economics, and finance. However, in all but the simplest of cases, singular stochastic control problems cannot be solved analytically. In this paper, we propose a method for numerically solving a class of singular stochastic control problems. We combine finite element methods that numerically solve partial differential equations with a policy update procedure based on the principle of smooth pasting to iteratively solve Hamilton-Jacobi-Bellman equations associated with the stochastic control problem. A key feature of our method is that the presence of singular controls simplifies the procedure. We illustrate the method on two examples of singular stochastic control problems, one drawn from economics and the other from queueing systems.
ISSN:0030-364X
1526-5463
DOI:10.1287/opre.1030.0107