Practical Mathematical Optimization: An Introduction to Basic Optimization Theory and Classical and New Gradient-Based Algorithms

Presents basic optimization principles and gradient-based algorithms to a general audience. This work pays attention to the difficulties - such as noise, discontinuities, expense of function evaluations, and the existence of multiple minima - that often unnecessarily inhibit the use of gradient-based methods.