Contents -- Foreword -- 1 Introduction -- 2 An Overview -- 3 Mathematical Preliminaries -- 4 Dynamic Programming under Certainty -- 5 Applications of Dynamic Programming under Certainty -- 6 Deterministic Dynamics -- 7 Measure Theory and Integration -- 8 Markov Processes -- 9 Stochastic Dynamic Programming -- 10 Applications of Stochastic Dynamic Programming -- 11 Strong Convergence of Markov Processes -- 12 Weak Convergence of Markov Processes -- 13 Applications of Convergence Results for Markov Processes -- 14 Laws of Large Numbers -- 15 Pareto Optima and Competitive Equilibria -- 16 Applications of Equilibrium Theory -- 17 Fixed-Point Arguments -- 18 Equilibria in Systems with Distortions.