As is well known, Pontryagin's maximum principle and Bellman's dynamic programming are the two principal and most commonly used approaches in solving stochastic optimal control problems. * An interesting phenomenon one can observe from the literature is that these two approaches have been developed separately and independently. Since both methods are used to investigate the same problems, a natural question one will ask is the fol- lowing: (Q) What is the relationship betwccn the maximum principlc and dy- namic programming in stochastic optimal controls? There did exist some researches (prior...
As is well known, Pontryagin's maximum principle and Bellman's dynamic programming are the two principal and most commonly used approaches in solving ...
Beginning with Jackson networks and ending with spatial queuing systems, this book describes several basic stochastic network processes, with the focus on network processes that have tractable expressions for the equilibrium probability distribution of the numbers of units at the stations. Intended for graduate students and researchers in engineering, science and mathematics interested in the basics of stochastic networks that have been developed over the last twenty years, the text assumes a graduate course in stochastic processes without measure theory, emphasising multi-dimensional Markov...
Beginning with Jackson networks and ending with spatial queuing systems, this book describes several basic stochastic network processes, with the focu...
A self-contained treatment of stochastic processes arising from models for queues, insurance risk, and dams and data communication, using their sample function properties. The approach is based on the fluctuation theory of random walks, L vy processes, and Markov-additive processes, in which Wiener-Hopf factorisation plays a central role. This second edition includes results for the virtual waiting time and queue length in single server queues, while the treatment of continuous time storage processes is thoroughly revised and simplified. With its prerequisite of a graduate-level course in...
A self-contained treatment of stochastic processes arising from models for queues, insurance risk, and dams and data communication, using their sample...
The object of queueing theory (or the theory of mass service) is the investigation of stochastic processes of a special form which are called queueing (or service) processes in this book. Two approaches to the definition of these processes are possible depending on the direction of investigation. In accordance with this fact, the exposition of the subject can be broken up into two self-contained parts. The first of these forms the content of this monograph. . The definition of the queueing processes (systems) to be used here is dose to the traditional one and is connected with the...
The object of queueing theory (or the theory of mass service) is the investigation of stochastic processes of a special form which are called queueing...
This research monograph presents results to researchers in stochastic calculus, forward and backward stochastic differential equations, connections between diffusion processes and second order partial differential equations (PDEs), and financial mathematics. It pays special attention to the relations between SDEs/BSDEs and second order PDEs under minimal regularity assumptions, and also extends those results to equations with multivalued coefficients. The authors present in particular the theory of reflected SDEs in the above mentioned framework and include exercises at the end of each...
This research monograph presents results to researchers in stochastic calculus, forward and backward stochastic differential equations, connections...
One of the first books in the timely and important area of heavy traffic analysis of controlled and uncontrolled stochastics networks, by one of the leading authors in the field. The general theory is developed, with possibly state dependent parameters, and specialized to many different cases of practical interest.
One of the first books in the timely and important area of heavy traffic analysis of controlled and uncontrolled stochastics networks, by one of th...
A self-contained and coherent account of probabilistic techniques, covering: distance measures, kernel rules, nearest neighbour rules, Vapnik-Chervonenkis theory, parametric classification, and feature extraction. Each chapter concludes with problems and exercises to further the readers understanding. Both research workers and graduate students will benefit from this wide-ranging and up-to-date account of a fast- moving field.
A self-contained and coherent account of probabilistic techniques, covering: distance measures, kernel rules, nearest neighbour rules, Vapnik-Chervone...
The present volume is an adaptation of a series of lectures on numerical mathematics which the author has been giving to students of mathematics at the Novosibirsk State University during the span of several years. In dealing with problems of applied and numerical mathematics the author sought to focus his attention on those complicated problems of mathe- matical physics which, in the course of their solution, can be reduced to simpler and theoretically better developed problems allowing effective algorithmic realization on modern computers. It is usually these kinds of problems that a young...
The present volume is an adaptation of a series of lectures on numerical mathematics which the author has been giving to students of mathematics at th...
Stochastic control is a very active area of research. This monograph, written by two leading authorities in the field, has been updated to reflect the latest developments. It covers effective numerical methods for stochastic control problems in continuous time on two levels, that of practice and that of mathematical development. It is broadly accessible for graduate students and researchers.
Stochastic control is a very active area of research. This monograph, written by two leading authorities in the field, has been updated to reflect ...
This book provides an introduction to stochastic controls, via the method of dynamic programming, formulated by nonlinear semigroup. The dynamic programming principle, originated by R. Bellman in 1950s, is known as the two stage optimization procedure and gives a powerful tool to analyze stochastic control problems. Through the dependence of value function on its terminal cost function, we construct a nonlinear two parameter semigroup which formulates the dynamic programming principle and whose generator provides Hamilton--Jacobi--Bellman equation. Here we mainly concerned with finite time...
This book provides an introduction to stochastic controls, via the method of dynamic programming, formulated by nonlinear semigroup. The dynamic progr...
