The basic stochastic approximation algorithms introduced by Robbins and MonroandbyKieferandWolfowitzintheearly1950shavebeenthesubject of an enormous literature, both theoretical and applied. This is due to the large number of applications and the interesting theoretical issues in the analysis of "dynamically de?ned" stochastic processes. The basic paradigm is a stochastic di?erence equation such as ? = ? + Y, where ? takes n+1 n n n n its values in some Euclidean space, Y is a random variable, and the "step n size" > 0 is small and might go to zero as n . In its simplest form, n ? is a...

This book focuses on two-time-scale Markov chains in discrete time. Our motivation stems from existing and emerging applications in optimization and control of complex systems in manufacturing, wireless communication, and ?nancial engineering. Much of our e?ort in this book is devoted to designing system models arising from various applications, analyzing them via analytic and probabilistic techniques, and developing feasible compu- tionalschemes. Ourmainconcernistoreducetheinherentsystemcompl- ity. Although each of the applications has its own distinct characteristics, all of them are...

This IMA Volume in Mathematics and its Applications TOPICS IN STOCHASTIC ANALYSIS AND NONPARAMETRIC ESTIMATION contains papers that were presented at the IMA Participating Institution conference on "Asymptotic Analysis in Stochastic Processes, Nonparamet ric Estimation, and Related Problems" held on September 15-17, 2006 at Wayne State University. The conference, which was one of approximately ten selected each year for partial support by the IMA through its affiliates program, was dedicated to Professor Rafail Z. Khasminskii on the occasion th of his 75 birthday, in recognition of his...

The basic stochastic approximation algorithms introduced by Robbins and MonroandbyKieferandWolfowitzintheearly1950shavebeenthesubject of an enormous literature, both theoretical and applied. This is due to the large number of applications and the interesting theoretical issues in the analysis of "dynamically de?ned" stochastic processes. The basic paradigm is a stochastic di?erence equation such as ? = ? + Y, where ? takes n+1 n n n n its values in some Euclidean space, Y is a random variable, and the "step n size" > 0 is small and might go to zero as n . In its simplest form, n ? is a...

This edited volume contains 16 research articles. It presents recent and pressing issues in stochastic processes, control theory, differential games, optimization, and their applications in finance, manufacturing, queueing networks, and climate control. One of the salient features is that the book is highly multi-disciplinary. The book is dedicated to Professor Suresh Sethi on the occasion of his 60th birthday, in view of his distinguished career.