This book is intended as a text covering the central concepts and techniques of Competitive Markov Decision Processes. It is an attempt to present a rig orous treatment that combines two significant research topics: Stochastic Games and Markov Decision Processes, which have been studied exten sively, and at times quite independently, by mathematicians, operations researchers, engineers, and economists. Since Markov decision processes can be viewed as a special noncompeti tive case of stochastic games, we introduce the new terminology Competi tive Markov Decision Processes that emphasizes the...
This book is intended as a text covering the central concepts and techniques of Competitive Markov Decision Processes. It is an attempt to present a r...
The general theory of stochastic processes and the more specialized theory of Markov processes evolved enormously in the second half of the last century. In parallel, the theory of controlled Markov chains (or Markov decision processes) was being pioneered by control engineers and operations researchers. Researchers in Markov processes and controlled Markov chains have been, for a long time, aware of the synergies between these two subject areas. However, this may be the first volume dedicated to highlighting these synergies and, almost certainly, it is the first volume that emphasizes the...
The general theory of stochastic processes and the more specialized theory of Markov processes evolved enormously in the second half of the last ce...
The 21st century promises to be an era dominated by international response to c- tain global environmental challenges such as climate change, depleting biodiversity and biocapacity as well as general atmospheric, water and soil pollution problems. Consequently, Environmental decision making (EDM) is a socially important ?eld of development for Operations Research and Management Science (OR/MS). - certainty is an important feature of these decision problems and it intervenes at very different time and space scales. The Handbook on "Uncertainty and Environmental Decision Making" provides a...
The 21st century promises to be an era dominated by international response to c- tain global environmental challenges such as climate change, depletin...
This research monograph summarizes a line of research that maps certain classical problems of discrete mathematics and operations research - such as the Hamiltonian Cycle and the Travelling Salesman Problems - into convex domains where continuum analysis can be carried out. Arguably, the inherent difficulty of these, now classical, problems stems precisely from the discrete nature of domains in which these problems are posed. The convexification of domains underpinning these results is achieved by assigning probabilistic interpretation to key elements of the original deterministic...
This research monograph summarizes a line of research that maps certain classical problems of discrete mathematics and operations research - such a...
The 21st century promises to be an era dominated by international response to c- tain global environmental challenges such as climate change, depleting biodiversity and biocapacity as well as general atmospheric, water and soil pollution problems. Consequently, Environmental decision making (EDM) is a socially important ?eld of development for Operations Research and Management Science (OR/MS). - certainty is an important feature of these decision problems and it intervenes at very different time and space scales. The Handbook on "Uncertainty and Environmental Decision Making" provides a...
The 21st century promises to be an era dominated by international response to c- tain global environmental challenges such as climate change, depletin...
The general theory of stochastic processes and the more specialized theory of Markov processes evolved enormously in the second half of the last century. In parallel, the theory of controlled Markov chains (or Markov decision processes) was being pioneered by control engineers and operations researchers. Researchers in Markov processes and controlled Markov chains have been, for a long time, aware of the synergies between these two subject areas. However, this may be the first volume dedicated to highlighting these synergies and, almost certainly, it is the first volume that emphasizes the...
The general theory of stochastic processes and the more specialized theory of Markov processes evolved enormously in the second half of the last ce...
This research monograph summarizes a line of research that maps certain classical problems of discrete mathematics and operations research - such as the Hamiltonian Cycle and the Travelling Salesman Problems - into convex domains where continuum analysis can be carried out. Arguably, the inherent difficulty of these, now classical, problems stems precisely from the discrete nature of domains in which these problems are posed. The convexification of domains underpinning these results is achieved by assigning probabilistic interpretation to key elements of the original deterministic...
This research monograph summarizes a line of research that maps certain classical problems of discrete mathematics and operations research - such a...
