"This monograph ... is intended to be a textbook for graduate students in statistics, computer science and engineering. It covers a very broad range of topics ... . Each chapter is finished by a rather long list of relevant references. Thus, it can be used also as a reference book by researches in the fields of machine learning, pattern recognition ... . it can be a useful reference to many important Monte Carol methods." (Jaromír Antoch, zbMATH 1483.65001, 2022)
"True to its goal, the text offers a comprehensive overview on Monte Carlo methods. ... this text is a quality reference for researchers interested in computer vision, computer graphics, machine learning, artificial intelligence and related fields." (Grant Innerst, MAA Reviews, July 18, 2021)
1 Introduction to Monte Carlo Methods.- 2 Sequential Monte Carlo.- 3 Markov Chain Monte Carlo - the Basics.- 4 Metropolis Methods and Variants.- 5 Gibbs Sampler and its Variants.- 6 Cluster Sampling Methods.- 7 Convergence Analysis of MCMC.- 8 Data Driven Markov Chain Monte Carlo.- 9 Hamiltonian and Langevin Monte Carlo.- 10 Learning with Stochastic Gradient.- 11 Mapping the Energy Landscape.
Adrian Barbu received his PhD in Mathematics from Ohio State University in 2000 and his PhD in Computer Science from the University of California, Los Angeles in 2005. His research interests are in machine learning, computer vision and medical imaging. He received the 2011 Thomas A. Edison Patent Award with his co-authors from Siemens for their work on Marginal Space Learning. In 2007 he joined the Statistics Department at Florida State University, first as an assistant professor, and since 2013 as an associate professor.
Song-Chun Zhu received his PhD degree in Computer Science from Harvard University in 1996. He is currently a professor of Statistics and Computer Science, and director of the Center for Vision, Learning, Cognition and Autonomy, at the University of California, Los Angeles. His main research interest has been in pursuing a unified statistical and computational framework for vision and intelligence, which includes the Spatial, Temporal and Causal And-Or graph (STC-AOG) as a unified representation and numerous Monte Carlo methods for inference and learning. He has published over 200 papers in the areas of computer vision, statistical learning, cognition, AI, and robot autonomy. He has received a number of honors, including the David Marr Prize in 2003 for image parsing, and twice Marr Prize honorary nominations in 1999 for texture modeling and in 2007 for object modeling. In 2008 he received the J.K. Aggarwal Prize from the Intl. Association of Pattern Recognition for “contributions to a unified foundation for visual pattern conceptualization, modeling, learning, and inference”. In 2013 he received the Helmholtz Test-of-Time Prize for a paper on image segmentation. He has been a fellow of IEEE Computer Society since 2011, and the principal investigator leading several ONR MURI and DARPA teams working on scene and event understanding and cognitive robots under a unified mathematical framework.
This book seeks to bridge the gap between statistics and computer science. It provides an overview of Monte Carlo methods, including Sequential Monte Carlo, Markov Chain Monte Carlo, Metropolis-Hastings, Gibbs Sampler, Cluster Sampling, Data Driven MCMC, Stochastic Gradient descent, Langevin Monte Carlo, Hamiltonian Monte Carlo, and energy landscape mapping. Due to its comprehensive nature, the book is suitable for developing and teaching graduate courses on Monte Carlo methods. To facilitate learning, each chapter includes several representative application examples from various fields. The book pursues two main goals: (1) It introduces researchers to applying Monte Carlo methods to broader problems in areas such as Computer Vision, Computer Graphics, Machine Learning, Robotics, Artificial Intelligence, etc.; and (2) it makes it easier for scientists and engineers working in these areas to employ Monte Carlo methods to enhance their research.