Originally developed by Claude Shannon in the 1940s, information theory laid the foundations for the digital revolution, and is now an essential tool in telecommunications, genetics, linguistics, brain sciences, and deep space communication. In this richly illustrated book, accessible examples are used to introduce information theory in terms of everyday games like 20 questions before more advanced topics are explored. Online MatLab and Python computer programs provide hands-on experience of information theory in action, and PowerPoint slides give support for teaching. Written in an informal...

Discovered by an 18th century mathematician and preacher, Bayes' rule is a cornerstone of modern probability theory. In this richly illustrated book, a range of accessible examples is used to show how Bayes' rule is actually a natural consequence of common sense reasoning. Bayes' rule is then derived using intuitive graphical representations of probability, and Bayesian analysis is applied to parameter estimation using the MatLab and Python programs provided online. The tutorial style of writing, combined with a comprehensive glossary, makes this an ideal primer for novices who wish to become...