This book describes the development of statistics, which for more than a century was called "the calculus of observations." The approach will help readers gain a clearer understanding of the historical development as well as the essential nature of some of the commonly used statistical estimation procedures. Detailed descriptions of the fitting of linear relationships by the method of least squares and the closely related least absolute deviations and minimax absolute deviations procedures are presented, along with some of the important work by Laplace, Gauss, and Adrain.