The theory of linear discrete time filtering started with a paper by Kol mogorov in 1941. He addressed the problem for stationary random se quences and introduced the idea of the innovations process, which is a useful tool for the more general problems considered here. The reader may object and note that Gauss discovered least squares much earlier; however, I want to distinguish between the problem of parameter estimation, the Gauss problem, and that of Kolmogorov estimation of a process. This sep aration is of more than academic interest as the least squares problem leads to the normal...
The theory of linear discrete time filtering started with a paper by Kol mogorov in 1941. He addressed the problem for stationary random se quences an...