This work is aimed at mathematics and engineering graduate students and researchers in the areas of optimization, dynamical systems, control sys- tems, signal processing, and linear algebra. The motivation for the results developed here arises from advanced engineering applications and the emer- gence of highly parallel computing machines for tackling such applications. The problems solved are those of linear algebra and linear systems the- ory, and include such topics as diagonalizing a symmetric matrix, singular value decomposition, balanced realizations, linear programming, sensitivity...