This manual presents a number of self-learning (adaptive) control algorithms and theoretical as well as practical results for both unconstrained and constrained finite Markov chains. It seeks to efficiently process new information by adjusting the control strategies directly or indirectly.

In the last decade there has been a steadily growing need for and interest in computational methods for solving stochastic optimization problems with or wihout constraints. Optimization techniques have been gaining greater acceptance in many industrial applications, and learning systems have made a significant impact on engineering problems in many areas, including modelling, control, optimization, pattern recognition, signal processing and diagnosis. Learning automata have an advantage over other methods in being applicable across a wide range of functions. Featuring new and efficient...

This volume deals with continuous time dynamic neural networks theory applied to the solution of basic problems in robust control theory, including identification, state space estimation (based on neuro-observers) and trajectory tracking. The plants to be identified and controlled are assumed to be a priori unknown but belonging to a given class containing internal unmodelled dynamics and external perturbations as well. The error stability analysis and the corresponding error bounds for different problems are presented. The effectiveness of the suggested approach is illustrated by its...