Rule-Based Evolutionary Online Learning Systems: A Principled Approach to Lcs Analysis and Design

ISBN-13: 9783642064777 / Angielski / Miękka / 2010 / 259 str.

Martin V. Butz

Opis

Rule-basedevolutionaryonlinelearningsystems, oftenreferredtoasMichig- style learning classi?er systems (LCSs), were proposed nearly thirty years ago (Holland, 1976; Holland, 1977) originally calling them cognitive systems. LCSs combine the strength of reinforcement learning with the generali- tion capabilities of genetic algorithms promising a ?exible, online general- ing, solely reinforcement dependent learning system. However, despite several initial successful applications of LCSs and their interesting relations with a- mal learning and cognition, understanding of the systems remained somewhat obscured. Questions concerning learning complexity or convergence remained unanswered. Performance in di?erent problem types, problem structures, c- ceptspaces, andhypothesisspacesstayednearlyunpredictable. Thisbookhas the following three major objectives: (1) to establish a facetwise theory - proachforLCSsthatpromotessystemanalysis, understanding, anddesign;(2) to analyze, evaluate, and enhance the XCS classi?er system (Wilson, 1995) by the means of the facetwise approach establishing a fundamental XCS learning theory; (3) to identify both the major advantages of an LCS-based learning approach as well as the most promising potential application areas. Achieving these three objectives leads to a rigorous understanding of LCS functioning that enables the successful application of LCSs to diverse problem types and problem domains. The quantitative analysis of XCS shows that the inter- tive, evolutionary-based online learning mechanism works machine learning competitively yielding a low-order polynomial learning complexity. Moreover, the facetwise analysis approach facilitates the successful design of more - vanced LCSs including Holland's originally envisioned cognitive systems. Martin V.

Spis treści

Prerequisites.- Simple Learning Classifier Systems.- The XCS Classifier System.- How XCS Works: Ensuring Effective Evolutionary Pressures.- When XCS Works: Towards Computational Complexity.- Effective XCS Search: Building Block Processing.- XCS in Binary Classification Problems.- XCS in Multi-Valued Problems.- XCS in Reinforcement Learning Problems.- Facetwise LCS Design.- Towards Cognitive Learning Classifier Systems.- Summary and Conclusions.

Blurb

This book offers a comprehensive introduction to learning classifier systems (LCS) – or more generally, rule-based evolutionary online learning systems. LCSs learn interactively – much like a neural network – but with an increased adaptivity and flexibility. This book provides the necessary background knowledge on problem types, genetic algorithms, and reinforcement learning as well as a principled, modular analysis approach to understand, analyze, and design LCSs. The analysis is exemplarily carried through on the XCS classifier system – the currently most prominent system in LCS research. Several enhancements are introduced to XCS and evaluated. An application suite is provided including classification, reinforcement learning and data-mining problems. Reconsidering John Holland’s original vision, the book finally discusses the current potentials of LCSs for successful applications in cognitive science and related areas.