Reservoir Computing: Theory, Physical Implementations, and Applications

ISBN-13: 9789811316869 / Angielski / Twarda / 2021 / 458 str.

Kohei Nakajima; Ingo Fischer

Opis

The exciting field of reservoir computing, which originated from a pioneering study on echo state networks and liquid state machines in the early 2000s, has emerged as a highly promising and efficient training scheme for recurrent neural networks.

Spis treści

Chapter 1: The cerebral cortex: A delay coupled recurrent oscillator network?.- Chapter 2: Cortico-Striatal Origins of Reservoir Computing, Mixed Selectivity and Higher Cognitive Function.- Chapter 3: Reservoirs learn to learn.- Chapter 4: Deep Reservoir Computing.- Chapter 5: On the characteristics and structures of dynamical systems suitable for reservoir computing.- Chapter 6: Reservoir Computing for Forecasting Large Spatiotemporal Dynamical Systems.- Chapter 7: Reservoir Computing in Material Substrates.- Chapter 8: Physical Reservoir Computing in Robotics.- Chapter 9: Reservoir Computing in MEMS.- Chapter 10: Neuromorphic Electronic Systems for Reservoir Computing.- Chapter 11: Reservoir Computing using Autonomous Boolean Networks Realized on Field-Programmable Gate Arrays.- Chapter 12: Programmable Fading Memory in Atomic Switch Systems for Error Checking Applications.- Chapter 13: Reservoir computing leveraging the transient non-linear dynamics of spin-torque nano-oscillators.- Chapter 14: Reservoir computing based on spintronics technology.- Chapter 15: Reservoir computing with dipole-coupled nanomagnets.- Chapter 16: Performance improvement of delay-based photonic reservoir computing.- Chapter 17: Computing with integrated photonic reservoirs.- Chapter 18: Quantum reservoir computing.- Chapter 19: Towards NMR Quantum Reservoir Computing.

O autorze

Kohei Nakajima is an Associate Professor in the Graduate School of Information Science and Technology at the University of Tokyo. He received BS, MS, and PhD degrees from the University of Tokyo in 2004, 2006, and 2009, respectively. After obtaining his PhD, he spent five years as a post-doctoral fellow and a JSPS Postdoctoral Fellow for Research Abroad at the University of Zurich and at ETH Zurich in Switzerland. In 2013, he was awarded the title of the Hakubi researcher at Kyoto University, and until 2017, he was an Assistant Professor at the Hakubi Center for Advanced Research at Kyoto University. He was also a JST PRESTO researcher from 2015 to 2019. His research interests include nonlinear dynamical systems, information theory, reservoir computing, physical reservoir computing, and soft robotics.

Ingo Fischer has since 2009 been a Research Professor of the Spanish National Research Council (CSIC) at the Institute for Cross-Disciplinary Physics and Complex Systems IFISC (UIB-CSIC) in Palma de Mallorca (Spain). Moreover, he is head of the University group ‘Experimental Physics of Complex Systems’ at the Universitat de les Illes Balears (UIB) and currently Deputy Scientific Director of the Maria de Maeztu Unit of Excellence on ‘Information Processing in and by Complex Systems’. His research has been covering nonlinear photonics, brain-inspired information processing, in particular reservoir computing, complex systems and their applications, broad area semiconductor lasers and quantum chaos. He received his diploma and Ph.D. degrees in physics from Philipps-University Marburg (Germany) in 1992 and 1995, respectively. He was a Post-doctoral researcher at Advanced Telecommunication Research Labs at Kyoto (Japan), was Hochschul-Assistent (Assistant Professor) at TU Darmstadt (Germany), senior visiting scientist at Vrije Universiteit Brussel (Belgium), and from 2007 to 2009 full professor (chair) for photonics and integrated systems at Heriot-Watt University, Edinburgh (U.K.) In 2017 and 2018, he has also been Distinguished Visiting Professor at the Yukawa Institute, Kyoto University (Japan). He received several research prizes, including the first Hassian Industry Cooperation Prize for Technology Transfer.     

Blurb

This book is the first comprehensive book about reservoir computing (RC). RC is a powerful and broadly applicable computational framework based on recurrent neural networks. Its advantages lie in small training data set requirements, fast training, inherent memory and high flexibility for various hardware implementations. It originated from computational neuroscience and machine learning but has, in recent years, spread dramatically, and has been introduced into a wide variety of fields, including complex systems science, physics, material science, biological science, quantum machine learning, optical communication systems, and robotics. Reviewing the current state of the art and providing a concise guide to the field, this book introduces readers to its basic concepts, theory, techniques, physical implementations and applications.

The book is sub-structured into two major parts: theory and physical implementations. Both parts consist of a compilation of chapters, authored by leading experts in their respective fields. The first part is devoted to theoretical developments of RC, extending the framework from the conventional recurrent neural network context to a more general dynamical systems context. With this broadened perspective, RC is not restricted to the area of machine learning but is being connected to a much wider class of systems. The second part of the book focuses on the utilization of physical dynamical systems as reservoirs, a framework referred to as physical reservoir computing. A variety of physical systems and substrates have already been suggested and used for the implementation of reservoir computing. Among these physical systems which cover a wide range of spatial and temporal scales, are mechanical and optical systems, nanomaterials, spintronics, and quantum many body systems.

This book offers a valuable resource for researchers (Ph.D. students and experts alike) and practitioners working in the field of machine learning, artificial intelligence, robotics, neuromorphic computing, complex systems, and physics.