Recent advances in physical reservoir computing: A review
- PMID: 30981085
- DOI: 10.1016/j.neunet.2019.03.005
Recent advances in physical reservoir computing: A review
Abstract
Reservoir computing is a computational framework suited for temporal/sequential data processing. It is derived from several recurrent neural network models, including echo state networks and liquid state machines. A reservoir computing system consists of a reservoir for mapping inputs into a high-dimensional space and a readout for pattern analysis from the high-dimensional states in the reservoir. The reservoir is fixed and only the readout is trained with a simple method such as linear regression and classification. Thus, the major advantage of reservoir computing compared to other recurrent neural networks is fast learning, resulting in low training cost. Another advantage is that the reservoir without adaptive updating is amenable to hardware implementation using a variety of physical systems, substrates, and devices. In fact, such physical reservoir computing has attracted increasing attention in diverse fields of research. The purpose of this review is to provide an overview of recent advances in physical reservoir computing by classifying them according to the type of the reservoir. We discuss the current issues and perspectives related to physical reservoir computing, in order to further expand its practical applications and develop next-generation machine learning systems.
Keywords: Machine learning; Neural networks; Neuromorphic device; Nonlinear dynamical systems; Reservoir computing.
Copyright © 2019 The Author(s). Published by Elsevier Ltd.. All rights reserved.
Similar articles
-
Recurrent kernel machines: computing with infinite echo state networks.Neural Comput. 2012 Jan;24(1):104-33. doi: 10.1162/NECO_a_00200. Epub 2011 Aug 18. Neural Comput. 2012. PMID: 21851278
-
Transfer-RLS method and transfer-FORCE learning for simple and fast training of reservoir computing models.Neural Netw. 2021 Nov;143:550-563. doi: 10.1016/j.neunet.2021.06.031. Epub 2021 Jul 6. Neural Netw. 2021. PMID: 34304003
-
A Unified Framework for Reservoir Computing and Extreme Learning Machines based on a Single Time-delayed Neuron.Sci Rep. 2015 Oct 8;5:14945. doi: 10.1038/srep14945. Sci Rep. 2015. PMID: 26446303 Free PMC article.
-
An Overview of Machine Learning within Embedded and Mobile Devices-Optimizations and Applications.Sensors (Basel). 2021 Jun 28;21(13):4412. doi: 10.3390/s21134412. Sensors (Basel). 2021. PMID: 34203119 Free PMC article. Review.
-
Dynamic memristor for physical reservoir computing.Nanoscale. 2024 Jul 25;16(29):13847-13860. doi: 10.1039/d4nr01445f. Nanoscale. 2024. PMID: 38984618 Review.
Cited by
-
Neuromorphic overparameterisation and few-shot learning in multilayer physical neural networks.Nat Commun. 2024 Aug 27;15(1):7377. doi: 10.1038/s41467-024-50633-1. Nat Commun. 2024. PMID: 39191747 Free PMC article.
-
In Situ Observation of Topotactic Linker Reorganization in the Aperiodic Metal-Organic Framework TRUMOF-1.J Am Chem Soc. 2024 Oct 9;146(40):27262-27266. doi: 10.1021/jacs.4c09487. Epub 2024 Sep 26. J Am Chem Soc. 2024. PMID: 39325965 Free PMC article.
-
Reservoir Computing-Based Design of ZnO Memristor-Type Digital Identification Circuits.Micromachines (Basel). 2022 Oct 10;13(10):1700. doi: 10.3390/mi13101700. Micromachines (Basel). 2022. PMID: 36296053 Free PMC article.
-
Reservoir computing with dielectric relaxation at an electrode-ionic liquid interface.Sci Rep. 2022 Apr 28;12(1):6958. doi: 10.1038/s41598-022-10152-9. Sci Rep. 2022. PMID: 35484156 Free PMC article.
-
Interpretable Design of Reservoir Computing Networks Using Realization Theory.IEEE Trans Neural Netw Learn Syst. 2023 Sep;34(9):6379-6389. doi: 10.1109/TNNLS.2021.3136495. Epub 2023 Sep 1. IEEE Trans Neural Netw Learn Syst. 2023. PMID: 34982700 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources