方法对比

	回声状态网络	长短期记忆网络	循环神经网络
领域	深度学习	深度学习	深度学习
方法族	Machine learning	Machine learning	Machine learning
起源年份	2004	1997	1986–1990
提出者	Herbert Jaeger & Harald Haas	Hochreiter, S. & Schmidhuber, J.	Rumelhart, D. E.; Elman, J. L.
类型	Recurrent neural network with fixed random reservoir	Recurrent neural network (gated memory cell)	Sequential neural network
开创性文献	Jaeger, H., & Haas, H. (2004). Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication. Science, 304(5667), 78–80.	Hochreiter, S. & Schmidhuber, J. (1997). Long Short-Term Memory. Neural Computation, 9(8), 1735–1780.	Elman, J. L. (1990). Finding structure in time. Cognitive Science, 14(2), 179–211.
别名	ESN, Liquid State Machine (related formulation), Reservoir Computing, Yankı Durum Ağı	LSTM (Uzun Kısa Dönem Bellek Ağı), long short-term memory, LSTM network, recurrent neural network with memory cells	RNN, Elman network, Jordan network, simple recurrent network
相关	3	5	3
摘要	An Echo State Network (ESN) is a type of recurrent neural network introduced by Herbert Jaeger and Harald Haas in 2004 that exploits a large, randomly connected, fixed recurrent layer — the reservoir — to project input signals into a high-dimensional nonlinear space. Only the linear output weights are trained, typically via ridge regression, making ESNs computationally inexpensive yet highly expressive for temporal and chaotic time-series modeling tasks.	LSTM (Long Short-Term Memory) is a recurrent neural network architecture, introduced by Sepp Hochreiter and Jürgen Schmidhuber in 1997, that can learn long-term dependencies in sequential data and is widely used for time-series and sequence prediction. It keeps an internal memory that lets information persist across many time steps.	A Recurrent Neural Network (RNN) is a class of neural network designed to process sequential data by maintaining a hidden state that carries information across time steps. Introduced in its modern form by Rumelhart et al. (1986) and further shaped by Elman (1990), RNNs became the dominant architecture for sequence modelling in NLP, speech, and time-series analysis before the rise of attention-based models.