So sánh phương pháp
Xem các phương pháp đã chọn cạnh nhau; những hàng khác biệt được làm nổi bật.
| Học chuyển giao với Word2Vec× | Mạng nơ-ron hồi quy× | |
|---|---|---|
| Lĩnh vực | Học sâu | Học sâu |
| Họ | Machine learning | Machine learning |
| Năm ra đời≠ | 2013-2014 | 1986–1990 |
| Người khởi xướng≠ | Mikolov, T. et al. (Word2Vec); transfer-learning application popularised by Kim, Y. | Rumelhart, D. E.; Elman, J. L. |
| Loại≠ | Transfer learning / embedding initialization | Sequential neural network |
| Công trình gốc≠ | Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., & Dean, J. (2013). Distributed representations of words and phrases and their compositionality. Advances in Neural Information Processing Systems (NIPS), 26, 3111-3119. link ↗ | Elman, J. L. (1990). Finding structure in time. Cognitive Science, 14(2), 179–211. DOI ↗ |
| Tên gọi khác | Word2Vec transfer learning, pre-trained Word2Vec embeddings, Word2Vec embedding initialization, Word2Vec fine-tuning | RNN, Elman network, Jordan network, simple recurrent network |
| Liên quan≠ | 5 | 3 |
| Tóm tắt≠ | Transfer Learning with Word2Vec uses word embeddings pre-trained on large text corpora via the Skip-gram or CBOW objectives introduced by Mikolov et al. (2013) to initialize the embedding layer of a downstream NLP model. This approach transfers distributional semantic knowledge to tasks where labeled data is scarce, consistently outperforming random initialization. | A Recurrent Neural Network (RNN) is a class of neural network designed to process sequential data by maintaining a hidden state that carries information across time steps. Introduced in its modern form by Rumelhart et al. (1986) and further shaped by Elman (1990), RNNs became the dominant architecture for sequence modelling in NLP, speech, and time-series analysis before the rise of attention-based models. |
| ScholarGateBộ dữ liệu ↗ |
|
|