Machine learningDeep learning / NLP / CV
Transfer Learning with Word2Vec
Transfer Learning with Word2Vec uses word embeddings pre-trained on large text corpora via the Skip-gram or CBOW objectives introduced by Mikolov et al. (2013) to initialize the embedding layer of a downstream NLP model. This approach transfers distributional semantic knowledge to tasks where labeled data is scarce, consistently outperforming random initialization.
Open in MethodMindSoonVideoSoon
Read the full method
Members only
Sign inSign in with a free account to read this section.
Sources
- Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., & Dean, J. (2013). Distributed representations of words and phrases and their compositionality. Advances in Neural Information Processing Systems (NIPS), 26, 3111-3119. link ↗
- Kim, Y. (2014). Convolutional Neural Networks for Sentence Classification. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 1746-1751. DOI: 10.3115/v1/D14-1181 ↗