方法证据记录
Self-supervised Transfer learning
Self-supervised transfer learning combines two powerful paradigms: a model first learns rich representations from unlabeled data using self-supervised pretext tasks, then those learned representations are transferred and fine-tuned on a downstream task with limited labeled data. This approach underlies landmark systems such as BERT in NLP and SimCLR and DINO in computer vision, dramatically reducing labeled-data requirements across many domains.
源记录
引文逐字复制自方法源记录。这些引文不代表任何层级的验证。
Self-supervised Pre-training for Transfer Learning
分类方法记录 · ml-model / machine-learning
- Chen, T., Kornblith, S., Norouzi, M., & Hinton, G. (2020). A simple framework for contrastive learning of visual representations. In Proceedings of the 37th International Conference on Machine Learning (ICML), PMLR 119, 1597–1607. · URL
- Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of NAACL-HLT 2019, 4171–4186. Association for Computational Linguistics. · DOI 10.18653/v1/N19-1423
精选声明
声明已持久化到证据分类账中,每个声明都有自己的评估。
尚无精选声明
当分类账中没有声明时,此视图不会自行创建声明评估。
相关方法
从方法图中生成,显示为机器建议的关系 — 不推断任何证据声明。