방법 비교
선택한 방법을 나란히 검토하세요. 서로 다른 행은 강조 표시됩니다.
| 미세 조정된 Doc2Vec× | BERT 기반 분류× | |
|---|---|---|
| 분야 | 딥러닝 | 딥러닝 |
| 계열 | Machine learning | Machine learning |
| 기원 연도≠ | 2014 (base); fine-tuning practice ca. 2015 | 2019 |
| 창시자≠ | Le, Q. V. & Mikolov, T. (Doc2Vec base); fine-tuning practice adopted by the NLP community ca. 2015–2017 | Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (Google AI Language) |
| 유형≠ | Representation learning / transfer learning | Pre-trained language model with fine-tuning |
| 원전≠ | Le, Q. V., & Mikolov, T. (2014). Distributed Representations of Sentences and Documents. Proceedings of the 31st International Conference on Machine Learning (ICML 2014), PMLR 32(2), 1188–1196. link ↗ | Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of NAACL-HLT 2019 (pp. 4171–4186). Association for Computational Linguistics. DOI ↗ |
| 별칭 | fine-tuned Paragraph Vector, domain-adapted Doc2Vec, PV fine-tuning, Doc2Vec transfer learning | BERT classifier, BERT fine-tuning for classification, BERT text classification, BERT-CLS |
| 관련≠ | 5 | 4 |
| 요약≠ | Fine-Tuned Doc2Vec adapts a pre-trained Paragraph Vector (Doc2Vec) model by continuing its training on a target corpus, producing document embeddings that capture both the general language knowledge of the original training and the vocabulary and style of the new domain. It is used for text classification, semantic similarity, and clustering when labeled data are scarce but unlabeled domain text is available. | BERT-based Classification fine-tunes Google's Bidirectional Encoder Representations from Transformers model on a labelled text dataset, replacing the generic pre-trained head with a task-specific classification layer. It exploits deep bidirectional context from hundreds of millions of pre-trained parameters to deliver state-of-the-art accuracy on short- and medium-length text classification tasks with relatively modest amounts of labelled data. |
| ScholarGate데이터셋 ↗ |
|
|