So sánh phương pháp
Xem các phương pháp đã chọn cạnh nhau; những hàng khác biệt được làm nổi bật.
| Mô hình Chủ đề LDA Tinh chỉnh× | Phân loại dựa trên BERT tinh chỉnh× | |
|---|---|---|
| Lĩnh vực | Học sâu | Học sâu |
| Họ | Machine learning | Machine learning |
| Năm ra đời≠ | 2003 (base); adaptation practice ~2010s | 2019 |
| Người khởi xướng≠ | Blei, D. M., Ng, A. Y., & Jordan, M. I. (base LDA); domain adaptation via online/warm-start LDA | Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (Google AI) |
| Loại≠ | Probabilistic generative topic model (fine-tuned / domain-adapted) | Pre-trained transformer fine-tuned for classification |
| Công trình gốc≠ | Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent Dirichlet Allocation. Journal of Machine Learning Research, 3, 993–1022. link ↗ | Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of NAACL-HLT 2019, 4171–4186. DOI ↗ |
| Tên gọi khác | Domain-Adapted LDA, Adapted LDA, LDA Fine-Tuning, Online LDA Fine-Tuning | BERT fine-tuning, BERT classifier, fine-tuned BERT, BERT sequence classification |
| Liên quan | 5 | 5 |
| Tóm tắt≠ | Fine-Tuned LDA adapts a Latent Dirichlet Allocation model trained on a large general corpus to a specific target domain by continuing inference on domain-specific documents. Rather than fitting LDA from scratch, the pre-trained topic-word distributions are used as an informed starting point, enabling the model to discover coherent domain topics faster and with less data than training cold. | Fine-Tuned BERT-based Classification adapts a pre-trained BERT transformer to a specific text classification task by adding a lightweight output layer and continuing gradient-based training on labelled examples. It consistently achieves near-state-of-the-art accuracy on sentiment analysis, topic categorisation, intent detection, and other NLP classification tasks with relatively small labelled datasets. |
| ScholarGateBộ dữ liệu ↗ |
|
|