Bandingkan kaedah

	Klasifikasi Berasaskan BERT yang Ditala Halus	Transformer yang Ditalar Halus
Bidang	Pembelajaran Mendalam	Pembelajaran Mendalam
Keluarga	Machine learning	Machine learning
Tahun asal	2019	2017–2019
Pengasas	Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (Google AI)	Vaswani et al. (architecture); fine-tuning paradigm popularised by Howard & Ruder, Devlin et al.
Jenis	Pre-trained transformer fine-tuned for classification	Transfer learning / supervised fine-tuning
Sumber perintis	Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of NAACL-HLT 2019, 4171–4186.	Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30.
Alias	BERT fine-tuning, BERT classifier, fine-tuned BERT, BERT sequence classification	Transformer fine-tuning, pre-trained transformer fine-tuning, task-adaptive transformer, downstream-tuned transformer
Berkaitan	5	4
Ringkasan	Fine-Tuned BERT-based Classification adapts a pre-trained BERT transformer to a specific text classification task by adding a lightweight output layer and continuing gradient-based training on labelled examples. It consistently achieves near-state-of-the-art accuracy on sentiment analysis, topic categorisation, intent detection, and other NLP classification tasks with relatively small labelled datasets.	Fine-tuning a Transformer adapts a large pre-trained model — such as BERT, GPT, or ViT — to a specific downstream task by continuing gradient-based training on a labelled target dataset. This two-stage paradigm (pre-train then fine-tune) consistently achieves state-of-the-art results across NLP and computer vision tasks with far less task-specific data than training from scratch.