เปรียบเทียบวิธี

	เซมิซูเปอร์ไวส์ GRU	Transformer แบบกึ่งกำกับดูแล
สาขาวิชา	การเรียนรู้เชิงลึก	การเรียนรู้เชิงลึก
ตระกูล	Machine learning	Machine learning
ปีกำเนิด	2014–2015	2018–2019
ผู้ริเริ่ม	Dai, A. M. & Le, Q. V. (semi-supervised sequence learning); Cho, K. et al. (GRU architecture)	Devlin, J. et al. (BERT); broader SSL-Transformer paradigm community
ประเภท	Semi-supervised sequence model	Semi-supervised deep learning
แหล่งต้นตำรับ	Dai, A. M., & Le, Q. V. (2015). Semi-supervised Sequence Learning. Advances in Neural Information Processing Systems (NeurIPS), 28.	Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of NAACL-HLT 2019, 4171–4186.
ชื่อเรียกอื่น	Semi-supervised GRU, SSL-GRU, GRU with unlabeled data, semi-supervised recurrent classifier	semi-supervised transformer model, SSL transformer, transformer with self-supervised pre-training, semi-supervised attention model
ที่เกี่ยวข้อง	5	5
สรุป	Semi-supervised GRU applies the Gated Recurrent Unit architecture to settings where only a small fraction of sequential data is labeled. By first pre-training or jointly training on abundant unlabeled sequences — through language modeling, auto-encoding, or consistency regularization — and then fine-tuning on labeled examples, the model exploits the full corpus to learn richer sequence representations than supervised-only training would allow.	Semi-supervised learning with Transformer architectures leverages large quantities of unlabeled data alongside a small labeled set to train powerful sequence models. The dominant pattern — exemplified by BERT — first pre-trains the Transformer on unlabeled data using self-supervised objectives such as masked token prediction, then fine-tunes it on the labeled task. This two-stage approach dramatically reduces the labeled data needed to achieve strong performance.