Сравнение методов

	Слабо контролируемая классификация на основе RoBERTa	Классификация на основе RoBERTa
Область	Глубокое обучение	Глубокое обучение
Семейство	Machine learning	Machine learning
Год появления	2019–2020	2019
Автор метода	Liu et al. (RoBERTa, 2019); weak supervision paradigm: Ratner et al. (2016–2020)	Liu, Y. et al. (Facebook AI Research / University of Washington)
Тип	Pretrained transformer classifier with weak supervision	Pre-trained transformer fine-tuned for sequence classification
Основополагающий источник	Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv:1907.11692.	Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv preprint arXiv:1907.11692.
Другие названия	WS-RoBERTa, RoBERTa with weak supervision, weakly supervised transformer classification, noisy-label RoBERTa classifier	RoBERTa classifier, RoBERTa text classification, Robustly Optimized BERT Classification, RoBERTa fine-tuning for classification
Связанные	5	5
Сводка	Weakly supervised RoBERTa-based classification combines the RoBERTa pretrained transformer with weak supervision — programmatic or heuristic labeling sources — to train powerful text classifiers without requiring a fully hand-labeled dataset. Labeling functions, distant supervision, or crowd-sourced signals generate noisy labels that are aggregated and used to fine-tune RoBERTa for downstream classification tasks.	RoBERTa-based Classification applies the RoBERTa pre-trained transformer — trained more robustly than BERT with dynamic masking and larger batches — to text categorisation tasks by adding a lightweight classification head on top of the [CLS] token representation and fine-tuning the entire model on labelled examples. It consistently matches or outperforms BERT on standard NLP benchmarks.