Machine learningDeep learning / NLP / CV

Weakly Supervised RoBERTa-based Classification

Weakly supervised RoBERTa-based classification combines the RoBERTa pretrained transformer with weak supervision — programmatic or heuristic labeling sources — to train powerful text classifiers without requiring a fully hand-labeled dataset. Labeling functions, distant supervision, or crowd-sourced signals generate noisy labels that are aggregated and used to fine-tune RoBERTa for downstream classification tasks.

Open in MethodMindSoonVideoSoon

Read the full method

Members only

Sign in with a free account to read this section.

Sign in

Sources

  1. Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv:1907.11692. link
  2. Zhang, J., Yu, Y., Li, Y., Wang, Y., Yang, Y., Yang, M., & Ratner, A. (2021). WRENCH: A Comprehensive Benchmark for Weak Supervision. NeurIPS 2021 Datasets and Benchmarks Track. link

Related methods

Referenced by

ScholarGateWeakly Supervised RoBERTa-based Classification (Weakly Supervised Text Classification with RoBERTa). Retrieved 2026-06-04 from https://scholargate.app/en/deep-learning/weakly-supervised-roberta-based-classification