Machine learningDeep learning / NLP / CV
Weakly Supervised RoBERTa-based Classification
Weakly supervised RoBERTa-based classification combines the RoBERTa pretrained transformer with weak supervision — programmatic or heuristic labeling sources — to train powerful text classifiers without requiring a fully hand-labeled dataset. Labeling functions, distant supervision, or crowd-sourced signals generate noisy labels that are aggregated and used to fine-tune RoBERTa for downstream classification tasks.
Open in MethodMindSoonVideoSoon
Read the full method
Members only
Sign inSign in with a free account to read this section.
Sources
- Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv:1907.11692. link ↗
- Zhang, J., Yu, Y., Li, Y., Wang, Y., Yang, Y., Yang, M., & Ratner, A. (2021). WRENCH: A Comprehensive Benchmark for Weak Supervision. NeurIPS 2021 Datasets and Benchmarks Track. link ↗