Machine learningDeep learning / NLP / CV
Self-supervised Named Entity Recognition
Self-supervised named entity recognition (NER) combines large-scale self-supervised pretraining — such as masked language modeling — with token-level fine-tuning to identify and classify named entities in text. By learning general linguistic representations before seeing any entity labels, the model achieves strong performance even when annotated NER training data is scarce.
Open in MethodMindSoonVideoSoon
Read the full method
Members only
Sign inSign in with a free account to read this section.
Sources
- Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of NAACL-HLT 2019, 4171–4186. link ↗
- Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016). Neural Architectures for Named Entity Recognition. Proceedings of NAACL-HLT 2016, 260–270. link ↗