Machine learningDeep learning / NLP / CV
Transfer Learning with Text Summarization
Transfer Learning with Text Summarization adapts a large language model pre-trained on broad text corpora — such as T5, BART, or PEGASUS — to the task of condensing documents into shorter, coherent summaries. By reusing learned linguistic knowledge and fine-tuning on domain-specific pairs of source documents and reference summaries, this approach achieves strong summarization quality with modest labeled data requirements.
Open in MethodMindSoonVideoSoon
Read the full method
Members only
Sign inSign in with a free account to read this section.
Sources
- Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2020). Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 21(140), 1–67. link ↗
- Lewis, M., Liu, Y., Goyal, N., Ghahravi, M., Mohamed, A., Chen, D., Levy, O., & Zettlemoyer, L. (2020). BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (pp. 7871–7880). ACL. DOI: 10.18653/v1/2020.acl-main.703 ↗