Machine learningDeep learning / NLP / CV

Transfer Learning with Text Summarization

Transfer Learning with Text Summarization adapts a large language model pre-trained on broad text corpora — such as T5, BART, or PEGASUS — to the task of condensing documents into shorter, coherent summaries. By reusing learned linguistic knowledge and fine-tuning on domain-specific pairs of source documents and reference summaries, this approach achieves strong summarization quality with modest labeled data requirements.

Open in MethodMindSoonVideoSoon

Read the full method

Members only

Sign in with a free account to read this section.

Sign in

Sources

  1. Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2020). Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 21(140), 1–67. link
  2. Lewis, M., Liu, Y., Goyal, N., Ghahravi, M., Mohamed, A., Chen, D., Levy, O., & Zettlemoyer, L. (2020). BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (pp. 7871–7880). ACL. DOI: 10.18653/v1/2020.acl-main.703

Related methods

Referenced by

ScholarGateTransfer Learning with Text Summarization (Transfer Learning with Neural Text Summarization). Retrieved 2026-06-04 from https://scholargate.app/en/deep-learning/transfer-learning-with-text-summarization