Сравнение методов

	Автоматическая оценка текста	Векторные представления BERT	Тематическое моделирование
Область	Интеллектуальный анализ текста	Интеллектуальный анализ текста	Глубокое обучение
Семейство	Process / pipeline	Process / pipeline	Machine learning
Год появления	2002 (BLEU); 2004 (ROUGE); 2020 (BERTScore)	2019	1999–2003
Автор метода	BLEU: Papineni et al. (2002); ROUGE: Lin (2004); BERTScore: Zhang et al. (2020)	Devlin, Chang, Lee & Toutanova (Google AI)	Hofmann, T. (pLSA, 1999); Blei, D. M., Ng, A. Y., & Jordan, M. I. (LDA, 2003)
Тип	Reference-based NLG evaluation metric suite	Contextual transformer text-representation method	Unsupervised generative probabilistic model
Основополагающий источник	Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2002). BLEU: A Method for Automatic Evaluation of Machine Translation. Proceedings of ACL 2002.	Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. NAACL-HLT, 4171-4186.	Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent Dirichlet Allocation. Journal of Machine Learning Research, 3, 993–1022.
Другие названия	Otomatik Metin Değerlendirme (BLEU, ROUGE, BERTScore), NLG evaluation, MT evaluation metrics	contextual embeddings, transformer embeddings, BERT Tabanlı Metin Gömülmeleri	Latent Semantic Analysis, probabilistic topic modeling, topic discovery, thematic modeling
Связанные	4	4	5
Сводка	Automatic text evaluation is a family of reference-based metrics used to measure the quality of machine-generated text — such as translations, summaries, or natural-language-generation (NLG) outputs — by comparing them to one or more human-written reference texts. Pioneered by Papineni et al. with BLEU in 2002, the field has grown to include n-gram overlap metrics (BLEU, ROUGE) and semantically aware metrics (BERTScore, MoverScore) that capture meaning beyond surface word matches.	BERT-based text embeddings, introduced by Devlin and colleagues at Google AI in 2019, turn text into context-sensitive dense vectors using a bidirectional Transformer encoder. Because the meaning of a word shifts with its context, BERT produces richer representations than static methods such as Word2Vec or topic models like LDA.	Topic Modeling is a family of unsupervised probabilistic techniques for discovering latent thematic structure in large text collections. By learning which words tend to co-occur, models such as Latent Dirichlet Allocation (LDA) automatically surface coherent topics — each represented as a distribution over vocabulary — without requiring labelled data.