ScholarGate
Асистент

Сравнение на методи

Прегледайте избраните методи един до друг; редовете с разлики са откроени.

Анализ на честотата на думите×Лексикално разнообразие×TF-IDF×Тематично моделиране×
ОбластИзвличане на текстИзвличане на текстИзвличане на текстДълбоко обучение
СемействоProcess / pipelineProcess / pipelineProcess / pipelineMachine learning
Година на възникване194919881999–2003
СъздателGeorge K. Zipf (frequency-distribution foundation)Salton & BuckleyHofmann, T. (pLSA, 1999); Blei, D. M., Ng, A. Y., & Jordan, M. I. (LDA, 2003)
ТипDescriptive text-mining analysisText quantification / lexical richness measurementText vectorization / term-weighting schemeUnsupervised generative probabilistic model
Основополагащ източникZipf, G. K. (1949). Human Behavior and the Principle of Least Effort. Addison-Wesley. link ↗McCarthy, P. M. & Jarvis, S. (2010). MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversity assessment. Behavior Research Methods, 42(2), 381-392. DOI ↗Salton, G. & Buckley, C. (1988). Term-weighting approaches in automatic text retrieval. Information Processing & Management, 24(5), 513-523. DOI ↗Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent Dirichlet Allocation. Journal of Machine Learning Research, 3, 993–1022. link ↗
Други названияword frequency analysis, n-gram frequency analysis, Metin Frekans Analizilexical richness, vocabulary richness, Sözcüksel Çeşitlilik Analiziterm weighting, tf-idf weighting, TF-IDF VektörizasyonuLatent Semantic Analysis, probabilistic topic modeling, topic discovery, thematic modeling
Свързани4335
РезюмеText frequency analysis is a descriptive text-mining method that counts how often words, n-grams, and phrases occur in a corpus to reveal content patterns and dominant themes. It rests on the frequency-distribution insight formalised by George K. Zipf (1949), that a few terms occur very often while most are rare, and it is one of the most basic and widely used entry points into quantitative text analysis.Lexical diversity analysis quantifies how varied the vocabulary of a text is — how rich an author's word choice is — using measures such as the type-token ratio (TTR), MTLD, vocd-D, and Yule's K. The MTLD and vocd-D measures were validated by McCarthy and Jarvis (2010), building on earlier work by Tweedie and Baayen (1998) on the stability of lexical-richness measures.TF-IDF, introduced by Salton and Buckley (1988), is a term-weighting scheme that scores each word in a document by how often it appears there and how rare it is across the whole collection. It turns raw text into weighted document vectors, giving high weight to terms that are frequent in one document but uncommon elsewhere.Topic Modeling is a family of unsupervised probabilistic techniques for discovering latent thematic structure in large text collections. By learning which words tend to co-occur, models such as Latent Dirichlet Allocation (LDA) automatically surface coherent topics — each represented as a distribution over vocabulary — without requiring labelled data.
ScholarGateНабор от данни
  1. v1
  2. 2 Източници
  3. PUBLISHED
  1. v1
  2. 2 Източници
  3. PUBLISHED
  1. v1
  2. 1 Източници
  3. PUBLISHED
  1. v1
  2. 2 Източници
  3. PUBLISHED

Към търсенето Изтегляне на слайдове

ScholarGateСравнение на методи: Text Frequency Analysis · Lexical Diversity · TF-IDF · Topic Modeling. Извлечено на 2026-06-18 от https://scholargate.app/bg/compare