手法を比較

	語彙の多様性	TF-IDF
分野	テキストマイニング	テキストマイニング
系統	Process / pipeline	Process / pipeline
提唱年	—	1988
提唱者	—	Salton & Buckley
種類	Text quantification / lexical richness measurement	Text vectorization / term-weighting scheme
原典	McCarthy, P. M. & Jarvis, S. (2010). MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversity assessment. Behavior Research Methods, 42(2), 381-392.	Salton, G. & Buckley, C. (1988). Term-weighting approaches in automatic text retrieval. Information Processing & Management, 24(5), 513-523.
別名	lexical richness, vocabulary richness, Sözcüksel Çeşitlilik Analizi	term weighting, tf-idf weighting, TF-IDF Vektörizasyonu
関連	3	3
概要	Lexical diversity analysis quantifies how varied the vocabulary of a text is — how rich an author's word choice is — using measures such as the type-token ratio (TTR), MTLD, vocd-D, and Yule's K. The MTLD and vocd-D measures were validated by McCarthy and Jarvis (2010), building on earlier work by Tweedie and Baayen (1998) on the stability of lexical-richness measures.	TF-IDF, introduced by Salton and Buckley (1988), is a term-weighting scheme that scores each word in a document by how often it appears there and how rare it is across the whole collection. It turns raw text into weighted document vectors, giving high weight to terms that are frequent in one document but uncommon elsewhere.