Krahasoni metodat

	BERT Embeddings	Modelimi i temave
Fusha	Nxjerrja e tekstit	Mësimi i thellë
Familja	Process / pipeline	Machine learning
Viti i origjinës	2019	1999–2003
Krijuesi	Devlin, Chang, Lee & Toutanova (Google AI)	Hofmann, T. (pLSA, 1999); Blei, D. M., Ng, A. Y., & Jordan, M. I. (LDA, 2003)
Lloji	Contextual transformer text-representation method	Unsupervised generative probabilistic model
Burimi themelues	Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. NAACL-HLT, 4171-4186.	Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent Dirichlet Allocation. Journal of Machine Learning Research, 3, 993–1022.
Emërtime të tjera	contextual embeddings, transformer embeddings, BERT Tabanlı Metin Gömülmeleri	Latent Semantic Analysis, probabilistic topic modeling, topic discovery, thematic modeling
Të lidhura	4	5
Përmbledhja	BERT-based text embeddings, introduced by Devlin and colleagues at Google AI in 2019, turn text into context-sensitive dense vectors using a bidirectional Transformer encoder. Because the meaning of a word shifts with its context, BERT produces richer representations than static methods such as Word2Vec or topic models like LDA.	Topic Modeling is a family of unsupervised probabilistic techniques for discovering latent thematic structure in large text collections. By learning which words tend to co-occur, models such as Latent Dirichlet Allocation (LDA) automatically surface coherent topics — each represented as a distribution over vocabulary — without requiring labelled data.