Gaussian Mixture Model
Gaussian Mixture Model (GMM Clustering) · Also known as: Gaussian Karışım Modeli (GMM Kümeleme), GMM, GMM clustering, mixture of Gaussians, model-based clustering
A Gaussian Mixture Model is a probabilistic clustering method that models the data as a weighted mixture of several Gaussian distributions, fitted with the Expectation–Maximization algorithm formalized by Dempster, Laird & Rubin in 1977. It is a generalization of K-means in which each cluster can take its own shape, size, and orientation.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Use a Gaussian Mixture Model for clustering or exploring continuous, roughly Gaussian-shaped data when clusters may overlap, differ in size, or be elongated rather than spherical, and you want soft probabilistic memberships rather than hard labels. It assumes the data was generated by a mixture of Gaussians, works on continuous variables, and needs at least about 50 observations. The number of components can be chosen with BIC or AIC, and PCA preprocessing is advised against the curse of dimensionality. With fewer than about 50 observations, or when the Gaussian assumption fails, K-means is a more robust choice.
Strengths & limitations
- Soft, probabilistic cluster memberships instead of forced hard assignments.
- Each component has its own covariance, so clusters can be elongated, rotated, or differently sized.
- A true generalization of K-means that relaxes the spherical, equal-size cluster assumption.
- Component count can be chosen objectively with information criteria such as BIC or AIC.
- Assumes the data was generated by a mixture of Gaussians; results suffer when that assumption fails.
- EM can converge to a local optimum, so results depend on initialization.
- Covariance matrices can become singular, especially in high dimensions or small samples.
- Needs at least about 50 observations and benefits from PCA preprocessing to avoid the curse of dimensionality.
Frequently asked
How is a Gaussian Mixture Model different from K-means?
K-means assigns each point to exactly one spherical, equal-size cluster. A Gaussian Mixture Model is its generalization: each component has its own covariance, so clusters can be elongated, rotated, or differently sized, and every point receives a probability of belonging to each component rather than a single hard label.
How do I choose the number of components?
Fit the model for several candidate component counts and compare them with information criteria such as BIC or AIC, which weigh goodness of fit against model complexity, then pick the count that optimizes the criterion.
Why does my GMM give different results each run?
It is fitted with EM, which can converge to a local optimum depending on initialization. Running several restarts and keeping the best fit, and reducing dimensions with PCA first, makes the result more stable.
When should I prefer K-means instead?
When the sample is small (below about 50) or the data is clearly not Gaussian, EM can settle in a local optimum and covariance matrices can become singular; K-means is the more robust choice in those cases.
Sources
- Dempster, A.P., Laird, N.M. & Rubin, D.B. (1977). Maximum Likelihood from Incomplete Data via the EM Algorithm. Journal of the Royal Statistical Society: Series B, 39(1), 1–22. DOI: 10.1111/j.2517-6161.1977.tb01600.x ↗
How to cite this page
ScholarGate. (2026, June 1). Gaussian Mixture Model (GMM Clustering). ScholarGate. https://scholargate.app/en/machine-learning/gaussian-mixture
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- DBSCANMachine learning↔ compare
- Hierarchical ClusteringMachine learning↔ compare
- Principal Component AnalysisMachine learning↔ compare
- UMAPMachine learning↔ compare