Score-Based Generative Model
Score-Based Generative Modeling through Stochastic Differential Equations · Also known as: Skor Tabanlı Üretici Model (Score-Based / SDE), score-based diffusion, SDE-based generative model, score SDE
A score-based generative model, introduced by Yang Song and Stefano Ermon in 2019 and generalized to the stochastic differential equation (SDE) framework in 2021, learns the gradient of the data density — the score — rather than predicting noise directly, and uses it to generate new samples. It is the mathematical generalization that unifies diffusion models under a continuous-time formulation.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Suitable for high-fidelity generation and density estimation of continuous data when a large training set (around 1000 observations or more) or a pretrained model is available and GPU/TPU resources can be used. It makes no normality assumption, but the sampler must be matched to the chosen SDE. Below about 1000 observations a variational autoencoder is a safer choice, and below 500 a simpler method such as PCA is preferable.
Strengths & limitations
- Learns the data-density gradient directly, giving a principled mathematical generalization of diffusion models.
- Continuous-time SDE framework unifies multiple diffusion formulations under one objective.
- No normality assumption on the data.
- Produces high-fidelity samples of continuous data and supports density estimation.
- Requires a large dataset (around 1000+ observations) or a pretrained model to estimate the density gradient reliably.
- Needs GPU/TPU hardware to train and sample.
- The sampler must be chosen to match the SDE type, adding configuration burden.
- On small samples the score estimate is poor and generation becomes meaningless.
Frequently asked
What is the score that the model learns?
The score is the gradient of the log probability density with respect to the input. Knowing it at every point and noise level lets the model push samples toward where real data is concentrated.
How is this related to diffusion models?
It is the mathematical generalization of diffusion models: by formulating the forward corruption and reverse generation as continuous-time stochastic differential equations, score-based modeling unifies diffusion approaches under one framework.
How much data do I need?
Around 1000 observations or more, or a pretrained model. Below 1000 a variational autoencoder is safer, and below 500 SDE-based generation is meaningless and a simpler method such as PCA is preferable.
What hardware does it require?
GPU or TPU resources are needed for both training and sampling, and the sampler must be chosen to match the type of SDE used.
Sources
How to cite this page
ScholarGate. (2026, June 1). Score-Based Generative Modeling through Stochastic Differential Equations. ScholarGate. https://scholargate.app/en/deep-learning/score-based-diffusion
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Capsule NetworkDeep learning↔ compare
- Deep Reinforcement LearningDeep learning↔ compare
- Neural ODEDeep learning↔ compare
- Principal Component AnalysisMachine learning↔ compare
- Variational AutoencoderDeep learning↔ compare