Neural ODE
Neural Ordinary Differential Equation · Also known as: Nöral Diferansiyel Denklem (Neural ODE), neural ordinary differential equation, continuous-depth network, ODE-Net
A Neural ODE, introduced by Chen and colleagues in 2018, models a hidden state as the continuous solution of an ordinary differential equation whose dynamics are parameterised by a neural network. It generalises the limiting case of residual connections, making it well suited to irregularly spaced time series and physics-based modelling.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Use a Neural ODE for prediction or forecasting on continuous-time data — particularly irregularly sampled time series and longitudinal trajectories — where a smooth, continuously evolving dynamic system is a plausible model. It works on continuous variables and does not require normally distributed data, but it expects a reasonably long series (about 100 observations as a floor, and noticeably more for stable training) and an ODE solver using the adjoint method. On small datasets it cannot learn the continuous dynamics well; with fewer than around 500 observations a tree ensemble such as Random Forest is safer, and below about 100 a solver-based model is not meaningful at all.
Strengths & limitations
- Handles irregularly and unevenly sampled time series naturally, since the state is defined at any time point.
- Memory-efficient training: the adjoint method keeps memory constant regardless of solver depth.
- A principled fit for physics-based and continuous dynamical-system modelling.
- Continuous-depth formulation generalises residual networks and lets accuracy be traded against solver cost.
- Needs a fair amount of data: with fewer than about 500 observations it cannot learn the dynamics reliably.
- Below roughly 100 observations a solver-based model is essentially meaningless.
- Training relies on an ODE solver and the adjoint method, adding numerical and engineering complexity.
- Stiff or rapidly changing dynamics can make the solver slow and the training unstable.
Frequently asked
How is a Neural ODE different from a residual network?
A residual network adds a discrete increment at each of a fixed number of layers. A Neural ODE takes the limit where those increments become infinitesimal, so a neural network defines the continuous rate of change of the state and an ODE solver integrates it. Depth becomes continuous time rather than a fixed layer count.
Why use the adjoint method for training?
The adjoint sensitivity method computes gradients by solving an auxiliary ODE backwards in time. This keeps memory cost low and constant regardless of how many steps the forward solver took, which is the main reason it is recommended for training Neural ODEs.
When should I avoid a Neural ODE?
On small datasets. With fewer than about 500 observations the model cannot learn the continuous dynamics reliably, and below roughly 100 a solver-based model is not meaningful. In those cases a tree ensemble such as Random Forest or XGBoost is a safer choice.
What kind of data does it suit best?
Continuous-valued time series and longitudinal data, especially when observations are irregularly or unevenly spaced. Because the state is defined at any time point, the method does not require resampling the data onto a fixed grid.
Sources
- Chen, T. Q., Rubanova, Y., Bettencourt, J. & Duvenaud, D. (2018). Neural Ordinary Differential Equations. Advances in Neural Information Processing Systems (NeurIPS). link ↗
- Rubanova, Y., Chen, T. Q. & Duvenaud, D. (2019). Latent ODEs for Irregularly-Sampled Time Series. Advances in Neural Information Processing Systems (NeurIPS). link ↗
How to cite this page
ScholarGate. (2026, June 1). Neural Ordinary Differential Equation. ScholarGate. https://scholargate.app/en/deep-learning/neural-ode
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- LSTMDeep learning↔ compare
- Random ForestMachine learning↔ compare
- Recurrent Neural NetworkDeep learning↔ compare
- XGBoostMachine learning↔ compare