ScholarGate
Get started
Machine learningDeep learningAlgorithm

Dilated CNN

Also known as: Dilate Edilmiş CNN (WaveNet / TCN), WaveNet, Temporal Convolutional Network, TCN, dilated convolution

Originatorvan den Oord, A. et al.; Bai, S., Kolter, J.Z. & Koltun, V.Year2016Sources2Related methods7

A Dilated CNN is a one-dimensional convolutional network whose receptive field grows exponentially with depth, letting it model long-range structure in time series and audio signals. WaveNet (van den Oord et al., 2016) and the Temporal Convolutional Network of Bai, Kolter and Koltun (2018) are the prominent members of this family.

Key highlights

  • Receptive field grows exponentially with depth, capturing long-range dependencies with few layers.
  • Convolutions parallelise well, training faster than recurrent networks on long sequences.
  • No normality assumption; works directly on continuous sequential signals.
  • Proven on demanding tasks, from WaveNet raw-audio generation to general TCN sequence modelling.

Intuition

This section is available to Pro members. Upgrade to Pro

How it works

This section is available to Pro members. Upgrade to Pro

When to use it

Use a Dilated CNN for forecasting or prediction on continuous, sequential time-series data when long-range dependencies matter and you have at least a few hundred observations. It does not assume normally distributed data, but it needs sequential data, benefits strongly from a GPU, and the receptive-field size should be matched to the task. Below about 500 observations it tends to overfit, and below roughly 100 a deep convolutional model is not worth training.

Strengths & limitations

Strengths
  • Receptive field grows exponentially with depth, capturing long-range dependencies with few layers.
  • Convolutions parallelise well, training faster than recurrent networks on long sequences.
  • No normality assumption; works directly on continuous sequential signals.
  • Proven on demanding tasks, from WaveNet raw-audio generation to general TCN sequence modelling.
Limitations
  • Needs a fairly large training set — overfits when n is below about 500.
  • A GPU is effectively required for practical training.
  • The receptive-field size must be tuned to the task; too small a field misses long dependencies.
  • Deep convolutional sequence training is not meaningful on very short series (n below about 100).

Common pitfalls

This section is available to Pro members. Upgrade to Pro

Applications

This section is available to Pro members. Upgrade to Pro

Frequently asked

Why dilation instead of just a deeper network?

Dilation lets the receptive field grow exponentially rather than linearly with depth, so a few layers can reach thousands of past steps while keeping the parameter count and computation modest.

How does it compare to recurrent networks?

Bai, Kolter and Koltun (2018) found that convolutional architectures like the TCN often match or beat recurrent networks on sequence tasks, and they train faster because convolutions parallelise across time.

How much data do I need?

Plan for at least a few hundred sequential observations. Below about 500 the model tends to overfit, and below roughly 100 training a deep convolutional model is not worthwhile — a tree-based model is safer.

Do I need a GPU?

A GPU is strongly recommended; without one, training on long sequences becomes impractically slow.

Sources

  1. 1.
    van den Oord, A. et al. (2016). WaveNet: A Generative Model for Raw Audio. arXiv.
    https://arxiv.org/abs/1609.03499
  2. 2.
    Bai, S., Kolter, J.Z. & Koltun, V. (2018). An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling. arXiv:1803.01271.
    https://arxiv.org/abs/1803.01271

You have read it. What now?

Ask about this methodSimilar methods

Cite this page

ScholarGate. (2026, June 1). Dilated CNN. ScholarGate. https://scholargate.app/deep-learning/dilated-cnn

Dilated CNN | ScholarGate