Wavelet Neural Network

A wavelet neural network (WNN) is a function approximation architecture that uses wavelet functions as activation functions in place of traditional sigmoid or ReLU functions. Introduced by Zhang and Benveniste (1992), WNNs combine the multiscale decomposition properties of wavelets with the learning capabilities of neural networks. The result is a flexible nonparametric model that can capture localized features and multi-resolution patterns efficiently, with fewer parameters and better interpretability than standard deep networks.