Model selection for wavelet-based signal estimation

Research output: Contribution to conferencePaperpeer-review

5 Scopus citations


There has been a growing interest in wavelet-based methods for signal estimation from noisy samples. Signal denoising involves calculating discrete wavelet transform (using training samples) and then discarding `insignificant' wavelet coefficients (presumably corresponding to noise). Various wavelet thresholding heuristics for discarding insignificant wavelets have been recently proposed. These methods are conceptually based on asymptotic results for linear models, but also take into account special properties of wavelet basis functions. Wavelet thresholding represents a special case of model selection; hence we compare popular wavelet thresholding methods with model selection using VC generalization bounds developed for finite samples. Since wavelet methods are linear (in parameters), VC bounds can be rigorously applied, i.e. the VC-dimension of linear models can be accurately estimated. Successful application of VC-theory to wavelet denoising also requires specification of a suitable structure on a set of wavelet basis functions. We propose such a structure suitable for orthogonal basis functions, which includes wavelets as a special case. The combination of the proposed structure with VC bounds yields a new powerful method for signal estimation with wavelets. Our comparisons indicate that using VC bounds for model selection gives uniformly better results than other wavelet thresholding methods under small sample/ high noise setting. On the other hand, with large samples model selection becomes trivial, and most reasonable methods (including wavelet thresholding heuristics) perform reasonably well.

Original languageEnglish (US)
Number of pages4
StatePublished - Jan 1 1998
EventProceedings of the 1998 IEEE International Joint Conference on Neural Networks. Part 1 (of 3) - Anchorage, AK, USA
Duration: May 4 1998May 9 1998


OtherProceedings of the 1998 IEEE International Joint Conference on Neural Networks. Part 1 (of 3)
CityAnchorage, AK, USA


Dive into the research topics of 'Model selection for wavelet-based signal estimation'. Together they form a unique fingerprint.

Cite this