Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Optimality of Operator-Like Wavelets for Representing Sparse AR(1) Processes
 
research article

Optimality of Operator-Like Wavelets for Representing Sparse AR(1) Processes

Pad, Pedram  
•
Unser, Michael  
2015
IEEE Transactions on Signal Processing

The discrete cosine transform (DCT) is known to be asymptotically equivalent to the Karhunen-Loève transform (KLT) of Gaussian first-order auto-regressive (AR(1)) processes. Since being uncorrelated under the Gaussian hypothesis is synonymous with independence, it also yields an independent-component analysis (ICA) of such signals. In this paper, we present a constructive non-Gaussian generalization of this result: the characterization of the optimal orthogonal transform (ICA) for the family of symmetric-α-stable AR(1) processes. The degree of sparsity of these processes is controlled by the stability parameter 0 < α ≤ 2 with the only non-sparse member of the family being the classical Gaussian AR(1) process with α = 2. Specifically, we prove that, for α < 2, a fixed family of operator-like wavelet bases systematically outperforms the DCT in terms of compression and denoising ability. The effect is quantified with the help of two performance criteria (one based on the Kullback-Leibler divergence, and the other on Stein's formula for the minimum estimation error) that can also be viewed as statistical measures of independence. Finally, we observe that, for the sparser kind of processes with 0 < α ≤ 1, the operator-like wavelet basis, as dictated by linear system theory, is undistinguishable from the ICA solution obtained through numerical optimization. Our framework offers a unified view that encompasses sinusoidal transforms such as the DCT and a family of orthogonal Haar-like wavelets that is linked analytically to the underlying signal model.

  • Details
  • Metrics
Type
research article
DOI
10.1109/Tsp.2015.2447494
Web of Science ID

WOS:000360065700008

Author(s)
Pad, Pedram  
Unser, Michael  
Date Issued

2015

Publisher

IEEE

Published in
IEEE Transactions on Signal Processing
Volume

63

Issue

18

Start page

4827

End page

4837

Subjects

Operator-like wavelets

•

independent-component analysis

•

auto-regressive processes

•

stable distributions

URL

URL

http://bigwww.epfl.ch/publications/pad1501.html

URL

http://bigwww.epfl.ch/publications/pad1501.pdf

URL

http://bigwww.epfl.ch/publications/pad1501.ps
Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LIB  
Available on Infoscience
October 24, 2015
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/120059
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés