Sparse decomposition of transformation-invariant signals with continuous basis pursuit

C Ekanadham, D Tranchina and E P Simoncelli

Published in Proc. Int'l Conf Acoustics Speech Signal Processing (ICASSP), pp. 4060--4063, May 2011.

DOI: 10.1109/ICASSP.2011.5947244

This publication has been superseded by:
Recovery of sparse translation-invariant signals with continuous basis pursuit
C Ekanadham, D Tranchina and E P Simoncelli.
IEEE Trans. Signal Processing, vol.59(10), pp. 4735--4744, Oct 2011.


Download:

  • Reprint (pdf)
  • Official (pdf)

  • Consider the decomposition of a signal into features that undergo transformations drawn from a continuous family. Current methods discretely sample the transformations and apply sparse recovery methods to the resulting finite dictionary. These methods do not exploit the underlying continuous structure, thereby limiting the ability to produce sparse solutions. Instead, we employ interpolation functions which linearly approximate the manifold of scaled and transformed features. Coefficients are interpreted as interpolation weights, and we formulate a convex optimization problem for obtaining them, enforcing both reconstruction accuracy and sparsity. We compare our method, which we call continuous basis pursuit (CBP) with the standard basis pursuit approach on a sparse deconvolution task. CBP yields substantially sparser solutions without sacrificing accuracy, and does so with a smaller dictionary. We conclude that for signals generated by transformation-invariant processes, a representation that explicitly accommodates the transformation(s) can yield sparser and more interpretable decompositions.
  • Listing of all publications