Colloquium | Irad Yavneh, A Multilevel Algorithm for L_1 Minimization with Application to Sparse Representation of Signals

Thursday, September 19, 2013 3:30 pm - 3:30 pm EDT (GMT -04:00)

²Ñ°äÌý5158

Speaker

Irad Yavneh, Computer Science, Technion-Israel Institute of Technology

Title

A Multilevel Algorithm for L1ÌýMinimization with Application to Sparse Representation of Signals

Abstract

The area of sparse representation of signals is drawing tremendous attention in recent years in diverse fields of science and engineering. The ideaÌýbehind the model is that a signal can be approximated as a linear
combination of a few "atoms'' from a pre-specified and over-complete
"dictionary'' (typically represented by columns from a matrix with more
columns than rows). The sparse representation of a signal is often achievedÌýby minimizing anÌýL1Ìýpenalized least squares functional. Various
iterative-shrinkage algorithms have recently been developed and are quiteÌýeffective for handling these problems, often surpassing traditional
optimization techniques. Here we suggest a new iterative multilevel approachÌýthat reduces the computational cost of existing solvers for these inverseÌýproblems. Our method takes advantage of the typically sparse representationÌýof the signal, and, at each iteration, it adaptively creates and processes aÌýhierarchy of lower-dimensional problems employing well-known iteratedÌýshrinkage methods. Analytical observations suggest, and numerical resultsÌýconfirm, that this new approach may significantly enhance the performance ofÌýexisting iterative shrinkage algorithms in cases where the dictionary is anÌýexplicit matrix.
(This is joint work with Eran Treister.)