Patch Foveation in Nonlocal Imaging

Electrical and Computer Engineering
NYU Community Event

Speaker: Professor Alessandro Foi 

Host Faculty: Professor Ivan Selesnick


Patch-based nonlocal imaging methods rely on the assumption that natural images contain a large number of mutually similar patches at different locations within the image. Patch similarity is typically assessed through the Euclidean distance of the pixel intensities and therefore depends on the patch size: while large patches guarantee stability with respect to degradations such as noise, the mutual similarity that can be verified between pairs of patches tends to reduce as the patch size grows. Thus, a windowed Euclidean distance is commonly used to balance these two conflicting aspects, assigning lower weights to pixels far from the patch center. We propose patch foveation as an alternative to windowing in nonlocal imaging. Foveation is performed by a spatially variant blur operator, characterized by point-spread functions having bandwidth decreasing with the spatial distance from the patch center. Patch similarity is thus assessed by the Euclidean distance of foveated patches, leading to the concept of foveated self-similarity. In contrast with the conventional windowing, which is only spatially selective and attenuates sharp details and smooth areas in equal way, patch foveation is selective in both space and frequency. In particular, we present an explicit construction of a patch-foveation operator that, given an arbitrary windowing kernel, replaces the corresponding windowing operator providing equivalent attenuation of i.i.d. Gaussian noise, yet giving full weights to flat regions. Examples of this special form of self-similarity are shown for a number of imaging applications, with particular emphasis on image filtering, for which we demonstrate that foveated self-similarity is a more effective regularity assumption than the windowed self-similarity in assessing the patch similarity in nonlocal means denoising. Ref:

About the Speaker

Alessandro Foi received the M.Sc. degree in Mathematics from the Università degli Studi di Milano, Italy, in 2001, the Ph.D. degree in Mathematics from the Politecnico di Milano in 2005, and the D.Sc.Tech. degree in Signal Processing from Tampere University of Technology, Finland, in 2007. His research interests include mathematical and statistical methods for signal processing, functional and harmonic analysis, and computational modeling of the human visual system. Currently, he is Academy Research Fellow (Akatemiatutkija) with the Academy of Finland, at the Department of Signal Processing, Tampere University of Technology. His recent work focuses on spatially adaptive (anisotropic, nonlocal) algorithms for the restoration and enhancement of digital images, on noise modeling for imaging devices, and on the optimal design of statistical transformations for the stabilization, normalization, and analysis of random data. He is an Associate Editor for the IEEE Transactions on Image Processing.