5 Years of Learned Compression - What's Next?

Lecture / Panel
For NYU Community

Johannes Ballé Speaker ECE


Johannes Ballé


"5 Years of Learned Compression - What's Next?"


Since its emergence about half a decade ago, the field of learned data compression has attracted considerable attention. Using machine learning in source coding promises faster innovation cycles, as well as better adaptation to novel data modalities and nonlinear distortion metrics. For example, image codecs can now be end-to-end optimized to perform best for specific types of images, by simply replacing the training set. They may be designed to minimize a given perceptual metric, or in fact any differentiable perceptual loss function, without the need to evaluate it during encoding. In this talk, I will first review the current state of learned data compression, and then discuss one of the next challenges in learned image compression: developing better models of human perception, and improving realism of reconstructed images.


Johannes Ballé is a Staff Research Scientist at Google. They defended their master's and doctoral theses on signal processing and image compression under the supervision of Jens-Rainer Ohm at RWTH Aachen University in 2007 and 2012, respectively. This was followed by a brief collaboration with Javier Portilla at CSIC in Madrid, Spain, and a postdoctoral fellowship at New York University’s Center for Neural Science with Eero P. Simoncelli to study the relationship between perception and image statistics. While there, they pioneered the use of variational Bayesian models and deep learning techniques for end-to-end optimized image compression. They joined Google in 2017 to continue working in this line of research. Johannes has served as a reviewer for top-tier publications in both machine learning and image processing, such as NeurIPS, ICLR, ICML, Picture Coding Symposium, and several IEEE Transactions journals. They have been a co-organizer of the annual Workshop and Challenge on Learned Image Compression (CLIC) since 2018.