Under review as a conference paper at ICLR 2017 END-TO-END OPTIMIZED IMAGE COMPRESSION Johannes Ball´e∗ Center for Neural Science New York University New York, NY 10003, USA johannes.balle@nyu.edu Valero Laparra Image Processing Laboratory Universitat de Val`encia 46980 Paterna, Spain valero.laparra@uv.es Eero P. Simoncelli∗ Center for Neural Science and Courant Institute of Mathematical Sciences