Francesc Moreno-Noguer Presents "Geometric Deep Learning for Perceiving and Modeling Humans"

ABSTRACT: Perceiving and modeling the shape and appearance of the human body from single images is a severely under-constrained problem that not only requires large volumes of data, but also prior knowledge. In this talk, I will present recent solutions on how deep learning can leverage on geometric reasoning to address tasks like 3D estimation of the body pose and the shape of the clothes. In the second part of the talk, I will also describe novel GAN’s conditioning schemes to model the full body’s appearance and facial expressions in a weakly supervised manner.

BIO: Francesc Moreno-Noguer is an associate researcher of the Spanish Scientific Research Council, at the Institut de Robòtica i Informàtica Industrial in Barcelona. His research interests are in Computer Vision and Machine Learning, with topics including human shape and motion estimation, 3D reconstruction of rigid and nonrigid shape and camera pose estimation. He received best paper honorable mention award at ECCV'18, best paper awards at ICCV workshop on Fashion'17, Machine Vision Applications'15, Jornadas Automática'14 and Ibpria'05, UPC’s Doctoral Dissertation Extraordinary Award in 2008, and Amazon research award (2019) and Google Faculty research awards (2017, 2019).