The world is three-dimensional. We are broadly interested in processing and synthesis of 3D data. One line of work concerns 3D reconstruction, with the aim of producing photorealistic models of objects and environments. Such photorealistic models are used in virtual reality, special effects production, and computer games, and can also be used in training visual perception and sensorimotor control systems. Another line of work concerns 3D data processing. We are interested both in classic optimization techniques and in novel deep network architectures that operate on three-dimensional representations.