DGP Talk: Quo Vadis Mixed Reality?

We are delighted to welcome Prof. Otmar Hilliges from ETH Zurich to talk about his recent research about Virtual and Mixed Reality.


Quo Vadis Augmented Reality?


Virtual and Mixed Reality (XR) holds the promise to significantly change the ways we interact with digital information. Despite much progress from both research and industry there are still many challenges to be mastered before XR can become a mainstream interaction paradigm. In this talk I will review where we are as a field, outline some of the challenges ahead and talk about some of the recent research from our lab in this space. In particular, I will discuss new ways to capture rich user input, including full-body pose and detailed hand pose configurations without the need for environment mounted cameras or other tracking systems, enabling rich sensing of human activities in on-the-go scenarios. In the second half of the talk I will discuss novel light-weight approaches to haptic feedback for XR and adaptive UIs that control what information to display where, depending on the user’s internal state.


Otmar Hilliges is currently an Associate Professor of computer science at ETH Zurich, where he leads the AIT lab. His research is at the intersection of machine learning, computer vision and human computer interaction (HCI). The main mission is to develop new ways for humans to interact with complex interactive systems (computers, wearables, robots), powered by advanced algorithms and technologies in machine perception, planning and data driven user modelling. Prior to joining ETH he was a Researcher at Microsoft Research Cambridge (2010-2013). His Diplom (equiv. MSc) in Computer Science is from Technische Universität München, Germany (2004) and his PhD in Computer Science from LMU München, Germany (2009). He spent two years as a postdoc at Microsoft Research Cambridge (2010-2012). He has published more than 70 peer-reviewed papers in the major venues on computer vision, HCI and computer graphics and received an ERC starting grant in 2017 for computational approaches to sensing based human-computer interfaces. Finally, 20+ patents have been filed in his name on a variety of subjects from surface reconstruction to AR/VR.