Seminar: Exploring Gesture Control with Depth Sensing Camera in Virtual Reality

Yin Zhang
M.Sc. Candidate
Supervisor: Dr. Oscar Meruvia-Pastor

Exploring Gesture Control with Depth Sensing Camera in Virtual Reality

Department of Computer Science
Thursday, April 14, 2016, 11:00 a.m., Room EN 2022


Abstract

Immersive Virtual Reality (VR) has become more affordable with the appearance of VR headsets such as the Oculus Rift, Google Cardboard or the Samsung Gear. In addition, portable depth-sensing cameras allow users to control interfaces using hand gestures at a short range from the camera. Both technologies are being put together to create immersive VR experiences that respond to hand gestures. The goal of this project is to explore gesture-based interaction in immersive VR environments using Unity, Leap Motion, a Smartphone and the FreeFly VR headset. We implemented a system that allows users to play a game in a virtual world with the ultimate objective to explore improvements to this type of system. In this presentation, we will describe this project in more detail and present our findings.