Usability Study of Leap Motion Controller

Alberto Scicali and Hans-Peter Bischof
Conference Proceedings: , 2015 Conference on Modeling, Simulations and Visualization Methods
Page number: 
Publication date: 
July 30, 2015

The Leap Motion Controller is a small USB device that tracks hand and finger movements using infrared LEDs, allowing users to input gesture commands into an application in place of a mouse or keyboard. This creates the potential for developing a general gesture recognition system in 3D that can be easily set up by laypersons using a simple, commercially available device. To investigate the effectiveness of the Leap Motion controller for hand gesture recognition, we collected data from over 100 participants and then used this data to train a 3D recognition model based on convolutional neural networks, which can recognize 2D projections of the 3D space. This achieved an accuracy rate of 92.4% on held out data. We also describe preliminary work on incorporating time series gesture data using hidden Markov models, with the goal of detecting arbitrary start and stop points for gestures when continuously recording data.

Home | Links | Credits | Search | Terms of Use | Disclaimer | My Account 

Center for Computational Relativity and Gravitation, School of Mathematical Sciences,
Rochester Institute of Technology,
One Lomb Memorial Drive, Rochester, New York 14623, USA
Phone: (585) 475-7752
Fax: (585) 475-7340
Education - This is a contributing Drupal Theme
Design by WeebPal.