Per Ola Kristensson | Continuous gesture recognition using the Kinect

Bio
Publications
Impact / Press
Teaching
Software
Other Stuff
Blog

Click here for the continuous gesture recognizer for touchscreens.

Note: this software was written for the first-generation Kinect using an early version of the Kinect SDK. The software is not maintaned or supported anymore but might be useful as a reference.

Introduction


Copyright © 2012 ACM
We have developed a continuous gesture recognition interface for one-handed and two-handed gestures for Microsoft Kinect. Given a set of gesture templates (which can be designed for either one-handed or two-handed use) the system outputs a probability distribution over this template set as a function of a user's partial or complete gesture articulation. It enables interactive systems to eagerly process users' input before users have completed their input gestures. For more details, please see our research paper.

Reference

If you use this code please remember to cite our paper:

Kristensson, P.O., Nicholson, T.F.W. and Quigley, A. 2012. Continuous recognition of one-handed and two-handed gestures using 3D full-body motion tracking sensors. In Proceedings of the 17th ACM International Conference on Intelligent User Interfaces (IUI 2012). ACM Press: 89-92. (pdf)

Source Code

The complete source code for the system is available in the zip-file below. It is a Microsoft Visual Studio 2010 (Ultimate Edition) project written in C#. To run the code you need to install the Kinect Beta 2 SDK.

ThinAirWriter.zip

License

The code is open source and licensed under the MIT license. The license is included in the source code files above. Among other things, it allows commercial and non-commercial use of the code free of charge.

Acknowledgements

This work was supported by the Engineering and Physical Sciences Research Council (grant number EP/H027408/1) and the Scottish Informatics and Computer Science Alliance.

Contact

Email: kristensson @ acm.org

Dr Per Ola Kristensson
Department of Engineering
Trumpington Street
Cambridge CB2 1PZ
United Kingdom