Fingers and Gesture Recognition with Kinect v2 Sensor

Open access

Abstract

The paper presents enhancements and innovative solutions of the proposed in [3] algorithms for fingers tracking and hand gesture recognition based on new defined features describing hand gestures and exploiting new-tracked tip and thumb joints from Kinect v2 sensor. Dynamic Time Warping (DTW) algorithm is used for gestures recognition. We increased its accuracy, scale and rotational invariance by defining new 3D featuring angles describing gestures and used for training a gesture database. 3D positions for fingertips are extracted from depth sensor data and used for calculation of featuring angles between vectors. The provided by Kinect v2 3D positions for thumb, tip and hand joints also participates during the phases of recognition. A comparison with the latest published approach for finger tracking has been performed. The feasibility of the algorithms have been proven by real experiments.

3. Rayan, D. Finger and Gesture Recognition with Microsoft Kinect. https://brage.bibsys.no/xmlui/handle/11250/181783. MSc. Thesis, 2012, 203-208.

6. Stein, M. Finger Tracker. 2012. http://makematics.com/code/FingerTracker/.

7. Tang, M. Hand Gesture Recognition Using Microsoft’s Kinect. Paper Written for CS229, March 16, 2011.

8. Ren, M., J. Yang, and H. Sun. Tracing Boundary Contours in a Binary Image. – Image and vision computing, 20, 2002, No. 2, 125-131.

9. Chang, F., C. Chen, and C. Lu. A Linear-time Component-labelling Algorithm Using Contour Tracing Technique. – Computer Vision and Image Understanding, 93, 2004, No. 2, 206-220.

10. Yan, L. and Z. Min. A New Contour Tracing Automaton in Binary Image. IEEE Int. Conf. on Computer Science and Automation Engineering (CSAE), 2011, 2, 2011, 577-581.

11. Trigo, T., S. Pellegrino. An Analysis of Features for Hand-gesture Classification. 17th Int. Conference on Systems, Signals and Image Processing (IWSSIP), 2010, 412-415.

Information Technologies and Control

The Journal of Institute of Information and Communication Technologies of Bulgarian Academy of Sciences

Journal Information

Metrics

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 355 355 100
PDF Downloads 116 116 38