Open Access Open Access  Restricted Access Subscription Access

Modernized Art for a Smarter Environment

V. Subashini


Gesture recognition is a technology that uses the mathematical algorithms to identify human gestures. Gesture recognition recognizes the hand, tracks its movements, and provides information about hand position, orientation, and finger flux. This research work describes a sophisticated and user-friendly Human Computer Interaction (HCI) technology that employs the Raspberry Pi to easily translate user intentions into corresponding commands and output. The proposed system overcomes the disadvantages present in the existing systems such as hardware complexity, dependence on external object and limitation in recognition of the movements. It is a gestural interface that connects the physical world to digital information around us and employs an Open CV-based gesture and colour recognition algorithm. This recognizes the hand, tracks its movements, and provides information about it. Color markers are applied to the user’s fingertips. This assists the camera in identifying the hand movement. The signals generated from hand movements are fed into ARM for processing using Python C coding. The processed signals are fed into the monitor to be displayed. Techniques used for processing are Video processing technology, Background Removal, Segmentation, Erosion, and Dilation. By tracking the user’s fingertip movements, the drawing application allows the user to draw on any surface. The pictures that the user draws can be displayed on any other surface. The proposed system overcomes the disadvantages present in the existing systems.


Gesture recognition, mathematical algorithms, Open CV, Human Computer Interaction (HCI), hardware complexity

Full Text:



Xie R, Sun X, Xia X, Cao J. Similarity matching-based extensible hand gesture recognition. IEEE Sens J. 2015 Jan 14; 15(6): 3475–83.

Zou X, Zhao X, Chi Z. A robust background subtraction approach with a moving camera. In IEEE 2012 7th International Conference on Computing and Convergence Technology (ICCCT). 2012 Dec 3; 1026–1029.

Shen Y, Hu W, Yang M, Liu J, Wei B, Lucey S, Chou CT. Real-time and robust compressive background subtraction for embedded camera networks. IEEE Trans Mob Comput. 2015 Apr 1; 15(2): 406–18.

Kothiya SV, Mistree KB. A review on real time object tracking in video sequences. In 2015 International Conference on Electrical, Electronics, Signals, Communication and Optimization (EESCO). 2015 Jan; 1–4.

Shlepakov DV, Shlepakov LN. On zonal morphological approach to natural language texts processing. In IEEE Proceedings DCC 2000. Data Compression Conference. 2000 Mar 28; 571.

Xu R, Zhou S, Li WJ. MEMS accelerometer based nonspecific-user hand gesture recognition. IEEE Sens J. 2011 Sep 5; 12(5): 1166–73.

Kadu AA, Nagdive AS. Real-time 3D game using sixth sense and haptic technology. In IEEE 2014 International Conference on Computation of Power, Energy, Information and Communication (ICCPEIC). 2014 Apr 16; 449–454.

Guo B, Satake S, Imai M. Sixth-sense: context reasoning for potential objects detection in smart sensor rich environment. In 2006 IEEE/WIC/ACM International Conference on Intelligent Agent Technology. 2006 Dec 18; 191–194.

Batool A, Rauf S, Zia T, Siddiqui T, Shamsi JA, Syed TQ, Khan AU. Facilitating gesture-based actions for a Smart Home concept. In IEEE 2014 International Conference on Open Source Systems & Technologies. 2014 Dec 18; 6–12.

Krejcar O. Handicapped people virtual keyboard controlled by head motion detection. In IEEE 2011 3rd International Congress on Ultra-Modern Telecommunications and Control Systems and Workshops (ICUMT). 2011 Oct 5; 1–7.

Bang WC, Chang W, Kang KH, Choi ES, Potanin A, Kim DY. Self-contained spatial input device for wearable computers. In 7th IEEE International Symposium on Wearable Computers, 2003. Proceedings, IEEE Computer Society. 2003 Oct 1; 26–26.

Bailador G, Sanchez-Avila C, Guerra-Casanova J, de Santos Sierra A. Analysis of pattern recognition techniques for in-air signature biometrics. Pattern Recognit. 2011 Oct 1; 44(10–11): 2468–78.

Katsura S, Ohishi K. Acquisition and analysis of finger motions by skill preservation system. IEEE Trans Ind Electron. 2007 Nov 19; 54(6): 3353–61.

Mitra S, Acharya T. Gesture recognition: A survey. IEEE Trans Syst Man Cybern, C Appl Rev. 2007 Apr 16; 37(3): 311–24.


  • There are currently no refbacks.

Copyright (c) 2022 Research & Reviews: A Journal of Embedded System & Applications