Moment Invariant Features Extraction for Hand Gesture Recognition of Sign Language based on SIBI
Abstract
Myo Armband became an immersive technology to help deaf people for communication each other. The problem on Myo sensor is unstable clock rate. It causes the different length data for the same period even on the same gesture. This research proposes Moment Invariant Method to extract the feature of sensor data from Myo. This method reduces the amount of data and makes the same length of data. This research is user-dependent, according to the characteristics of Myo Armband. The testing process was performed by using alphabet A to Z on SIBI, Indonesian Sign Language, with static and dynamic finger movements. There are 26 class of alphabets and 10 variants in each class. We use min-max normalization for guarantying the range of data. We use K-Nearest Neighbor method to classify dataset. Performance analysis with leave-one-out-validation method produced an accuracy of 82.31%. It requires a more advanced method of classification to improve the performance on the detection results.
Downloads
References
Sulfayanti, Dewiani, and Armin Lawi, “A real time alphabets sign language recognition system using hands tracking,†2016 Int. Conf. Comput. Intell. Cybern., pp. 69–72, 2016.
F. Ramirez-Garibay, C. M. Olivarria, A. F. E. Aguilera, and J. C. Huegel, “MyVox—Device for the communication between people: blind, deaf, deaf-blind and unimpaired,†IEEE Glob. Humanit. Technol. Conf. (GHTC 2014), pp. 506–509, 2014.
M. T. Wolf et al., “Decoding static and dynamic arm and hand gestures from the JPL BioSleeve,†IEEE Aerosp. Conf. Proc., pp. 1–9, 2013.
S. Mitra, S. Member, T. Acharya, and S. Member, “Gesture Recognition : A Survey,†IEEE, vol. 37, no. 3, pp. 311–324, 2007.
L. Chen, F. Wang, H. Deng, and K. Ji, “A Survey on Hand Gesture Recognition,†2013 Int. Conf. Comput. Sci. Appl., pp. 313–316, 2013.
Z. Yang and S. Narayanan, “Modeling Dynamics of Expressive Body Gestures In Dyadic Interactions,†IEEE Trans. Affect. Comput., vol. XX, no. XX, pp. 1–1, 2016.
S. Ongkittikul, S. Worrall, and A. Kondoz, “Two hand tracking using colour statistical model with the K-means embedded particle filter for hand gesture recognition,†7th Comput. Inf. Syst. Ind. Manag. Appl. CISIM 2008, pp. 201–206, 2008.
V. Bhame, R. Sreemathy, and H. Dhumal, “Vision based hand gesture recognition using eccentric approach for human computer interaction,†2014 Int. Conf. Adv. Comput. Commun. Informatics, pp. 949–953, 2014.
S. S. Ge, Y. Yang, and T. H. Lee, “Hand Gesture Recognition and Tracking based on Distributed Locally Linear Embedding,†IEEE, no. ii, 2006.
S. Khare, “Finger gesture and pattern recognition based device security system,†2015 Int. Conf. Signal Process. Commun. ICSC 2015, pp. 443–447, 2015.
“Multi-feature criteria with fuzzy logic pattern recognition for hand gesture classification,†in Midwest Symposium on Circuits and Systems, 2015, vol. 2015–Septe, pp. 1–4.
M. Vanco, I. Minarik, and G. Rozinaj, “Evaluation of static hand gesture algorithms,†21st Int. Conf. Syst. Signals Image Process., no. May, pp. 83–86, 2014.
Y. Liu et al., “Image processing and recognition of multiple static hand gestures for human-computer interaction,†Proc. - 2013 7th Int. Conf. Image Graph. ICIG 2013, pp. 465–470, 2013.
V. et al Elamaran, “Image Processing Algorithms for Gesture Recognition using MATLAB,†2014 IEEE Int. Conf. Adv. Commun. Control Comput. Technol., no. 978, pp. 0–1, 2014.
E. H. El-shazly, M. M. Abdelwahab, A. Shimada, and R. Taniguchi, “Real Time Algorithm for Efficient HCI Employing Features Obtained From MYO Sensor,†IEEE 59th Int. Midwest Symp. Circuits Syst., no. October, pp. 16–19, 2016.
A. A. Hidayat, Z. Arief, and D. C. Happyanto, “LOVETT Scaling with Flex Sensor and MYO Armband for Monitoring Finger Muscles Therapy of Post-Stroke People,†EMITTER International Journal of Engineering Technology, Vol. 3, No. 2, pp. 60–76, 2015.
A. F. Ruiz-olaya, M. Callejas-cuervo, and A. M. Perez, “EMG-based Pattern Recognition with Kinematics Information for Hand Gesture Recognition,†Signal Process. Images Comput. Vis. (STSIVA), 2015 20th Symp., pp. 1–4, 2015.
Z. Arief, I. A. Sulistijono, and R. A. Ardiansyah, “Comparison of five time series EMG features extractions using Myo Armband,†2015 Int. Electron. Symp., pp. 11–14, 2015.
J. G. Abreu, J. M. Teixeira, L. S. Figueiredo, and V. Teichrieb, “Evaluating Sign Language Recognition Using the Myo Armband,†Proc. - 18th Symp. Virtual Augment. Reality, SVR 2016, pp. 64–70, 2016.
A. L. P. Madushanka, R. G. D. C. Senevirathne, L. M. H. Wijesekara, S. M. K. D. Arunatilake, and K. D. Sandaruwan, “Framework for Sinhala Sign Language Recognition and Translation Using a Wearable Armband,†pp. 49–57, 2016.
S. Rawat, S. Vats, and P. Kumar, “Evaluating and Exploring the MYO ARMBAND,†pp. 4–9, 2016.
Wahyudi, A. Susanto, W. Widada, and S. P. Hadi, “Inertial Measurement Unit using multigain accelerometer sensor and gyroscope sensor,†Proc. 2011 Int. Conf. Electr. Eng. Informatics, ICEEI 2011, no. July, pp. 4–8, 2011.
T. Harada, H. Uchino, T. Mori, and T. Sato, “Portable orientation estimation device based on accelerometers, magnetometers and gyroscope sensors for sensor network,†IEEE Int. Conf. Multisens. Fusion Integr. Intell. Syst., vol. 2003–Janua, pp. 191–196, 2003.
E. Fresk and G. Nikolakopoulos, “Full Quaternion Based Attitude Control for a Quadrotor,†Eur. Control Conf., pp. 3864–3869, 2013.
W. Djojonegoro, Kamus Sistem Bahasa Isyarat Bahasa Indonesia, Ketiga. Jakarta: Departemen Pendidikan Nasional, 2001.
J. Flusser, B. Zitova, and T. Suk, Moments and Moment Invariants in Pattern Recognition; Kapitel 6, First Edit. Prague, Cezh Republic: WILEY, 2010.
Copyright (c) 2017 EMITTER International Journal of Engineering Technology
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
The copyright to this article is transferred to Politeknik Elektronika Negeri Surabaya(PENS) if and when the article is accepted for publication. The undersigned hereby transfers any and all rights in and to the paper including without limitation all copyrights to PENS. The undersigned hereby represents and warrants that the paper is original and that he/she is the author of the paper, except for material that is clearly identified as to its original source, with permission notices from the copyright owners where required. The undersigned represents that he/she has the power and authority to make and execute this assignment. The copyright transfer form can be downloaded here .
The corresponding author signs for and accepts responsibility for releasing this material on behalf of any and all co-authors. This agreement is to be signed by at least one of the authors who have obtained the assent of the co-author(s) where applicable. After submission of this agreement signed by the corresponding author, changes of authorship or in the order of the authors listed will not be accepted.
Retained Rights/Terms and Conditions
- Authors retain all proprietary rights in any process, procedure, or article of manufacture described in the Work.
- Authors may reproduce or authorize others to reproduce the work or derivative works for the author’s personal use or company use, provided that the source and the copyright notice of Politeknik Elektronika Negeri Surabaya (PENS) publisher are indicated.
- Authors are allowed to use and reuse their articles under the same CC-BY-NC-SA license as third parties.
- Third-parties are allowed to share and adapt the publication work for all non-commercial purposes and if they remix, transform, or build upon the material, they must distribute under the same license as the original.
Plagiarism Check
To avoid plagiarism activities, the manuscript will be checked twice by the Editorial Board of the EMITTER International Journal of Engineering Technology (EMITTER Journal) using iThenticate Plagiarism Checker and the CrossCheck plagiarism screening service. The similarity score of a manuscript has should be less than 25%. The manuscript that plagiarizes another author’s work or author's own will be rejected by EMITTER Journal.
Authors are expected to comply with EMITTER Journal's plagiarism rules by downloading and signing the plagiarism declaration form here and resubmitting the form, along with the copyright transfer form via online submission.
