This paper shows the first part of the automatic Indonesian sign language (SIBI) into text translation system. The focus of this project is on translation of the alphabet (A to Z) and numbers 1 to 10. Using a combination of a Kinect camera, Discrete Cosine gtransform (DTC), Cross Correlation Function and Classifying algorithm Generalized Learning Vector Quantization (GLVQ) can create a simple system to recognition aplhabet A to Z and number 1 to 10 in Indonesian Sign Language. The skeleton extraction function and depth sensor from the Kinect camera are used to capture and tranfer of hand gesture movements into frames of images. DCT is used to transform spatial data of each frame of image into its spectral domain. Collection of cross correlation values between same rows or columns of data from two consecutive frames can be used as a signature of a character. Each signature is unique and needs a small amount of data. GLVQ is used as the classifying algorithm to recognition the character. From our experiments, the system we proposed has obtained a high degree of accuracy in the recognition of alphabet and numbers in Indonesians Sign Language.
|
|