A Novel Approach to Vocalize the Hand Gesture Movement for Speech Disabled

Abstract

Abstract: Mute People use sign language to communicate with each other. They face a problem to communicate with people who can hear and talk. Gesture Vocalizer is a device which reduces the barrier of communication between the mute community and the people not familiar with the concept of sign language, so that the messages that a mute person is trying to relay is understandable to a person with no knowledge of sign language. The aim of this paper is to show how a hand gesture vocalizer can be implemented using Proteus Software. This is a boon to people who suffer from MUTISM. Gesture vocalizer is a prototype made for a social purpose. We know that it is very difficult for deaf people to communicate with normal people. Deaf people communicate with hand gestures, and it is difficult for other people to understand their sign language. Gesture vocalizer is a device which detects the gestures of a deaf and mute person and displays the corresponding output on the virtual terminal. The main objective of this paper is to reduce the communication gap between communicative people and the mute community. It helps the mute community to be independent. A prototype is developed, and simulation is carried out using Flex sensors, an accelerometer, dynamic time warping, an Arduino Uno board, and an output device. The input to be converted is initiated through the Flex. This is given as input to Arduino. Using Dynamic Time Warping technique, a corresponding analog signal is generated and measured. This mapping is done using distance matrix. Later, optimal analog signal is converted into the digital signal. The Arduino module displays on android screen the digital equivalent of the flex and the gesture name associated with the digital value. The Bluetooth module on Arduino board gets connected to the android based mobile phone and converts the text into speech.

Index Terms: MUTISM, Gesture Vocalizer, Flex sensors, Dynamic Time Warping, Hand gesture vocalizer