HAND GESTURE RECOGNITION

BASED VOICE ANNUNCIATION

HANDTALK: ASSISTIVE TECHNOLOGY FOR THE DEAF

Abstract:
Hand gesture is one of the typical methods used in sign
language for non-verbal communication. It is most commonly used
by people who have hearing or speech problems to communicate
among themselves or with normal people. Various sign language
systems have been developed by manufacturers around the globe
but they are neither flexible nor cost-effective for the end users.

This paper presents a system prototype that is able to

automatically recognize sign language to help normal people to
communicate more effectively with the hearing or speech impaired
people. The Sign to Voice system prototype, S2V, was developed
using wearable gloves connected with sensors. Different sets of
universal hand gestures were stored in the Microcontroller and
utilized to train the Voice IC for classification purpose. The
experimental results have shown satisfactory result for sign-to-
voice translation.

MICROCONTROLLER ATMEL 89C51

The AT89C51 is a low-power, high-performance CMOS 8-bit
microcomputer with 4K bytes of Flash Programmable and
Erasable Read Only Memory (PEROM). The device is
manufactured using Atmel’s high density nonvolatile memory
technology and is compatible with the industry standard MCS-51™
instruction set and pinout

APR9600

The APR9600 device offers true single-chip voice recording,

non-volatile storage, and playback capability for 40 to 60
seconds. The device supports both random and sequential
access of multiple messages.

Sample rates are user-selectable, allowing designers to

customize their design for unique quality and storage time
needs. Integrated output amplifier, microphone amplifier, and
AGC circuits greatly simplify system design. the device is ideal
for use in portable voice recorders, toys, and many other
consumer and industrial applications

Embedded Software
• Keil C

Embedded Hardware
• Atmel 89c51 Microcontroller

• Signal Conditioning Circuit

• Power Supply

• Flex Sensors
 HAND GESTURE RECOGNITION BASED
VOICE ANNUNCIATION
HANDTALK: ASSISTIVE TECHNOLOGY FOR THE DEAF

BLOCK DIAGRAM

Relay Driver
Power Supply

FLEX
Conditioning Circuit

SENSOR 1
Sensor Signal

FLEX
SENSOR 2
APR 9600
FLEX
VOICE
SENSOR 3
Microcontr RECORD
&

FLEX oller PLAY

SENSOR 4

FLEX
SENSOR 5