Escolar Documentos
Profissional Documentos
Cultura Documentos
ABSTRACT
In this project, we design and build a versatile robotic arm system. The arm has the ability to manipulate objects such as pick and place operations. Firstly, the robotic arm is built in order to interface with a prosthetic control board. The circuit board enables user to completely control the robotic arm and moreover, enables feedbacks from user. The control circuit board uses a powerful integrated microcontroller, a PIC (Programmable Interface Controller). The PIC is primarily programmed using assembly programming language and it is used as the brain of the arm. The second part of the project is to use speech recognition control on the robotic arm. A speech recognition circuit board is constructed with onboard components such as PIC and other integrated circuits. The robotic arm is able to receive instructions as spoken commands through a speech recognition system via a microphone and perform operations with respect to the commands such as picking and placing operations.
PAACET
1. INTRODUCTION
An upper limb myoelectric prosthetic arm is an aid that tries to give a chance of a better quality of life to disabled people. It tries to give back some of the natural and fundamental functions of a physiological human arm, even if the movements that is able to perform are not so deeply similar to those of a natural arm. To control such a device, several ways are possible. The more traditional one is nowadays the EMG (electromyography) control, which is based on EMG signals extracted from surface electrodes of users arm or forearm, while the simplest technique is using buttons or switches when the electromyography activity of patient muscles is not so good or clear. Lately, in the last decade more complex ways were explored to widen the range of possible input sources for the controller of a prosthetic arm, so neuro cortical control , foot control with wireless wearable insoles , control with implantable myoelectric sensors (IMES), with MMG sensors (mechanomyographic) and ultrasonic sensors were
investigated, even if is not clear if these techniques are really used by patients in their everyday life or if they are just interesting theoretical contributions in the wide field of prosthetic arm control. All these techniques start from the assumption that the prosthetic motion is directly linked to the human motion, the source being both the EMG activity or the foot motion or something else. Since the most common control scheme for an upper limb prosthetic arm is a sequential control (where signals or switches are used to change control from one degree of freedom to another), it follows that all these techniques have the same problem: when the patient has to perform a complex task, formed by a predetermined and precise sequence of movements, he has to do a precise sequence of contractions/movements, always remembering which motor is selected in every instant of time. This is not as simple as one can believe, especially when there are more degrees of freedom (typically three for a transhomerus or a shoulder disarticulated patient: the flection/extention of the elbow, the prono/supination of the wrist and the opening/closing of the hand). A myoelectric prosthesis uses EMG signals or potentials from voluntarily contracted muscles within a person's residual limb on the surface of the skin to control the
PAACET
movements of the prosthesis, such as elbow flexion/extension, wrist supination/pronation (rotation) or hand opening/closing of the fingers. Prosthesis of this type utilizes the residual neuro-muscular system of the human body to control the functions of an electric powered prosthetic hand, wrist or elbow. This is as opposed to an electric switch prosthesis, which requires straps and/or cables actuated by body movements to actuate or operate switches that control the movements of prosthesis or one that is totally mechanical. It is not clear whether those few prostheses that provide feedback signals to those muscles are also myoelectric in nature. It has a self suspending socket with pick up electrodes placed over flexors and extensors for the movement of flexion and extension respectively. Let consider the following case: a patient has to bring a bottle and pour water into his glass. The sequence of contractions that he must do, in the case of sequential control of the motors and thinking about three sources of emg signal, is illustrated in table 1:
TABLE I
From the table above we can understand that even if the motion task seems to be very easy, the patient has to do a precise sequence of twelve contractions to perform it. If
PAACET
we think that now, in some cases, there is the idea to add, besides the elbow, the wrist and the hand motors, also a shoulder motor group with two motors, one for the intra-extra rotation and one for the elevation-adduction, (so adding four possible movements, with other four sources of emg signals) it is clear that controlling the prosthetic device only with emg signals could become more and more difficult, also because the possible EMG sources located in the muscles near the amputation line are not utilizable, due to a bad or insufficient EMG activity. For this reason we thought to another alternative input source, potentially efficient and easy to be used, and overall disconnected from the human body motion. In particular we focused on the voice control.
PAACET
There are many ways to control an electrical prosthesis, one of the more popular being myoelectric control. Whenever a muscle in the body is contracted, or flexed, a small electrical signal called an EMG in the range of 5 to 20 microvolts is created by a chemical interaction in the body (Animated Prosthetics). A typical light bulb uses 110 to 120 volts, so the signal generated by the body is less than a millionth of the strength of a light bulb (Animated Prosthetics). One of the key components of the myoelectric arm is the electrode attached to the surface of the skin to record the EMG signal. Once recorded, the signal is amplified, then processed by a controller that switches the motors on or off in the hand, wrist, or elbow to produce movement and function (Animated Prosthetics).
PAACET
Not everyone can wear the myoelectric arm. Users must be able to produce an EMG strong enough to be recorded and sufficiently amplified. Users must also be able to separate muscle contractions. Separating contraction means that when one muscle is contracted, the opposing muscle is relaxed. If both muscles were contracted at the same time (co-contraction), the controller would receive signals to both turn the motor on and off at the same time. This would signal the hand to open and close simultaneously, resulting in no function.
PAACET
PAACET
To the arm
PAACET
3.2VOICE RECOGNITION
Speech recognition is the process of converting an acoustic signal, captured by a microphone or a telephone, to a set of words. The recognized words can be the final result, as for applications such as command & control, data entry, and document preparation or retrieval. The basic assumption of the whole word pattern matching approach is that different utterance of the same word by a particular talker result in similar patterns of sound. There will be variation in spectrum shape at corresponding parts of the patterns from the same word. There will also be variations in the time scale of the patterns, and this will make it difficult to compare corresponding parts. The basic building block of speech is the phoneme. There is one phoneme for every basic sound in the language. For example, the word 'cat' is constructed from three phonemes -'k', 'a' andt. A Speech Recognition Engine will need to construct the sequence of the phonemes in the speech, before it can produce the sequence of words. This is typically carried out in a number of distinct stages.
PAACET
TEMPLATE MEMORY
PAACET
10
created and sent by voice are envisaged. Word recognizers are being incorporated in to consumers products, such as voice operated telephone dialing systems, and are used in voice activated domestic appliance for disabled people with limited movement. This increases their independence by enabling them to perform simple tasks such as turning on/off lights, radio or TV. There are of course numerous potential applications of voice recognition. However, it appears that future advances in this area will rely significantly on artificial intelligence techniques because of the need for machines to understand as well as recognize speech. A speech recognition control system capable of controlling the robotic arm using voice commands is also constructed, where hands-free operation is desired. The ability to communicate with a robot through speech is the ultimate user interface. When a robot obtains the ability to recognize words, it is well on its way to becoming a true humanoid. This speech recognition control circuit to be built provides a simple and effective means for humans to specify a task for the robot to acquire new skills without any additional hard coded programming. Robots have become important over a wide range of applications--from manufacturing, to surgery, to the handling of hazardous materials. Consequently, it's important to understand how they work, and what problems exist in designing effective robots.
PAACET
11
HM2007 HM2007is a single chip CMOS voice recognition LSI circuit with the on-chip analog front end voice analysis, recognition process and system control functions. A 40
isolated-word voice recognition system can be composed of external microphone, keyboard, 64K SRAM and some other components .Combined with the microprocessor,
TC8860F The voice recognition chip used for processing the input speech is TC8860F. It is a single chip LSI with onchip circuits and functions required for voice recognition including analog circuit, registration RAM, and pattern matching function. It is possible to construct a voice recognition system only by externally connecting a microphone and keyboard to this LSI. The chip can be operated in manual/CPU mode. In manual mode of operation, a 4 x 3 keypad matrix is used for inputting the commands to the chip. The chip has a 4Kbit volatile built in SRAM.
PAACET
12
FEATURES OF TC8860F: Single chip voice recognition LSI Speaker dependent word recognition system Linear matching system No. of words that can be registered: Max 10 words Response time is Max 0.60sec, average 0.35sec Input voice time length allowed: 0.16 ~ 0.96sec Built-in 4Kbit RAM for registration A microphone for inputting the voice Built-in 800KHz oscillator circuit 5V single power supply
PAACET
13
The comparison of different speech recognition chips yields us the information that HM2007 is having an average signal to noise ratio. Apart from the cost of the chip, its availability was given more importance compared to its counterparts. This is the reason why it is selected for designing the voice controlled prosthetic arm project. The pin out of the HM2007 IC is given in the figure below.
PAACET
14
PAACET
15
PAACET
16
concerning the style of speech it can recognize. For example, it can only recognize words that spoken separately with pause in between each word. It is programmable to recognize 40 unique words of 0.96s length and a maximum of 20 words of 1.952s length. The length of the words affects the number of words able to be store in the 8K x 8 static RAM chip. The circuit is able to detect voice as far as one foot from the microphone. This speech circuit provides many advantages compared with other circuits as the response time is less than 300 ms, it requires only a 5 V DC power supply and it can support CPU mode and manual mode whereby the manual mode is connected to a keypad and CPU mode is connected to a microcontroller
PAACET
17
The output is connected to a PIC microcontroller to read the all the 8-bit outputs from the circuit. The 8 outputs are taken from the output of the 74LS373 latch. The PIC is then connected to the serial servo controller circuit and control the movement of the 8 servo motors. The circuit was constructed a few times and troubleshooting was done by ensuring all connections are correct and all necessary pin connections are connected.
PAACET
18
An ordinary human arm consists of the following parts: Upper arm Elbow Wrist Fingers
The robotic arm is designed to be similar with a human arm with nine degrees of freedom where each part of the arm is actuated with servo motors.Our objective is to attain all the degrees of freedom. This is accomplished using high torque motors. Among different types of DC motors available, servo motors have higher torque capacity. This enables the prosthetic arm to do jobs in close relation with an ordinary arm. The table
PAACET
19
shown below gives a clear idea about the relation between output combinations of speech processing system with that of the arm movements. The robotic arm is controlled by the control board which is based on the PIC 16F877A, a type flash programmable controller. The main objective of designing using a microcontroller is that a large amount of electronics needed for certain applications can be eliminated.
BIT COMBINATIONS B3 0 0 0 0 0 0 0 1 B2 0 0 0 1 1 1 1 0 B1 0 1 1 0 0 1 1 0 B0 1 0 1 0 1 0 1 0
ARM MOVEMENTS
Shoulder motor right Shoulder motor left Elbow motor up Elbow motor down Wrist motor right Wrist motor left Plunger for finger movement (IN) Plunger for finger movement (IN)
PAACET
20
PERIPHERAL FEATURES: Timer0: 8-bit timer/counter with 8-bit prescaler \ Timer1: 16-bit timer/counter with prescaler, can be incremented during Sleep via external crystal/clock Timer2: 8-bit timer/counter with 8-bit period register, prescaler and postscaler Two Capture, Compare, PWM modules Capture is 16-bit, max. resolution is 12.5 ns Compare is 16-bit, max. resolution is 200 ns PWM max. resolution is 10-bit
Synchronous Serial Port (SSP) with SPI (Master mode) and I2C (Master/Slave) Universal Synchronous Asynchronous Receiver Transmitter (USART/SCI) with 9-bit address detection Parallel Slave Port (PSP) 8 bits wide with external RD, WR and CS controls (40/44-pin only) Brown-out detection circuitry for Brown-out Reset (BOR)
ANALOG FEATURES: 10-bit, up to 8-channel Analog-to-Digital Converter (A/D) Brown-out Reset (BOR) Analog Comparator module with: Two analog comparators Programmable on-chip voltage reference
(VREF) module
PAACET
21
Programmable input multiplexing from device inputs and internal voltage reference
SPECIAL MICROCONTROLLER FEATURES: 100,000 erase/write cycle Enhanced Flash program memory typical 1,000,000 erase/write cycle Data EEPROM memory typical Data EEPROM Retention > 40 years Self-reprogrammable under software control In-Circuit Serial Programming (ICSP) via two pins Single-supply 5V In-Circuit Serial Programming Watchdog Timer (WDT) with its own on-chip RC oscillator for reliable operation Programmable code protection Power saving Sleep mode Selectable oscillator options In-Circuit Debug (ICD) via two pins
CMOS TECHNOLOGY:
Low-power, high-speed Flash/EEPROM technology Fully static design Wide operating voltage range (2.0V to 5.5V) Commercial and Industrial temperature ranges Low-power consumption
PAACET
22
CONCLSUION
During the first phase of our project we were able to finish the speech recognition part and a part of the prosthetic control board. The construction of the arm and interfacing the servo motors are the major task before us for the second phase of our project.
PAACET
23
REFERENCE:
Tele-Operated Anthropomorphic Arm and Hand Design Namal A. Senanayake, Khoo B. How, and Quah W. Wai Controlling a prosthetic arm with a throat microphone Elena Mainardi, Angelo Davalli Development of a prosthetic arm: experimental validation with the user and an adapted software V. Artigue, G. Thomann
PAACET
24