IMPLEMENTATION OF SPEECH TECHNOLOGY IN

NAVIGATION AIDS FOR THE VISUALLY IMPAIRED

Advisors :
1. Haryadi Amran Darwito, S.ST, MT
NIP. 197001021995121001
2. Reni Soelistijorini, B.Eng, MT
NIP. 197104281999032002

Abdul Fatah
1203131043

Electronic Engineering Polytechnic Institute of Surabaya

Background

Limited information about environment for navigation

Inability of the visually impared on working

Need a navigation aid that provide confident and safe method of

navigation

Electronic Engineering Polytechnic Institute of Surabaya

Objective

Help the blind to make it easier to receive navigation instructions

Helping the blind to know navigation directions
To help the blind know that have been arrived the destination of their
navigation

Electronic Engineering Polytechnic Institute of Surabaya

Problems Formulation

How to process voice as input Raspberry Pi users to set the destination

?

How to give voice output distance information to user ?

How to provide information to the user that the system is ready for
use ?

How to provide voice output direction of the navigation information ?

Electronic Engineering Polytechnic Institute of Surabaya

Problems Limitation

This system is implemented on navigation aids for the blind

Voice input as the destination has been determined in ITS area

The accuracy of the instruction depends on the accuracy of GPS

Using Google Speech API

Electronic Engineering Polytechnic Institute of Surabaya

System Design
Obtacle Detection

Azimuth

Voice navigation
intructions

Voice Input

User data
location

Movement
user location

Electronic Engineering Polytechnic Institute of Surabaya

How it works

User input voice

destinaton +
current location

Finish notification

Voice data
converted to text

Send user position

Route searching

Searching
coordinate
destination

Real-time
instruction

Route data
converted to
speech

Electronic Engineering Polytechnic Institute of Surabaya

Reserch Test

System Test
Voice Recognition Accuracy
Detection information
Warning information about
obstacle and wrong way

Electronic Engineering Polytechnic Institute of Surabaya

Progress

Electronic Engineering Polytechnic Institute of Surabaya

Thank
You
Electronic Engineering Polytechnic Institute of Surabaya

References
[1] Bathara Banyu Uluum, Perancangan Alat Bantu Jalan Tunanetra Dengan Sensor Ultrasonik Berbasis
Mikrokontroler, A.Md. Tugas Akhir, Universitas Telkom., Bandung, 2013.
[2] Jae Sung Cha, Dong Kyun Lim and Young-Nyuo Shin, Design and Implementation of a Voice Based
Navigation for Visually Impaired Persons, International Journal of Bio-Science and Bio-Technology., vol. 5,
no. 3, pp. 61-68, June 2013.
[3] Bruce Moulton, Gauri Pradhan and Zenon Chaczko, Voice Operated Guidance Systems for Vision
Impaired People: Investigating a User-Centered Open Source Model, International Journal of Digital Content
Technology and its Applications., vol. 3, no.4, pp. 60-68, December 2009.
[4] Desi Nurhasanah, Perancangan dan imlementasi komunikasi data Text To Speech (TTS) dalam bahasa
Indonesia, S.Kom. Skripsi, Universitas Komputer Indonesia., Bandung, 2005.
[5] Raspberry Pi, https://en.wikipedia.org/wiki/Raspberry_Pi, 15 Des, 2015.
[6] Agus Irawan Hadi Kusuma, Implementasi Speech to Text dan Text to Speech pada aplikasi Traveling
Conversations Assistance Berbasis Mobile, S.Kom. Skripsi, Universitas Komputer Indonesia., Bandung,
2014.
[7] Modem, https://id.wikipedia.org/wiki/Modem, 15 Desember, 2015.
[8] Headset, https://id.wikipedia.org/wiki/Headset, 15 Desember, 2015.

Electronic Engineering Polytechnic Institute of Surabaya