BY MANVIR SINGH GILL M TECH (I &C )

OUTLINE
Introduction
History How the human brain works

Biological and artificial neuron model

Benefits of neural network Neural networks versus conventional computers

Applications

INTRODUCTION
Neural network is a parallel distributed processor made up of simple processing units.
Machine model that is designed in the same

way in which the brain performs a particular task. (machine learning)

Learn by example

Learn by analogy

Learn from experience

HISTORY
Neural networks theory was first independently proposed

by Alexander Bain (1873) and William James (1890) According to Bain, every activity led to the firing of a certain set of neurons. When activities were repeated, the connections between those neurons strengthened. And this repetition was what led to the formation of memory James theory was similar to Bains he suggested that

memories and actions resulted from electrical currents flowing among the neurons in the brain. In 1898 C. S. Sherrington, conducted experiment to test James theory , his work led to the discovery of the concept of habituation.

HUMAN BRAIN NN
DENDRITES AXON

HUMAN BRAIN NN (CONTD.)

At the end of each branch, a structure called a synapse converts the activity from the axon into electrical effects that inhibit or excite in the connected neurones

FEATURES OF BRAIN
Brain incorporates nearly 10 billions neurons and 60 trillion connections, synapses, between them . It perfoem hundreds of operations /sec. Need not to be replaced. Low reliability

ANALOGY B/W BIOLOGICAL AND ARTIFICIAL NN

BIOLOGICAL NN.
SOMA DENDRITES AXON SYNAPSES

ARTIFICIAL NN.
NEURON INPUT OUTPUT WEIGHT
Bias Induced Field Activation function
( )

Input values

x1 x2 xm

w1 w2

Summing function

Output

wm
weights

ARTIFITIAL NEURON
Artificial neuron is device with many inputs and one

output. The neuron has two modes of operation 1. Training mode 2. Using mode In training mode, neuron can be trained to perform a particular task according to the input . In using mode , if input pattern does not belong to taught list of input pattern , the firing rule determine whether to fire or not . Firing rule not only relates the previous input pattern but it relates all input patterns.

 Non linearity :- interconnection of linear or non linear

BENEFITS

neurons. I/O mapping:- minimize the difference b/t the desired output and actual output with an appropriate statistical criteria. Adaptability:- can easily be retrained to deal with minor changes in non stationary environment. Evidential response :- provide information not only about particular pattern but also about the confidence in decision made. Contextual informations :- It is dealt naturally by neural network.

Fault tolerance :- has a potential to be inherently fault

tolerance.

BENEFITS (contd.)
VLSI Implementation :- parallel nature of neural

network make it potential to implement in VLSI . Uniformity of analysis & design :- neuron , in one form or another, represent an ingredient common to all neural network Neurobiological analogy :- engineers look to neurobiology for new ideas to solve more complex problems than those based on conventional hard wired design technique.

APPLICATIONS
Signal processing:- suppress line noise, with adaptive echo

canceling, blind source separation Control:- e.g. backing up a truck: cab position, rear position, and match with the dock get converted to steering instructions. Manufacturing plants for controlling automated machines. Robotics :- navigation, vision recognition Pattern recognition:- i.e. recognizing handwritten characters, recognition Medicine:- i.e. storing medical records based on case information Speech production & recognition Financial Applications : time series analysis, stock market prediction Game Playing:- eg chess