Escolar Documentos
Profissional Documentos
Cultura Documentos
! "# $
*
% ! &
&
**
()
*** * +
567
.
:
, %
)
&$
. ?
@
+
$% ?.$+
)
@
+ ?
:
8
*
. 9%+)9
9
93:
; % 9
#
+
!
. 9%+)9
9
93:
; % 9<
**
9? ?
9?
93:
; % 9 (
)
#
=
> ***
. 9%+)
213
A
( 2 <
2 &$
%
,
*
ABSTRACT
This research aims at studying and designing a three-layer neural network, capable of
dealing with massive data, relying on the back-propagation error method. It also explores
the effect of parameters-change (learning step, number of nodes, type of activation
function for a few different input signals) and the major impact, caused by this change on
the neural network performance.
The results of these experiments have demonstrated the extreme sensitivity of the
designed network which depends on the back-propagation mechanism to change these
parameters.
Key words: neural networks, back propagation algorithm, learning algorithm, layers.
*
Associate Professor, Department of Computer and Automatic Control, Faculty of Mechanical and
Electrical Engineering, Tishreen University, Lattakia, Syria.
** Assistant Professor, Department of Computer and Automatic Control, Faculty of Mechanical and
Electrical Engineering, Tishreen University, Lattakia, Syria.
*** Postgraduate Student, Department of Computer and Automatic Control, Faculty of Mechanical
and Electrical Engineering, Tishreen University, Lattakia, Syria.
214
Tishreen University Journal. Eng. Sciences Series 2009 (1) %
(31) $"
$%
1
%" $"
:
@
!$
!B
9!8
"
/ '
/
&$ C
%
/
. D
..... C
@
.
(%
C
)
:
@ D
! $
:
+
C
2
9$
.[3] E
/
. '
.+ 1 .M
C ?
. BP %
)
@
+
%
9
@
+ ?
.(error)*+
3
%
C
2
3 ?
215
A
( 2 <
2 &$
%
,
*
f1 (e1 )
W11 W14
X W12 f 2 (e 2 ) W24 f 4 (e 4 ) Y
W13 W34
f3 (e3 )
@> &
$# (1)(
'
. /+
0 1
@8
% ; &8
'
1
1 9 1 /
/+!
x /
1 / L+
3 f ( ) /
1%
3 C
!
1
1
@8
w / 6 %
1
@8 /+
C
" 4" / e G+
y
.G+
/+
O% 3 B%
9
$ / % . ( X 1 , X 2 ,.....)
% " 9
G 1
%
.[4]
%
1
@2
( /
%
: $
@
+
+ 9
/
%
0
(
3
$
: % 9
" 1 /+
'0
, 2
$% '+ /
.(2) /
1
1 / 1 / G+
216
Tishreen University Journal. Eng. Sciences Series 2009 (1) %
(31) $"
$%
1
%" $"
"# H
# (7
>
H%)> G7 =
8 (2)(
NN $
."
%
,
" Werbos A
1974 •
.1985
E "F
$% " &$ Parker $ 1982 •
217
A
( 2 <
2 &$
%
,
*
"
@
+
&$ E8
*
–
1
/
2 1985 •
.
%
.$
*+
E
/+ /"2 1 *+
E P
1
EP = ∑
2 i
(t i − ai )2 ( 2)
.$%.
G+
a i
.
i
*+
,
&$ C
, 1
@8
/%" A
∆w = −η∇E ( 3)
. '+
"
(
$%
)G
/ η
: j 1%
3 i 1%
7
1@
,
1
∂E
∇w ji = −η∇ ji E = −
∂w ji
∂E
.[7] NN
%
&$
H
1
%
1
∂wij
∂E ∂E ∂a j ∂net j
= ⋅ ⋅ ( 4)
∂w ji ∂a j ∂net j ∂w ji
. net j
/+ 1 (4) %
<@"
F
9
n
net j = ∑ ai * w ji
i =0
∂net j ∂ n n ∂w jk a k
∂w ji
=
∂w ji
∑ w jk a k = ∑
K =0 k =0 ∂w ji
( 5)
∂w jk
. k = i 1
.
7
1* E <@"
F
L.
∂w ji
:(5) %
N
∂net j
= ai
∂w ji
218
Tishreen University Journal. Eng. Sciences Series 2009 (1) %
(31) $"
$%
1
%" $"
∂a j
a j = f (net j ) 12 : <@"
F
&0 '% 2
∂net j
1
f (net j ) = − net j
1+ e
∂a j
= f ′(net j ) =
d 1 + e −x ( )−1
"
∂net j dnet j
(
d 1 + e −x )−1
= (−1)(1 + e − x ) − 2 e − x (−1)
dnet j
e −x 1
= ⋅
1 + e 1 + e−x
−x
1 + e−x − 1 1 1 + e−x 1 1
= −x
⋅ −x
= −x
− ⋅
1+ e 1+ e 1+ e 1 + e−x 1+ e
−x
= (1 − a j )a j
:1
∂a j
= (1 − a j )a j ( 6)
∂net j
∂E
:(2) %
1
. :(4) %
1 /8
F
9
∂a j
&0 '%
1
EP = ∑
2 i
(t i − ai )2 ( 7)
<@"
F
/"2 1 1
R 12
G+ &$ 1
4"
' G+ J •
(hidden layer)
.+
$ J •
:$
F
9 12 3
' G+ j
0
∂E ∂ 1
⋅ ∑ (t i − a i )
2
=
∂a j ∂a j 2 i
∂ (t i − ai )
= ∑ (t i − a i )
i ∂a j
= (t i − ai )(− 1) = −(t i − a i )
∂ j = −(t i − a i )(1 − a j )a j
219
A
( 2 <
2 &$
%
,
*
&!$ F!
G!
1!( &$ /)
&0 G 1 % (h)
.+
$ a j
0 2
.[8] j '
&0 /
k
∂E
= δ ⋅ wij ⋅ f ′(net h ) ⋅ X i (8)
∂w ji
:
∂out h
f ′(net h ) =
∂net h
∂net o
wij =
∂out h
∂net h
xi =
∂wi
:( $)
($ 34 &
E7
S ' 6
7
*+
3 *+ / C+2 $
%
*+
L( 2
& '
@
: %
'
@ L(
0
H
" 9
1 *+
L(
. (3) /
1
220
Tishreen University Journal. Eng. Sciences Series 2009 (1) %
(31) $"
$%
1
%" $"
/+
د ا
N
ج ا ج ام
Yn Ys
()ا
E=Ys-Yn
N=N+1
+ *
E>0.03
stop
($ &
E7 :(3) (
:%
I
:
2 '.
: T(
.( STEP_W )
$%
'+
, ?1
..$+ /+
0 –3 . ( NO_OF_NODE) %
, ?2
( STEP_W) &>7 9FH !
.
&$ )
H + 6. +
3
sin(2πt / 250) 3 12
221
A
( 2
*
<
2 &$
%
,
().$ D
! "# &>7 87 :(1
"*+
3 4
%
*+ '+
%
)(9
%
.
%
$%
E8
.
16.06 200 -0.002718 0.01 200 1000
188.83 200 -0.317749 0.00 200 1000
1
7.20 120 -0.000080 0.06 200 1000
1.5
1
0.5
ج ا
0
ج ام
-0.5 1 139 277 415 553 691 829 967
-1
-1.5
=.1000
.200=E8
%
.0.01=
$%
'+
1.5
1
0.5
ج ا
0
ج ام
967 829 691 553 415 277 139 1 -0.5
-1
-1.5
()0.001= $!
# &>7 (5
=.1000
.200=E8
%
0.001=
$%
'+
222
Tishreen University Journal. Eng. Sciences Series 2009 (1) %
(31) $"
$%
1
%" $"
1.5
1
0.5
ج ا
0
ج ام
-0.5
-1
-1.5
1.5
1
0.5
ج ا
0
ج ام
-0.5 1 139 277 415 553 691 829 967
-1
-1.5
50=
@
#
# G7 (7)(
.1000=
.50=E8
%
.0.06=
$%
'+
223
A
( 2 <
2 &$
%
,
*
1.5
1
0.5
ج ا
0
ج ام
-0.5 1 139 277 415 553 691 829 967
-1
-1.5
100=
@
#
# G7 (8) (
.1000=
.100=E8
%
.0.06=
$%
'+
1.5
1
0.5
ج ا
0
ج ام
-0.5 1 139 277 415 553 691 829 967
-1
-1.5
150=
@
#
# G7 (9) (
.1000=
.150=E8
%
0.06=
$%
'+
: 87 (7
L –
.$ D
! "# (7
&
L , 87 :3 (
*+
4" %
'
4
% %
*+
3
E8
/+
.
.
224
Tishreen University Journal. Eng. Sciences Series 2009 (1) %
(31) $"
$%
1
%" $"
1.5
1
0.5
ج ا
0
ج ام
-0.5 1 139 277 415 553 691 829 967
-1
-1.5
sin (7
&
L
# D
! (10)(
.1000=
.200=E8
%
0.06=
$%
'+
1.5
1
0.5
ج ا
0
ج ام
-0.5 1 139 277 415 553 691 829 967
-1
-1.5
cos (7
&
L
# D
! (11)(
.1000=
.150=E8
%
0.05 =
$%
'+
1.5
0.5
ج ا
0
ج ام
997 914 831 748 665 582 499 416 333 250 167 84 1
-0.5
-1
-1.5
sin*cos (7
&
L
# D
! (12)(
225
A
( 2 <
2 &$
%
,
*
.1000=
.200=E8
%
.115 =
.
% %
1.2
0.8
0.6
ج ا
0.4
ج ام
0.2
0
1959 1781 1603 1425 1247 1069 891 713 535 357 179 1
-0.2
-0.4
sin 2 (7
&
L
# D
! (13)(
.1000=
.150=E8
%
0.05 =
$%
'+
!
G+
1
9
N2 $ (STEP_W )
$%
'+ $ 62 " (1) /"
3! 4" 1 0.001 7
$%
'+ 0 K (2)/
6B
22
G+
. 1
2 1
"+
1
188.83 7
*+
.
: 1 /B8
9
(2) /"
*+
3
( 1 /(2 (3.29)
62 )
# 0 1
H
% 2
"
3
3 /+
'0 1 J
&$ 62 E (3) /"
/
1
H
"
G+ E
G+ 1
9
1 < /
+
12 %
.(13)
:
$
F
.
%
9
'
" $
V % .$+
)
@
+ 12
;<
?1
.'
.+ 1 A*
N
?2
226
Tishreen University Journal. Eng. Sciences Series 2009 (1) %
(31) $"
$%
1
%" $"
"
@
+
+ N
W K
@
+
+ 9
" ;<
( ?4
.
%
$ 8
;<
&0 /$
: M
227
A
( 2 <
2 &$
%
,
*
228