Escolar Documentos
Profissional Documentos
Cultura Documentos
Hebbian
Hebbian
:Kohonen
Hebbian
1949Donald Hebb
Hebb
Hebb i
j j
j i
Hebb(Stent1973)
1.
2.
Hebb
Hebbian
Hebb p
wij
w ij ( p ) = F [ y j ( p ), x i ( p ) ]
Hebb
wij ( p) = a y j ( p) xi ( p )
HebbianHebb
wij
(6-33)Hebb
wij ( p) = y j ( p) xi ( p) y j ( p) wij ( p)
0 1
0.01 0.1
Hebbian
1:
[0, 1]
2:
p
n
y j ( p) = xi ( p) wij ( p) j
i =1
nj j
3:
:
Hebbian
6-22a
Hebbian
McCulloch Pitts
0
0
0
0
0
0
1
0
0
1
X1 = 0 X 2 = 0 X 3 = 0 X 4 = 1 X 5 = 0
0
0
1
0
0
0
1
0
0
1
()
1
0
X = 0
0
1
Y = sign 0
0
0
0
0
0 1 0.4940 0
2.0204 0
0 2.0204 0 0.2661 1
0 1.0200 0
0 0 0.0907 = 0
0
0 0.9996 0 0 0.9478
0
2.0204 0
0 2.0204 1 0.0737 1
Hebbian
2070
20 80
Teuvo Kohonen
(
)
Kohonen
Kohonen
Kohonen
(Kohonen)
Kohonen
Kohonen
(
)
Kohonen
wij
wij
( xi wij ), if neuron j wins the competition
wij =
0,
if neuron j loses the competition
xi
01
j
Wj X
n1XWj
1/ 2
2
d = X W j = ( xi wij )
i =1
n
xiwijXWji
X
jX
j X = min X W j ,
j
j = 1, 2, . . ., m
mKohonen
X 3
Kohonen
0.52
X=
0
.
12
Wj
0.27
W1 =
0
.
81
0.42
W2 =
0
.
70
0.43
W3 =
0
.
21
( )
jX :
d1 = ( x1 w11) 2 + ( x2 w21) 2 = (0.52 0.27) 2 + (0.12 0.81) 2 = 0.73
d2 = ( x1 w12) 2 + ( x2 w22) 2 = (0.52 0.42) 2 + (0.12 0.70) 2 = 0.59
d3 = ( x1 w13) 2 + ( x2 w23) 2 = (0.52 0.43) 2 + (0.12 0.21) 2 = 0.13
3 (6-36)
W3
w13 =
w23 =
p+1 W3:
0.43 0.01 0.44
+
=
W3( p + 1) = W3 ( p) + W3 ( p) =
0
.
21
0
.
01
0
.
20
3 W3
X
1:
01
2:
X Kohonen
p
j X
1/ 2
2
j X ( p) = min X W j ( p) = [ xi wij ( p)]
j
i =1
j = 1, 2, . . ., m
n
n m (
Kohonen)
3:
wij(p) p
wij ( p) =
[ xi wij ( p)] ,
0,
j j ( p)
j j ( p)
j(p) jX
p
4:
p 12
Kohonen
1001010
Kohonen
1000
1 +1
1 +1
0.1
1
0.8
0.6
0.4
W(2,j)
0.2
0
-0.2
-0.4
-0.6
-0.8
-1
-1
-0.8
-0.6
-0.4
-0.2
W(1,j)
0.2
0.4
0.6
0.8
100
1
0.8
0.6
0.4
W(2,j)
0.2
0
-0.2
-0.4
-0.6
-0.8
-1
-1
-0.8
-0.6
-0.4
-0.2
0
W(1,j)
0.2
0.4
0.6
0.8
1000
1
0.8
0.6
0.4
W(2,j)
0.2
0
-0.2
-0.4
-0.6
-0.8
-1
-1
-0.8
-0.6
-0.4
-0.2
W(1,j)
0.2
0.4
0.6
0.8
10,000
1
0.8
0.6
0.4
W(2,j)
0.2
0
-0.2
-0.4
-0.6
-0.8
-1
-1
-0.8
-0.6
-0.4
-0.2
0
W(1,j)
0.2
0.4
0.6
0.8