8

Hebbian
Hebbian

:Kohonen

Hebbian
1949Donald Hebb
Hebb
Hebb i
j j

j i

Hebb(Stent1973)
1.

2.

Hebb

Hebbian

 Hebb p
wij
w ij ( p ) = F [ y j ( p ), x i ( p ) ]

Hebb
wij ( p) = a y j ( p) xi ( p )

 HebbianHebb

wij

(6-33)Hebb

wij ( p) = y j ( p) xi ( p) y j ( p) wij ( p)

0 1
0.01 0.1

Hebbian
1:
[0, 1]

2:
p
n

y j ( p) = xi ( p) wij ( p) j
i =1

nj j

 3:
:

wij ( p + 1) = wij ( p) + wij ( p)

wij(p)p

wij ( p) = y j ( p)[ xi ( p) wij ( p)]

4:
p12

Hebbian
6-22a
Hebbian

McCulloch Pitts

0
0
0
0
0
0
1
0
0
1





X1 = 0 X 2 = 0 X 3 = 0 X 4 = 1 X 5 = 0





0
0
1
0




0
0
1
0
0
1

 ()
1
0

X = 0

0
1

Y = sign 0
0

0
0
0
0 1 0.4940 0

2.0204 0
0 2.0204 0 0.2661 1

0 1.0200 0
0 0 0.0907 = 0


0
0 0.9996 0 0 0.9478
0

2.0204 0
0 2.0204 1 0.0737 1

Hebbian

 2070

20 80
Teuvo Kohonen

(
)

 Kohonen

Kohonen
Kohonen

(Kohonen)
Kohonen

Kohonen


(
)

(Mexican hat function)

Kohonen

 Kohonen

wij

wij
( xi wij ), if neuron j wins the competition
wij =
0,
if neuron j loses the competition

xi
01

 j
Wj X

n1XWj
1/ 2

2
d = X W j = ( xi wij )

i =1
n

xiwijXWji

 X
jX
j X = min X W j ,
j

j = 1, 2, . . ., m

mKohonen

 X 3
Kohonen
0.52
X=

0
.
12

Wj
0.27
W1 =

0
.
81

0.42
W2 =

0
.
70

0.43
W3 =

0
.
21

 ( )
jX :
d1 = ( x1 w11) 2 + ( x2 w21) 2 = (0.52 0.27) 2 + (0.12 0.81) 2 = 0.73
d2 = ( x1 w12) 2 + ( x2 w22) 2 = (0.52 0.42) 2 + (0.12 0.70) 2 = 0.59
d3 = ( x1 w13) 2 + ( x2 w23) 2 = (0.52 0.43) 2 + (0.12 0.21) 2 = 0.13

3 (6-36)
W3
w13 =

( x1 w13) = 0.1 (0.52 0.43) = 0.01

w23 =

( x2 w23) = 0.1(0.12 0.21) = 0.01

 p+1 W3:
0.43 0.01 0.44
+
=
W3( p + 1) = W3 ( p) + W3 ( p) =

0
.
21
0
.
01
0
.
20

3 W3
X


1:
01

 2:
X Kohonen
p
j X
1/ 2

2
j X ( p) = min X W j ( p) = [ xi wij ( p)]
j
i =1

j = 1, 2, . . ., m
n

n m (
Kohonen)

 3:

wij ( p + 1) = wij ( p) + wij ( p)

wij(p) p

wij ( p) =

[ xi wij ( p)] ,
0,

j j ( p)
j j ( p)

j(p) jX
p

 4:
p 12

Kohonen
1001010
Kohonen

1000
1 +1
1 +1
0.1


1
0.8
0.6
0.4

W(2,j)

0.2
0

-0.2
-0.4
-0.6
-0.8
-1
-1

-0.8

-0.6

-0.4

-0.2

W(1,j)

0.2

0.4

0.6

0.8

100
1
0.8
0.6
0.4

W(2,j)

0.2
0

-0.2
-0.4
-0.6
-0.8
-1
-1

-0.8

-0.6

-0.4

-0.2

0
W(1,j)

0.2

0.4

0.6

0.8

1000
1
0.8
0.6
0.4

W(2,j)

0.2
0
-0.2
-0.4
-0.6
-0.8
-1
-1

-0.8

-0.6

-0.4

-0.2

W(1,j)

0.2

0.4

0.6

0.8

10,000
1
0.8
0.6
0.4

W(2,j)

0.2
0
-0.2
-0.4
-0.6
-0.8
-1
-1

-0.8

-0.6

-0.4

-0.2

0
W(1,j)

0.2

0.4

0.6

0.8