1

What is Image Segmentation ????

Introduction to Image Segmentation

The

purpose of image segmentation is to partition an image into meaningful regions with respect to a particular application. segmentation is based on measurements taken from the image and might be graylevel, colour, texture, depth or motion. image segmentation is an initial and vital step in a series of processes aimed at overall image understanding .

The

Usually

Techniques of Image Segmentation in DIP.....

GRAYLEVEL Histogram-based segmentation

We will look at two very simple image segmentation techniques that are based on the GRAYLEVEL histogram of an image
Thresholding

Clustering

We will use a very simple object background test image

We will consider a zero, low and high noise

image

GRAYLEVEL Histogram-based segmentation

Noise free

Low noise

High noise

GRAYLEVEL Histogram-based segmentation

How do we characterise low noise and high noise? We can consider the histograms of our images

For the noise free image, its simply two spikes at

i=100, i=150 For the low noise image, there are two clear peaks centred on i=100, i=150 For the high noise image, there is a single peak two GRAYLEVEL populations corresponding to object and background have merged
7

GRAYLEVEL Histogram-based segmentation

h(i)
2500.00

2000.00

1500.00 Noise free Low noise 1000.00 High noise

500.00

0.00 0.00

i
50.00 100.00 150.00 200.00 250.00

GRAYLEVEL Thresholding

We can easily understand segmentation based on thresholding by looking at the histogram of the low noise object/ background image
There is a clear valley between to two

peaks

GRAYLEVEL Thresholding
h(i)
2500.00 2000.00

1500.00

Background

1000.00

Object
500.00

0.00 0.00

i
50.00 100.00 150.00 200.00 250.00

10

GRAYLEVEL Thresholding

We can define the GRAYLEVEL thresholding algorithm as follows:

If the GRAYLEVEL of pixel p <=T then pixel

p is an object pixel
else

Pixel p is a background pixel

11

GRAYLEVEL Clustering
Clustering tries to separate the histogram into 2 groups Defined by two cluster centres c1 and c2

GRAYLEVELs classified according to the

nearest cluster centre

12

GRAYLEVEL clustering
A nearest

neighbour clustering algorithm allows us perform a GRAYLEVEL segmentation using clustering A simple case of a more general and widely used K-means clustering

13

GRAYLEVEL clustering

But, we have a chicken and egg situation

The problem with the above definition is that

each group mean is defined in terms of the partitions and vice versa The solution is to define an iterative algorithm

14

Colour-based segmentation
It is based on colours in the image..... 2) The image is segmented on the basis of colour in that image as shown. Method A) The chromaticity and intensity values for each pixel are calculated. A 3D colour histogram is constructed from the colour original image B) Then each component of the 3D histogram is divided into Q quantization levels. Consequently, the histogram is divided into QxQxQ bins and each pixel belongs to one of the bins.
1)

Thus the image quantization is been done and the colour we want to segment is chosen according to its R-GB components
15

ALGORITHM

16

Applications of Image Segmentation.....

17

Identifying objects in a scene for object-based measurements such as size and shape. Identifying objects in a moving scene for object-based video compression (MPEG4) . Face detection/recognition.

18

Face Detection......

19

 Face

interface
Face database
Output: Mr.Chan

Face detection Face recognition

Face detection

Face recognition

Prof..Chen

20

20

 To

detect faces in an image (Not recognize it yet) Challenges

A picture has 0,1 or many faces. Faces are not the same: with spectacles, mustache etc. Sizes of faces vary a lot.

Available

in most digital cameras nowadays The simple method

Slide a window across the window and detect faces.

Too slow, pictures have too many pixels. (1280x1024=1.3M pixels)

21
21

Detection rate Total number of faces that are correctly detected/total number of faces actually exist in the picture Should be high > 95%. A good system has High detection rate, Low false positive rate.

False positive rate The detector output is positive but it is false (there is actually no face)
22
22

 What

are the detection rate and false positive rate here?

Answer

detection rate=(6/9)*100% false positive rate=(1/7)*100%

7 windows reported to have faces , but in 1 window it is not a face

False positive result

23

23

Method of Face Detection using colour based technique......

24

Given a digital image of students and teaching staff, detect the presence of faces in the image
25

For faces, the Hue value is seen to typically occupy values in the range H < 19 H > 240 We use this fact to remove some of the non-faces pixels in the image.
26

In the same manner, we found empirically that for the YCbCr space that the face pixels occupied the range 102 < Cb < 128 125 < Cr < 160 Any other pixels were assumed non-face and removed.

27

Finally, we found some useful trends in the RGB space as well. The Following rules were used to further isolate face candidates: 0.836G 14 < B < 0.836G + 44 0.89G 67 < B < 0.89G + 42

28

Just as we used information regarding face color, orientation, and scale from The training images, we also allowed ourselves to make the assumption that Faces were unlikely to appear in the lower portion of the visual field: We Removed that region to help reduce the possibility of false detections.
29

THUS WE showed that :

1) what is image segmentation.... 2)what are its various techniques.. 3)what are its applications.... 4)how we can use image segmentation in face detection...

30

We will continue our project in the direction of face detection using colour based technique and may extend it to face recognition using template matching........
31

Thank You......

32