平面傳播科技系: 影像處理原理

Digital Image Processing (Fall 2000)

Textbook: Digital Image Processing,

by R.C. Gonzalez and R.E. Woods, Addison Wesley, 1992.

Recommended Reading:
Digital Image Processing,
by K.R. Castleman, Prentice Hall, 1996.
Digital Image Processing,
2nd Edition, by W.K. Pratt, John Wikey & Sons, 1991.
Fundamentals of Digital Image Processing,
by A.K. Jain, Prentice Hall, 1989.
Handbook of Visual Communications,
by H.M. Hang and J.W. Woods, Academic Press, 1995.

Grading: Computer Homework (20%) + Project (40%) 60%

Midterm Exam 20%
Final Exam 20%

Background: Signal & System, DSP, C or C++ or Matlab Programming

Contents:
Chap 1 : Introduction p . 1 ~p.10
Chap 2 : Human Visual System p.11~p.21
Chap 3 :Color p.22~p.34
Chap 4 :Digital Image Fundamentals p.35~p.43
Chap 5 :Image Transforms p.44~p.60
Chap 6 :Image Enhancement p.61~p.73
Chap 7 :Image Restoration p.74~p.89
Chap 8 :Image Segmentation p.90~p.109
Chap 9 : Image compression p.110~p.139
Chap 10 :Representation & Description p.140~p.163

Introduction 0
Homework and Test p.164~p.170

Chapter 1 Introduction
(1) Improve pictorial information

Motivations (image enhancement, image restoration)

(2) Image storage & transmission

(image compression)

(3) Autonomous Machine Perception

(image analysis, computer vision)

History

 Early 1920’s: early application
Bartlane cable picture transmission system

1921: Improve printing methods.

Photographic reproduction

 1929: Increase brightness levels.

5 levels 15 levels

 1964 - present Large-scale digital computers.

Declining cost of equipment.
Increasing availability of equipment.
Steady growth of new applications.
Medical images
Automatic character recognition
Aerial imagery
Visual communication
etc.

Introduction 1
original image enhanced image
 A Digital Image Processing (DIP) System



To other computers/ networks

communication

Image output
Acquisition
processor
TV camera + digitizer CRT
image scanner printer
plotter
photo copy
Storage

Image Acquisition


1. Tube Camera:
Photoconductive
yoke
target Glass
anode
Electron beam faceplate

Electron gun

Electron
beam

mesh faceplate mesh Transparent

Charge metal coating
layer

2. Solid-state Camera:

 Charge-Coupled Devices
φ1
φ2
SiO2

P-Si

φ2
φ1

Pixel (pel): picture element

Introduction 2
 Full Frame CCD Interline Transfer CCD Frame Transfer CCD

Line Line Line

Image Array
shift shift shift
Full Frame
Array Masked
Storage
Array

Serial Register Serial Register Serial Register

Pixel shift Pixel shift Pixel shift

 Charge Injection Devices

Row
Scan

Column Scan

3. Camera Comparison
Solid-state camera:
geometric fidelity
superior in size, weight, and power
ruggedness
high-speed shuttering
CCD: gaps between pixels
blooming problem
a dead pixel may wipe out all or part of an entire column.
CID: less sensitive to blooming and radiation damage.
no gaps between pixels.
less light sensitive.

Introduction 3
 Tube camera:
better response uniformity
lag problem

Image Representation


(0,0) Y

I(x,y)
Pixel (picture element)

68 65 30 32 31 32
68 66 62 31 30 32
69 67 64 63 29 89
67 66 66 92 89 91
X 120 121 122 120 121 124
123 120 123 122 125 122
120 119 120 123 122 124

represented as a 2-D function I(x,y)


I: intensity, brightness
x,y: spatial coordinates

I(x,y) is discretized in I, x, and y
I(m,n)

Quantization (discretization of I)



Coarse quantization

Introduction 4
 Sampling (discretization of x and y)



Low sampling rate

Image Storage



images require large storage

(e.g., 512 by 512, 8-bit monochrome image: 0.25Mbytes)

short term storage: frame buffers

on-line storage: magnetic disks, optical disks,
magneto-optical storage.

archival storage: magnetic tapes, optical disks.

image data file format
Some popular file formats:
Name Type Usage
Tagged image file format *.TIF DOS, UNIX, and Macintosh images
Encapsulated PostScript *.EPS Publishing industry format
Graphical interchange format *.GIF CompuServe graphics format
Bit-mapped format *.BMP Microsoft Windows format
Macintosh *.PICT Apple Macintosh images

Processing & Communication



Processing
-- Hardware

general purpose CPU, DSP

dedicated image processing hardware (video processor, DCT

chip, …)
-- Software

Communication
Digital TV (720x480x2x30): 167 Mbits/sec
Digital HDTV (1920x1080x1.5x30): 746 Mbits/sec

Introduction 5
 Output



TV monitors: monochrome or color

Hardcopies: slides, photographs, or transparencies

Printing: gray-tone

halftone

Digital Halftoning (Spatial Dithering, Screening)

(Reference: “Digital Halftoning” by R. Ulichney, The MIT Press, 1990.)

Create an illusion of continuous-tone images from the judicious

arrangement of binary picture elements.

Two Major Types of Dithering:

(1) Ordered dither and (2) Error diffusion

 Threshold Dithering (with White Noise)

threshold an input image to a selected threshold. The



selected threshold can be a uniformly distributed

uncorrelated (white) noise with a proper mean value.

 grainy appearance

 Clustered-Dot Ordered Dither

 used for those binary display devices which cannot properly

display isolated pixels.

 compare pixels from an original continuous-tone image to a

Introduction 6
 threshold value from a deterministic, periodic array.

 example of threshold array (Javis, Judice, Ninke; 1976)

43 44 45 46 47 48 49 50
42 21 22 23 24 25 26 51
41 20 7 8 9 10 27 52
40 19 6 1 2 11 28 53
39 18 5 4 3 12 29 54
38 17 16 15 14 13 30 55
37 36 35 34 33 32 31 56
64 63 62 61 60 59 58 57

 Dispersed-Dot Ordered Dither

 yield high frequency fidelity and illusions of constant gray
regions.

 to be produced on a device that can faithfully display
separate binary pixels

 example of threshold array (Javis, Judice, Ninke; 1976)

0 32 8 40 2 34 10 42
48 16 56 24 50 18 58 26
12 44 4 36 14 46 6 38
60 28 42 20 62 30 44 22
3 35 11 43 1 33 9 41
51 19 59 27 49 17 57 25
15 47 7 39 13 45 5 37
63 31 45 23 61 29 43 21

 Error Diffusion

 to be produced on a device that can faithfully display
separate binary pixel

 Error Diffusion Algorithm

J[n] ⊕ Threshold I[n]

+
⊕

Error Filter
e[n]
Errors are “diffused” over a weighted neighborhood.

Introduction 7
 e[m] = J[m] – I[m]
J’[n] = J[n] – h[m]*e[m]
If(J’[n] >= R/2) I[n] = R; otherwise, I[n]=0.
Where J[] is the original image pel,
I[] is the binary (halftoned) pel,
R is the chosen threshold, and
* is the convolution operator.

Example of error filter (h[]): . 7/16

(Floyd and Steinberg) 3/16 5/16 1/16

 Blue Noise: A proper amount of random noise is added to

(subtracted from) the error filter weights. This often
produces more “natural” (better subjective quality) pictures.

 Inverse Halftoning (Descreening)

Recover the “original” gray scale picture from the halftoned
binary picture.

Introduction 8

Photographic Film
Introduction 9

Structure supercoat
emulsion
substrate
film base H & D curve
backing layer shoulder

Characteristics

Density
contrast 1.0 Linear region
γ:=0.7=−=1.0= = ( medium contrast ) toe ( slope: film gamma (γ))
1.5=−=10 ( high contrast )
speed Gross fog α
0.0
ASA(linear), DIN(logarithmic) Log E
graininess ( exposure E = I×T )
resolving power

Diaphragm & Shutter Speed


Diaphragm
f-number: inversely proportional to the amount of light admitted.
1.4, 2, 2.8, 4, 5.6, 8, 11, 16, 22


Shutter Speed
1, 1/2, 1/4, 1/8, 1/15, 1/30, 1/60, 1/125, 1/250, 1/500, 1/1000 sec

Introduction 10