MAKE YOUR NETWORK SMARTER

Image data processing

ppt_aa2_p04_image_data_processing_4.3_en_0609
 Image data processing

Lens Filter Image sensor

ppt_aa2_p04_image_data_processing_4.3_en_0609
 The image DSP (Digital Signal Processing)

DSP functions:
8 Convert raw sensor specific data into a bitmap in a
specified color space
8 Reduces noise
8 Collect image statistics for automatic exposure and
white balance
8 Provide means of controlling final image appearance
in terms of sharpness and contrast

ppt_aa2_p04_image_data_processing_4.3_en_0609
 Noise reduction
8 Goal:
¬ Eliminate too bright and dark pixels.
8 Method:
¬ Replace defect pixels with a detecting algorithm of neighbors.

Most noticeable in very low light

or with poor image sensors.

ppt_aa2_p04_image_data_processing_4.3_en_0609
 Auto exposure

8 Without the right exposure, the

resulting images are not usable.
8 A user can set:
¬ Exposure time
¬ Digital gain
¬ Iris (F-stop) 11,000 lux

By changing one or more of

these parameters, the resulting
images will appear equally bright,
regardless of the illumination.
8 The brightness should be
comparable to what the eye
perceives when looking at the scene.
100 lux

ppt_aa2_p04_image_data_processing_4.3_en_0609
 Backlight compensation
8 Problem:
¬ A strong isolated light source might have too much
impact on overall exposure level.
8 Solution:
¬ Ignore (or partly ignore) the brightest pixels.

ppt_aa2_p04_image_data_processing_4.3_en_0609
 Window-based AE & backlight compensation
8 Problem:
¬ Parts of the scene are more important than others. Center
The unimportant parts should not affect the overall
exposure.

8 Solution: Left
¬ Divide the image into sub images and assign different
weights for the exposure algorithm.

Right

Top

Bottom

ppt_aa2_p04_image_data_processing_4.3_en_0609
 White balance: getting colors right
fluorescent

sunny day light bulb

ppt_aa2_p04_image_data_processing_4.3_en_0609
 Setting white balance

Goal
8 To achieve the right color, neutral (black/gray/white) colors
in the scene should stay neutral in the resulting image
regardless of the illumination.

Auto white balance

8 The camera uses two/three different gain factors to amplify
R, G and B respectively.

ppt_aa2_p04_image_data_processing_4.3_en_0609
 Sharpening / Contrast

8 Digital sharpening and contrast enhancement:

two tools to fine tune digital images

8 Digital sharpening = edge contrast.

It increases the contrast by lightening the light
pixels and darkening the dark pixels at the Without contrast enhancement
edges

8 Contrast = balancing tones.

Affects the entire image. Increasing contrast
introduces more tones of gray.

With contrast enhancement

Regular Sharpened Increased contrast Decreased contrast

Sharpening vs. Contrast

ppt_aa2_p04_image_data_processing_4.3_en_0609
 Q&A

ppt_aa2_p04_image_data_processing_4.3_en_0609