INTELLIGENT VIDEO ANALYSIS

INTELLIGENT VIDEO ANALYSIS

(IVA)
(IVA)
Instructor: Hoang Le Uyen Thuc
Electronic and Telecommunication Engineering Department
Danang University of Technology
hluthuct@dut.udn.vn
Goals
Goals
1. Knowledge:
- Overview of IVA system and applications.
2. Skills:
- Using Matlab toolboxes
- Reading/Writing technical reports
Grading
Grading
1. Homework: 20%
Matlab-based problems
2. Midterm: 30% (peer-evaluation +
instructors evaluation)
Midterm reports
Homework and Midterm report are group-based
Schedule
Schedule
Introduction to IVA and applications (2 hrs)
Image processing (4 hrs)
Object segmentation (3 hrs)
Feature extraction (3 hrs)
Pattern recognition(3 hrs)
Introduction to IVA systems
Introduction to IVA systems
Duration: 2 hr
Outline:
1. IVA applications
2. IVA system
What is IVA?
What is IVA?
Speech signal
ECG
Intelligent Video Analysis
Video understanding
Great deal of promising applications in many fields
IVA Applications
IVA Applications
Speech signal
ECG
Agriculture
Industry
Commerce
Smart transportation
Security surveillance
Entertainment
Healthcare
Military technology
and more
Typical IVA system
Typical IVA system
Applications
Object
segmentation
Feature
extraction
Pattern
Recognition/classification
Object segmentation
Object segmentation
Speech signal
ECG
Perform on each frame in
the input video stream
Extract the target object
Object segmentation
Object segmentation
Speech signal
Non-human
object
Object segmentation
Object segmentation
Speech signal
Human object
Feature extraction
Feature extraction
Speech signal
ECG
Extract characteristics of the segmented objects.
Represent extracted characteristics in some forms
of feature.
Special form of dimensionality reduction:
Input data: much data but not much
information high redundancy
Feature vector: less data but much information
low redundancy
Feature extraction
Feature extraction
Speech signal
ECG
14
Feature extraction
Feature extraction
[C.C. Yu, et al, 2010]
[C.H. Lin, et al, 2010]
15
Feature extraction
Feature extraction
[M. Muller, et al, 2005]
Pattern recognition
Pattern recognition
Speech signal
ECG
Recognize patterns based on the
represented features.
Using classification algorithms.
Classification algorithms
Static
classification
Temporal
classification
Template
matching
State-space
models
-KNN
-SVM
-ANN
-HMM
-DBS
-DTW
Example of IVA for fall detection
Example of IVA for fall detection
Speech signal
ECG
pixels white gray
pixels gray
velocity Motion
# #
#
+
=
If centroids of ellipse is lower than the threshold
1
and
motion velocity is higher than the threshold
2
then FALL
else O-FALL for suitable values of
1
and
2
.