NH 67, Karur Trichy Highways, Puliyur C.

F, 639 114 Karur District

DEPARTMENT OF INFORMATION TECHNOLOGY

ACADEMIC YEAR (2014-2015)
SUBJECT CODE/NAME: IT2302 INFORMATION THEORY AND CODING
BRANCH/YEAR: IT/III
SEMESTER: V
FACULTY NAME: S.SAKTHI , ASSISTANT PROFESSOR
LESSON PLAN
COURSE OBJECTIVES:
The Objective of this course is to
Focuses on information theory and coding within the context of modern digital
communications applications.
Introduce the basic concepts of information theory, source coding, channel and
channel capacity, channel coding. Lossless data compression will be lightly touched
in source coding.
Channel and channel capacity will include discrete memoryless channel model,
Markov processes and source with memory.
Channel coding will focus on block error correction code such as hamming codes,
BCH, Reed-Solomon coding and so on.
Convolution codes will also be covered in the channel coding. Finally, the typical
applications of the error correction codes will be introduced.

COURSE OUTCOMES:
Upon completion of this course the student will be familiar with:
Understand the course provides a general introduction to the topic of Information
Theory with a focus on the application of Information Theory to communications in
general and on channel coding and capacity in particular.

S.NO

1.

Understand Entropy and mutual information, the asymptotic equipartition principle,

entropy for stochastic processes (entropy rate), introduction to data compression and
source coding, channel capacity and coding for noisy channels, capacity for different
channel models (with emphasis on discrete memoryless channels and Gaussian
channels), finite field theory, design and analysis of error correcting codes (with a
focus on linear block codes), introduction to network information theory.
TITLE

REFERENCE/
PAGE
TEXT BOOKS
NUMBER
INFORMATION THEORY

DURATION
IN HOURS

TEACHING AIDS

T1

(3-10)

*BB

T1

(19-20)

*BB

3.

IntroductionInformation, Entropy,
Information Rate
Classification of Codes.,
Kraft McMillan
inequality
Source coding Theorem

T1

(16-22)

*BB

4.

Shannon Fano Coding

T1

(30-33)

*BB

5.

Huffman coding
algorithm, tree
construction,

T1

(22-30)

*BB,*PPT

2.

8.

Efficiency , dynamic
Huffman coding,
Extended Huffman
Coding
Joint and Conditional
Entropies, Mutual
information and its
properties
Discrete Memoryless
channels BSC
BEC, Channel Capacity

9.

Shannon Limit

6.

7.

T1

(42-44)

*BB,*PPT

T1

(60-66)

*BB

T1

(62-63)

*BB

T1

(71-73)

*BB,*PPT

SOURCE CODING: TEXT, AUDIO AND SPEECH

10.

T2

(124-130)

*BB

T2

(130-134)

*BB

12.

Introduction to Text
coding, Adaptive
Huffman Coding
Adaptive Huffman
Coding
Arithmetic Coding

T2

(134-136)

*BB

13.

LZW Algorithm

T2

(137-140)

*BB,*PPT

14.

Introduction to Audio
coding, Perceptual
coding, Masking
Techniques
Psychoacoustic model,
MPEG Audio layers I, II,
III
Dolby AC3

T2

(182-185)

*BB

T2

(215-232)

*BB,*PPT

T2

(190-193)

*BB

Introduction to Speech
Coding, Channel
Vocoder
Linear Predictive
Coding

T2

(189)

*BB,*PPT

T2

(179-181)

*BB

11.

15.
16.
17.
18.

SOURCE CODING: IMAGE AND VIDEO

19.

Image and Video

Formats GIF, TIFF
SIF, CIF, QCIF

T2

(141-150)

*BB,*PPT

T2

(141-150)

*BB,*PPT

Image Compression READ

JPEG

T2

(141-150)

*BB

T2

(150-168)

*BB,*PPT

T2

(150-168)

*BB

24.

Video Compression
Principles I,B,P frames
Motion Estimation

T2

(194-203)

*BB

25.

Motion Compensation

T2

(194-203)

*BB,*PPT

26.

H.261 Standard

T2

(203-207)

*BB,*PPT

27.

MPEG Standard

T2

(215-233)

*BB,*PPT

*BB

20.
21.
22.
23.

ERROR CONTROL CODING: BLOCK CODES

28.

Introduction to error
control codingDefinitions and

T1

(89-96)

Principles
29.

T1

(115-120)

*BB

T1

(105-115)

*BB

31.

Hamming Weight,
Hamming Distance,
Minimum distance
decoding
Single Parity codes,
Hamming Codes,
Repetition Codes
Linear Block Codes

T1

(89-96)

*BB

32.

Cyclic Codes

T1

(131-141)

*BB

33.

Cyclic Codes

T1

(131-141)

*BB

34.

Syndrome Calculation

T1

(108-109)

*BB

35.

Encoder and decoder

T1

(108-109)

*BB

36.

CRC

T1

(148-151)

*BB

30.

ERROR CONTROL CODING: CONVOLUTIONAL CODES

37.

T1

(189-190)

*BB

38.

Introduction to
Convolutional codes
Code Tree

T1

(190-195)

*BB

39.

Trellis codes

T1

(190-195)

*BB,*PPT

40.

State Diagram

T1

(190-195)

*BB,*PPT

41.

Encoding

T1

(192-195)

*BB

42.

Decoding

T1

(192-195)

*BB

43.

Sequential Search

T1

(207-214)

*BB,*PPT

44.

Viterbi algorithm

T1

(207-214)

*BB,*PPT

45

Total No. of Hours

*BB-BLACK BOARD

Text Books:
1.R Bose, Information Theory, Coding and Cryptography, TMH 2007
2.Fred Halsall, Multidedia Communications: Applications, Networks, Protocols and
Standards, Perason Education Asia, 2002
Prepared by

Approved by

Signature

Name

S.SAKTHI

DR.RAJENDRAN.T

Designation
Date

Assistant Professor

HOD/IT