Escolar Documentos
Profissional Documentos
Cultura Documentos
Course Rationale:
Artificial neural networks use learning algorithms that are inspired by brain learning abilities. Industry, worldwide,
is very active in developing products based on intelligent systems with emphasis on the latest neural network and
machine learning technologies such as supervised and unsupervised neural networks. In this context, the learner is
required to gain a practical and theoretical understanding of how neural networks can be processed by computers as
part of a specialized course
Syllabus:
Introduction to Artificial Neural Networks: Introduction, history, structure and function of a
single neuron, neural net architectures, neural learning, use of neural networks. Artificial Neural
Networks: McCulloch-Pitts model, different network structures, approximation of nonlinear
phenomenon, MCP error correction-based learning. Logic Networks: Boolean functions, feed-
forward vs. recurrent networks, finite automata and finite state machines, harmonic analysis
via Walsh-Hadamard Transform.
Weighted Networks - The Perceptron: pattern recognition via Perceptron, limitations of the
perceptron, linearly separable functions, Perceptron Learning Algorithms: learning algorithm
types (supervised vs. unsupervised), vector notation, algorithmic learning, Markov Decision
Processes, and Dynamic Programming.
The Back-Propagation Learning Algorithm: multi-layer perceptron networks, alternative
activation functions (e.g. sigmoid), back propagation learning algorithm theory, implementation
of back propagation on Feed Forward Nets. More Advanced Neural Network Topics
Overview: clustering, k-means and k-nearest neighbors, PCA, one vs. two-layer networks, over-
fitting vs. under-fitting, gradient descent, momentum, initial weight selection, data decorrelation,
complexity theory, associative memories.
Advanced Networks: Hopfield ANN, Training and Testing algorithms. Bi – Directional
Associative Memories, types, Training and testing.
Software: Python and Mat Lab to simulate various network architectures, learn training and
testing procedures, validate the outputs and deployment for commercial applications.
Commercially Available ANNs: A Case study and Simulation. 1. Use ANN to recognize Hand
written characters using a benchmark dataset.2. Study ANN and their Business applications. 3.
Simulation of an industrial wastewater treatment plant using artificial neural networks and
principal components analysis.
Text Books:
1. Laurene Fausett, "Fundamentals of Neural Networks", Pearson Education, 2004.
2. Simon Haykin, "Neural Networks- A comprehensive foundation", Pearson Education, 2003.
Reference Books:
1. S.N.Sivanandam, S.Sumathi,S. N. Deepa "Introduction to Neural Networks using MATLAB 6.0", TATA
Mc Graw Hill, 2006.
2. S. Rajasekharan and G. A. Vijayalakshmi pai, "Neural Networks, Fuzzy logic, Genetic algorithms:
synthesis and applications", PHI Publication, 2004.
Web Refernces/MOOCs:
1. http://www.nptelvideos.in/2012/12/neural-networks-and-applications.html from NPTEL
2. https://nptel.ac.in/courses/117105084/2 NPTEL
PPT&
1 1 1 Introduction, history T2- p23 Discussion
Marker
PPT &
2 1 1 Biological neurons T2-p28 Discussion
Marker
Structure and
PPT& Brain storm &
3 1 1 function of single T1 p3
Marker Discussion
neuron
MCP error
PPT& Brain storm &
11 2 1 correction-based T2 P73
Marker Short note
learning
PPT& Discussion&
12 2 1 Learning logic T2 P74
Marker Case study
PPT& Quiz &
13 2 1 Boolean functions T2 P75
Marker Discussion
Feed-forward vs. PPT& Quiz &
14 2 1 T2 P40-45
Recurrent networks Marker Discussion
https://www.cs.princeton.edu/c
Finite automata and PPT&
15 2 1 ourses/archive/spr06/cos116/F Discussion
finite state machines Marker
SM_Tutorial.pdf
http://user.engineering.uiowa.e
PPT& Program &
17 2 2 Clustering, k-means du/~ie_155/lecture/K-
Marker Discussion
means.pdf
http://www.cs.upc.edu/~bejar/a
PPT& Program &
18 2 2 K-nearest neighbors pren/docum/trans/03d-algind-
Marker Discussion
knn-eng.pdf
The Perceptron:
PPT& Program &
20 3 1 pattern recognition T2-P157
Marker Discussion
via Perceptron
Limitations of the
PPT&
21 3 1 perceptron, linearly T2 P197-200 Discussion
Marker
separable functions
Perceptron Learning
Algorithms: learning
PPT& https://nptel.ac.in/courses/1061 Program &
22 3 1 algorithm types ALMs,
Marker 05078/pdf/Lesson%2038.pdf Discussion
(supervised vs. HAs
Unsupervised)
Sem-In
Vector notation, PPT& Exam 2,
23 3 1 T3 pp:49-50 Discussion
algorithmic learning. Marker Sem
End
Markov Decision Exam
Processes and PPT&
24 3 1 T2 pp:626
Discussion
Dynamic Marker
Programming
Associative PPT&
25 3 2 T1 PP101 Program
memories Marker
Back propagation
PPT& Discussion&
30 3 2 learning algorithm: T2 p:191-192
Marker Quiz
Rate of Learning
Implementation of
PPT& Discussion&
31 4 1 back propagation on T2 p:192-193
Marker Quiz
Feed Forward Nets.
PPT& Program &
32 4 1 Gradient descent T1 pp:289
Marker Discussion
PPT& Program &
33 4 2 Momentum T3 Pp107
Marker Discussion
Initial weight PPT& Discussion
34 4 2 T2 Pp:204 &One
selection Marker
minute paper
PPT& Program &
35 4 3 Data decorrelation T2 Pp:196
Marker Discussion
PPT& Program &
36 4 3 Complexity theory T2 Pp:196
Marker Discussion
Bi – directional
associative PPT& Debate/Fish
37 4 3 T1 PP140 bowl &
memories: Marker
architecture Discussion
Bi – directional
PPT&
38 4 3 associative T1 pp:141-142 Discussion
Marker
memories: algorithm
Bi – directional
associative PPT&
39 4 3 T1 pp:144 Discussion
memories: Marker
application
T1: Laurene Fausett, "Fundamentals of Neural Networks”, Pearson Education, 2004.
T2: Simon Haykin, "Neural Networks- A comprehensive foundation", Pearson Education, 2003
T3: An introduction to neural networks, Kevin Gurney, University of Sheffield, UCL Press Limited
Session wise Teaching – Learning Plan
Session Number: 1
Session Outcome: Understand the history of ANN
Teaching –
Time(min) Topic BTL Learning
Method
20 Introduction to course and other course requirements - PPT
15 Recap of fundamentals 1 Brain storm
10 Discussion on fundamentals of signals 1 Discussion
05 45 min + 5 mins attendance - -
Session Number: 2
Session Outcome: Understand the Structure of biological neuron
Teaching –
Time(min) Topic BTL Learning ALM
Method
05 Recap - PPT
15 Structure of a single neuron 1 Brain storm
20 Discussion of various applications 1 PPT
5 Queries and Answers on Topic - Q/A-Share
05 45 min + 5 mins attendance - -
Session Number: 3
Session Outcome: Describe the function of a single neuron
Teaching –
Time(min) Topic BTL Learning ALM
Method
05 Recap - PPT
15 The function of a single neuron 1 Brain storm
20 Discussion of various applications 1 PPT
5 Queries and Answers on Topic - Q/A-Share
05 45 min + 5 mins attendance - -
Session Number: 4
Session Outcome: Understand the Neural net architectures
Teaching –
Time(min) Topic BTL Learning ALM
Method
05 Recap -
20 Evolution Neural net architectures 1 PPT
15 Applications Neural net architectures 1 PPT and chalk
AL-group
05 Group discussion -
discussion
05 45 min + 5 mins attendance -
Session Number: 5
Session Outcome: Acquaint with the neural learning
Teaching –
Time(min) Topic BTL Learning ALM
Method
05 Recap -
20 Neural learning 1 PPT
15 Learning techniques 1 PPT and chalk
AL-group
05 Group discussion -
discussion
05 45 min + 5 mins attendance -
Session Number: 6
Session Outcome: Acquaint the use of neural networks
Teaching –
Time(min) Topic BTL Learning ALM
Method
05 Recap -
20 Use of neural networks 1 PPT
15 Various engineering areas of ANN 1 Chalk
Discussion&
05 Group Discussion -
Fish bowl
05 45 min + 5 mins attendance -
Session Number: 7
Session Outcome: Understand the Artificial Neural Networks
Teaching –
Time(min) Topic BTL Learning ALM
Method
05 Recap -
20 McCulloch-Pitts model 1 PPT
15 Example 2 PPT and Chalk
05 Random questions - Fish bowl
05 45 min + 5 mins attendance -
Session Number: 8
Session Outcome: Acquaint the different network models
Teaching –
Time(min) Topic BTL Learning ALM
Method
05 Recap
20 Different network structures 1 PPT
15 Applications 2 Chalk
5 Quiz - Quiz &debate
05 45 min + 5 mins attendance
Session Number: 9
Session Outcome: Understand the non-linear phenomenon
Teaching –
Time(min) Topic BTL Learning ALM
Method
05 Recap
20 Nonlinear phenomenon 1 PPT & Chalk
15 Approximation of nonlinearity 2 Debate
05 Applications - Quiz
05 45 min + 5 mins attendance
Session Number: 10
Session Outcome: Demonstrate the alternative activation functions (e.g. sigmoid),
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
20 Alternative activation functions (e.g. sigmoid) 2 PPT&chalk
15 Examples 2 Program
05 Queries and Answers on Topic - Q/A-Share
05 45 min + 5 mins attendance
Session Number: 11
Session Outcome: Describe the MCP learning
Teaching –
Time(min) Topic BTL Learning ALM
Method
05 Recap
20 MCP error correction-based learning 1 PPT& chalk
15 Examples 1 Brain storm
5 Queries and Answers on Topic - Q/A-Share
05 45 min + 5 mins attendance
Session Number: 12
Session Outcome: Understand Learning Logic
Teaching –
Time(min) Topic BTL Learning ALM
Method
05 Recap
20 Binary learning 1 PPT& chalk
15 Learning Logic 1 Case study
5 Queries and Answers on Topic - Q/A-Share
05 45 min + 5 mins attendance
Session Number: 13
Session Outcome: Describe the Boolean functions
Teaching –
Time(min) Topic BTL Learning ALM
Method
05 Recap
20 1 PPT& chalk
Boolean functions
15 1 Case study
05 Examples - QUIZ
05 45 min + 5 mins attendance
Session Number: 14
Session Outcome: Understand the difference between feed-forward & recurrent networks
Teaching –
Time(min) Topic BTL Learning
Method
05 Introduction
20 Feed-forward 1 PPT&chalk
15 Recurrent networks 1 Discussion
05 Quiz on topic Quiz
05 45 min + 5 mins attendance
Session Number: 15
Session Outcome: Understand finite automata and finite state machines
Teaching –
Time(min) Topic BTL Learning ALM
Method
05 Introduction
20 Finite automata 1 PPT& chalk
15 Finite state machines 1 Discussion
05 Quiz on topic Quiz
05 45 min + 5 mins attendance
Session Number: 16
Session Outcome: Describe the harmonic analysis
Teaching –
Time(min) Topic BTL Learning ALM
Method
05 Recap
20 Harmonic analysis 1 PPT &chalk
15 Hadamard-Walsh Transform 1 Discussion
5 Queries and Answers on Topic - Q/A-Share
05 45 min + 5 mins attendance
Session Number: 17
Session Outcome: Understand the k-means clustering
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
More Advanced Neural Network Topics Overview:
20 2 PPT& chalk
clustering
15 k-means 2 Fish bowl
Session Number: 18
Session Outcome: Understand the k-nearest neighbor algorithm
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
20 k-nearest neighbors 2 PPT&chalk
15 Some examples 2 Discussion
05 Queries and Answers on Topic - Q/A-Share
05 45 min + 5 mins attendance
Session Number: 19
Session Outcome: Distinguish between Over-fitting vs. Under-fitting
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
20 PCA 2 PPT& chalk
15 One vs. two-layer networks 2 chalk
Session Number: 20
Session Outcome: Describe pattern recognition via Perceptron
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
10 Pattern recognition via Perceptron 1 PPT&chalk
20 Pattern recognition via Perceptron 1 Case study
5 Queries and Answers on Topic - Q/A-Share
05 45 min + 5 mins attendance
Session Number: 21
Session Outcome: Identify the limitations of the perceptron
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
25 Limitations of the perceptron 1 PPT&chalk
10 Alternatives of perceptron 1 Discussion
5 Queries and Answers on Topic - Q/A-Share
05 45 min + 5 mins attendance
Session Number: 22
Session Outcome: Understand the Perceptron Learning Algorithms
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
20 Perceptron Learning Algorithms: learning algorithm 2 PPT&chalk
10 types (supervised vs. unsupervised), 2 program
10 Queries and Answers on Topic - Q/A-Share
05 45 min + 5 mins attendance
Session Number: 23
Session Outcome: Discuss the vector notation, algorithmic learning
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
15 2 PPT&chalk
Vector notation, algorithmic learning
20 2 Debate
Q/A-Share
05 Queries and Answers on Topic -
05 45 min + 5 mins attendance
Session Number: 24
Session Outcome: Understand the Markov Decision Processes
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
20 Markov Decision Processes 2 PPT& chalk
20 Dynamic Programming 2 PPT& chalk
05 45 min + 5 mins attendance
Session Number: 25
Session Outcome: Outline associative memories
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
20 Associative memories 2 PPT&chalk
15 BAM 2 Discussions
05 Quiz on vector quantization - Quiz
05 45 min + 5 mins attendance
Session Number: 26
Session Outcome: Understand the Hopfield ANN
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
20 2 PPT& chalk
Hopfield ANN
15 2 Program
05 Queries and Answers on Topic - Q/A-Share
05 45 min + 5 mins attendance
Session Number: 27
Session Outcome: Understand the Training and Testing algorithms of Hopfield N/w.
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
15 Training algorithms. 2 PPT& chalk
20 Testing algorithms. 2 Program
05 Quiz - Q/A-Share
05 45 min + 5 mins attendance
Session Number: 28
Session Outcome: Describe the multi-layer perceptron networks
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
20 The Back-Propagation Learning Algorithm 2 PPT& chalk
15 multi-layer perceptron networks 2 Program
05 Queries and Answers on Topic - Q/A-Share
05 45 min + 5 mins attendance
Session Number: 29
Session Outcome: Understand the back propagation learning algorithm
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
20 2 PPT&chalk
The back propagation learning algorithm
15 2 Discussion
05 Queries and Answers on Topic - Discussion
05 45 min + 5 mins attendance
Session Number: 30
Session Outcome: Acquaint with rate of learning in the back propagation algorithm
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
20 2 PPT&chalk
The rate of learning in BPA
15 2 Discussion
05 Queries and Answers on Topic - Discussion
05 45 min + 5 mins attendance
Session Number: 31
Session Outcome: Demonstrate the Implementation of back propagation on Feed Forward Nets.
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
20 Implementation of back propagation on Feed Forward 1 PPT&chalk
15 Nets. 1 program
05 Queries and Answers on Topic - Q/A-Share
05 45 min + 5 mins attendance
Session Number: 32
Session Outcome: Understand the gradient descent
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
20 Gradient descent algorithm 1 PPT&chalk
Session Number: 33
Session Outcome: Describe the momentum in BPA
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
15 Momentum, 2 PPT&chalk
20 Application 2 Discussion
05 Queries and Answers on Topic - Q/A-Share
05 45 min + 5 mins attendance
Session Number: 34
Session Outcome: Describe the initial weight selection
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
15 Initial weight selection 2 PPT&chalk
20 Methods of weights modification 2 Fish bowl
05 Queries and Answers on Topic - Q/A-Share
05 45 min + 5 mins attendance
Session Number: 35
Session Outcome: Acquaint with the data decorrelation
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
20 2 PPT&chalk
Data decorrelation,
15 3 Discussion
05 Quiz - Quiz
05 45 min + 5 mins attendance
Session Number: 36
Session Outcome: Understand complexity theory
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
20 Complexity theory 2 PPT&chalk
15 Hessian matrix 3 Discussion
05 Quiz - Quiz
05 45 min + 5 mins attendance
Session Number: 37
Session Outcome: Understand the Bi – Directional Associative Memories, types
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
20 Bi – Directional Associative Memories, types 2 PPT&chalk
15 Training and testing 3 Discussion
05 Queries and Answers on Topic -
Q/A-Share
05 45 min + 5 mins attendance
Session Number: 38
Session Outcome: Understand the Bi – Directional Associative Memories Training and testing
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
20 2 PPT&chalk
Training and testing
15 3 Discussion
05 Listing different application - Quiz
05 45 min + 5 mins attendance
Session Number: 39
Session Outcome: Analyze Bi – directional associative memories applications
Teaching – ALM
Time(min) Topic BTL Learning
Method
05 Recap
15 Bi – Directional Associative Memories testing 2 PPT&chalk
20 Applications 3 chalk
05 Queries and Answers on Topic - Q/A-Share
05 45 min + 5 mins attendance
Remedial Classes (for weak learners-after Sem in Exam-1) (Note: Student need to maintain 90% attendance)
Sessi
C CO
on. Topic (s) Teaching Learning
O I References / MOOCS
No. Methods Methods
Hour 1 2 3 4 5 6 7 8 9
Day Component 9:00-9:50 9:50-10:40 11:00-11:50 11:50-12:40 12:40-1:30 1:30-2:20 2:20-3:10 3:20-4:10 4:10-5:00
Mon Theory
Tue Theory
Wed Theory
Thu Theory
Fri Theory
Sat Theory
Evaluation Plan
Evaluatio
Evaluation n Durati
Weightage /Marks Assessment Dates CO 1 CO 2 CO 3 CO 4
Type Compone on
nt
Blooms Taxonomy Level 1,2 1,2 1,2 1,2
Weightage 10% 2.5% 2.5% 2.5% 2.5%
ALM
Marks 80 20 20 20 20
Formative
Continuous Evaluation 1.25 1.25 1.25 1.25
Evaluation Weightage 5%
HA % % % %
Total = 20
Marks 20 5 5 5 5
%
Weightage 5%
Attendance Continuous Evaluation
Marks 5M
In-Semester Weightage 15% 7.5% 7.5%
1.5
Summative Test 1 Test 1 dates
Marks 30 M hours 15 15
Evaluation
Total = 30 Weightage 15% 1.5 7.5% 7.5%
Test 2 Test 2 dates
% Marks 30 M hours 15 15
End-
12.5 12.5 12.5 12.5
Semester Weightage 50%
Semester End Sem Exam % % % %
Summative 3 hours
End Exam dates
Evaluation
Marks 60 M 15 15 15 15
Total= 50%
ATTENDANCE POLICY
Every student is expected to be responsible for regularity of his/her attendance in class rooms and laboratories, to
appear in scheduled tests and examinations and fulfill all other tasks assigned to him/her in every course. For
Promotion, a Minimum of 40% of internal marks must be obtained. In every course, student has to maintain a
minimum of 75% attendance to be eligible for appearing in Semester end examination of the course, for cases of
medical issues and other unavoidable circumstances the students will be condoned if their attendance is between
65% to 75% in every course, subjected to submission of medical certificates, medical case file and other needful
documental proof to the concerned departments.
PLAGIARISM POLICY
Use of unfair means in any of the evaluation components will be dealt with strictly, and the case will be reported to
the examination committee.
Course Team members, Chamber Consultation Hours and Chamber Venue details:
Chamber
Chamber Chamber
Consultation Signature of
S. No. Name of Faculty Consultation Consultation
Timings for Course faculty
Day(s) Room No:
each day
1
Dr. Kasi Prasad Mannepalli All working days 1 - 2PM R102