ISD 21ITV103 NN&DL
ISD 21ITV103 NN&DL
2 0 2 3
PRE-REQUISITE:
COURSE OBJECTIVES :
To understand the basics in deep neural networks
To understand the basics of associative memory and unsupervised learning networks
To apply CNN architectures of deep neural networks
To analyze the key computations underlying deep learning, then use them to
build and train deep neural networks for various tasks.
To apply auto encoders and generative models for suitable applications.
UNIT I INTRODUCTION 6
Neural Networks-Application Scope of Neural Networks-Artificial Neural Network: An Introduction-
Evolution of Neural Networks-Basic Models of Artificial Neural Network- Important Terminologies of
ANNs-Supervised Learning Network.
ASSOCIATIVE MEMORY AND UNSUPERVISED LEARNING
UNIT II 6
NETWORKS
Training Algorithms for Pattern Association-Auto associative Memory Network-Hetero associative Memory
Network-Bidirectional Associative Memory (BAM)-Hopfield Networks-Iterative Auto associative Memory
Networks-Temporal Associative Memory Network-Fixed Weight Competitive Nets- Kohonen Self-
Organizing Feature Maps-Learning Vector Quantization-Counter propagation Networks-Adaptive
Resonance Theory Network.
UNIT III THIRD-GENERATION NEURAL NETWORKS 6
Spiking Neural Networks - Convolutional Neural Networks-Deep Learning Neural Networks-Extreme
Learning Machine Model - Convolutional Neural Networks: The Convolution Operation – Motivation –
Pooling–Variants of the basic Convolution Function–Structured Outputs–Data Types–Efficient
Convolution Algorithms – Neuro scientific Basis – Applications: Computer Vision, Image Generation,
Image Compression.
UNIT IV DEEP FEEDFORWARD NETWORKS 6
History of Deep Learning- A Probabilistic Theory of Deep Learning- Gradient Learning – Chain Rule and
Back propagation - Regularization: Dataset Augmentation – Noise Robustness -Early Stopping,Bagging and
Dropout- batch normalization-VC Dimension and Neural Nets.
UNIT V RECURRENTNEURALNETWORKS 6
Recurrent Neural Networks: Introduction – Recursive Neural Networks – Bidirectional RNNs – Deep
Recurrent Networks – Applications: Image Generation, Image Compression, Natural Language
Processing. Complete Auto encoder, Regularized Auto encoder, Stochastic Encoders and Decoders,
Contractive Encoders
TOTAL:30 PERIODS
COURSE OUTCOMES:
After the successful completion of this course, the student will be able to
TEXT BOOKS:
1. IanGood fellow,Yoshua Bengio, Aaron Courville, “ DeepLearning”, MITPress, 2019.
2. Francois Chollet, “Deep Learning with Python”, Second Edition, Manning Publications, 2021.
REFERENCE BOOKS:
1. AurélienGéron,“Hands-On Machine Learning with Scikit LearnandTensorFlow”,Oreilly,2018.
2. Michael Nielsen, “Neural Networks and Deep Learning”, Determination Press, 2015.
3. JoshPatterson, Adam Gibson, “Deep Learning: A Practitioner’s Approach”, O’ReillyMedia,2017.