Artificial Neural Networks - 7: Dr. Aditya Abhyankar
Artificial Neural Networks - 7: Dr. Aditya Abhyankar
Last Time
Pattern Association.
Linear Vector Spaces revisited
Eigenvalues and Eigenvectors - examples
Autoassociative Nets examples (mistakes
and missing bits)
Recursive Nets examples
Fixed Point Cycle problem.
Today
Discrete Hopfield
Iterative autoassociative Net
Weights Symmetric and no selfconnections
USPs:
Only one unit updates its activation at a time
(asynchronous - Lyapunov)
Each unit continues to receive external signal
Discrete Hopfield
Discrete Hopfield
Discrete Hopfield
Discrete Hopfield
Ex: [1 1 1 0]
Let W be bipolar
Let update bin order be y1,y4,y3,y2
Test: [0 0 1 0]
Extend the analysis to bipolar inputs
E [ wij y j xi i ].yi
j
xi wij y j i
j
n
p
2 log 2 n
BAM
BAM examples
Character recognition (A [-1 1]), (C
[1 1])
Directional reversal
Noisy input:
Test with output of [0 1]
x = [0 0 1 0 0 1 0 1 1 0 0 1 1 1 0]
x = [0 0 1 0 0 1 0 1 0 0 0 0 0 0 0]