Download - BACKPROPAGATION NEURAL NETWORK
BACK PROPAGATION LEARNING THEORY1
Submitted to Presented bySubmitted to Presented by
Dr. Vishal Sahani Puneet Kr Singh
M.Tech(2nd sem)
Full Time
P K Singh , F O E , D E I http://pksingh.webstarts.com/student_community.html
BACKPROPAGATION NEURAL NETWORK
One of the most commonly used supervised ANN model is back propagation network that uses back propagation learning algorithm.
These elements or nodes are arranged into different layers: input, middle and output.
The output from a back propagation neural network is computed using a procedure known as the forward pass
2P K Singh , F O E , D E I
The input layer propagates a particular input vector’s components to each node in the middle layer.
Middle Layer nodes compute output values, which becomes input to the nodes of output layer.becomes input to the nodes of output layer.
The output layer nodes compute the network output for the particular input vector.
3P K Singh , F O E , D E I
Multi-layer neural network using
4
Multi-layer neural network using back propagation
P K Singh , F O E , D E I
5P K Singh , F O E , D E I
Artificial Neuron:Classical Activation Functions
z z
Linear activation Logistic activation
1
1 zz
e
zz
1
6
Threshold activation Hyperbolic tangent activation
u
u
e
eutanhu
2
2
1
1
1, 0 ,
s ig n ( )1, 0 .
if zz z
if z
z
z z-1
1
0
0
1
-1
P K Singh , F O E , D E I
Xk
7P K Singh , F O E , D E I
BACKPROPAGATION WEIGHT UPDATE PROCEDURE
8P K Singh , F O E , D E I
BACKPROPAGATION WEIGHT UPDATE PROCEDURE
9P K Singh , F O E , D E I
10P K Singh , F O E , D E I
11P K Singh , F O E , D E I
12P K Singh , F O E , D E I
FUNCTION APPROXIMATION
13P K Singh , F O E , D E I
REPRESENTATIONSTEP
14P K Singh , F O E , D E I
15P K Singh , F O E , D E I
16P K Singh , F O E , D E I
17P K Singh , F O E , D E I
18P K Singh , F O E , D E I
19P K Singh , F O E , D E I
20P K Singh , F O E , D E I
21P K Singh , F O E , D E I
22P K Singh , F O E , D E I
23P K Singh , F O E , D E I
24P K Singh , F O E , D E I
25P K Singh , F O E , D E I
26P K Singh , F O E , D E I
27P K Singh , F O E , D E I
28P K Singh , F O E , D E I
29P K Singh , F O E , D E I
30P K Singh , F O E , D E I
31P K Singh , F O E , D E I
32P K Singh , F O E , D E I
33P K Singh , F O E , D E I
Thanks For YourAttention!!!
P K Singh , F O E , D E I http://pksingh.webstarts.com/student_community.html