pulsed neural networks neil e. cotter ece department university of utah

41
Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Upload: marybeth-hardy

Post on 12-Jan-2016

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Pulsed Neural Networks

Neil E. Cotter

ECE DepartmentUniversity of Utah

Page 2: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Overview

Page 3: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Challenging Problems

Page 4: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Challenging Problems

Image recognition in varied settings

Speech recognition in noise

Robotic control and navigation

Page 5: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Artificial Neural Networks

Page 6: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Biological Neuron

Page 7: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Biological Neuron

Page 8: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Perceptron

Page 9: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Perceptron Response

Page 10: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Linear Separability

Page 11: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Linear Separability

Page 12: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Logic Gates

Page 13: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Parallel Processing

Page 14: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Sigmoid Neuron

Page 15: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Sigmoid Neuron Response

Page 16: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Neural Network

Page 17: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Neural Network

Page 18: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Universal Approximation

Page 19: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Universal Approximation

Page 20: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Universal Approximation

Page 21: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Function Approximations

Page 22: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Learning

Page 23: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Gradient Descent

Page 24: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Local Minima

Page 25: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Backward-Error Propagation

Page 26: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Dynamic Networks

Page 27: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Dynamic Networks

Page 28: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Learning through Time

Page 29: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Learning through Time

q

±F

qx x q

State 0 or 1

x1

x16

w1

w16

noisey

v1

v16

noise

delay

l reward = ±1

p

bdeca

y r̂a

Adaptive Critic

Associative Search

Page 30: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Pulsed Networks

Page 31: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Pulsed Neuron

Page 32: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Pattern Processing

Page 33: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Response Regions

Page 34: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Pattern Windows

Page 35: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Pattern Windows

Page 36: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Dynamic Pulsed Networks

Page 37: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Applications

Page 38: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Speech Recognition

Page 39: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Auditory System

Page 40: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Research Opportunities

Mathematically describe pattern processing

Devise pattern-learning algorithms

Build circuits

Page 41: Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah

Title