Associative Learning

Outline

Simple Associative Network Unsupervised Hebb Rule Simple Recognition Network Instar Rule Simple Recall Network Outstar Rule

Simple Associative Network

Banana Associator

Unsupervised Hebb Rule

Banana Recognition Example

Example

Problems with Hebb Rule

Weights can become arbitrarily large

There is no mechanism for weights to decrease

Hebb Rule with Decay

Example: Banana Associator

Example

Problem of Hebb with Decay

Instar (Recognition Network)

Instar Operation

Vector Recognition

Instar Rule

Graphical Representation

Example

Training

Further Training

Kohonen Rule

Outstar (Recall Network)

Outstar Operation

Outstar Rule

Example - Pineapple Recall

Definitions

Iteration 1

Convergence