cam brain
DESCRIPTION
cam brainTRANSCRIPT
![Page 1: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/1.jpg)
BUILDING AN ARTIFICIAL BUILDING AN ARTIFICIAL BRAINBRAIN
Using an FPGA CAM-Brain MachineUsing an FPGA CAM-Brain Machine
Mika ShoshaniMika Shoshani
Yossy SalpeterYossy Salpeter
![Page 2: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/2.jpg)
An ARTIFICIAL BRAIN?!
• What?– A machine modeling the Human brain
• Why?– Breaking the limits of traditional computers
• And How?– “Teaching” the machine…
![Page 3: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/3.jpg)
Scope
• Introduction
• Background– The basis of the “Brain Building” field
• The CAM-Brain machine
• Domo Arigato Mr. ROBOKONEKOROBOKONEKO– “Proof of concept”
• What’s Next...
![Page 4: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/4.jpg)
Buzz words
• Neurons, Axons, Dendrites…
• Neural Network Module
• CAM - Cellular Automata Model
• FPGA - Field Programmable Gate Array
• Genetic Algorithms
• “Evolvable Hardware”
![Page 5: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/5.jpg)
• A network of 1014 neurons• Data transfer by electric signals• DendriteDendrite cells (neurons Input)
– Collect signals and pass them to the neuron
• NeuronsNeurons– “Decide” when to initiate a signal
• AxonAxon cells (neurons Output)– Propagate neuron signals
The Human Brain
![Page 6: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/6.jpg)
Genetic Algorithms
• A process imitating natural evolution
Random population
Fitness function
The fittestCrossover & MutationNew Generation
REPRODUCTION
![Page 7: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/7.jpg)
Genetic Algorithms
• A process imitating natural evolution
Random population
Fitness function
The fittestCrossover & Mutation3’ed Generation
REPRODUCTION
![Page 8: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/8.jpg)
Genetic Algorithms
• A process imitating natural evolution
Random population
Fitness function
The fittestCrossover & Mutation4’th Generation
REPRODUCTION
![Page 9: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/9.jpg)
Genetic Algorithms
• A process imitating natural evolution
Random population
Fitness function
The fittestCrossover & Mutation5’th Generation
Fittest individual
REPRODUCTION
![Page 10: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/10.jpg)
“Evolvable Hardware”• The Application of a Genetic Algorithm
on programmable hardware:Chip with
random circuitsMeasuring circuit
BestPerforming
circuits
Random MutationsNew Generationof mutant circuits
REPRODUCTION
Functioningcircuit
Evolve Hardware to perform a desired functionEvolve Hardware to perform a desired function
AT HARDWARE SPEEDS!!!
![Page 11: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/11.jpg)
Human Brain vs. The Computer
• 1014 Neurons• Parallel Computing• Speed: 100+ M./sec.• Natural Evolution
• CPU - Central Processing Unit
• Serial Computing• Approx. Speed of light• “Designable”
![Page 12: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/12.jpg)
The CAM-Brain Machine (CBM)
• A research tool of an artificial brain
• Consists of 32,768 neural modules
• Neural modules evolve in hardware using Genetic Algorithms
![Page 13: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/13.jpg)
CBM Goal
• Create a complex functionality without any a priori knowledge of howhow to achieve it…
• Requires the desired Input/Output function!
![Page 14: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/14.jpg)
CELLULAR automata MODEL
• A 3D grid of cells
• Each can be in one of a finite number of possible states.
• Sync. updated in discrete time steps.
• According to a local, identical interaction rule. “Chromosome”
![Page 15: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/15.jpg)
CBM Neural Network Model
• The CBM implements the:
“CoDi” Cellular Automata based
neural network model
• Goals:– Fast evolution– Portability into electronic hardware
![Page 16: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/16.jpg)
CoDI Cell design
• A cube with six neighbor cells
• Can function as Neuron, Axon or Dendrite
• A Neuron Cell:– 5 dendritic inputs + 1 axonic output– 4-bit input accumulator, “fires” on threshold
• A Dendrite cell: 5 Inputs / 1 Output
• An Axon cell: 1 Input / 5 Outputs
![Page 17: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/17.jpg)
CoDI Module Evolving
• All cells are seeded with “chromosome”
• Seed Neuron cells randomly
• Growth procedure:– Each Neuron sends grow dendrite/axon signals– Blank cells become dendrite/axon– Grown cells propagate growth signals– Propagation direction is set by the chromosome
![Page 18: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/18.jpg)
CoDI Module Evolving
![Page 19: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/19.jpg)
CoDI Module evolution
• Each module is given a specific function
• Genetic Algorithem:– Initial population of 30-100 modules– Run for 200-600 Generations– Up to 60,000 different module evaluations
• Full module evolution takes approx. 1sec
![Page 20: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/20.jpg)
CBM Architecture
• Cellular Automata Module
• Genotype/Phenotype Memory
• Fitness Evaluation Unit
• Genetic Algorithm Unit
• Module Interconnection Memory
• External Interface
![Page 21: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/21.jpg)
Architecture {1}
• Cellular Automata Module– The hardware core of the CBM
– 3D array of identical logic circuits (cells)
– Module size of 24*24*24 cells (13,824)
– Implemented by 72 FGPAs
– Time shared between multiple modules - Forming a brain during simulation.
– No idle time between modules
![Page 22: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/22.jpg)
Architecture {2}
• Genotype & Phenotype Memory– Total 1180 Mbytes RAM– Genotype memory for Evolution mode:
• Store Chromosome bitstrings• Store module neuron location & orientation
– Phenotype memory for Run mode:• Holds all evolved module maps
– Can support up to 32,758 modules
![Page 23: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/23.jpg)
Architecture {3}
• Fitness evaluation unit – Evaluates module fitness– Signals each module inputs– Compares Module output to target output– This comparison gives a measure of
module performance
![Page 24: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/24.jpg)
Architecture {4}
• Genetic Algorithm Unit – Selects a subset of the “best” evolved
modules for reproduction– Implements Crossover and Mutation masks– Generates offspring modules– Offspring chromosome generated in
hardware
![Page 25: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/25.jpg)
Architecture {5}
• Module Interconnection Memory – Supports operation of Evolved modules as
one artificial brain– Provides signaling between modules
![Page 26: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/26.jpg)
Architecture {6}
• External Interface – CBM Signaling is by 1-bit spiketrains– I/O For each module
• Input of up to 188 spiketrains• Output of up to 3 spiketrains
![Page 27: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/27.jpg)
Human Brain vs. CAM-Brain
• 1014 Neurons• Parallel Computing• Speed: 100+ M./sec.• Natural Evolution
• 4*107 Neurons• 1150 parallel neurons• Approx. speed of light• “Designable” Evolution
![Page 28: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/28.jpg)
• Political & Strategic goals
• A controlled cat as a “proof of concept”
• Radio connected to CBM
• Demonstrates CBM via evolved behaviors
• GoalGoal - The “CUTE” factor...
ROBOKONEKO
![Page 29: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/29.jpg)
Behavior Evolving
• Moition control modules– Fitness criterion - speed & distance – Mechanical vs. Simulated behavior evolving– Slow evolution, 2-3 min. per chromosome– Hand coded base criterion.
• Non motion control modules evolution -Predicted to be Faster
![Page 30: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/30.jpg)
SUMMARY
• Artificial Brain Building
• “CAM Brain Project”– Aims to build an artificial brain with 32000
evolved net modules, 40 million neurons
• “Robokoneko”– A Cat robot controled by the CAM-Brain– In development of motion control modules
![Page 31: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/31.jpg)
What’s Next...
• “Intelligent” robotic pets, Household robots, Soldier robots.
• Artilect - Artificial Intellect
• Ultra-Intelligent Artilect = Moral dilemma
![Page 32: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/32.jpg)
The prophecy
• Future WAR “Cosmists” vs. “Terrans”…
• The End of Human race as we know it...
![Page 33: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/33.jpg)
References {1}
• "Building an Artificial Brain Using an FPGA Based CAM-Brain Machine", Applied Mathematics and Computation Journal, Special Issue on "Artificial Life and Robotics, Artificial Brain, Brain Computing and Brainware", North Holland. (Invited by Editor, to appear 1999), Hugo de Garis, Michael Korkin, Felix Gers, Eiji Nawa, Michael Hough.
• "A 40 Million Neuron Artificial Brain for an Adaptive Robot Kitten "Robokoneko", Hugo de Garis, Michael Korkin, Gary Fehr, Nikolai Petroff, Eiji Nawa, to be submitted to the Connection Science Journal, Special Issue on Adaptive Robots.
• "Simulation and Evolution of the Motions of a Life Sized Kitten Robot "Robokoneko" as Controlled by a 32000 Neural Net Module Artificial Brain", Hugo de Garis, Nikolai Petroff, Michael Korkin, Gary Fehr, Eiji Nawa, (Invitation by Editor to the Computational Geometry Journal (CGJ), Special Issue on Computational Geometry in Virtual Reality)
![Page 34: Cam brain](https://reader035.vdocuments.net/reader035/viewer/2022062704/5559c3d9d8b42a236c8b53f9/html5/thumbnails/34.jpg)
References {www}
• A Brief Introduction to Genetic Algorithms, by Moshe Sipper, http://lslsun.epfl.ch/~moshes/ga_main.html
• Non-uniform cellular automata, by Moshe Sipper, http://lslsun.epfl.ch/~moshes/ga_main.html
• Prof. Dr. Hugo de Garis Home Page, http://www.cs.usu.edu/~degaris/
• CNN - Swiss scientists warn of robot Armageddon, http://www.cnn.com/TECH/science/9802/18/swiss.robot/
• ,האוניברסיטה העברית בירושלים - המוחhttp://gifted.snunit.k12.il/activities/brain/