evolutionary algorithms and artificial intelligence paul grouchy phd candidate university of toronto...

39
Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies [email protected]

Upload: oswald-andrews

Post on 11-Jan-2016

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

Evolutionary Algorithms and Artificial Intelligence

Paul GrouchyPhD Candidate

University of Toronto Institute for Aerospace Studies

[email protected]

Page 2: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

Intro to Evolutionary Algorithms (EAs)

Program flow of a Genetic Algorithm (GA):1. Randomly initialize population of “genomes”2. Evaluate “fitness” of all genomes3. Select high-fitness genomes to become

“parents”4. Produce new population of “offspring” genomes

from “parent” genomes5. End of a single “generation”

Page 3: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

Intro to Evolutionary Algorithms (EAs)

Toy problem: Maximize the sum of 5 bits

Genome: 0 1 1 0 0Fitness

(sum of bits)2

Page 4: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

Intro to Evolutionary Algorithms (EAs)

Toy problem: 1 generation0 1 1 0 00 1 0 0 0 0 1 0 0 1 0 0 0 1 0

fitness: 1 fitness: 2 fitness: 2 fitness: 1

Page 5: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

Intro to Evolutionary Algorithms (EAs)

Toy problem: 1 generation

0 1 1 0 0 0 0 0 1 0 Parents

0 1 1 1 0 0 0 0 0 0 Offspring

mutation

0 1 0 0 0

crossover point crossover point

Page 6: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

evaluate fitness of each genome using fitness function

select and reproduce parents based on fitness values

Generation t

Generation t+1Mutation

Crossover

0 1 1 0 1

0 1 0 0 1

0 1 1 0 0 0 1 0 1 1

0 1 1 1 1

Intro to Evolutionary Algorithms (EAs)

Page 7: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

Intro to Evolutionary Algorithms (EAs)

Page 8: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

Intro to Evolutionary Algorithms (EAs)Evolutionary Computation: A Unified Approach (2006)

Kenneth De Jong

Page 9: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

EAs as AIs

http://boxcar2d.com/

Page 10: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

https://xkcd.com/720/

Page 11: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

EAs as AIs

• Eureqa (http://creativemachines.cornell.edu/eureqa)

– Based on Genetic Programming (GP):

Page 12: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

EAs as AIs

• Eureqa (http://creativemachines.cornell.edu/eureqa)

Page 13: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

EAs as AIs

http://www.gp-field-guide.org.uk/

(FREE!)

Page 14: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

EAs are Embarrassingly Parallelizable

Page 15: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

AI vs. AGI

• AI:

Page 16: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

AI vs. AGI

• Artificial General Intelligence (AGI):

Page 17: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

AI vs. AGI

• Artificial General Intelligence (AGI):

Page 18: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

EAs to evolve AIs

Page 19: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

EAs to evolve AIs

evaluate fitness of each genome using fitness function

select and reproduce parents based on fitness values

Generation t

Generation t+1

Page 20: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

EAs to evolve AIs

Inputs Outputs

Page 21: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

EAs to evolve AIs

evaluate fitness of each genome using fitness function

select and reproduce parents based on fitness values

0.32 1.10 -0.21 … 0.11

0 1 2

-2

-1

0

1

2

=

Page 22: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

EAs to evolve AIs

Page 23: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

EAs to evolve AIs

Page 24: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

EAs to evolve AIs

Page 25: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

Learning and Generalizability

[Urzelai & Floreano, 2001]

Page 26: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

Learning and Generalizability

[Soltoggio et al., 2007]

Page 27: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

EAs to evolve AIs

Page 28: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

Can we evolve an abstraction of a brain?

0D3v0Ordinary Differential Equation Evolution

Page 29: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

Learning Capabilities

Simulation environment Typical evolved forage path

Typical evolved “eat” output

Page 30: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

https://xkcd.com/534/

Page 31: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

ALife/Evolution of Communication Sim

(x,y)

cin

(Δx,Δy)

cout

Page 32: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

ALife/Evolution of Communication Sim

Page 33: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

ALife/Evolution of Communication Sim

Page 34: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

ALife/Evolution of Communication Sim

Page 35: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

ALife/Evolution of Communication Sim

Page 36: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

ALife/Evolution of Communication Sim

Page 37: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

ALife/Evolution of Communication Sim

Page 38: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

ALife/Evolution of Communication Sim

Page 39: Evolutionary Algorithms and Artificial Intelligence Paul Grouchy PhD Candidate University of Toronto Institute for Aerospace Studies pgrouchy@gmail.com

THANK YOU!!!

Paul GrouchyPhD Candidate

University of Toronto Institute for Aerospace Studies

[email protected]