cotesys-ros fall school munich november 3 th 2010 general concept & first demonstrator jos...

26
CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Upload: damon-barton

Post on 23-Dec-2015

216 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

CoTeSys-ROS Fall SchoolMunich November 3th 2010

General Concept & First Demonstrator

Jos ElfringRob Janssen

Page 2: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

General concept• Humans in day2day tasks

• 90% feedforward – learning and memorization• 10% feedback – sensory feedback

[email protected]@tue.nl

Page 3: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

General concept• Humans in day2day tasks

• 90% feedforward – learning and memorization• 10% feedback – sensory feedback

• RoboEarth – learning and memorization• Share any reusable knowledge between robots• World-Wide-Web for and by robots

[email protected]@tue.nl

Page 4: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

General concept• Humans in day2day tasks

• 90% feedforward – learning and memorization• 10% feedback – sensory feedback

• RoboEarth – learning and memorization• Share any reusable knowledge between robots• World-Wide-Web for and by robots

• Four year EC funding (FP7)

[email protected]@tue.nl

Page 5: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Concept

[email protected]@tue.nl

Page 6: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Concept

[email protected]@tue.nl

Page 7: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Concept

[email protected]@tue.nl

Page 8: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Concept

[email protected]@tue.nl

Page 9: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Example

[email protected]@tue.nl

Page 10: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Example

[email protected]@tue.nl

Bed

Page 11: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Example

[email protected]@tue.nl

Bed

Cabinet

Page 12: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Example

[email protected]@tue.nl

Bed

Cabinet

Power plug

Page 13: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Example

[email protected]@tue.nl

Bed

Cabinet

Power plug

Bed

Cabinet

Power plug

Page 14: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Example

[email protected]@tue.nl

Bed

Cabinet

Power plug

Bed

Cabinet

Power plug

Page 15: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Example

[email protected]@tue.nl

Bed

Cabinet

Power plug

Bed

Cabinet

Power plug

Bed

Cabinet

Power plug

Page 16: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

‘Birth of RoboEarth workshop’Two classes of robots sharing knowledge through RoboEarth

TUE Eindhoven bot RFC Stuttgart bot

[email protected]@tue.nl

Page 17: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Experiment description

• The two classes will collaboratively explore a maze• Sharing of knowledge on two levels

• Sharing of learned inputs for moving 1[m] front, back, left and right within class

• Sharing of environmental knowledge on the maze between classes

[email protected]@tue.nl

Page 18: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Visualisation

1. Learning input primitives (using Iterative learning Control)

[email protected]@tue.nl

1 [m]

Page 19: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Visualisation

1. Learning input primitives (using Iterative learning Control)

[email protected]@tue.nl

1 [m]

1 [m]

Page 20: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Visualisation

1. Learning input primitives (using Iterative learning Control)

[email protected]@tue.nl

1 [m]

1 [m]

1 [m]

Page 21: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Visualisation

1. Learning input primitives (using Iterative learning Control)

[email protected]@tue.nl

1 [m]

1 [m]

1 [m]

1 [m]

Page 22: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Visualisation

1. Learning input primitives (using Iterative learning Control)

[email protected]@tue.nl

1 [m]

1 [m]

1 [m]

1 [m]

Page 23: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Visualisation

1. Learning input primitives (using Iterative learning Control)

[email protected]@tue.nl

1 [m]

1 [m]

1 [m]

1 [m]

Page 24: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Visualisation

2. Use primitives to collaboratively explore a maze (using Q-learning)

[email protected]@tue.nl

Page 25: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

Summary

All though imposed methods in this experiment rather trivial, it can been shown that

• robots benefit from sharing knowledge (increased efficiency)• scalable• many forms of knowledge can be shared (object information,

environmental data, action recipes)• RoboEarth databases function as backup servers• sharing through WWW can be used globally

[email protected]@tue.nl

Page 26: CoTeSys-ROS Fall School Munich November 3 th 2010 General Concept & First Demonstrator Jos Elfring Rob Janssen

[email protected]@tue.nl