an integrated, modular framework for computer vision & cognitive robotics research (icvision)...
DESCRIPTION
We present an easy-to-use, modular framework for performing computer vision related tasks in support of cognitive robotics research on the iCub humanoid robot. The aim of this biologically inspired, bottom-up architecture is to facilitate research towards visual perception and cognition processes, especially their influence on robotic object manipulation and environment interaction. The icVision framework described provides capabilities for detection of objects in the 2D image plane and locate those objects in 3D space to facilitate the creation of a world model.TRANSCRIPT
![Page 1: An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Research (icVision) #bica2012](https://reader033.vdocuments.net/reader033/viewer/2022051610/54977975ac795925288b5514/html5/thumbnails/1.jpg)
#bica 2012
An Integrated,Modular Framework for
Computer Vision & Cognitive Robotics Research (icVision)
S. Harding, M. Frank, A. Förster, J. Schmidhuber
istituto dalle molle di studi sull’intelligenza artificialeuniversità della svizzera italiana
idsia / usi / supsi
Jürgen ’Juxi’ Leitner
![Page 2: An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Research (icVision) #bica2012](https://reader033.vdocuments.net/reader033/viewer/2022051610/54977975ac795925288b5514/html5/thumbnails/2.jpg)
manipulation
our iCubsetup is for
![Page 3: An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Research (icVision) #bica2012](https://reader033.vdocuments.net/reader033/viewer/2022051610/54977975ac795925288b5514/html5/thumbnails/3.jpg)
perceptionvisual
thanks to G. Metta and IIT for this picture
![Page 4: An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Research (icVision) #bica2012](https://reader033.vdocuments.net/reader033/viewer/2022051610/54977975ac795925288b5514/html5/thumbnails/4.jpg)
perceptionvisual
levels of abstraction
from 2D to 3D
![Page 5: An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Research (icVision) #bica2012](https://reader033.vdocuments.net/reader033/viewer/2022051610/54977975ac795925288b5514/html5/thumbnails/5.jpg)
three parts
Harding et al., GPTP 2012,Leitner et al., ICDL 2012 BICA 2012Leitner et al., IROS 2012
![Page 6: An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Research (icVision) #bica2012](https://reader033.vdocuments.net/reader033/viewer/2022051610/54977975ac795925288b5514/html5/thumbnails/6.jpg)
frameworkicVision
![Page 7: An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Research (icVision) #bica2012](https://reader033.vdocuments.net/reader033/viewer/2022051610/54977975ac795925288b5514/html5/thumbnails/7.jpg)
CoreicVision
![Page 8: An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Research (icVision) #bica2012](https://reader033.vdocuments.net/reader033/viewer/2022051610/54977975ac795925288b5514/html5/thumbnails/8.jpg)
objectsdetecting
Harding et al., GPTP 2012, Leitner et al., ICDL 2012
FiltericVision
![Page 9: An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Research (icVision) #bica2012](https://reader033.vdocuments.net/reader033/viewer/2022051610/54977975ac795925288b5514/html5/thumbnails/9.jpg)
objects localizing
Leitner et al., IROS 2012
3DicVision
![Page 10: An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Research (icVision) #bica2012](https://reader033.vdocuments.net/reader033/viewer/2022051610/54977975ac795925288b5514/html5/thumbnails/10.jpg)
interactionmodule
![Page 11: An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Research (icVision) #bica2012](https://reader033.vdocuments.net/reader033/viewer/2022051610/54977975ac795925288b5514/html5/thumbnails/11.jpg)
interactionmodule
![Page 12: An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Research (icVision) #bica2012](https://reader033.vdocuments.net/reader033/viewer/2022051610/54977975ac795925288b5514/html5/thumbnails/12.jpg)
interactionmodule
![Page 13: An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Research (icVision) #bica2012](https://reader033.vdocuments.net/reader033/viewer/2022051610/54977975ac795925288b5514/html5/thumbnails/13.jpg)
MoBeEframework Frank et al., ICINCO, 2012.
![Page 14: An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Research (icVision) #bica2012](https://reader033.vdocuments.net/reader033/viewer/2022051610/54977975ac795925288b5514/html5/thumbnails/14.jpg)
layers of modules
workfuture
eye-hand coordination
vision approach for reaching/grasping
![Page 15: An Integrated, Modular Framework for Computer Vision & Cognitive Robotics Research (icVision) #bica2012](https://reader033.vdocuments.net/reader033/viewer/2022051610/54977975ac795925288b5514/html5/thumbnails/15.jpg)
for listeningthanks
[email protected] http://Juxi.net/projects http://robotics.idsia.chvideos at http://robotics.idsia.ch/im-clever/
and http://youtube.com/user/IDSIARobotics