ubiquitous network robots for life support...map data glossary/ontology industry safety care safety...

31
Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved. DAY 2: EXPERTS WORKSHOP Active and Healthy Ageing: Research and Innovation Responses from Europe and Japan “Success Stories in ICT/Information Society Research for Active and Healthy Ageing” Ubiquitous Network Robots for Life Support October 10, 2012 Dr. Takahiro Miyashita Group Leader, Dept. of Network Robots ATR Intelligent Robotics and Communication Labs [email protected] This research is supported by the Ministry of Internal Affairs and Communications.

Upload: others

Post on 17-Mar-2021

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

DAY 2: EXPERTS WORKSHOP Active and Healthy Ageing: Research and Innovation Responses

from Europe and Japan

“Success Stories in ICT/Information Society Research for Active and Healthy Ageing”

Ubiquitous Network Robots for Life Support

October 10, 2012

Dr. Takahiro Miyashita

Group Leader, Dept. of Network Robots ATR Intelligent Robotics and Communication Labs

[email protected] This research is supported by the Ministry of Internal Affairs and Communications.

Page 2: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

OUTLINE

1.  Robotic Services

2.  Ubiquitous Network Robots (UNR) for Life Support

3.  UNR Platform and its Standardization

4.  Conclusion

Page 3: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

1. Robotic Services

Page 4: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Community building support

Touring support

Shopping support

Health care

Active hearing

Robotic Services for Active & Healthy Ageing

Page 5: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

However, Stand-alone robotic services are not enough for continuously and seamlessly supporting daily activity.

Page 6: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Real World in Social Interaction with or via Robots (2002)

Noisy, Noisy, Noisy, Noisy

Page 7: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Networked Robots in School (2002)

wireless tag

Antenna

Page 8: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Structuring Environmental Information on Human Trajectories and Behaviors (UbiComp 2008)

T. Kanda et al., “Who will be the customer?: A social robot that anticipates people’s behavior from their trajectories,” Proc. of UbiComp 2008, pp.380-389, 2008.

Page 9: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

T. Kanda et al., “Abstracting People’s Trajectories for Social Robots to Proactively Approach Customers,” IEEE Trans. on Robotics, Vol.25, No.6, pp.1382-1396, 2009.

Ambient Intelligence Map Anticipation of People’s Trajectories and Behaviors

Page 10: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Robots in Smartphone (2010)

  CG character agent

  He can move and talk in a display with same commands for robots in real world.

Page 11: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Three Types of Robots with UNR Platform

Virtual-type

Visible-type

Unconscious-type

Ubiquitous Network Robot(UNR) Platform

ICT Infrastructure (Cloud and Ubiquitous Computing & Wireless

Communication, )

User Interface easy-to-use & inevitable utility in daily use Price: Reasonable

iPhone, iPad, DS-3D,

Location Precision: 3m 5cm accuracy Price gradually decreasing

RF-ID, Camera, LRF,

User Interface: Broaden to Elderly Price competitive to bike or vehicle, (or hobby)

Physical Robot, Geminoid, WheelChair

Page 12: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

2. Ubiquitous Network Robots

(UNR) for Life Support

Page 13: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

UNR Research Project (Supported by MIC)

Period June, 2009 to March, 2013

BudgetATR, Toshiba, NTT, Hitachi, and NEC

-  Create core technologies allowing network robot services across multiple areas for elderly and disables (challenged) which are hardly realized by single robots. -  Propose the common platform, called the Ubiquitous Network

Robot PlatForm (UNR-PF), which provides the common functionalities on the services of human-robot interaction.

Purpose

Partners34M US$

Page 14: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

One location to

Multi-location

Tele-operated Communication

-R Collaboration

and Coordination

Human-Robot Interaction

Ubiquitous Network

Robots Platform

Ubiquitous Network Robots for Life Support

2004-2009

Page 15: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Shopping Support for Elderly Customer (2009)

Entrance of Super Market

Teleoperator

HomeShopping Area

Page 16: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Networked Robots help elderly customers in a supermarket (December, 2009) http://networked-robots.cs.umn.edu/node/84

Page 17: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Shopping Support with UNR over three area Area Home

Area Entrance of a Supermarket

Area Shopping Area

17

Page 18: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Networked Robots help elderly customers in a supermarket (December, 2009)

Comments from Elderly Customer Participant

Page 19: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Shopping support service for elderly wheelchair users

Page 20: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Shopping support service for elderly wheelchair users (March, 2011) http://networked-robots.cs.umn.edu/

Page 21: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

3. UNR Platform

and its Standardization

Page 22: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Conventional Style of Service Application Programming

face recognition

wheel control

robot 1

find face

guest name face position

move to the position

RFID tag Detection

leg control

robot 2

find tag

tag ID tag position

walk to the position

Service App. 2Service App. 1

Implementation layer (hardware layer)

Implementation-dependent functions called from service applications and their return values

Application program and robot implementation are tightly coupled

Page 23: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Proposed Service Application Programming Style

HRI Engine 1

face recognition

wheel control

Service App. X

robot 1

Who is there?

person ID position

approach the person

RFID tag Detection

leg control

robot 2

HRI Engine 2

Service App. X

Who is there?

person ID position

approach the person

Standard Interfaces

and Framework

compatible

Standard APIs enhance the reusability of application programs

Implementations are invisible from outside

Implementation-independent functions and their return values in common message type

Page 24: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Proposed Service Application Programming Style

HRI Engine 1

face recognition

wheel control

Service App. X

robot 1

Who is there?

person ID position

approach the person

RFID tag Detection

leg control

robot 2

HRI Engine 2

Service App. X

Who is there?

person ID position

approach the person

Standard Interfaces

and Framework

compatible

Standard APIs enhance the reusability of application programs

Implementations are invisible from outside

Implementation-independent functions and their return values in common message type

UNR-PF Layer Service Apps.

Robotic Compos.

Page 25: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Ubiquitous Network Robot Platform

 separates the developments of robots and robotic service applications.

  connects various service applications to appropriate robots in a variety of places.

  permits service applications to share their own data between each other.

  UNR-PF alpha (test release) is available.

K. Kamei et al., “Cloud Networked Robotics,” in IEEE Network Magazine, vol. 26, no. 3, pp. 28-34, May 2012 http://dx.doi.org/10.1109/MNET.2012.6201213

http://www.irc.atr.jp/std/UNR-Platform.html

Page 26: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Implementation Model of UNR Platform

Local Platform (Location A)

Local Platform (Location B)

Service Registry

Resource Management

User Registry

Map Registry

Robotic Service Management (Global (multi-area) Integration)

Service Registry (global)

Robot Registry (global)

Network Robot Interface

Component

Robotic Service

Component Component Component Component Component Component

Status: 4W =Who/When/

Where/ What

Command

Platform

Page 27: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Standardizations

Local Platform (Location A)

Local Platform (Location B)

Service Registry

Resource Management

User Registry

Map Registry

Robotic Service Management (Global (multi-area) Integration)

Service Registry (global)

Robot Registry (global)

Network Robot Interface

Component

Robotic Service

Component Component Component Component Component Component

Status: 4W =Who/When/

Where/ What

Command

Platform

NR-PFNR-PFUNR-PF

CityGML

RLS

RoISRoIS

Page 28: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Sensor Network

Indoor Map

Standardization Map

ISO/TC 211ISO/TC 184

ITU-T SG16

OGC

OMGIEEE

IEC/TC 61

Network

Industrial Robots

Service Robots

Multimedia

Electrical Appliances

Device

GIS

Sensor Network

Distributed

System Service Robots

Page 29: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

Sensor Network

Indoor Map

Standardization Map

GeoSMS

Safety Life Cycle

Network Robot Platform

Map data Glossary/ontology

Industry Safety

Care Safety

Vocabulary

Safety of households

Personal Care

Robotic Localization

Service RLS

Robotic Interaction Service RoIS

Robotics components

RTC

ISO/TC 211ISO/TC 184

ITU-T SG16

OGC

OMG

IEEE

IEC/TC 61

IndoorGMLCityGML

ISO191XX series

GML

ORiN

DDC4RTC

Network

Industrial Robots

Service Robots

Multimedia

Electrical Appliances

Device

GIS

Sensor Network

Distributed

System

Service Robots

Page 30: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

•  Scientific and Technological Challenges•  System Reliability and Standardization •  Insurance and legal issues •  Collaboration with local administrations •  Design service & Evaluation tests•  User Acceptance •  End-User Analysis & Education •  Cross fertilization: academics and industry •  Cost Performance

Future work for Creating Robotic Services Market

Page 31: Ubiquitous Network Robots for Life Support...Map data Glossary/ontology Industry Safety Care Safety Vocabulary Safety of households Personal Care Robotic Localization Service RLS Robotic

Copyright (C) 2012 ATR, Kyoto, JAPAN All rights reserved.

  The concept of “Ubiquitous Network Robot” and some of robotic service applications based on UNR were introduced.

  The UNR is one of key concepts for supporting “Active and Healthy Ageing.”

  Let’s collaborate with not only robots but also us (!) to develop the robotic services!

Conclusion

Thank you for your kind attention.This research is supported by the Ministry of Internal Affairs and Communications.