ami 2015 - definition of ambient intelligence

54
Definitions of Ambient Intelligence Ambient intelligence: technology and design Fulvio Corno Politecnico di Torino, 2014/2015 http://praxis.cs.usyd.edu.au/~peterris

Upload: fulvio-corno

Post on 14-Jul-2015

262 views

Category:

Education


0 download

TRANSCRIPT

Page 1: AmI 2015 - Definition of Ambient Intelligence

Definitions of Ambient Intelligence Ambient intelligence: technology and design

Fulvio Corno

Politecnico di Torino, 2014/2015

http://praxis.cs.usyd.edu.au/~peterris

Page 2: AmI 2015 - Definition of Ambient Intelligence

Summary

• Technology trends

• Definition(s)

• Application areas

• Requested features

• Architectures

2014/2015 Ambient intelligence: technology and design 2

Page 3: AmI 2015 - Definition of Ambient Intelligence

TECHNOLOGY TRENDS Definitions and Application Areas

2014/2015 Ambient intelligence: technology and design 3

Page 4: AmI 2015 - Definition of Ambient Intelligence

Technology trends

Verona, 28/10/2014 Ambient Intelligence 4

Home Automation / Building Automation

Smart Home / Smart Building

Smart Devices / Ubiquitous / Wearable

Mobile Devices

Clo

ud

co

mp

uti

ng

Inte

rnet

/ C

on

nec

tivi

ty

Internet of Things

Page 5: AmI 2015 - Definition of Ambient Intelligence

Technology trends

Verona, 28/10/2014 Ambient Intelligence 5

Home Automation / Building Automation

/ Smart Home / Smart Building

Smart Devices / Ubiquitous / Wearable

Mobile Devices

Clo

ud

co

mp

uti

ng

Inte

rnet

/ C

on

nec

tivi

ty

Internet of Things

Integration

Integration

Page 6: AmI 2015 - Definition of Ambient Intelligence

Conquering the user

Verona, 28/10/2014 Ambient Intelligence 6

Smart Home

Electrical plants and componen

ts Consumer electronics

Computers

Telecommunications

Industrial automatio

n plants

Surveillance systems

Smart appliance

On-line services

Controlling the smart home market

is appealing to producers of…

May we talk?

Page 7: AmI 2015 - Definition of Ambient Intelligence

Technology trends

Verona, 28/10/2014 Ambient Intelligence 7

Home Automation / Building Automation

Smart Home / Smart Building

Smart Devices / Ubiquitous / Wearable

Mobile Devices

Clo

ud

co

mp

uti

ng

Inte

rnet

/ C

on

nec

tivi

ty

Internet of Things

IoT Applications

(IoT) Users

Page 8: AmI 2015 - Definition of Ambient Intelligence

Where research is…

Verona, 28/10/2014 Ambient Intelligence 8

Home Automation / Building Automation

Smart Home / Smart Building

Smart Devices / Ubiquitous / Wearable

Mobile Devices

Clo

ud

co

mp

uti

ng

Inte

rnet

/ C

on

nec

tivi

ty

Internet of Things

IoT Applications

(IoT) Users

Page 9: AmI 2015 - Definition of Ambient Intelligence

DEFINITION(S) Definitions and Application Areas

2014/2015 Ambient intelligence: technology and design 9

Page 10: AmI 2015 - Definition of Ambient Intelligence

What is Ambient Intelligence?

• Wide area

• Expectations evolving over time

• “Definition” or “prediction”?

• Multiple definitions found, from complementary points of view

• Some researchers trying to define a common framework

2014/2015 Ambient intelligence: technology and design 10

Page 11: AmI 2015 - Definition of Ambient Intelligence

The starting point

• The concept of Ambient Intelligence (AmI) provides a vision of the Information Society where the emphasis is on greater user-friendliness, more efficient services support, user-empowerment, and support for human interactions. People are surrounded by intelligent intuitive interfaces that are embedded in all kinds of objects and an environment that is capable of recognising and responding to the presence of different individuals in a seamless, unobtrusive and often invisible way.

2014/2015 Ambient intelligence: technology and design 11

Published in 2001

Page 12: AmI 2015 - Definition of Ambient Intelligence

Some other definitions

2014/2015 Ambient intelligence: technology and design 12

Page 13: AmI 2015 - Definition of Ambient Intelligence

Comprehensive AmI definition

• “An Ambient Intelligence system is a digital environment that proactively, but sensibly, supports people in their daily lives”

Cook et al, Ambient Intelligence: Technologies, applications and opportunities, 2009

2014/2015 Ambient intelligence: technology and design 13

Page 14: AmI 2015 - Definition of Ambient Intelligence

Comprehensive IE definition

• “An Intelligent Environment is one in which the actions of numerous networked controllers (controlling different aspects of an environment) is orchestrated by self-programming pre-emptive processes (e.g., intelligent software agents) in such a way to create an interactive holistic functionality that enhances occupants experiences.”

Augusto et al, Intelligent Environments: a Manifesto, 2013

2014/2015 Ambient intelligence: technology and design 14

Page 15: AmI 2015 - Definition of Ambient Intelligence

Interactions among disciplines

2014/2015 Ambient intelligence: technology and design 15

Page 16: AmI 2015 - Definition of Ambient Intelligence

Main steps for AmI

Sensing

Reasoning

Acting

Interacting

2014/2015 Ambient intelligence: technology and design 16

Page 17: AmI 2015 - Definition of Ambient Intelligence

Main steps for AmI

Sensing

Reasoning

Acting

Interacting

2014/2015 Ambient intelligence: technology and design 17

Page 18: AmI 2015 - Definition of Ambient Intelligence

Sensing

• Sensors, sensor networks

– Wired or wireless

– Independent or embedded in a device (eg. Smartphone)

• Ambient or body

2014/2015 Ambient intelligence: technology and design 18

Page 19: AmI 2015 - Definition of Ambient Intelligence

Examples (ambient, wireless)

2014/2015 Ambient intelligence: technology and design 19

Page 20: AmI 2015 - Definition of Ambient Intelligence

Examples (wearable)

2014/2015 Ambient intelligence: technology and design 20

http://www.notchdevice.com/ Inside clothes Haptic Feedback Movement capture

Metria™ Informed Health 3-axis accelerometer, Galvanic Skin Response, 2 temperature sensors (body, skin)

Self-tracking Steps, calories, sleep, distance, …

Page 21: AmI 2015 - Definition of Ambient Intelligence

Sensor data

Huge Noisy

Missing points Heterogeneous

measures

Time- & space- dependent

Raw vs. processed

• “Making sense of data”

• Stream data processing

• Signal processing algorithms

• Sensor fusion

• Big data handling

• Filtering, disambiguation, interpretation

2014/2015 Ambient intelligence: technology and design 21

Page 22: AmI 2015 - Definition of Ambient Intelligence

Main steps for AmI

Sensing

Reasoning

Acting

Interacting

2014/2015 Ambient intelligence: technology and design 22

Page 23: AmI 2015 - Definition of Ambient Intelligence

Reasoning

• Needed to provide responsiveness and adaptability

• Interpret and recognize context and activity

• User modeling, context modeling

• Context detection and context awareness

• Mobility tracking

• Activity recognition, activity prediction

• Decision making

– Acting vs. suggesting

• Centralized vs. Distributed

2014/2015 Ambient intelligence: technology and design 23

Page 24: AmI 2015 - Definition of Ambient Intelligence

Main steps for AmI

Sensing

Reasoning

Acting

Interacting

2014/2015 Ambient intelligence: technology and design 24

Page 25: AmI 2015 - Definition of Ambient Intelligence

Acting

• Home automation systems (lights, doors, windows, temperature, …)

• User Interfaces or Wearable devices (notifications, information, alerting, …)

• Robots

2014/2015 Ambient intelligence: technology and design 25

Page 26: AmI 2015 - Definition of Ambient Intelligence

Main steps for AmI

Sensing

Reasoning

Acting

Interacting

2014/2015 Ambient intelligence: technology and design 26

Page 27: AmI 2015 - Definition of Ambient Intelligence

Interacting with users

• Traditional user interfaces

– Web, mobile

• Home fixtures

• Natural user interfaces

– Speech, gestures, body motion tracking, emotions, facial expressions, attention, …

– Interaction bypasses ICT equipment (“disappearing computer”)

• Should be the most important aspect of an AmI, but…

2014/2015 Ambient intelligence: technology and design 27

Page 28: AmI 2015 - Definition of Ambient Intelligence

Don’t push technologies

Verona, 28/10/2014 Ambient Intelligence 28

http://radar.oreilly.com/2014/05/most-of-what-we-need-for-smart-cities-already-exists.html

http://radar.oreilly.com/2014/04/ioth-the-internet-of-things-and-humans.html

Page 29: AmI 2015 - Definition of Ambient Intelligence

Related Buzzwords…

• IoT – Internet of Things – Physical objects are part of the Internet infrastructure.

Objects are capable of interacting with other objects

• M2M – Machine to machine communication – Technologies that allow both wireless and wired systems to

communicate with other devices of the same type

• IoE – Internet of Everything – The Internet of Everything is the networked connection of

people, process, data, and things (Cisco)

• Smart Homes, Domotics – Today’s solutions, with limited or no intelligence

2014/2015 Ambient intelligence: technology and design 29

Page 30: AmI 2015 - Definition of Ambient Intelligence

APPLICATION AREAS Definitions and Application Areas

2014/2015 Ambient intelligence: technology and design 30

Page 31: AmI 2015 - Definition of Ambient Intelligence

Application areas

• The general principles are applicable to different types of environments

– Private homes

– Public/shared buildings

– Open spaces

• The type of applications is extremely varied

• The approach and many founding technologies are shared across application domains

2014/2015 Ambient intelligence: technology and design 31

Page 32: AmI 2015 - Definition of Ambient Intelligence

Some application areas

2014/2015 Ambient intelligence: technology and design 32

Note: Just “Smart” or

Really “Intelligent” ?

Page 33: AmI 2015 - Definition of Ambient Intelligence

A recent example…

2014/2015 Ambient intelligence: technology and design 33

https://nest.com/

Page 34: AmI 2015 - Definition of Ambient Intelligence

REQUESTED FEATURES Definitions and Application Areas

2014/2015 Ambient intelligence: technology and design 34

Page 35: AmI 2015 - Definition of Ambient Intelligence

Features

• What are the features characterizing an AmI system?

• What is really an “intelligent” system, versus a “smart” one, versus an “automated” one?

• What characteristics are implied by the AmI definition(s)?

2014/2015 Ambient intelligence: technology and design 35

Page 36: AmI 2015 - Definition of Ambient Intelligence

Features

AmI

Sensitive

Responsive

Adaptive

Transparent

Ubiquitous

Intelligent

2014/2015 Ambient intelligence: technology and design 36

Page 37: AmI 2015 - Definition of Ambient Intelligence

Sensitive & Responsive

• Able to sense

– The environment

– The occupants

• Able to process sensor data

• Able to respond to user needs

• Able to act on the environment

2014/2015 Ambient intelligence: technology and design 37

Page 38: AmI 2015 - Definition of Ambient Intelligence

Adaptive

• Able to infer a situational context

– From environment data

– From user data (identity, presence, actions, …)

– From statistics and preferences

– From external information sources

• Able to adapt to the context

– the interpretation of sensing

– the generated response

• «Context-Aware Computing»

2014/2015 Ambient intelligence: technology and design 38

Page 39: AmI 2015 - Definition of Ambient Intelligence

Transparent

• «The most profound technologies are those that disappear. They weave themselves into the fabric of everyday life until they are indistinguishable from it» (Weiser, 1991)

• «Disappearing computer»

2014/2015 Ambient intelligence: technology and design 39

Page 40: AmI 2015 - Definition of Ambient Intelligence

Ubiquitous

• Ubiquitous Computing, Pervasive Computing

– Ubiquitous: present, appearing, found everywhere

– Pervasive: spreading widely throughout an area or a group of people

• Able to be distributed over the ambient and over different people

• Requires mobility, miniaturization, wireless communications, energy management

• Requires interoperability, discovery, self-configuration

2014/2015 Ambient intelligence: technology and design 40

Page 41: AmI 2015 - Definition of Ambient Intelligence

Intelligent

• Incorporates Artificial Intelligence:

– Machine learning, agent-based software, robotics

– Hearing, vision, language, knowledge processing

– Semantic web, reasoning

• AI is an enabler for achieving context awareness, adaptivity, proactive responsiveness

2014/2015 Ambient intelligence: technology and design 41

Page 42: AmI 2015 - Definition of Ambient Intelligence

ARCHITECTURES Definitions and Application Areas

2014/2015 Ambient intelligence: technology and design 42

Page 43: AmI 2015 - Definition of Ambient Intelligence

AmI requires complex systems

• Drawing from may different fields of Computer Science and Electronics

• Requiring the most advanced solutions for integrating such diverse and numerous subsystems and devices

• Needing to switch from one-off prototypes to scalable, reusable, plug&play, industrially robust solutions

• Industries and researchers need to play together with standardization initiatives

• Need to (re)gain the central role of end users

2014/2015 Ambient intelligence: technology and design 43

Page 44: AmI 2015 - Definition of Ambient Intelligence

Home automation technologies

2014/2015 Ambient intelligence: technology and design 44

Page 45: AmI 2015 - Definition of Ambient Intelligence

Home automation technologies

2014/2015 Ambient intelligence: technology and design 45

RS-485

Home Automation

Building Automation

Computer-derived

Page 46: AmI 2015 - Definition of Ambient Intelligence

Standards?

• Users are in the hands of manufacturers

• Technologies and protocols

– Don’t interoperate

– Rapid obsolescence

– Don’t trust new «Universal Standards»

2014/2015 Ambient intelligence: technology and design 46

http://xkcd.com/927/

Page 47: AmI 2015 - Definition of Ambient Intelligence

System overview

2014/2015 Ambient intelligence: technology and design 47

D D D D

Application

Devices

• Sensor Technologies • Communication protocols • Scale (local, geographic) • Number of devices • Sampling Frequencies • Security/ authentication • Data types • Bidirezional • Data Encoding • Polling / Pushing

Infrastructure & AmI

• Ambient sensors (temperature, humidity, CO2, pollutants, illumination, wind, …)

• User sensors (presence, movement, accesses, …)

• Energy meters (electrical energy and power, gas and water usage, …)

• Actuators (relays, valves, motors, displays, …) • Automation Sistems • Types of interconnection

• Dashboard (visualization, monitoring, …) • Historical data (storage, querying,

wharehouses, …) • Alarms (anomalies, thresholds, …) • Remote control (actuation, [de]activate

actions, set-points, …) • Trends (historical data analysis, real-time data

analysis) • Real time computations (computing derived

values, virtual sensors, …) • Ambient intelligence (comfort, energy saving,

scenarios, dynamic adaptation, …) • Integration with information systems

Page 48: AmI 2015 - Definition of Ambient Intelligence

In the real world

2014/2015 Ambient intelligence: technology and design 48

D D D D

Devices

AmI Infrastructure

Application

Application

Application

Application

Application

D Wired

Wireless

Custom-made

Appliance

Internet

Page 49: AmI 2015 - Definition of Ambient Intelligence

Errors to avoid

2014/2015 Ambient intelligence: technology and design 49

D D D D

Application

Devices

Infrastructure

D D

D

D

Application

Infrastructure

D

«All you can eat» application The «tooooo smart gateway»

Devices

Page 50: AmI 2015 - Definition of Ambient Intelligence

Target approach

2014/2015 Ambient intelligence: technology and design 50

AmI system

Page 51: AmI 2015 - Definition of Ambient Intelligence

Open Horizontal AmI Architectures

2014/2015 Ambient intelligence: technology and design 51

D D D D D D D D D D D D

Application Application Application Application

Neutral representation

Basic services

API

Protocol interfaces/drivers

Data exchange

Real time processing Intelligence Application (service, agent)

Intelligence

Page 52: AmI 2015 - Definition of Ambient Intelligence

An example middleware

2014/2015 Ambient intelligence: technology and design 52

D D D D D D D D Domotic devices (switches, buttons, relays, sensors, meters, …)

Domotic bus (wired, wireless)

GW Bus-to-IP gateway Bus-to-serial gateway GW

Ethernet, Wi-Fi, USB

User Interface

Mobile, Web, Home Display, Multi Touch, Accessibility, Natural language, …

Data analysis

ERP, Web services, Stream processors, Datawarehouse

Dog Bundles

Device abstraction, Event abstraction, State abstraction, Rules engine, …

User Interface

User Interface

Smart Appliance

Page 53: AmI 2015 - Definition of Ambient Intelligence

Resources

• Scenarios for Ambient Intelligent in 2010, ISTAG Group, 2001 • Smart Environments: Technology, Protocols and Applications,

DJ Cook, S Das, John Wiley & Sons, 2004 • How smart are our environments? An updated look at the

state of the art, DJ Cook, SK Das - Pervasive and mobile computing, 2007

• Ambient intelligence: Technologies, applications, and opportunities, DJ Cook, JC Augusto, VR Jakkula - Pervasive and Mobile Computing, 2009

• Intelligent environments: a manifesto, JC Augusto, V Callaghan, D Cook, A Kameas, I Satoh - Human-centric Computing and Information Sciences, 2013

• Ambient Intelligence: A Survey, F Sadri, ACM Comput. Surv., October 2011

2014/2015 Ambient intelligence: technology and design 53

Page 54: AmI 2015 - Definition of Ambient Intelligence

License

2014/2015 Ambient intelligence: technology and design 54

• These slides are distributed under a Creative Commons license “Attribution – NonCommercial – ShareAlike (CC BY-NC-SA) 3.0”

• You are free to: – Share — copy and redistribute the material in any medium or format – Adapt — remix, transform, and build upon the material – The licensor cannot revoke these freedoms as long as you follow the license

terms.

• Under the following terms: – Attribution — You must give appropriate credit, provide a link to the license,

and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.

– NonCommercial — You may not use the material for commercial purposes. – ShareAlike — If you remix, transform, or build upon the material, you must

distribute your contributions under the same license as the original. – No additional restrictions — You may not apply legal terms or technological

measures that legally restrict others from doing anything the license permits.

• http://creativecommons.org/licenses/by-nc-sa/3.0/