the foundations of ubiquitous computing

IntelligentIntelligent SSpacepace國立台灣大學資訊工程研究所智慧型空間實驗室國立台灣大學資訊工程研究所智慧型空間實驗室

The Foundations of Ubiquitous The Foundations of Ubiquitous ComputingComputing

AuthorAuthor

Mark WeiserMark Weiser

Xerox PARC (Palo Alto Research Center)Xerox PARC (Palo Alto Research Center)

ReporterReporter

Chun-Feng LiaoChun-Feng Liao

Mar 25,2005Mar 25,2005


Trilogy of WeiserTrilogy of Weiser

Mark Weiser, Mark Weiser, The Computer for the 21th CenturThe Computer for the 21th Centuryy, Scientific American, September 1991. , Scientific American, September 1991.

Mark Weiser, Mark Weiser, Some computer science issues in Some computer science issues in ubiquitous computingubiquitous computing, Communications of the A, Communications of the ACM, 36(7):75-85, July 1993. CM, 36(7):75-85, July 1993.

Mark Weiser, John S. Brown, The Coming Age oMark Weiser, John S. Brown, The Coming Age of Calm Technology, 1996. f Calm Technology, 1996.

Int’l Conference on UbiComp was first hold on 1999.Int’l Conference on UbiComp was first hold on 1999.

UbiComp 2005: Sep 11-14,2005. Tokyo, Japan.UbiComp 2005: Sep 11-14,2005. Tokyo, Japan.


Significance of Significance of “The Computer for the 21th “The Computer for the 21th Century”Century”

This is not a research paper.This is not a research paper. The article is the The article is the origin of UbiComporigin of UbiComp.. Heavily cited by papers in this area.Heavily cited by papers in this area. Several revolutionary concepts of HCI come froSeveral revolutionary concepts of HCI come fro

m Xerox PARC. (ex: Windows, Desktop)m Xerox PARC. (ex: Windows, Desktop)

PARC = Palo Alto Research CenterPARC = Palo Alto Research Center

UbiComp = Ubiquitous Computing, some researchers also call it Pervasive CoUbiComp = Ubiquitous Computing, some researchers also call it Pervasive Computing.mputing.


What can we learn from this article?What can we learn from this article?

Concepts and DefinitionsConcepts and Definitions of UbiComp. of UbiComp. VisionsVisions of UbiComp. of UbiComp. ScenariosScenarios of UbiComp of UbiComp(not reported in this seminar).(not reported in this seminar).

ChallengesChallenges of UbiComp. of UbiComp.

NOTE: Keep in mind that this article was wrote on 1991. NOTE: Keep in mind that this article was wrote on 1991.


How Ubicomp is Related to Our ResearchHow Ubicomp is Related to Our Research

Yellow: Yellow: Our research area.Our research area. Gray: Gray: Related research area.Related research area.

: Contained by..: Contained by..

: Supports.. : Supports..

HCI / VR

UbiComp

Distributed Computing

Embedded System

E Home

Context-aware Computing

Ontology and Semantic Web

Agent

Sensing Technologies

Mobile Computing


The Evolution PathThe Evolution Path

Distributed Computing (PC + networks)Distributed Computing (PC + networks) Challenges: performance, scalability, server or network

failures, open networks, performance,

Mobile computing (Mobile devices + wireless Mobile computing (Mobile devices + wireless networks)networks) Challenges: resource-limitation, unpredictable

network, power

Ubicomp (Everyday objects + wireless networks)Ubicomp (Everyday objects + wireless networks) Challenges: understanding user intention,

heterogeneous ubicomp environments, invisible user experience, more ..

Source: Dr. Chu’s Lecture I in the Ubicomp course 2005


AgendaAgenda

IntroductionIntroduction Key issues of UbiCompKey issues of UbiComp

Location and size Privacy

Requirements of UbiCompRequirements of UbiComp Hardware Software

ConclusionConclusion Possible Researching DirectionsPossible Researching Directions


The most profound technologies are those that disThe most profound technologies are those that disappear.appear.

Mark Weiser, “The Computer for the 21Mark Weiser, “The Computer for the 21stst Century”. Century”.

Profound: Profound: 意義深遠的。意義深遠的。


Computer that DisappearedComputer that Disappeared

Weiser and his colleagues in PARC think that thWeiser and his colleagues in PARC think that the idea of e idea of a “Personal” computer itself is misplacea “Personal” computer itself is misplacedd..

““Disappearance” is a fundamental consequence Disappearance” is a fundamental consequence of human psychology.of human psychology.

Ex: Writing, electrical motors, silicon-based deviEx: Writing, electrical motors, silicon-based devices...ces...


VR versus EV (Embodied Virtuality)VR versus EV (Embodied Virtuality)

““Perhaps most Perhaps most diametrically opposeddiametrically opposed to our to our vision is the notion of ‘virtual reality’ ”, which vision is the notion of ‘virtual reality’ ”, which attempts to make a world inside the computerattempts to make a world inside the computer..

Embodied Virtuality: the process of drawing Embodied Virtuality: the process of drawing computers out of their electronic shells.computers out of their electronic shells.

VR: 將現實世界放到虛擬世界中

EV: 將電腦中的數位資訊帶入現實生活

Embodied: Embodied: 具體化具體化

Virtual World Real World


Ubicomp v.s AgentsUbicomp v.s Agents

““Ubicomp is exploring quite different ground Ubicomp is exploring quite different ground from personal digital assistants or autonomous from personal digital assistants or autonomous agents” [Weiser93]agents” [Weiser93]

Object

黃老

Agent

Object

黃老

Agent(Invisible)

Traditional Agent

I want to move that object

Yes sir, I will do it for you

為什麼都不用花力氣 ?

因為我在暗中幫你推…

Ubicomp Agent

Invisibility is critical in Ubicomp !!


Research Methods of UbicompResearch Methods of Ubicomp

Standard experimental Computer Science:Standard experimental Computer Science: Construct working prototype Evaluate working prototype in everyday use Find out real vs. imaginary issues


Key Issues of UbiCompKey Issues of UbiComp

LocationLocation and and ScaleScale Location: ubiquitous computers must know Location: ubiquitous computers must know

where the are in order to provide appropriate where the are in order to provide appropriate services.services.

Scale: tabs, pads and boards.Scale: tabs, pads and boards.

Note: The Concept of “Location” was extended to “Context” Note: The Concept of “Location” was extended to “Context” by Brown et, al.(in PARC) in 1994, by Brown et, al.(in PARC) in 1994, published in special issue on “Context in Design” in Journal of HCI.published in special issue on “Context in Design” in Journal of HCI.


TabTab

Clip-on computers roughly the size of an Clip-on computers roughly the size of an employee ID card.employee ID card.

Doors open only to the right badge wearer.Doors open only to the right badge wearer. Rooms greet people by name.Rooms greet people by name.


PadPad

Pads are not portable computersPads are not portable computers The pad that must be carried from place to place is a

failure. Pads are intended to be “scrap computers” that can

be grabbed and used anywhere. Pads may even be as small and light as actual paper Many electronic pads around on the desk, just as you

spread out papers.


BoardsBoards

Multipurpose:Multipurpose: In home: video screens and bulletin boards. In office: bulletin board, white boards or flip charts. Book case: download texts to a pad or tab.

Interacting with electronic chalk.Interacting with electronic chalk.


Requirements of Ubicomp: Requirements of Ubicomp: InvisibilityInvisibility

Cheap, low-power computersCheap, low-power computers DisplayDisplay

Large display: must be viewable form arm’s length as well as from across a room.

High-speed wireless networkHigh-speed wireless network Software systemsSoftware systems

Software architecture : Microkernel architectural Middleware


Zero ConfigurationsZero Configurations

In Ubicomp environment, local devices come anIn Ubicomp environment, local devices come and god go

The context in an environment may change freqThe context in an environment may change frequently.uently.

New software for new devices may be needed at New software for new devices may be needed at any time.any time.

MicrokernelMicrokernel architecture may offer an solution. architecture may offer an solution. (CMU Aura Project and Vrige Univ. at Amsterda(CMU Aura Project and Vrige Univ. at Amsterdam)m)


Microkernel Architectural PatternMicrokernel Architectural Pattern

Infrastructure

Application


Software Architectures of Context-aware Software Architectures of Context-aware ComputingComputing

Blackboard Architectural Pattern (POSA) Blackboard architecture for context-aware computing(Stanford).

Context Widget architecture (Georgia Tech)

Microkernel (PARC,CMU-Aura)Microkernel Architectural Pattern (POSA)

Service-oriented Architecture (Singapore Univ.,IEEE Computer 2004)

MVC Architectural Pattern (POSA)

Ontology, Semantic Web

Agent-orient, Mobile Agent, Multi-agent

Pipeline / Filter (POSA)


Core Idea of BlackboardCore Idea of Blackboard

Blackboard

Expert A

Expert B

Expert C

Moderator

13

Predefined Heuristic Function

2

4

(又稱 Knowledge Sources)

(又稱 Control)


Context Server/Context Widget Context Server/Context Widget ArchitectureArchitecture

Camera Laser Ranger

Vision Context Widget Voice Context Widget

Speech Recognizer

Context Server for John Context Server for Television

Env Context Widget

Thermometer

“每一個 Entity會有一個 Context Server”


ConclusionConclusion

This article provides the vision and challenges foThis article provides the vision and challenges for UbiComp.r UbiComp.

Tabs, pads and boards are just the beginning of Tabs, pads and boards are just the beginning of UbiComp.UbiComp. The real power comes from the interaction of all of the

m. The hundreds of processors have no “user interface” l

ike mouse or windows, just a pleasant and effective “place” to get things done.


Possible Researching TopicsPossible Researching Topics

A pattern system for context-aware computing.A pattern system for context-aware computing. Comparing each architectural design and identifying

their trade-offs.

Distributed computing issues on context-aware Distributed computing issues on context-aware computingcomputing Identifying distributed computing issues and solve

with enhanced distributed computing algorithms. Synchronization Mutual Exclusions Leader Election


Possible Researching TopicsPossible Researching Topics

Cross-cutting concerns of UbiCompCross-cutting concerns of UbiComp Security, Privacy, Transaction, Synchronization, Servi

ce Lookup… Aspect-oriented middleware for UbiComp.

UbiComp and the Semantic WebUbiComp and the Semantic Web Context representation with RDF.

Home robotHome robot


BackupBackup


Privacy IssuesPrivacy Issues

How to avoid inappropriate use of personal How to avoid inappropriate use of personal information.information.

Morris’s RuleMorris’s Rule Build computer system to have the same privacy

safeguards as the real world, but no more, so ethical conventions will be automatically applied.


ScenarioScenario

Coffee is ready before the clock alarm.Coffee is ready before the clock alarm. Privacy configurations, adaptive video data-rate.Privacy configurations, adaptive video data-rate. Tangible media(newspaper, circle to transmit).Tangible media(newspaper, circle to transmit). Finding things.Finding things. Check traffic in car.Check traffic in car. Finding parking lot.Finding parking lot. Greeting according to one’s badges.Greeting according to one’s badges. Virtual office / conferenceVirtual office / conference More…More…


BlackboardBlackboard

Advantages of BB:Advantages of BB: Support for changeability and maintainability. Reusable knowledge sources. Support for fault tolerance.

Disadvantages of BB:Disadvantages of BB: Difficulty of testing Low efficiency High development effort No support for parallelism


Context Widget Context Widget Acquiring a certain type of context information, Acquiring a certain type of context information,

make this information available in a general make this information available in a general manner.manner.

Obtain the context without having to worry about Obtain the context without having to worry about how the context was sensed.how the context was sensed.


Context ServerContext Server Gather and manage context about a single Gather and manage context about a single

entity.entity. Behave as a proxy to the context for Behave as a proxy to the context for

applications.applications. Support 4 primary context types, also need to Support 4 primary context types, also need to

support the retrieving of secondary context support the retrieving of secondary context information.information.

the foundations of ubiquitous computing

Documents