Research ValueResearch Value of Smart Space of Smart Space

Outline

• Smart Space

• Smart Classroom

• Application

Ideal of Pervasive Computing

Trying to conceive a new way of thinking about computers in the world, one that takes into account the natural human environment and allows the computers themselves to vanish into the background

Living SpaceLiving Space

Cyber SpaceCyber Space

Sensor Network, NGI/NGN (Networking)

Pervasive Software Infrastructure (Computing)

Rich Media Natural HCI (Interaction)

Smart Spaces & Mobile Devices (Device)

Key characteristics of Percomp systems

• Physical integration

• Involve some integration between computing nodes and the physical world

• Ubicomp takes place in discrete environment

• A boundary specify the environment’s scope

• Physical integration• Spontaneous interoperation

• Components must spontaneously interoperate in changing the environment

Key characteristics of Percomp systems

Smart Space as research testbed

Smart Space are work environments with embedded computers, information appliances, and multi-modal sensors allowing people to perform tasks efficiently by offering unprecedented levels of access to information and assistance from computers

Typical system with the characteristics of pervasive computing

Scalable: Room 、 Building 、 Community 、 City

Inter-module coordinationCoordination Model, Multi-Agent, Communication Language

Natural Human Computer InterfaceTangible Interfaces, Sensors, Perceptual technology

Eternity & InvisibilityLoose coupling, Embedded technology

IndividualSmart Space

Cyber ForagingEnvironment Discovery, Resource Management

Surrogate, Virtual Service, Proxies,Hybrid Communication Method Support

OpenSmart Space

Inter-Space Operation

Inter-Space Resource Management

Hierarchy Space Organization

SmartCommunity

Smart Space as research testbed

Smart Space as research testbed

Typical system with the characteristics of pervasive computing

Testbed for Percomp researches on:• New paradigm of HCI

Natural UI based on context-awareness• Software Infrastructure

Computing service for interoperation

Natural Untethered User Experience

Voice Communication via MA Pen/Touch Interaction

Laser Pointer Interaction Context-aware Interaction

Spontaneous Interoperation

Outline

• Smart Space

• Smart Classroom

• Application

Smart Classroom

Experience Record of the classroom

Realtime Distributed Multimedia Communication

Telepresence of Remote Students

The Smart Classroom Projectan augmented classroom where a teacher can instruct remote and local students at the same time and in a similar fashion.

Http://media.cs.tsinghua.edu.cn/~pervasive

Tele-presence

Interface of Remote Clients

Student Board in the Classroom

Smart Cameraman

Overview

Showing a ModelWriting on the Board

Invisibility: Natural UI

• Pen-based writing• Highlight remote student by laser pointer and voice command

Your Name, Please.

I am Weikai

Virtual Assistant

A camera for Face-Recognition is

installed behind themirror

• Speech-capable virtual assistant

• Biometrics-based login

Go aheadThe remote student'simage is highlightedas the teacher aimsthe laser pointer at it

Experience Capture

• Auto-record the synchronized multiple data streams– Lecture on Mediaboard and

its presentation progress

– Writing and pointing on the borad

– Live Audio/Video

– Interaction with remote students

• Post-edit

• Playback

记录的板书

播放控制界面

记录的视频记录的讲义

记录的事件的时间轴显示

记录的视频

记录的讲义

记录的事件的属性编辑框

记录的板书

Hardware Infrastructure for Smart Classroom

PC

PC

PC PCPC

PC PC PC

主机共享器

100M以太网

鼠标 键盘

IEEE 802.11无线AP

VGA 信号线

连到每台主机的VGA口/键盘口 /鼠标口

StudentBoard投影机

MediaBoard投影机

SmartBoard设备

Sm

artBoard接

口线（串口）

教室现场视频摄像头组

教室事件 /状态识别摄像头组

所有连接摄像头的主机上安装有视频

采集卡

无线MIC接收器

音频分配器

手持设备

教师用无线MIC

学生用无线MIC

混音器

连到主机的音频输出口

连到主机的音频输入口

扬声器

Smart Platform: software infrastructure for smart space

Loose coupling: Publish-Subscribe inter-module coordination model Extensible: a multi-agent system abstraction model Distinguishing two classes of communications with different QoS

requirements, the message-oriented and the stream-oriented Support for heterogeneous platforms and programming languages:

wire protocol Lightweight

Outline

• Smart Space

• Smart Classroom

• Application

学习规划学习规划

质量管理质量管理

教学跟踪教学跟踪教学资源教学资源

课件 评估

资资源源库库

网上教室 作业E-mailBBS Chat

个人学习 小组讨论 网上实验室 数字图书馆

注册登记注册登记

学业证书学业证书

管理工作流

教学工作流

eLearning Platform

eLearning Platform

• deployed in Tsinghua Continuing Education School (http://www.itsinghua.edu.cn)

• regularly used by more than 20 thousand of users all over China

• 300+ online curriculum, ranging from Mathematics, Computer Technology, English to Law, Art Design and Economics

• Smart Classroom providing real time online collaboration over Internet

Application

A Classroom @ THU Client @ remote Students

chat

Medianoard

App manager Classroom video

Course: Ergonomics

Application

Course: Sign Design

Conclusion

Experiments show the Smart Classroom system can facilitate teacher and students understanding and communicating with each other in a classroom, as well as distantly via Internet.

Pervasive computing will be a fertile source of challenging research problems in computer systems for many years to come.