ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › uis-mcais ›...

40
1 Ubiquitous computing: a call for plasticity! Gaëlle Calvary Grenoble INP Laboratory of Informatics of Grenoble (LIG)

Upload: others

Post on 05-Jul-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

1

Ubiquitous computing: a call for plasticity!

Gaëlle Calvary Grenoble INP Laboratory of Informatics of Grenoble (LIG)

Page 2: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

Ubiquitous computing

2 © G. Calvary

Page 3: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

Ubiquitous computing

3 © G. Calvary [Lyytinen 2002]

Page 4: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

Ubiquitous computing

4 © G. Calvary [Lyytinen 2002]

Smart window, Samsung

Page 5: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

Ubiquitous computing

5 © G. Calvary [Lyytinen 2002]

[The Economist 2007]

Page 6: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

Ubiquitous computing

6 © G. Calvary [Lyytinen 2002]

Page 7: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

•  Display surfaces every where: fixed surfaces

Blue sky demonstrators

7 © G. Calvary

[Crowley 2004]

Page 8: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

Blue sky demonstrators

•  Display surfaces every where: mobile inert surfaces

8 © G. Calvary

[Borkowski 2004]

Page 9: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

•  Display surfaces every where: mobile mostly inert surfaces

Blue sky demonstrators

9 © G. Calvary [Mistry 2009]

Page 10: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

•  Display surfaces every where: mobile embodied surfaces

Blue sky demonstrators

10 © G. Calvary [Harrison 2010]

[Antaniac 2002]

Page 11: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

•  Display surfaces every where: flexible extensible surfaces

Blue sky demonstrators

11 © G. Calvary

Page 12: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

•  Display surfaces every where: composable surfaces

Blue sky demonstrators

12 © G. Calvary

[Hinckley 2003]

Page 13: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

•  Display surfaces every where: dynamic composition of entities

Blue sky demonstrators

13 © G. Calvary

[Rekimoto 2001]

Page 14: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

Question 1

•  What about the gap between research and real life?

14 © G. Calvary

Page 15: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

Exercice 1

•  Let’s imagine a valuable ubiquitous system …

15 © G. Calvary

Page 16: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

Research question

•  How to cope with this •  Diversity •  Variability •  Unforeseeability

•  Of both •  The context of use (user, platform, environment) •  The user’s goal?

16 © G. Calvary

Page 17: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

Approach 1: ad-hoc

•  To develop the systems on a case per case basis (ad-hoc manner) •  Development cost and maintenance: very high! •  Not consistent versions!

17 © G. Calvary

Page 18: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

Exercice 2: Let’s analyze the two systems

•  Google maps on PC vs on Ipad

18 © G. Calvary

Page 19: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

Approach 2: plasticity

•  Approach2: to improve the methods and tools in order to support •  Portability •  Reusability •  Modifiability •  Scalability in terms of

o  Computing resources o  Services o  Interaction techniques

=> Plasticity

19 © G. Calvary

Page 20: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

20

Plasticity: definition

•  Capacity of a User Interface (UI) •  To adapt •  To its context of use •  While preserving user-centered properties [Thevenin 99]

Page 21: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

Plasticity: example?

•  FlexClock [Grolaux 01]

21 © G. Calvary

Page 22: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

Plasticity: example?

•  FlexClock [Grolaux 01]

22

Nothing is or

is not plastic per se!

Page 23: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

Exercice 3

•  Let’s go for a series of questions •  1. Is adaptation plasticity? •  2. Is plasticity automatic? •  3. Is temperature part of the context of use?

23 © G. Calvary

Page 24: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

Plasticity: example

•  CamNote [Coutaz 2012]

24 © G. Calvary

Page 25: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

Plasticity: example

•  Sedan Bouillon [Coutaz 2012]

25 © G. Calvary

Page 26: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

26

Plasticity: definition

•  Context of use •  No general definition

« There is no context without context »

•  For plasticity « Any information that may inform the adaptation process » o  User o  Platform o  Environment

« Any information peripheral to the user’s task but that may have an impact on it! »

P. Brézillon

Adaptation … context of use

… properties

Page 27: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

27

Plasticity: definition

•  Adaptation

Style

Adaptation … context of use

… properties

Page 28: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

28

Plasticity: definition

•  Adaptation

Style

Interaction modality: < channel, device, language >

Adaptation … context of use

… properties

Page 29: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

29

Plasticity: definition

•  Adaptation

Style

Structure

Adaptation … context of use

… properties

Interaction modality: < channel, device, language >

Page 30: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

30

Plasticity: definition

•  Adaptation

Style

Remolding Structure

Task

Adaptation … context of use

… properties

Interaction modality: < channel, device, language >

Page 31: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

31

Plasticity: definition

•  Adaptation

Style

Remolding

Redistribution

Structure

Task

Partial/total migration

Adaptation … context of use

… properties

Remolding

Interaction modality: < channel, device, language >

Page 32: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

32

Plasticity: definition

•  Adaptation

Remolding

Redistribution

Style

Structure

Task

Partial/total migration

A large set of possibilities

Adaptation … context of use

… properties

Interaction modality: < channel, device, language >

Page 33: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

33

Plasticity: definition

•  User-centered properties •  Utility •  Usability •  … Worth [Cockton 2006]

•  + Inter-usability! [Karsenty 2005]

Adaptation … context of use

… properties

A difficult decision process

even at design time

Page 34: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

34

Context of use

User task Constant

Static & planned

Dynamic & planned

Unplanned

Plasticity: evolution of research

Page 35: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

35

Context of use

User task Constant

Static & planned

Dynamic & planned

Unplanned

Latent

Plasticity: evolution of research

Page 36: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

36

Context of use

User task Constant

Static & planned

Dynamic & planned

Unplanned

Latent Emergent

Plasticity: evolution of research

Page 37: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

37

Context of use

User task Constant

Static & planned

Dynamic & planned

Unplanned

Latent Emergent

Challenge

Plasticity: evolution of research

Page 38: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

References

•  Lyytinen, K., Yoo, Y.: Research commentary: the next wave of nomadic computing. Information Systems Research 13 (2002) 377-388

•  S. Borkowski, J. Letessier, and J.L. Crowley, Spatial Control of Interactive Surfaces in an Augmented Environment. ;In Proceedings of EHCI/DS-VIS. 2004, 228-244.

•  P. Mistry, P. Maes. SixthSense – A Wearable Gestural Interface. In the Proceedings of SIGGRAPH Asia 2009, Sketch. Yokohama, Japan. 2009

•  Antoniac, P., Pulli, P., Kuroda,T., Bendas, D., Hickey, S., Sasaki, H. Wireless User Perspectives in Europe: HandSmart Mediaphone Interface, Wireless Personal Communications, Vol. 22, pp. 161-174, 2002

38 © G. Calvary

Page 39: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

References

•  Harrison, C., Tan, D. Morris, D. 2010. Skinput: Appropriating the Body as an Input Surface. In Proceedings of the 28th Annual SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, April 10 - 15, 2010). CHI '10. ACM, New York, NY. 453-462

•  Hinckley, K., Ramos, G., Guimbretiere, F., Baudisch, P., and Smith, M. Synchronous Gestures for Multiple Persons and Computers. In Proc. UIST 2003 Symp. on User interface Software and Technology, Vancouver, Canada, pp. 149-158

•  Jun Rekimoto, Brygg Ullmer, Haruo Oba, Proceedings ofCHI '01, pp 269 - 276 ACM New York

•  Thevenin, D., Coutaz, J. Plasticity of User Interfaces: Framework and Research Agenda. In Proc. Interact’99, Edinburgh, Sasse, A., Johnson, C. Eds, IFIP IOS Press Publ., 1999, pp.110-117

39 © G. Calvary

Page 40: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth

References

•  Donatien Grolaux, Peter Van Roy, Jean Vanderdonckt: FlexClock, a Plastic Clock Written in Oz with the QTk toolkit, TAMODIA 2002: 135-142

•  J. Coutaz, G. Calvary HCI and Software Engineering for User Interface Plasticity (2012) In The Human Computer Handbook - Fundamentals, Evolving Technologies, and Emerging Applications, 3rd edition, Julie A. Jacko Ed.

•  Gilbert Cockton, Designing Worth is Worth Designing, NordiCHI 2006

•  Karsenty, L., Botherel, V. Analyse empirique de l’inter-utilisabilité d’un service multisupport Web et onferenc. Actes des Deuxièmes Journées Francophones sur l’Ubiquité et la Mobilité (UbiMob’05), Grenoble, 31 Mai-3 Juin 2005, ACM Press

40