jorgecardoso.eu [email protected] jorge c. … graphical user interface generation for web-based...

21
Dynamic graphical user interface generation for web-based public display applications Jorge C. S. Cardoso [email protected] http://jorgecardoso.eu PECCS 2014 - Lisbon, Portugal

Upload: vudieu

Post on 13-Mar-2018

219 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Dynamic graphical user interface generation for web-based public

display applications

Jorge C. S. [email protected]

http://jorgecardoso.eu

PECCS 2014 - Lisbon, Portugal

Page 2: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Open public display networks

● Open display networks○ "designed and implemented to be open to

applications and content from many sources and thus provide the foundation for work on a new global communications medium for information access and interaction”

Page 3: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Interaction toolkit for public displays

● Different displays may provide different interaction capabilities

● Developers need ○ Abstraction from interaction mechanisms○ Various high-level controls

Page 4: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

PuReWidgets

● High-level abstractions○ Widgets

● Independence from interaction mechanism○ SMS○ Email○ Touch○ Mobile interface○ QR code

Page 5: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Widgets

Page 6: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Interaction

Touch Text-based (SMS, email, …)

QR codes Mobile interface(Automatically generated)

Page 7: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Automatic GUI for mobile devices

● Discoverability○ Of apps○ Of apps’ features

● Interaction

● No extra effort for programmers of public display apps

Page 8: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Dynamic GUI generation approaches

● Downloadable UI code○ e.g., Jini Service UI

● Abstract UI description○ XWeb (Olsen et al., 2000)

● Hybrid○ Hodes & Katz, 1999 ○ iCrafter (Ponnekanti et al., 2001)

Author unknown. Taken from http://www.flixya.com/photo/2162704/BasikalBicycle

Page 9: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Dynamic GUI generation approaches

Author unknown. Taken from http://www.flixya.com/photo/2162704/BasikalBicycle

Page 10: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Dynamic GUI generation approaches

Author unknown. Taken from http://www.flixya.com/photo/2162704/BasikalBicycle

Page 11: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Dynamic GUI generation approaches

Author unknown. Taken from http://www.flixya.com/photo/2162704/BasikalBicycle

Page 12: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Dynamic GUI generation approaches

Author unknown. Taken from http://www.flixya.com/photo/2162704/BasikalBicycle

Page 13: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

PuReWidgets

Author unknown. Taken from http://www.flixya.com/photo/2162704/BasikalBicycle

Page 14: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Architecture

Page 15: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Widget structure

Author unknown. Taken from http://www.flixya.com/photo/2162704/BasikalBicycle

Interaction Manager Server

Page 16: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Rendering

Author unknown. Taken from http://www.flixya.com/photo/2162704/BasikalBicycle

Page 17: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Author unknown. Taken from http://www.flixya.com/photo/2162704/BasikalBicycle

Rendering

Page 18: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Preliminary evaluation

● Real-world deployment

Page 19: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Discussion

● Asynchronous interaction

● Rapidly changing widgets

Page 20: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Conclusion

● We need better tools to create applications for open display networks

○ Interaction abstractions

● PuReWidgets is just one attempt/model

Page 21: jorgecardoso.eu jorgecardoso@ieee.org Jorge C. … graphical user interface generation for web-based public display applications Jorge C. S. Cardoso jorgecardoso@ieee.org

Dynamic graphical user interface generation for web-based public

display applicationsJorge C. S. Cardoso

[email protected]

http://jorgecardoso.eu

PECCS 2014 - Lisbon, Portugal

Thank you!