community-driven adaptation: automatic content adaptation in pervasive environments

26
Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments Iqbal Mohomed, Alvin Chin, Jim Cai, Eyal de Lara Department of Computer Science University of Toronto WMCSA 2004: Session V - Pervasive Technologies

Upload: jonah-duke

Post on 03-Jan-2016

35 views

Category:

Documents


0 download

DESCRIPTION

Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments. Iqbal Mohomed, Alvin Chin, Jim Cai, Eyal de Lara Department of Computer Science University of Toronto. WMCSA 2004: Session V - Pervasive Technologies. One Size Does Not Fit All!. Useful Customizations. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Community-Driven Adaptation: Automatic Content Adaptation in

Pervasive Environments

Iqbal Mohomed, Alvin Chin, Jim Cai, Eyal de LaraDepartment of Computer Science

University of Toronto

WMCSA 2004: Session V - Pervasive Technologies

Page 2: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

One Size Does Not Fit All!

Page 3: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Useful Customizations

• Plethora of techniques for transforming content • Modality• Fidelity• Layout• Summarization

Distinct content types usually benefit from different transformations

Most transformations have configuration parameters that can be varied

How do we choose?

Page 4: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Content Adaptation

• Manual Adaptation• High human cost, not scalable, difficult

to maintain consistency and coherence• Automatic Adaptation

• Rule-based and Constraint-based techniques are the state-of-the-art

Page 5: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

• Specifying per-object, per-device, per-task rules is too much work• No different than manual adaptation

• In practice, a small set of global rules are utilized

• Global rules are insufficient because they are content and task agnostic

Limitations of Rules and Constraints

Fidelity sufficient to distinguish which object is a cell phone but not determine manufacturer visually

Page 6: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Core Issues

• Need rule for every object, device, task• Computer alone can't do it• Human Designer can, but it is costly and

does not scale

• Idea:• Let user make corrections• Apply decision to like-minded users

Page 7: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Community-Driven Adaptation (CDA)

• Group users into communities based on adaptation requirements

• System makes initial prediction as to how to adapt content (use rules and constraints)

• Let user fix adaptation decisions• Feedback mechanism

• System learns from user feedback• Improve adaptation prediction for future

accesses by member of community

Page 8: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Prediction

Mobile 1

How it Works

Application CDAProxy

Server 2

Server 1Improve Fidelity

Mobile 2

Application

Page 9: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Advantages

• User Empowerment: Can fix bad adaptation decisions

• Minimal Inconvenience: Burden of feedback is spread over entire community and is very low for each member • User does not have to provide feedback in

every interaction

Page 10: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Research Issues

• How good are CDA predictions?• How do we classify users into communities?

• How large of a community do we need?• What interfaces would encourage users to

provide feedback?• Types of adaptations supported by this

technique?

Page 11: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Experimental Evaluation

• How do we quantify performance?• Extent to which predictions meet users’ adaptation

requirements?

• Approach:• Step 1: User study

• Collect traces capturing the adaptation desired by actual users for realistic tasks and content

• Step 2: Simulation• Compare predictions to values in trace

Page 12: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Experimental Setup• 1 application• 1 kind of adaptation• 1 data type• 1 adaptation method

• 1 community

• Web browsing• Fidelity• Images• Progressive JPEG

compression

• Same device • Laptop at 56Kbps

• Same content• Same tasks

Page 13: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Trace Gathering System

Goal: Capture the desired fidelity level of a user for every image in a task

• Transcode images into progressive JPEG• Provide only 10% on initial page load• IE plug-in enables users to click on an image to request fidelity

refinements• Each click increases fidelity by 10%• Add request to trace

Proxy

ServerClient

Page 14: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Web Sites and TasksSites TasksCar show Find cars with license plates

E-Store Buy a PDA, Camera and Aibo based on visual features

UofT Map Determine name of all buildings between main library and subway

Goal: finish task as fast as possible (minimize clicks)

Traces capture minimum fidelity level that users’ consider sufficient for the task at hand.

Page 15: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Sample Web Site and Task Screenshot

Car show application

Lowest fidelity Improved fidelity

Page 16: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Trace Characteristics• 28 users

• 77 different full-sized images

• All tasks can be performed with images available at Fidelity 4 (3 clicks)

• Average data loaded by users for all 3 tasks• 790 KB

• 32 images are never clicked by any user

Page 17: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Evaluation Metrics

Fidelity Level Selected By

User

Fidelity Level Predicted by

Policy

Image 1 3 3

Image 2 2 3

Image 3 4 2

Correct!

OvershootExtra Data

UndershootExtra Clicks

Page 18: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Examples of Policies

• Rule-based• Fixed1, Fixed2, Fixed4• Level based on file size

• CDA • MAX, AVG, MEDIAN, MODE• AVG3, MAX3

• Limited window• UPPER60

• Fidelity that covers 60% of requests

Page 19: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

CDA User Ordering

• In practice, almost all users will access proxy after some history has been accumulated

• Fix each user to be the last one • Randomize ordering of previous users• Average performance among all user-ordering

combinations

Page 20: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Results

0.00

0.22

0.891.04

0.020.04

0.24

0.68

0.00

0.20

0.40

0.60

0.80

1.00

1.20

1.40

fixed10 fixed20 fixed40 avg med max2 upper60 max

Ex

tra

Dat

a (K

B).

No

rmal

ized

by

Av

g D

ata

Lo

aded

(7

90

KB

)

1.11.9

9.6

2.3

16.9

30.5

16.8 14.5

0

10

20

30

40

50

fixed10 fixed20 fixed40 avg med max2 upper60 max

Ext

ra C

licks

Page 21: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Results

0.00

0.22

0.891.04

0.020.04

0.24

0.68

0.00

0.20

0.40

0.60

0.80

1.00

1.20

1.40

fixed10 fixed20 fixed40 avg med max2 upper60 max

Ex

tra

Dat

a (K

B).

No

rmal

ized

by

Av

g D

ata

Lo

aded

(7

90

KB

)

1.11.9

9.6

2.3

16.9

30.5

16.8 14.5

0

10

20

30

40

50

fixed10 fixed20 fixed40 avg med max2 upper60 max

Ext

ra C

licks

Page 22: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Results

0.00

0.22

0.891.04

0.020.04

0.24

0.68

0.00

0.20

0.40

0.60

0.80

1.00

1.20

1.40

fixed10 fixed20 fixed40 avg med max2 upper60 max

Ex

tra

Dat

a (K

B).

No

rmal

ized

by

Av

g D

ata

Lo

aded

(7

90

KB

)

1.11.9

9.6

2.3

16.9

30.5

16.8 14.5

0

10

20

30

40

50

fixed10 fixed20 fixed40 avg med max2 upper60 max

Ext

ra C

licks

Page 23: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

CDA Policy Convergence

0

50

100

150

200

250

User Location in Ordering

Ext

ra D

ata

(KB

) max2 med mode_high avg

Policies converge quickly Communities can be small

Page 24: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Size vs. Fidelity

0

0.5

1

1.5

2

2.5

3

3.5

4

4.5

Avg

use

r cl

icks

Car Show Estore Map (99.3k-547.8k) (4.13k-321.7k) (8.412k -24.04k)

Thumbnails

Regular images

No correlation between image size and optimal fidelity Size-based general rules will not work

Page 25: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Summary

• CDA• Groups users into communities• Improves adaptation based on user feedback

• CDA outperforms rule-based adaptation90% less bandwidth wastage40% less extra clicks

Page 26: Community-Driven Adaptation: Automatic Content Adaptation in Pervasive Environments

Questions and Comments

Iqbal [email protected]

www.cs.toronto.edu/~iq