bhojan anand‡, karthik thirugnanam†, jeena sebastian‡, pravein g. kannan‡, akhihebbal l....
TRANSCRIPT
![Page 1: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/1.jpg)
Adaptive Display Power Management for Mobile
GamesBhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡,
Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan†
‡ National University of Singapore (NUS) and † Singapore Management University (SMU)
1
![Page 2: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/2.jpg)
2
Problem: Display draws significant phone power
Key Challenge: No loss in end user experience
Key problem and Solution
Display45-50%
Network35-40%
CPU4-
15%Measured on HTC Magic while streaming a Youtube Video
![Page 3: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/3.jpg)
3
Dynamically adjust image brightness and LCD display backlight levels
50-70% display power savings with no significant user experience impact
Key problem and Solution
![Page 4: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/4.jpg)
Key problem and Solution
Background
System Design
Evaluation
Discussion/Future Work
4
Talk Outline
![Page 5: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/5.jpg)
LCD displays have two components:
Power consumed mostly by the Backlight Thus brightening the image, and darkening
the backlight saves power.
5
Background - LCD Displays
Backlight - Provides light, and consumes power
LCD Panel - Filters light based on image to be displayed
![Page 6: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/6.jpg)
Method 1: Naively dim the display◦ Creates visible artifacts (flicker, brightness loss,
etc)◦ Especially noticeable in high frame rate
applications
6
Background: Saving Display Power
![Page 7: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/7.jpg)
Method 2: Compensate with increased brightness● Linearly apply same transform to entire image
Leads to saturated images
7
Background: Saving Display Power
![Page 8: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/8.jpg)
Method 2: Compensate with increased brightness● Non linear approaches prevent saturation but cause
contrast loss
Our solution uses this approach intelligently
8
Background: Saving Display Power
![Page 9: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/9.jpg)
Gamma Correction, or gamma, is a tone mapping function used to brighten scenes● Very Low Saturation relative to linear● Low computational overhead
9
Non Linear Gamma Correction
Before After: Gamma 2
![Page 10: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/10.jpg)
10
Effect of Gamma on Image Quality
Original Image after Gamma Increase
(gamma=2)
Image after Gamma Increase andbacklight reduction
![Page 11: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/11.jpg)
Games are popular and resource intensive● Extremely high frame rates● Flicker and brightness changes very noticeable to users
We use two representative games● Quake III – Commercial First Person Shooting (FPS) game ● Planeshift – Massively Multiplayer Role Playing Game
(MMORPG)
11
Test Applications
![Page 12: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/12.jpg)
Key problem and Solution
Background
System Design
Evaluation
Discussion/Future Work
12
Talk Outline
![Page 13: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/13.jpg)
Ultimate goal: Save significant power with no loss in end user experience
Challenge 1: Understanding the relationship between the backlight intensity, gamma, image brightness, and the power consumed
Challenge 2: Identifying human thresholds for brightness compensation
Challenge 3: Dynamically applying the solution
13
System Design: Key Challenges
![Page 14: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/14.jpg)
Relationship found to be linear. No other major contributing factors
14
Challenge 1: Backlight vs Power
0 50 100 150 200 2500
20
40
60
80
100
Backlight Value
% D
isp
lay P
ow
er
Co
nsu
me
d
HTC Hero
Laptop (W500)
HTC Magic
![Page 15: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/15.jpg)
Perceived brightness kept constant Non linear compensation necessary Useful gamma range is 1 to 4
15
Challenge 1: Backlight vs Gamma
0 1 2 3 4 5 6 7 8 9 100
50
100
150
200
250
Gamma Value
Ba
cklig
ht
Va
lue
![Page 16: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/16.jpg)
Obtained via small user study●5 postgraduate students
Each user shown a range of images●Covered a full range of brightness
For each image, users had to boost gamma to obtain two quality thresholds ●Described in next slide●Tool provided boosted gamma at .1 intervals
with automatic backlight compensation
16
Challenge 2: Human Thresholds
![Page 17: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/17.jpg)
Conservative: Image quality comparable to original
Aggressive: Image quality is affected but acceptable
17
Challenge 2: Two Thresholds
0 2 4 6 8 10 12 141
2
3
4
5
Image Brightness Levels (Darkest to Brightest)
Ga
mm
a V
alu
e
![Page 18: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/18.jpg)
18
Challenge 3: Runtime Algorithm
Start
Calculate Average Brightness of last X Samples. Is there a change?
Mode + Brightness -> Gamma & Backlight Leave Settings as it is
Sleep Thread for Y ms
Yes No
![Page 19: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/19.jpg)
Test platform● Most of the evaluation on Laptop● Prototype Mobile implementation available
(demo)
Objective Analytical Experiments ● Power measurements ● Measured power saved in different modes
Perceived User Impact● Large scale user study (60 users) with Quake III● Measured perceived quality loss in different
modes 19
Evaluation Methodology
![Page 20: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/20.jpg)
0 2 4 6 8 10 120
1
2
3
4
5
Image Brightness Levels (Darkest to Brightest)
Ga
mm
a V
alu
e
20
Evaluation: Three Test Modes
Unmodified
Conservative
Aggressive
Two bounding modes tested but omitted for simplicity
![Page 21: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/21.jpg)
21
A recorded trace used to measure power
Evaluation: Power Savings
Default
Conservative
Aggressive
0 10 20 30 40 50 60 70 80
0
49
68
% Display Power Saved
![Page 22: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/22.jpg)
Large Scale User study● 60 Singapore Management University
undergrads.● 34 Male and 26 Female students with differing
background and game experiences
Participants trained on an unmodified version of the game● They then played the 3 different versions of the
game● Play order randomized with recalibration at every
step
22
User Study Methodology
![Page 23: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/23.jpg)
23
Users rated each version by 6 criteria● Covered different quality dimensions
Evaluation: User Study Results
Aggressive Conservative Default1
2
3
4
5
Ave
rag
e A
cce
pta
bilit
y
Sco
re
Bad
Good
Strongly Agree =
Strongly Disagree =
Neutral =
![Page 24: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/24.jpg)
Aggressive Conservative Default1
2
3
4
5
Avg
Acc
ep
tab
ilit
y S
core
Default
Conservative
Aggressive
0 10 20 30 40 50 60 70 80
% Display Power Saved
Difference between Aggressive and Conservative significant
24
Evaluation: Aggressive vs Conservative
![Page 25: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/25.jpg)
25
Aggressive Conservative Default1
2
3
4
5
Avg
Acc
ep
tab
ilit
y S
core
Default
Conservative
Aggressive
0 10 20 30 40 50 60 70 80
% Display Power Saved
Difference betw. Conservative and Default
Evaluation: Power vs Perception
![Page 26: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/26.jpg)
Conservative (Dynamic Conservative)● High Quality
Perceived quality comparable to default.● Significant Savings – 49%
Aggressive (Dynamic Aggressive)
● High Power Saving – 68%● Acceptable Quality
26
Evaluation: Conclusions
![Page 27: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/27.jpg)
OLED Displays● Do not use Backlight● Power consumption depends on displayed
content● Algorithm needs to be rethought
Other Limitations & Future Work● Initial User studies were small scale, and in a
controlled environment● Power Measurements could be more accurate,
esp for mobile phone● Evaluation of mobile implementation
27
Discussion
![Page 28: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/28.jpg)
General systematic approach to save power on LCD screens
Identified key parameters determining the quality vs power savings tradeoff
Implemented and tested with 60 end users
System achieves significant power savings with minimal overhead and quality loss
28
Contributions
![Page 29: Bhojan Anand‡, Karthik Thirugnanam†, Jeena Sebastian‡, Pravein G. Kannan‡, Akhihebbal L. Ananda‡, Mun Choon Chan‡ and Rajesh Krishna Balan† ‡ National](https://reader036.vdocuments.net/reader036/viewer/2022062407/56649d9d5503460f94a866eb/html5/thumbnails/29.jpg)
Thank youAny Questions
29