qprobe: detecting the bottleneck in cellular … · 2015. 12. 9. · independent, bottleneck...

39
QPROBE: DETECTING THE BOTTLENECK IN CELLULAR COMMUNICATION NIMANTHA BARANASURIYA NATIONAL UNIVERSITY OF SINGAPORE VISHNU NAVDA MICROSOFT RESEARCH INDIA VENKAT PADMANABHAN MICROSOFT RESEARCH INDIA SETH GILBERT NATIONAL UNIVERSITY OF SINGAPORE

Upload: others

Post on 19-Apr-2021

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

QPROBE: DETECTING THE BOTTLENECK IN

CELLULAR COMMUNICATION

NIMANTHA BARANASURIYANATIONAL UNIVERSITY OF SINGAPORE

VISHNU NAVDAMICROSOFT RESEARCH INDIA

VENKAT PADMANABHANMICROSOFT RESEARCH INDIA

SETH GILBERTNATIONAL UNIVERSITY OF SINGAPORE

Page 2: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations
Page 3: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations
Page 4: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations
Page 5: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

The Big Picture

Internet

CellularNetwork

YouTubeServer

Page 6: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Internet

CellularNetwork

YouTubeServer

The Big Picture

Page 7: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

The Big Picture

Internet

CellularNetwork

YouTubeServer

Page 8: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Where is the Bottleneck?

Page 9: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Wireless WAN

QProbe

Where is the Bottleneck?

Page 10: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Alternate connection (e.g., WiFi)

Downsize media content

Route around the bottleneck

Pick a different replica

Why Detect?

Wireless WAN

Page 11: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

PF Scheduler

Page 12: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

PF Scheduler

Packet scheduler in cellular base stations

Per-device vs FIFO queues

Fairness vs no notion of fairness

Existing tools are unusable

Page 13: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Internet

CellularNetwork

TCPServer

QXDM BackgroundDownloaders

Page 14: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Schedulingfrequencydecreaseswithincreasingloadatthebasestation

Effect of base station load on slot gaps

Page 15: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

QProbe Design

Page 16: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Internet

CellularNetwork

QProbeServer

1 2 ... 253t

QProbe PacketTrain

QProbeApp

UDP0BytePayload

Page 17: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Internet

CellularNetwork

QProbeServerQProbe

App

1 2 ... 253t

QProbe PacketTrain

1 2 ... 25

QProbe PacketTrain

3~t

Page 18: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Internet

CellularNetwork

QProbeServerQProbe

App

1 2 ... 253t

QProbe PacketTrain

1 2 25

QProbe PacketTrain

3 ...

Page 19: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Internet

CellularNetwork

QProbeServer

1 2 ... 253t

QProbe PacketTrain

Can also happen due tocross traffic in the WAN

1 2 25

QProbe PacketTrain

3 ...

QProbeApp

Page 20: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

#back-to-backpackets,itself,can’taccuratelydetectthebottlenecklocation.

#Back-to-back packets for Wireless and WAN bottlenecks

Wireless bottleneck WAN bottleneck

Page 21: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Internet

CellularNetwork

QProbeServer

1 ... 25

UDPMTUBytePayloadTTL=HopCount- 1

2t

Load Load...

QProbeApp

Page 22: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Withloadpackets,#back-to-backpacketscandetectwirelessbottlenecks.

#Back-to-back packets for Wireless and WAN bottlenecks

Wireless bottleneck WAN bottleneck

Page 23: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

1 ... 252t

Load Load

T

...

1 . .. 252Load Load...

ThinWANPipe

Stretch-factor =Received gaps

Sent gaps

Page 24: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Loadpacketsincreasesthestretch-factor.ThisallowsusdetectWANbottlenecks.

Stretch factors for Wireless and WAN bottlenecks

Wireless bottleneck WAN bottleneck

Page 25: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Wireless

Yes

QProbe Algorithm

No

Unclassified

Packetgapsatthereceiver

WAN

Yes

#back-to-back<

bb_threshold

#back-to-back>

bb_threshold

Stretch_factor>

sf_threshold

Yes No

Page 26: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Evaluation

Page 27: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Measurement Study

Evaluation

~500 runs for which the ground truth is known

Classification accuracy: 97.4%

Controlled Experiments

Classification model using a 10-cross validation decision tree

Page 28: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Measurement Study

Page 29: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

iPhone App implementation

15 well-provisioned Azure servers

51 PlanetLab servers

2 months of data

8116 runs of QProbe

Page 30: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

iPhone App implementation

15 well-provisioned Azure servers

51 PlanetLab servers

2 months of data

8116 runs of QProbe

Page 31: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

iPhone App implementation

15 well-provisioned Azure servers

51 PlanetLab servers

2 months of data

8116 runs of QProbe

Page 32: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

iPhone App implementation

15 well-provisioned Azure servers

51 PlanetLab servers

2 months of data

8116 runs of QProbe

Page 33: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

642 Users | 33 Countries | 51 ISPs

Page 34: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

Technology Runs Wireless WAN

3G 2573 215 (8.35%) 97 (3.77%)

LTE 5480 441 (8.05%) 837 (15.27%)

Summary of QProbe Runs

Page 35: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

QProbe Results (3G)

Ground Truth Wireless WAN

Wireless 187 161(86.1%) 26(13.9%)

WAN 76 13(17.11%) 63(82.89%)

3G Classified Runs: 84.3%

QProbe Classification

Page 36: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

QProbe Results (LTE)

Ground Truth Wireless WAN

Wireless 330 307(93.03%) 23(6.97%)

WAN 708 116(16.38%) 592(83.62%)

LTE Classified Runs: 81.2%

QProbe Classification

Page 37: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

QProbe: lightweight, platform independent, bottleneck detection technique

Uses less than 4KB of data and runs in ~700ms

Extensive evaluations show >85% bottleneck detection accuracy

Data and code available atwww.comp.nus.edu.sg/~nimantha/qprobe.html

Page 38: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations

http://cdn1.dottech.org/wp-content/uploads/2013/04/binary_tunnel_wallpaper.jpg?2b1f17http://www.clker.com/cliparts/P/C/k/o/0/k/router-down-hi.pnghttp://status.freeftpspace.net/assets/img/server.pnghttp://g-ec2.images-amazon.com/images/G/01/wireless/detail/nokia-lumia928-veriz-black-main-lg.jpghttp://yizhantech.com/wp-content/uploads/2014/01/Cell-towers.jpghttp://www.psdgraphics.com/wp-content/uploads/2013/01/round-rating-buttons.jpg

Image Credits

Page 39: QPROBE: DETECTING THE BOTTLENECK IN CELLULAR … · 2015. 12. 9. · independent, bottleneck detection technique Uses less than 4KB of data and runs in ~700ms Extensive evaluations