glive: the gradient overlay as a market maker for mesh ...€¦ · july 6, 2011 glive – amir h....

39
GLive – Amir H. Payberah July 6, 2011 1 GLive: The Gradient overlay as a market maker for mesh-based P2P live streaming Amir H. Payberah - Jim Dowling - Seif Haridi {amir, jdowling, seif}@sics.se

Upload: others

Post on 06-Mar-2021

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. PayberahJuly 6, 2011 1

GLive: The Gradient overlay as a market maker for mesh­based P2P live streaming

Amir H. Payberah ­ Jim Dowling ­ Seif Haridi{amir, jdowling, seif}@sics.se

Page 2: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. PayberahJuly 6, 2011 2

Introduction

Page 3: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

  GLive – Amir H. Payberah 3July 6, 2011

Media Streaming

● Media streaming is a multimedia that is sent over a network and played as it is being received by end users.

● Users do not need to wait to download all the media.

● It could be

Live Media Streaming

Video on Demand (VoD)

Page 4: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

  GLive – Amir H. Payberah 4July 6, 2011

Solutions for Media Streaming

Client­Server 

Server Farm

Peer­to­Peer

Page 5: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. Payberah 5July 6, 2011

Problem Description (1/4)

● Building a streaming overlay network, such that: Nodes with higher upload bandwidth are positioned closer to the media source.

Nodes with similar upload bandwidth become neighbours.

● Reduces: Average number of hops

Streaming disruptions

Playback latency

Similar upload bandwidth

Page 6: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. Payberah 6July 6, 2011

Problem Description (1/4)

● Building a streaming overlay network, such that: Nodes with higher upload bandwidth are positioned closer to the media source.

Nodes with similar upload bandwidth become neighbours.

● Reduces: Average number of hops

Streaming disruptions

Playback latency

Similar upload bandwidth

Page 7: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. Payberah 7July 6, 2011

Problem Description (2/4)

● Bounded download/upload connections.

● A parent­child relation.

Parent

Child

Download slot

Upload slot

Page 8: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. Payberah 8July 6, 2011

Problem Description (3/4)

● Problem: How to assign upload slots to download slots?

Parent

Child

Download slot

Upload slot

Page 9: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. Payberah 9July 6, 2011

Problem Description (4/4)

● This can be modelled as an assignment problem.

● Centralized solution:

Needs global knowledge.

Possible for small system sizes.

● Distributed market­based approach:

Inspired by auction algorithms.

Each node knows only a small number of nodes in the system (partial view).

Page 10: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. PayberahJuly 6, 2011 10

GLive

Page 11: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

  GLive – Amir H. Payberah 11July 6, 2011

Design Space

● What overlay topology is built for data dissemination?

● What algorithm is used for data dissemination?

● How to discover supplying nodes?

Page 12: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

  GLive – Amir H. Payberah 12July 6, 2011

Design Space

● What overlay topology is built for data dissemination?

Tree

Multiple­tree

Mesh

● What algorithm is used for data dissemination?

Push

Pull

Push­Pull

● How to discover supplying nodes?

Centralized

DHT

Gossip­based

...

Page 13: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

  GLive – Amir H. Payberah 13July 6, 2011

Design Space

● What overlay topology is built for data dissemination?

Tree

Multiple­tree

Mesh

● What algorithm is used for data dissemination?

Push

Pull

Push­Pull

● How to discover supplying nodes?

Centralized

DHT

Gossip­based

...

GLive

Page 14: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. PayberahJuly 6, 2011 14

Glive – Design Space

What overlay topology is built for data dissemination?What algorithm is used for data dissemination?

How to discover supplying nodes?

Page 15: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. Payberah 15July 6, 2011

Mesh Overlay

● Divide he main stream into a small blocks.

● Nodes are connected in a mesh­network.

1 2 3 4 5 6

1

3

5

2

46

Media Server

Page 16: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. Payberah 16July 6, 2011

The Market Model ­ Node Properties

● Currency: The total number of blocks uploaded to children during the last 10 seconds.

● Price: The price of a node that has an unused upload slot is zero, otherwise the node’s price equals the lowest currency of its already connected children.

● Cost: The length of its path to the root via its shortest path.

Currency = 3Price = 1Cost = 3

currency = 2 currency = 1 currency = 2

Source

Page 17: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. Payberah 17July 6, 2011

The Market Model – Child Side

Currency: 3Cost: 5

Q:  Price: 1      Cost: 4

N:  Price: 2      Cost: 6

M:  Price: 5      Cost: 4

X:  Price: 3      Cost: 5

P

P

Q

N

MX

Page 18: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. Payberah 18July 6, 2011

The Market Model – Child Side

Currency: 3Cost: 5

Q:  Price: 1      Cost: 4

N:  Price: 2      Cost: 6

M:  Price: 5      Cost: 4

X:  Price: 3      Cost: 5

P

P

Q

N

MX

Page 19: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. Payberah 19July 6, 2011

The Market Model – Parent Side

Q

Request

P

Price: 1

Currency: 2 Currency: 3 Currency: 3 Currency: 1

Page 20: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. Payberah 20July 6, 2011

The Market Model – Parent Side

Q

P

Page 21: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. PayberahJuly 6, 2011 21

Glive – Design Space

What overlay topology is built for data dissemination?What algorithm is used for data dissemination?

How to discover supplying nodes?

Page 22: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. Payberah 22July 6, 2011

Data Dissemination (1/2)

● Each parent node periodically sends its buffer map and its load to all its assigned children.

● A child node, pull the required blocks using the received information.

Page 23: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. Payberah 23July 6, 2011

Data Dissemination (2/2)

● Sliding window

In­order set Rare set

Page 24: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. PayberahJuly 6, 2011 24

Glive – Design Space

What overlay topology is built for data dissemination?What algorithm is used for data dissemination?

How to discover supplying nodes?

Page 25: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. Payberah 25July 6, 2011

Node Discovery (1/2)

● Naïve solution: nodes in partial views are selected randomly from all the nodes.

● Optimization: nodes use the Gradient overlay to construct and maintain their partial view of the system.

Random view 

Page 26: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. Payberah 26July 6, 2011

The Gradient Overlay

● The Gradient overlay is a class of P2P overlays that arranges nodes using a local utility function at each node, such that nodes are ordered in descending utility values away from a core of the highest utility nodes.

Page 27: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. Payberah 27July 6, 2011

Node Discovery (2/2)

Similar­view 

Finger 

● Rather than have nodes explore the whole system for better parents, the Gradient enables nodes to limit exploration to the set of nodes with asimilar number of upload slots.

Random view 

Page 28: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. PayberahJuly 6, 2011 28

Conclusion

Page 29: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

  GLive – Amir H. Payberah 29July 6, 2011

Conclusion

● GLive   P2P solution for live media streaming.→

● Distributed market model

● Design space:

Overlay topology: Mesh

Data dissemination: Pull

Discover supplying nodes: Gossip – Gradient

Page 30: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

GLive – Amir H. PayberahJuly 6, 2011 30

Question?

Page 31: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

  GLive – Amir H. Payberah 31July 6, 2011

Experiment Setup

● Using the Kompics as a simulator platform.

● King dataset is used to model the latencies between nodes.

● The streaming rate to 512 Kbps, and it is split into 8 stripes (in sepidar). The stream/stripe is divided into a sequence of 16 Kb blocks.

● Nodes start playing the media after buffering it for 15 seconds.

● The number of upload slots for the non­root nodes is picked randomly from 1 to 10.

bandwidths from 128 Kbps to 1.25 Mbps.

● Compare with NewCoolstreaming.

Page 32: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

  GLive – Amir H. Payberah 32July 6, 2011

Playback Continuity

Page 33: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

  GLive – Amir H. Payberah 33July 6, 2011

Playback Latency

Page 34: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

  GLive – Amir H. Payberah 34July 6, 2011

Gradient overlay vs. Random overlay

Page 35: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

  GLive – Amir H. Payberah 35July 6, 2011

Buffering Time

Page 36: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

  GLive – Amir H. Payberah 36July 6, 2011

Playback Latency

Page 37: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

  GLive – Amir H. Payberah 37July 6, 2011

Gradient overlay vs. Random overlay

Page 38: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

  GLive – Amir H. Payberah 38July 6, 2011

Buffering Time

Page 39: GLive: The Gradient overlay as a market maker for mesh ...€¦ · July 6, 2011 GLive – Amir H. Payberah 3 Media Streaming Media streaming is a multimedia that is sent over a network

  GLive – Amir H. Payberah 39July 6, 2011

Fairness and Connectivity in Failure