2-hop torrentsmell a distributed tracking algorithm name:raynor vliegendhart date:july 10, 2009...

26
2-Hop TorrentSmell A distributed tracking algorithm name: Raynor Vliegendhart date: July 10, 2009 event: Tribler Dev Meeting

Upload: sherman-banks

Post on 18-Jan-2018

221 views

Category:

Documents


0 download

DESCRIPTION

Central Tracker 3 Request Peerlist

TRANSCRIPT

Page 1: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

2-Hop TorrentSmellA distributed tracking algorithm

name: Raynor Vliegendhartdate: July 10, 2009event: Tribler Dev Meeting

Page 2: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

Research Question

How to decentralizePeer Discovery Functionality

with hooks forSecurityand Scalability?

2

Page 3: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

Central Tracker

3

Download SwarmCentral TrackerYou

Request

Peerlist

Page 4: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

Central Tracker

4

Peer List

Download SwarmCentral TrackerYou

Page 5: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

Download SwarmCentral TrackerYou

Central Tracker

5

Connect to Download Swarm

Page 6: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

Central Tracker

6

Keep in touch with tracker to

1.discover newpeers;

2.announceyour presence.

Download SwarmCentral Tracker

Page 7: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

Distributed Tracking

How do we…

• track peers in the swarm?

• find the distributed trackerstracking the swarm?

7

Page 8: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

Distributed Tracking Algorithm

How do we…

• track peers in the swarm? RePEX• find the distributed trackers

tracking the swarm? Extended

Remote Content Search

8

2-HopTorrentSmell

Page 9: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

Peer Exchange

9

Modern BitTorrent clients can exchange their neighbourhood sets throughPeer Exchange (PEX)

136.12.5.59

8.33.232.4

65.1.5.212

Page 10: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

Peer Exchange

10

Modern BitTorrent clients can exchange their neighbourhood sets throughPeer Exchange (PEX)

136.12.5.59

136.12.5.59

8.33.232.4

65.1.5.212

Page 11: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

Peer Exchange

11

Modern BitTorrent clients can exchange their neighbourhood sets throughPeer Exchange (PEX)

136.12.5.59

8.33.232.4

65.1.5.212

65.1.5.212, 8.33.232.4

Page 12: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

RePEX

• Reconnect to PEX peers encountered before.• Discover new and reliable peers.

Goal:Each peer has a local list of peers in the swarm.

12

Page 13: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

• Which swarms to track?

• How often? How many peers to store?

RePEX Research Questions

13

Page 14: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

• Which swarms to track? Last 25 downloads, since we have been in those swarms before

• How often? How many peers to store? Yet unknown;

Measurements needed to determine churn, online status, connectivity, etc.

RePEX Research Questions

14

Page 15: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

Remote Content SearchCurrently implemented

in Tribler:

15

“Obama”

“Obama”

“Obama”

Page 16: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

Remote Content Search

16

obama.mp3 SHA1

obama.avi SHA1

X

Tribler peers respond with matching torrent files

Page 17: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

Extended Remote Content Search+ RePEX

17

“Obama”

“Obama”

“Obama”

RePEX Tribler Peer

Page 18: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

Extended Remote Content Search+ RePEX

18

RePEX Tribler Peer

obama.mp3 SHA1

obama.avi SHA1

X

+136.12.5.59, 8.33.232.4, …

A RePEX peer includes swarm peers in the response

Page 19: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

2-Hop TorrentSmell

19

• Tribler peers already announce their download profile through BuddyCast

• We can use this to further extendRemote Content Search

Page 20: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

2-Hop TorrentSmell

20

“Obama”

212.13.153.124

The user issues a query as normally

Page 21: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

2-Hop TorrentSmell

21

212.13.153.124

The responding Tribler peer knows who has downloaded obama.avi

obama.avi SHA1+RePEX: 212.13.153.124, …

Page 22: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

2-Hop TorrentSmell

22

212.13.153.124

So the user can reissue the query to that peer

“Obama”

Page 23: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

2-Hop TorrentSmell

23

212.13.153.124

Finally, the RePEX peer responds with a list of swarm peers

obama.avi SHA1+Swarm: 136.12.5.59, 8.33.232.4, …

Page 24: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

Algorithm Summary

24

• 2 Hops needed using Extended RCS• RePEX used for tracking

Page 25: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

Research Questions Recap

• How often do we have to revisit swarms?

• How many peers should we store per swarm?

• What’s the churn rate?

• Etc…

25

Page 26: 2-Hop TorrentSmell A distributed tracking algorithm name:Raynor Vliegendhart date:July 10, 2009 event:Tribler Dev Meeting

Additional Research Questions

But also:

• Do peers lie about PEX capabilities?

• What’s the PEX “response time”of non-Tribler peers?

• <your input…?>

26