the organic grid : self organizing computation on a peer to peer network vikram negi
TRANSCRIPT
![Page 1: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/1.jpg)
The Organic Grid : Self Organizing Computation on a
Peer to Peer Network
Vikram Negi
![Page 2: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/2.jpg)
Distributed Computing
• Internet Computing– Desktop Grids : Scalability
• SETI@HOME, FOLDING@HOME
• Globus
![Page 3: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/3.jpg)
Comparison
![Page 4: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/4.jpg)
Problem Focus
• Schedule Independent Identical subtasks of an Independent Task Application with data in one location – NCBI nucleotide nucleotide sequence
comparison with BLAST tool.
![Page 5: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/5.jpg)
Approach
• Tree Based Adaptive approach– Machine configuration, connection bandwidths,
network topology (absent)– Start Friends Lists ( Build overlay on fly)– Biology inspired LALI Principle
• Positive feedback - Activation
• Negative feedback - Inhibition
![Page 6: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/6.jpg)
Approach
• Initially recruit Friends List– Encourage close nodes v/s distant nodes– Child nodes give passive feedback to measure
effective performance.– Continuous on fly adaptation
![Page 7: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/7.jpg)
Basic Design
• Computation Agent– Identifies a child machine.– Allocate a subtask(computational process) in
child machine(availability).
• Tree structure– Node seeks more subtasks from parent if free.– Node send results to parents
![Page 8: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/8.jpg)
Design
• Maintenance of child lists– Seek a balanced tree– Rank active children on response times..– Maintain a list of potential children
• Restructuring of the Overlay Network– Maintain a tree– Highest throughput closest to root.– Push low throughput closer to leaves.
![Page 9: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/9.jpg)
Design
• Size of Result Burst– To determine rank – Average over a observation
• Fault tolerance– Maintain list of ancestors– Maintain list of unfinished tasks
• Cycles in the Overlay Network– Check the list of ancestors.
![Page 10: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/10.jpg)
Design
• Termination– Root informs all actual, potential and former
nodes.
• Self adjustment of task list size– High performance machine request more tasks
• Prefetching– Give time and number estimates of future tasks
to parents.
![Page 11: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/11.jpg)
Experiment Set up
• 18 machine
• NCBI BLAST application
• Task : Match– 256KB(sequence) with 320 Data chunk 512KB
size – Subtask match each sequence to chunk
![Page 12: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/12.jpg)
Results
The time required for code and the first subtask to arrive at different nodes.
![Page 13: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/13.jpg)
Autonomic ?
![Page 14: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/14.jpg)
Child Propagation
![Page 15: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/15.jpg)
Burst Size
Higher Burst Size slows experiment
![Page 16: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/16.jpg)
Prefetch – Initial Task Size
Ramp up: Time req for subtasks to reach every single nodeRunning Time increases for > 1 prefetch tasks
![Page 17: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/17.jpg)
Self Adjustment
![Page 18: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/18.jpg)
Number of Children
• Good Initial Configurations no affect on running times.
![Page 19: The Organic Grid : Self Organizing Computation on a Peer to Peer Network Vikram Negi](https://reader035.vdocuments.net/reader035/viewer/2022062421/56649dc55503460f94ab9528/html5/thumbnails/19.jpg)
Discussion
• Autonomic ?
Can we learn from
• Self Organizing :– Bird fly, Fishes swim in pattern
• Biods : simulation