Distributed ComputingWhat, why, and how

Prepared by arinto <arinto (at) gmail (dot) com>

Outline● What are DCs?

● DC in our daily life○ Dropbox○ Google Drive○ Spotify○ Parallel Processing

● DC in Indonesia○ Energy○ e-Government

What are DCs?

Store and compute!

Normal people usage: few hundreds of GB of data, browsing, email...

Web companies and scientific communities : Petabytes of data!

Petabytes.. so what??!!a MS Word document : 40 KB = 40 kilobytes

1 megabyte = 2^10 kilobytes = 1024 kilobytes

1 gigabyte = 2^10 megabytes = 1024*1024 kilobytes > 1000000 kilobytes

1 terabyte = 2^10 gigabytes = 1024 gigabytes

1 petabyte = 2^10 terabytes = 1024*1024 gigabytes > 1000000 gigabytes > 1000000000000 kilobytes

Google processed 24 Petabytes of data everyday in 2009!

Many as one

Resource Sharing

Fault Tolerance

Scalability

Scalability

Sum them up!● Many as one a.k.a transparent

○ User view them as a whole rather than a collection of cooperating components

● Resource sharing○ Same set of resource shared by multiple users

● Fault tolerance○ Still working despite failing

● Scalability○ System or user can increase easily

DropboxStore and retrieve data

How do we transfer data ? Thumbdrive

Backup? External HDD

Stolen?

Crashed?

X

● Simple access from anywhere● Simple sharing● Back up

Dropbox

Dropbox

X

● Simple access from anywhere● Simple sharing● Back up

Dropbox

XDataCenter

Google Drive

Write, store and read documents

Collaboration ? Send back and forth.. MyDocuv223.doc

Share? Send back and forth

Free ? No!!!!!

Can't access document from other device easily

Google Drive

Access your data from anywhere anytime

SpotifyDownload, store and listen music

How do we get the music ? Download!

Legal? No!!!

Clean? No!!!!!

Quality? Baddd :(

Can't access playlist from other device easily

Spotify

Vision: Music service easier and better than illegal music!

Spotify

Vision: Music service easier and better than illegal music!

Spotify

Vision: Music service easier and better than illegal music!

Peer-to-peer with master backup!

Parallel Processinga MS Word document : 40 KB = 40 kilobytes

Google processed 24 Petabytes of data everyday in 2009!

Estimated total document = 24*1000000000000 kilobytes / 40 kilobytes = 600000000000

If 1 docu needs 0.001 second, we need= 600000000 seconds = 10000000 hours = 416667 days = 1141.5 years!!!!

Solution: parallelize!!

DC in Indonesia1. Smart Grid

a. Communication between Power Sourceb. Monitoring and providing appropriate response

2. Smart City and Internet of Thingsa. Building Managementb. Interoperability

3. e-Governmenta. Open Datab. Online government service

Smart Grid

Ref: http://www.smartgrid.epri.com/Demo.aspx

Computing infrastructure, which is distributed!

Internet of Things (IoT)Nest Smart-Termostat● Learn our behavior, adjust temperature accordingly● Connected termostat to internet● Web-based management portal

Promotional video: http://www.nest.com/saving-energy/#videotour

IoT towards Smart City

IoT towards Smart City

IoT towards Smart City

e-Government - Open Data

● Open Data Stockholm (http://open.stockholm.se/oppna-data)- Population- Geodata, i.e: urban area, road network- Environmental Data- Traffic and Parking- School data

● Open Data Singapore (http://data.gov.sg)- Traffic and Parking

Conclusion1. We know what Distributed Computing is!

2. Distributed Computing is real and used in daily life!

3. Some applications of Distributed Computing in our beloved country!