the distributed & decentralized cloud
DESCRIPTION
Presentation given by Margaret Dawson & Praerit Garg of Symform Inc (www.symform.com) at Cloud Expo East 2012 on June 11, 2012TRANSCRIPT
![Page 1: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/1.jpg)
Praerit Garg, Co-founder & PresidentMargaret Dawson, Vice President
Distributed & Decentralized Cloud
![Page 2: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/2.jpg)
www.symform.com
How much digital data are we creating every
second?
![Page 3: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/3.jpg)
It’s all about the data
➡58 Gigabytes of data created every second
➡35 Zettabytes of digitally stored data by 2020
➡ That’s enough data to fill a stack of DVDs reaching from the Earth to the moon and back — about 240,000 miles each way.
33
![Page 4: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/4.jpg)
But…
4
The ‘Cloud’ Will Save Us!
4
![Page 5: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/5.jpg)
Only one problem
Cloud is powered by massive centralized infrastructure
5
![Page 6: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/6.jpg)
Cloud driving massive data center build out
6
Over 500,000 data centers worldwide covering 290m sqft or 6,000 football fields
6
![Page 7: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/7.jpg)
www.symform.com
What percentage of North American energy consumption do those data centers account
for?
![Page 8: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/8.jpg)
8
➡ Have to build for peak usage; excess capacity lying idle
➡ Power consumption issues
• 2% of North American energy consumption goes to servers and data centers
• 2% of global carbon footprint is data centers used to power cloud computing
• Google uses 260 million watts continuously across the globe -- equivalent to the power used by all the homes and businesses in a city of 200,000 people.
➡ Energy grid management
➡ Potential security and physical vulnerabilities (e.g. fire)
➡ Costs - data centers are expensive to build and maintain
➡ Bandwidth bottlenecks
Issues with over centralization
8
![Page 9: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/9.jpg)
9 ZB 4502015
2020 35 ZB
0.8 ZB 1602009
And we can’t keep pace with data growth . . .
99
![Page 10: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/10.jpg)
Good news . . .
10
The Internet is already highly distributedInternet Users by Country
Billions of devices sitting on the edge
Data distributed across devices, networks, data centers, and geos
![Page 11: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/11.jpg)
➡ Multi-tenant architecture
➡ Distributed database
➡ Virtualization
➡ Multi-threading
➡ Multi-core CPUs
➡ Parallel processing
➡ Distributed file systems
➡ Distributed Load Balancing
➡ RAID algorithms
Cloud Computing is driving distributed models:
You are already using distributed systems
11
![Page 12: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/12.jpg)
➡ System or process optimization
➡ Improved performance - faster
➡ Increased reliability & fault tolerance
➡ Lower costs
➡ Increased efficiencies
➡ Easier scalability or expansion
➡ Continuous or near continuous operations
And we’re realizing benefits
1212
![Page 13: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/13.jpg)
www.symform.com
What’s the largest distributed & decentralized
system in the world?
![Page 14: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/14.jpg)
Distributed alone is not enough . . .
Distributed only will not keep up with our data growth
Still heavily based on centralized models with distributed components
14
![Page 15: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/15.jpg)
Need to go beyond distributed to decentralized
15
Unused instances
Over provisioning
Under use of reserved instances
Orphaned services
Millions of dollars invested and wasted
Contributing source: Mat Ellis
Why?
![Page 16: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/16.jpg)
16
➡ No central hub or owner
➡ Power of large numbers
➡ Organic, demand driven growth in capacity
➡ Leverages existing infrastructure and devices on edge
➡ Shared information
➡ Concept of “Contribution” to the community
➡ Assume everyone / every node is “untrusted”
➡ Geographic spread of:• Ownership & participation
• Costs
• Management overhead
• Risks
How to think about Decentralization
16
![Page 17: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/17.jpg)
17
There are good examples of
decentralization today
Good news . . .
17
![Page 18: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/18.jpg)
www.symform.com
Do you have an example of a decentralized
system?
![Page 19: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/19.jpg)
19
➡ Linux – a Unix-Based operating system
➡ Apache — a leading server software and scripting language on the web
➡ MySQL — a database management system
➡ PHP — a widely used open source general-purpose scripting language
➡ Blender — a 3D graphics and animation software
➡ OpenOffice.org – an office suite software with word processor, spreadsheet, and presentation capabilities
➡ Mozilla — a web browser and e-mail client
➡ Perl — a programming/scripting language
➡ Wikipedia — Online encyclopedia open for anyone to update and revise content
Open Source Movement
Decentralized Development
Programmers who support the open source movement philosophy contribute to the open source community by voluntarily writing and exchanging programming code for software development.
19
![Page 20: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/20.jpg)
Skype is the largest telephone company in the world but has almost no centralized infrastructure
Decentralized Communications
20
![Page 21: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/21.jpg)
Search for extraterrestrial intelligence (SETI)
Decentralized Processing
World Community Grid
21
![Page 22: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/22.jpg)
Decentralized Cloud StorageWhat if we aggregated all the unused capacity across servers, desktops and storage devices on the edge of the Internet to build a global storage network?
22
![Page 23: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/23.jpg)
23
➡ CMOs often have as much IT purchasing power as CIOs
➡ Employees are buying rogue platforms, applications and devices
Alas . . . Also already here
Decentralized IT budgets
23
![Page 24: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/24.jpg)
24
Whoa! . . . “This is chaos for enterprise IT”
24
![Page 25: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/25.jpg)
25
➡ IT Policy and governance
➡ Security and compliance mandates
➡ Definition of “trust”
➡ API management
➡ Shared services (SOA)
➡ Vendor evaluation guidelines
➡ Data analysis aggregation (search, e-discovery & reporting)
What Stays Centralized?
Doesn’t mean loss of centralized control or IT power
25
![Page 26: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/26.jpg)
26
➡ Desire for Control
➡ Geo-political differences
➡ Random expertise
➡ Data security and encryption
➡ Integration
➡ Need more open API’s
➡ Consistent Quality of Service
Issues with decentralization
We are still in early stages
26
![Page 27: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/27.jpg)
www.symform.com
How much digitally stored data will there be
by 2020?
![Page 28: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/28.jpg)
28
We still need data centers
Data centers are ideal for:
➡ High volume, low latency transactions
➡ Data warehousing
➡ Search
28
![Page 29: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/29.jpg)
➡ Assumption of “untrusted” should be your security principle today
➡ Worry less about where the data is and on how to control access
➡ Be the source of centralized policy and governance
To Leverage Distributed & Decentralized Models
But we can look for opportunities
29
![Page 30: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/30.jpg)
Today’s Cloud: Centralized Data Centers
Apple
Amazon
30
![Page 31: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/31.jpg)
31
Tomorrow’s Cloud: Decentralized Grids
31
![Page 32: The Distributed & Decentralized Cloud](https://reader036.vdocuments.net/reader036/viewer/2022081413/546ca84eaf795953298b4f94/html5/thumbnails/32.jpg)
www.symform.com
Q&A