an introduction to cloud computing · cloud data mining services use techniques such as hadoop /...

36
© 2009 IBM Corporation Presented by IBM developerWorks ibm.com/developerworks/ ® Cloud Computing Cloud Computing An Introduction to Cloud Computing Dan O'Riordan IDR, La Gaude

Upload: others

Post on 09-Mar-2020

7 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

© 2009 IBM Corporation

Presented by IBM developerWorks

ibm.com/developerworks/®

Cloud ComputingCloud Computing

An Introduction to Cloud Computing

Dan O'Riordan

IDR, La Gaude

Page 2: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

2 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Agenda

� Introduction

� Cloud computing services

� Principles of openness

� Where we go from here

Page 3: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

3 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Before the Web

� If you wanted to sell things to the public, you needed a storefront

� Massive cost in real estate, fixtures, maintenance,

shrinkage

� Prohibitive cost to entry

Page 4: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

4 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

What if …

� You could have hundreds of millions of storefronts worldwide?

�Without real estate

�Without fixtures

�Without maintenance

�Without shrinkage

�With [relatively] zero cost to entry

� The Web changed everything

Page 5: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

5 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Before the cloud

� If you wanted to start an

enterprise, you needed an

IT shop

� Massive costs in hardware,

software, power,

administrative staff

� Prohibitive cost to entry

Page 6: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

6 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

What if …

� You could have unlimited computing resources?

�All the processing power you want

�All the data storage you want

�Data mining whenever you want

� Cloud computing will be the biggest change to our industry since the rise of the Internet

Page 7: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

7 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Cloud characteristics

� Rapid elasticity

�You can go from 5 servers to 50 or from 50 servers to 5

� Measured service

�You pay for what you use

� On-demand self-service

�You get elasticity automatically

� Ubiquitous network access

�You can access the cloud from anywhere

� Location-independent resource pooling

�You work with virtual machines that could be hosted anywhere

Source: NIST Working Definition of Cloud Computing

Page 8: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

8 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

You’re on the cloud already

� If you use Flickr or Facebook or LinkedIn or Twitter or Backpack or [insert hundreds of other sites here], you’re using the cloud

� Cloud is a metaphor for the internet

Page 9: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

9 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

A selection of cloud components

� Software as a Service

� Utility Computing

� Web Services

� Platform as a Service

� Managed Service Providers

� Service Commerce Platforms

� Internet Integration

Source: InfoWorld

Page 10: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

10 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Comparing cloud to other computing types

� Grid computing

� Utility computing

� Autonomic computing

Source: What’s In A Name? Utility vs. Cloud vs. Grid

Page 11: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

11 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

The evolution to cloud computing

Page 12: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

12 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

The emergence of cloud computing – differing points of view

IT Analysts

Financial Analysts

IT Customers

End Users

Common Attributes of CloudsEnhanced user experience

Elastic scaling Automated provisioning

Highly virtualized

Source: IBM Corporate Strategy analysis of MI, PR, AR and VCG compilations

Anywhere access to applications

through a simplified user interface

Rapid time to market

for new services.

Anywhere access to applications

through a simplified user interface

Ability to elastically

scale resources and maintain

high quality of service

Ability to elastically scale resources

at significantly lower

incremental management cost

Page 13: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

13 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Alternate Client Devices

Data-Intensive Applications

Infrastructure Technologies

Networking

Industrialization of IT

Business Model

Application Technologies

Data Center Pressures

Web Platforms and Applications

1980 1990 2000 2010 2020

Internet

Web

Cloud

Connectivity

Information and E-Commerce

ElasticServices

Evolving technologies help businesses continue to innovate

Page 14: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

14 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Alternate Client Devices:

Explosion of form factors, mobility, connectedness

Data-Intensive Applications:

From massively parallel (e.g., Google) to large data

files (e.g., YouTube)

Infrastructure Technologies:Virtualization and

automation

Networking:Growth in connectivity

and bandwidth through the Internet

Industrialization of IT:Standardization and

commoditization (e.g., e-mail), open source

Business Model:Advertising

subsidized, venture funding for service

model

Application Technologies:

From parallel processing (grid,

MapReduce, Hadoop) to Web 2.0, SOA

Data Center Pressures:

Growing costs of power and space,

server sprawl

Web Platforms and Applications:

Elastically scalable global class

infrastructure and mashable services built on WOA (e.g., REST,

RSS/Atom)

1980 1990 2000 2010 2020

Internet

Web

Cloud

Connectivity

Information and E-Commerce

ElasticServices

Evolving technologies help businesses continue to innovate

Page 15: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

15 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Agenda

� Introduction

� Cloud computing services

� Principles of openness

� Where we go from here

� Resources

Page 16: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

16 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Cloud services

� There are four basic things people are doing in the cloud:

�Machines in the cloud

�Storage in the cloud

�Databases in the cloud

�Applications in the cloud

� In addition to these four basics, cloud providers offer other services such as message queues and data

mining

� All of these things are lumped into the generic term “cloud computing”

Page 17: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

17 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Machines in the cloud

� Many cloud providers allow you to create a Virtual Machine (VM) and deploy it in the cloud

�Your VM images are stored in cloud storage

�You can create as many images as you need

�You can automatically start and stop running instances of those images as needed

� This is the simplest way to get started in the cloud, particularly if you’ve been using virtualization already

Page 18: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

18 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Storage in the cloud

� Most cloud storage systems are designed as distributed, redundant systems

�Your data are stored on more than one disk in more than one place

�If one part of the system goes down, the rest of the system keeps going

�“There should never be a single point of failure” is a stated design goal

� But you can’t think of cloud storage as just another hard drive

Page 19: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

19 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Databases in the cloud

� Cloud databases have similar design points

�Datasets are distributed for reliability

�Some cloud databases support schemas, some don’t

�Some cloud databases support joins, most don’t

�Some cloud databases are relational, almost all aren’t

�Some cloud databases are transactional, some aren’t

Page 20: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

20 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Other services in the cloud

� A number of vendors provide message queuing services in the cloud

�Some queuing services don’t let you peek a message, for example

� Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets

�Techniques that required supercomputers, large data centers and significant funds a few years ago can now be done for a few hundred pounds

� New businesses and business models will emerge based on the cost of data mining being reduced by several orders of magnitude

Page 21: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

21 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Amazon Elastic Compute Cloud

� What is Amazon EC2?

� Popular Uses for Amazon EC2

aws.amazon.com/ec2

Page 22: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

22 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Amazon Elastic Compute Cloud running IBM

� Run many of the proven IBM platform technologies by the hour as Amazon Machine Images (AMIs)

�IBM DB2

�IBM Informix

�IBM Lotus Content Management

�IBM Mashup Center

�IBM WebSphere Application Server

�IBM WebSphere sMash

�…

aws.amazon.com/ibm

Page 23: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

23 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Cloud implementation types

Page 24: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

24 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Cloud computing

Private Cloud

Client owned and managed.

Access limited to client and its partner network.

Drives efficiency, standardization

and best practices while retaining

greater customization and

control.

Public Cloud

Service provider owned and managed.

Access by subscription.

Delivers select set of standardized

business process, application

and/or infrastructure services on

a flexible pay per use basis.

Customization

Efficiency

Security and Privacy

Availability

Standardization

Capital preservation

Flexibility

Time to deploy

Page 25: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

25 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Cloud Computing Center at Wuxi

� The municipality of Wuxi, was working to

accelerate China’s transformation to a service economy

� IBM engaged the municipal government to develop a virtual data center linking several companies in a “software park”

� The public cloud implementation, China's

first commercial cloud, enabled by IBM technology and services will:

�Promote growth of software start-ups across China

�Accelerate development and test cycles

�Offer secure, network-isolated environments

�Deliver Backup and Restore asset protection capabilities

Page 26: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

26 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Cloud Computing in Agriculture

� Example from University of Melbourne

� Experimental farm using irrigation automation

�Irrigating short-term (minutes to hours)

�Predict micro-climate for coming week

�Predict market in coming months

� Interconnection of real-data with climate prediction

� Results are promising

�Orchid saw 300% increase in profitability

�Dairy farm saw 70% increase in profitability

�Local commercial dairy farm saw 70% increase in profitability

Page 27: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

27 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Agenda

� Introduction

� Cloud computing services

� Principles of openness

� Where we go from here

� Resources

Page 28: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

28 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Cloud services

� Machines in the cloud

�Can I move my VM elsewhere?

� Storage in the cloud

�Can I move my data elsewhere?

� Databases in the cloud

�Can I move my data elsewhere?

� Applications in the cloud

�Can I run my application elsewhere?

Page 29: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

29 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Vendor lock-in

� If there’s a new technology, any talented programmer will want to use it

�Maybe the shiny new thing is appropriate for what we’re doing

�Maybe not

�We’re probably going to use it anyway

� The challenge is to walk the line between using the newest, coolest thing and avoiding vendor lock-in

Page 30: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

30 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

The Open Cloud Manifesto

� A statement of principles for openness in cloud computing

� More than 300 supporters and

growing

� Join the “Open Cloud Manifesto” group

� Visit opencloudmanifesto.org

Page 31: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

31 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

The principles in action

� The Cloud Computing Use Cases Google group has a white paper of common use cases

� Join us at groups.google.com/ group/cloud-computing-use-

cases

� Version 2 of the paper is available at bit.ly/1FXRAH

Page 32: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

32 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Agenda

� Introduction

� Cloud computing services

� Principles of openness

� Where we go from here

� Resources

Page 33: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

33 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Issues with the Internet

� “It’s not secure.”

� “I don’t want to lose control of my infrastructure.”

� “I don’t know how reliable it is.”

� “I don’t know if my partners are going to use it.”

� All of these were important, legitimate issues

�With VPNs and other technology, the industry solved these problems

Page 34: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

34 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Issues with the cloud

� “It’s not secure.”

� “I don’t want to lose control of my infrastructure.”

� “I don’t know how reliable it is.”

� “I don’t know if my partners are going to use it.”

� All of these are important, legitimate issues

�We’ve got some work to do, but the massive economic incentives mean someone will find a way to solve these problems

Page 35: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

35 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks

Key questions to ask

� Will cloud computing help create and deliver innovative business and consumer services to achieve greater competitive differentiation?

� Can cloud computing help to quickly achieve goals for IT

optimization, cost savings and faster time to market?

� Is competitive advantage gained by using cloud computing?

Page 36: An Introduction to Cloud Computing · Cloud data mining services use techniques such as Hadoop / MapReduce to analyze massive data sets Techniques that required supercomputers, large

36 An Introduction to Cloud Computing © 2009 IBM Corporation

Presented by IBM developerWorks