cloud computing with aws and oracle tusc 2008

Cloud Computing with

Amazon and Oracle

Lewis CunninghamTUSC, Sr Datawarehouse Consultanthttp://it.toolbox.com/blogs/oracle-guidehttp://databasewisdom.com/ 11/15/2008

2

Introduction

• Oracle ACE Director• Author• Former Cloud Architect for EnterpriseDB• Currently Data Warehouse Consultant for

TUSC• Blogger,

An Expert's Guide to Oracle Technology

3

My New Bookhttp://sqlstarter.com

4

Agenda• What Is Cloud Computing?

• What Does Amazon Offer?

• The Value Proposition

• Where Does Oracle Fit In?

• How Does Amazon Work?

5

What is Cloud Computing?

Cloud computing is using the internet to access someone else's software running on someone else's hardware in someone else's data center.

Lewis Cunningham

6

What is Cloud Computing?

Cloud computing is using the internet to access someone else's software running on someone else's hardware in someone else's data center.

Lewis Cunningham

7

What is Cloud Computing?Distributed Computing

•Remember SETI@Home?•Heard of HADOOP?•Grid Computing•Distributed computing is spreading a

large task over many machines•Distributed computing can be cloud

computing but is not cloud computing

8

What is Cloud Computing?Software as a Service SaaS

•Gmail & Yahoo Mail•Google Docs•Mozy Online Backups•CRMRemember Application Service

Providers? The next big thing of 2000 that didn't happen.

9

What is Cloud Computing?Platform as a Service PaaS

•Salesforce.com•Google App Engine•Aptana

•Provides a development platform and hosting

10

What is Cloud Computing?

Infrastructure as a Service IaaS

•Amazon Web Services (AWS)•EMC Fortress (Storage Cloud)•HP Adaptive IaaS•WIPRO, CISCO, IBM, Sun•Everybody and their brother

11

What is Cloud Computing?

Key Features

•Virtualization•Nearly instance scalability•Everything is a service•Utility style (pay for what you use)•Hardware, OS, Software, Storage &

Network

Infrastructure as a Service IaaS

12

What Does Amazon Offer?

•Hardware Virtualization•Amazon Machine Image (AMI)•CPU, Memory, Storage•Linux, Solaris, Windows

•Safety•Coming Soon - Regions•Availability Zones

Electronic Compute CloudEC2

•Hardware Virtualization•Amazon Machine Image (AMI)•CPU, Memory, Storage•Linux, Solaris, Windows

•Safety•Coming Soon - Regions•Availability Zones

13

What Does Amazon Offer?Electronic Compute Cloud

EC2•Elastic Internet (IP) Addresses

•Dynamic Addition•Dynamic Reallocate

•Security•XEN Hypervisor•Disk encryption is your call•Security Groups controls access

14

What Does Amazon Offer?Electronic Compute Cloud

EC2•Storage is Transient

•S3•EBS

•SLA•Amazon warrants 99.95% uptime•<99.95 gets a 10% discount

15

What Does Amazon Offer?Electronic Compute Cloud

EC2•Computing Power based on a Compute

Unit•1 Compute Unit = 1 Circa 2007 1.0-1.2

GHz Opteron or Xeon CPU •Cost is based on Memory, Storage and

Compute Units

16

What Does Amazon Offer?Electronic Compute Cloud

EC2Instance Type

Memory Compute Units

Storage Platform Linux CPU/Hour

Windows CPU/Hour

Small 1.7GB 1 160GB 32-bit $0.10 $0.125

Large 7.5GB 4 850GB 64-bit $0.40 $0.50

Extra Large 15GB 8 1690GB 64-bit $0.80 $1.00

High CPU,Medium

1.7GB 5 350GB 32-bit $0.20 $0.30

High CPU, Large

7GB 20 1690GB 64-bit $0.80 $1.20

17

What Does Amazon Offer?

•API Driven Storage•Get, Put and Delete

•Organized around buckets•Bucket like a directory•Bucket can hold objects or more

buckets•Objects can be up to 5gb each

Simple Storage Service S3

18

What Does Amazon Offer?

•Access•Fast•Reliable•HTTP – REST or SOAP

•Secure•Access Control Lists (ACL)•Transfer uses SSL (encryption)•Can encrypt data at rest

Simple Storage Service S3

19

What Does Amazon Offer?Simple Storage Service

S3

Storage, US per GB Europe per GB

First 50TB/Month $0.150 $0.180

Next 50TB/Month $0.140 $0.170

Next 400TB/Month

$0.130 $0.160

Over 500TB/Month

$0.120 $0.150

20

What Does Amazon Offer?Simple Storage Service

S3Data Transfer US per GB Europe per GB

Transfer Into S3 $0.100 $0.100

First 10TB Out of S3

$0.170 $0.170

Next 40TB Out of S3

$0.130 $0.130

Next 100TB Out of S3

$0.110 $0.110

Out over 150TB $0.100 $0.100

21

What Does Amazon Offer?Simple Storage Service

S3

Requests US per Request Europe per Request

Put, Copy, List, Post

$0.01 $0.012

Delete (always free)

$0.00 $0.00

Get and all other requests

$0.01 $0.012

22

What Does Amazon Offer?

•SLA•99.9% Uptime Guarantee•If Between 99% and 99.9% Uptime

•10% Credit•If <99% Uptime

•25% Credit

Simple Storage Service S3

23

What Does Amazon Offer?

•Like a USB Drive•Portable between AMIs•Persistent•Dynamically add and remove•Snapshots•10 cents per GB per month•10 cents per 1 million IOs per month

Elastic Block StorageEBS

24

What Does Amazon Offer?

•Like Oracle AQ or IBM MQ Series•API based•Many interfaces

•Ruby, Java, Python, etc•8k messages and unlimited queues•1 cent per 10000 requests•Data transfer in and out of Amazon costs

Simple Queue ServiceSQS

25

What Does Amazon Offer?

•Amazon's first public web service•Very, very, very simple database•Not relational •Key/Value Pairs•Non-SQL•Not cheap, $1.50$0.25/GB/Month•Plus data transfer costs

SimpleDB

26

What Does Amazon Offer?

•Economics•Dev & Test no upfront capital•If you buy, buy exactly what you need•Pay for what you use•Pay as you go

•Easier•Faster

Value Proposition

27

Where Does Oracle Fit In?

•Oracle AMIs•Oracle 11g EE, SE & SE1 32-Bit•Oracle 11g EE, SE & SE1 64-Bit•Oracle 10g XE

•Oracle Hyperion Essbase•You can run OBIEE•You can run Application Server•Oracle provides licensing and support

28

Where Does Oracle Fit In?

•Oracle Secure Backup Cloud Module•RMAN to S3, 9iR3 & higher•Can run using OEM•32-Bit Linux and Windows•More reliable than tape•Faster than tape (40-50MB/Sec)•Takes care of off site storage

29

Where Does Oracle Fit In?

•Oracle Secure Backup Cloud Module•Automatically Encrypts•Will use Oracle 11g Fast Compressed

Backup (normally requires Advanced Compression license) at no cost

•No more mounting tapes•Cheap, Cheap, Cheap

30

Where Does Oracle Fit In?Oracle Cloud Control

31

How does Amazon work?

•Command Line Tools (Yuck)•3rd Party Add-ons

•ElasticFox (#1)•Cloud Studio

•3rd Party Vendors•RightScale•Elastra

This demo will use ElasticFox

32

Elastic Fox

33

Credentials

34

SSH Key Pairs

35

Security Group

36

Elastic IPs

37

Elastic Block StorageCreate Volume

38

Elastic Block StorageUnattached Volume

39

Current Availability Zones

40

Oracle AMIs

41

Start an Instance

42

Pending Instance

43

Instance Details

44

Attach an Elastic IP

45

Attached Elastic IP

46

Elastic Block StorageAttach Volume

47

Elastic Block StorageAttach Volume Popup

48

Elastic Block StorageAttached Volume

49

Instance StartupConsole Output

50

Oracle Started

51

SSH to Instance

52

Oracle License Agreement

53

Set Oracle Password

54

Ready to Rumble

55

Mount an ext2 Filesystemon EBS Volume

/sbin/mke2fs -j /dev/sdg

echo "/dev/sdg /vol ext3 noatime 0 0" >> /etc/fstab

mkdir /vol

mount /vol

$ df --si

56

Verify EBS Volumedf -si

57

AWS ApEx

Cloud Computing with

Amazon and Oracle

Lewis CunninghamTUSC, Sr Datawarehouse Consultanthttp://it.toolbox.com/blogs/oracle-guidehttp://databasewisdom.com/ 11/15/2008