delight your dev/ops team by building a private cloud for … your dev/ops team by building a...

33
Delight your Dev/Ops team by building a private Cloud for self service provisioning of Database as a service Harihara Balakrishnan Consulting IT Specialist IBM Systems Lab Services

Upload: dangbao

Post on 12-Apr-2018

220 views

Category:

Documents


5 download

TRANSCRIPT

Delight your Dev/Ops team by building a private Cloud for self service provisioning of Database as a service

Harihara Balakrishnan

Consulting IT Specialist

IBM Systems Lab Services

Agenda

• PowerVC – An Introduction

• Oracle DBaaS using PowerVC

• Open Source DBaaS using PowerVC

Virtualization and Cloud Management

HardwareManagement Console

• Hardware and firmware

configuration and mgt.

• Service and support

• PowerVM

PlatformManagement

PowerVCStandard Edition

• Simple user interface

• Capture, deploy, resize,

migrate VMs

• Placement policies

• PowerVM / PowerKVM

VirtualizationManagement

IBM CloudPowerVC Manager

Basic PowerVMIaaS Cloud

+Self-service portal

+Projects

+ Image templates

+Approvals

+Metering

Power Virtualization Center (PowerVC)

• Capture, Deploy, Place, Move, Change VMs

• Resource pooling

• Storage Provision

• IP Address Provision

• Built on OpenStack

• AIX, Linux, IBM i

PHYP

FSP

VIOSVIOSOSOS

PHYP

FSP

VIOSVIOSOSOS

Nova Controller

PowerVCNova

PowerVM 1Nova

PowerVM 2Nova

PowerVM 3

HMC 1

NovaPowerVM 4

NovaPowerVM 5

NovaPowerVM 6

HMC 2

OPAL & KVM

BMC / FSP

NovaOSLinux

Power Virtualization Center (PowerVC)

PowerVM NovaLink

Nova ControllerPowerVC

HMC

PHYP

FSP

OSOSVIOSVIOS

OPAL & KVM

BMC / FSP

NovaOSLinux

Nova

Policy Description Initial Placement

PackingPack workload on fewest physical servers

Maximizes usable capacity, reduces fragmentation, reduce energy consumption

Striping

Spread workload across as many physical servers as possible

Reduce impact of host failures, higher application performance

CPUBalance

Place VMs on the hosts with the least allocated CPU

Higher application performance

Memory Balance

Place VMs on the hosts with the most available memory

Improve application performance

Affinity

Affinity specifies that VMs should be placed on the same host or few hosts

Useful for collocating VMs on the same host(s)

Anti-Affinity

Do not place VMs on same host

Useful for ensuring VMs are not collocated

Availability cluster support (e.g. PowerHA)

Higher application performance

Placement Policies

PowerVC Host Groups

Marketing Group

Host 3

Host10

Host11

Host 12 Host 13 Host 14

Default Group

Host 8 Host 9

Sandbox GroupPOWER8 Group

Host 5 Host 6Host 2

Host 4Host 1 Host 7

PCI Group • Logical group of physical servers

• Each server in only one group

• Deployment, mobility, remote restart are

within the group

• Each group has its own placement policy

• Hosts in the default group when added

Imagemanagementand cloning

Multi-disk support

Storage PoolsRemote Restart

System Evacuation

IP address pools

VM placement policies

Dynamic Resource Optimization

AIX

Linux IBM i

PowerVMPowerVM

SharedProcessor

Pools

Host Groups

PowerVC – Virtualization Management

Relocate VMPowerVM

Relocate CapacityEnterprise Pools CoD

Dynamic Resource Optimizer

Policy-based automation to re-balance Linux, AIX, and IBM i workloads

VM Affinity and Anti-affinity

VM with no affinity requirements – can go anywhere within the host group

VMs with affinity – must be placed on the same host

VMs with anti-affinity – must be placed on different hosts

Host 1 Host 2 Host 3

PowerVC v1.3.2 Storage Options

For IBM I storage support see https://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS4563

Storage NPIV vSCSI

DS8870, DS8880 ✔ ✔

XIV / A9000 / A9000R ✔ ✔

SVC ✔ ✔

Storwize Family ✔ ✔

FlashSystem V Series ✔ ✔

EMC VMAX ✔ ✔

EMC VNX ✔ ✔

Hitachi VSP ✔ ✔

PowerVM Shared Storage Pools ✔

PowerVC Remote Restart

13

Host 1 Host 2 Host 3

PowerVC Remote VM Restart enables restarting VMs from a failed host on another server• Works with AIX, IBM i or Linux VMs• Requires a human decision to perform restart using PowerVC • Host Group policy controls VM placement• Supports both PowerVM and PowerKVM• Requires POWER8 with firmware 8.20

Improved recovery from unexpected system failures

Definition: Database as a Service

• Integrate with OpenStack

• Request new database instance

• Automatically provision VM, storage, network

• Automatically install and (re)configure database

Extending PowerVC as a Cloud Solution

• PowerVC provides for automatic execution of scripts at deploy time

• Scripts typically stored with image

• “Configuration script” option also allows for calling of scripts from file on PowerVC

• “Server metadata key-value pairs” are useable by cloud_init

Cloud foundation

Hypervisor

OpenStack Server, Storage and Network Integration as well as access to OpenStack APIs and Ecosystem

Compute StorageNetwork

PowerVM

Cloud stack

PowerVC

HMC

Cloud–init Oracle DBaaS – Post-deploy scripts

Cloud Management Stack for Oracle DBaaS

• Install AIX in new LPAR• Apply latest AIX patches

• Tune AIX for Oracle database• Add Oracle users• Create Oracle directory structure• Add Oracle binaries (11gR2, 12c)• Preconfigure listener• Add OEM agent cloning SW (if customer wants to do OEM registration or skip the step)• Add post-deploy script to adjust listener and OEM agent• Create Oracle database with application data as required

• Add additional post-deploy step to:o rename dbnameo Agent Clone script o adjust “/etc/oratab”o Update the environment files to reflect the oracle

directory structure

Use an existing AIX image captured in

PowerVC

Use for existing or other Oracle

database projects with a different

database instance

Capture Oracle DBaaS image is now in PowerVC image repository

OR

OR

Creating Combined AIX + Oracle Image

Activation Engine (Cloud-init)

/etc/inittab – Run the

rc.oracledbaas during deploy

/usr/local/bin/rc.oracledbaas

/usr/local/bin/chhost.ksh

/usr/local/bin/renamedbhost.ksh

/usr/local/bin/AgentCloneScript.sh

rmitab the line which initiates

/usr/local/bin/rc.oracledbaas

/home/oracle

pfile.ora

/tmp/clone_work

agentDeploy

Agentcoreimage.zip

Unzip

agentDEploy.sh

Agentimage.properties

/home/oracle

pfile.ora

/home/oracle/bin

AgentCloneScript.sh

oraCloud.cfg

chhost.ksh

renamedbhopst.ksh

New dbname /tmp/new_dbname.out

Script Structure and Locations

The Life of a Database as a Service

• Provisioning DBaaS can use many different technologies at every step• This presentation will provide one example of delivering DBaaS• IBM Systems Lab Services can also help with other approaches and technologies

Example: DBaaS with PowerVC

• In this example, we provision MongoDB as a service

• The VM for MongoDB in this case is Red Hat Enterprise Linux (RHEL) 7.1

• The self-service portal and provisioning tool are both PowerVC (Cloud PowerVC Manager for the self-service)

• MongoDB is deployed automatically via cloud-init script

• Configuration steps include:1. Install RHEL VM on Power, configure cloud-init, capture image in PowerVC

2. Prepare RHEL image for MongoDB

3. Capture combined RHEL + MongoDB image

20

Image Preparation and Requirements

• MongoDB files required for RHEL 7.1:• v8-3.14.5.10-2.el7.ppc64.rpm

• libmongodb-2.4.9-1.el7.ppc64.rpm

• mongodb-server-2.4.9-1.el7.ppc64.rpm

• mongodb-2.4.9-1.el7.ppc64.rpm

• Obtain via anonymous FTP from ftp://ftp.software.ibm.com/linux/rpms/redhat/7.0(not ///7.1)

• Transfer to RHEL 7.1 VM (e.g., in /tmp/mongo)

• Add database installation and configuration script to /var/lib/cloud/scripts/per-instance

21

Basic MongoDB Installation and Configuration Script

22

Deploying Combined RHEL + MongoDB Image

23

Deploying Combined RHEL + MongoDB Image

24

Deploying Combined RHEL + MongoDB Image

25

Deploying Combined RHEL + MongoDB Image

26

Post-deploy Validation

27

Additional PowerVC Capabilities

• Enables automatic execution of scripts at deploy time

• Scripts typically stored with image

• “Configuration script” option also allows for calling of scripts from file on PowerVC

• “Server metadata key-value pairs” are useable by cloud_init

28

|1

0

Future Madeibm.com/systems/services/labservices Contact us: [email protected]

OverviewIBM will implement a Database-as-a-Service (DBaaS) solution based on a jointly developed plan with the client.

Target Audience• Clients using Oracle on AIX with Power Systems• Power clients looking to deploy open source databases• Clients looking to deploy self-service database provisioning • Includes, but not limited to, clients with Power to Cloud Rewards on

Power 870 and 880

Benefits• Get started with on-premise DBaaS on Power Systems• Improve time-to-value with automated DB deployment• Improve speed and consistency of VM and databasedeployment

Qualifying Questions• Do you want a simpler and faster way to provision database

instances? • Are you looking to deploy open source databases?• Do you want to implement a database as a service cloud for your LOB

users?

IBM Systems Lab Services — Power SystemsDatabase as a Service Implementation

Key Features• Implement a full-function DBaaS solution with:

• Single-click provisioning of VM + database• Can include open-source or closed-source database• Integration with OpenStack• Automatic post-deploy system configuration• Automatic post-deploy DB configuration

Deliverables• After the implementation, the details of the DBaaS implementation are

documented and skills transfer is provided to the client.

DurationThe service varies depending on the size and complexity of the implementation, but can be customized to specific client requirements.

Resources

Learn more about Power cloud solutions at www.ibm.com/systems/power/solutions/cloud/?link=infr_prod

Consultant ContactsHarihara Balakrishnan, [email protected]

Opportunity ManagersRoy Mr Firmansyah, [email protected] Hoe Phoon, [email protected] Keong Chow, [email protected]

|1

0

Future Madeibm.com/systems/services/labservices Contact us: [email protected]

Consultant ContactsHarihara Balakrishnan, [email protected]

Opportunity ManagersRoy Mr Firmansyah, [email protected] Hoe Phoon, [email protected] Keong Chow, [email protected]

IBM Systems Lab Services — Power Systems

Cloud Design Workshop

|1

0

Future Madeibm.com/systems/services/labservices Contact us: [email protected]

Consultant ContactsHarihara Balakrishnan, [email protected]

Opportunity ManagersRoy Mr Firmansyah, [email protected] Hoe Phoon, [email protected] Keong Chow, [email protected]

IBM Systems Lab Services — Power Systems

PowerVC Implementation

|1

0

Future Madeibm.com/systems/services/labservices Contact us: [email protected]

Harihara Balakrishnan, [email protected]

Opportunity ManagersRoy Mr Firmansyah, [email protected] Hoe Phoon, [email protected] Keong Chow, [email protected]

IBM Systems Lab Services — Power Systems

PowerVM Novalink Implementation

|1

0

Future Madeibm.com/systems/services/labservices Contact us: [email protected]

Harihara Balakrishnan, [email protected]

Opportunity ManagersRoy Mr Firmansyah, [email protected] Hoe Phoon, [email protected] Keong Chow, [email protected]

IBM Systems Lab Services — Power Systems

PowerVC Enablement for VMware vRealize Automation