vmware vfabric data director
DESCRIPTION
VMware vFabric Data Director. Powering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric Postgres. Traditional IT. System Admin. Storage Admin. Network Admin. Application Team. DBA. Days - weeks to provision a development environment. Database Infrastructure Challenges. - PowerPoint PPT PresentationTRANSCRIPT
© 2010 VMware Inc. All rights reserved
Confidential
VMware vFabric Data DirectorPowering Database-as-a-Service for Oracle, SQL Server, Hadoop and vFabric Postgres
2
Traditional IT
Application Team
System Admin
Storage Admin
Network AdminDBA
Days - weeks to provision a development environment
3
Database Infrastructure Challenges
Postgre
Production
Postgre
Development
Postgre
Test
Postgre
UAT Shadow IT
Enterprise DBA
Security Routine TasksCompliance
4
vFabric Data Director Powers Database-as-a-Service for your Cloud
Enables database-aware virtualization on VMware vSphere and provides database-as-a-service for heterogeneous databases and Hadoop
Reduce capex through database-aware
virtualization
Save cost through database and Hadoop
virtualization
Increase IT agility
Automate database and Hadoop lifecycle
management
Accelerate analytics and application
development
Through self-service and automation
5
vFabric Data Director Platform Architecture
Cloud Infrastructure Platform
Enterprise Services
vCloud Director
Cloud Foundry
EMC Chorus
EMCData Domain
Cloud Infrastructure Platform
.
.
.
Integration Gatew
ay (AP
I)vFabric Data Director
Provisioning Backup/Restore Clone One click
HA
ResourceMgmt
Security Mgmt
Template Mgmt
Monitor
DBA App Dev
IT Admin
LifecycleServices
InfrastructureServices
DBA
DatabaseCatalog
PatchMgmt
vPostgres
DatabaseIngestion
…
Application Director
…
6
Oracle 10gR2, 11gR2
SQL Server 2008R2, SQL Server 2012
Postgres 9.1.6
Hadoop 1.0 based distributions:• Apache Hadoop 1.0.x
• Cloudera CDH3
• Greenplum HD 1.1 and 1.2
• Hortonworks Data Platform 1.0
• MapR - Soon
Supported Data Engines
7
SQL Server Support - New
Confidential
Data Director now supports SQL Server database• Supports provisioning of SQL Server 2008 R2 and SQL Server 2012 databases
Key features include
• Create SQL Server templates easily with built-in configurations
• Size VMs and configure database settings through a single UI
• Join VMs to domain as part of provisioning
• Compatibility with existing tools
8
Provision Any Database from Same Web Portal
9
Provision and Manage Any Hadoop Distribution with One Click
10
Hadoop Support Powered by Serengeti
Open source project launched in June, 2012 To learn more - projectserengeti.org
Serengeti
11
Why Virtualize Hadoop?
Shrink and expand cluster on demand
Independent scaling of Compute and data
Strong multi-tenancy
Elasticity & Multi-tenancy
High availability for entire Hadoop stack
One click to setup
Battle-tested
High Availability
Rapid deployment
One stop command center
Easy to configure/reconfigure
Operational Simplicity
12 Confidential
Data Director Benefits
Don’t Let Your DBAs Hit the 40 DB Ceiling• Automate provisioning and management• Enforce policies and best practices automatically
Double Your DBAs
Reduce Costs by > 50%• Consolidate servers by 10–15X• Save on Hardware, Software, Power and Cooling
Stretch Your Servers
Use the Right Database for the Job• Use the most cost-effective licensing for your application• Leverage low-cost HA and clustering with vSphere
Liberate Your Licenses
Keep Your Data Secure With Automation• Make security a holistic part of the database lifecycle.• Help admins keep systems patched and up-to-date.
Secure Your Stuff
13 Confidential
vFabric Data Director
Data Director will help you:1. Stretch Your Servers2. Liberate Your Licenses3. Double Your DBA Productivity4. Secure Your Stuff
14 Confidential
vFabric Data Director
Data Director will help you:1. Stretch Your Servers2. Liberate Your Licenses3. Double Your DBA Productivity4. Secure Your Stuff
15 Confidential
We Looked at 700,000 Servers
The average PRODUCTION Oracle Database Instance uses:•4% of CPU•2MB/second of Network•1200 IOPS
The average SQL Server database only does slightly better (about 5% CPU).
This does not strain a modern server in any way.
16 Confidential
How Can We Do Better?
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
5%
75%
0.95
25%
Used Unused Overhead
Physical Server
Virtual Server
You can consolidate 10-15 databases on a single server without affecting overall performance.
17 Confidential
vFabric Data Director
Data Director will help you:1. Stretch Your Servers2. Liberate Your Licenses3. Double Your DBA Productivity4. Secure Your Stuff
18 Confidential
How Can We Use fewer Licenses?
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
5%
75%
0.95
25%
Used Unused Overhead
Physical Server
Virtual Server
Oracle and SQL Server are typically licensed by core. If you consolidate by a factor of 10-15x you will need far fewer licenses.
19 Confidential
TEMP SWAP LOG DATA
T
TEMP SWAP LOG DATA
How Can I Virtualize a Physical Database
Linux
DB Management Server
Data Director Application Oracle 11.1 Template
Linux
Oracle 11.1
Monitoring Agents
Shell Virtual Machines
Empty DBVM
Linux
Oracle 11.1
Monitoring Agents
Clone of Physical DBPhysical DB Server
20 Confidential
A Single License Management Pane
Don’t get a million dollar surprise because you couldn’t track your database licenses.
21 Confidential
A Real World Example
EMC is one of the largest Oracle shops in the world and it runs on VMware.
EMC was able to:•Consolidate their servers by a factor of 13:1•Reduce RAC to Single Instance databases•Convert Enterprise to Standard Edition databases•Add HA to single instance databases.•Realize millions of dollars in cost savings
See Whitepaper “EMC IT’s Virtual Oracle Deployment Framework”, November 2011
22 Confidential
vFabric Data Director
Data Director will help you:1. Stretch Your Servers2. Liberate Your Licenses3. Double Your DBA Productivity4. Secure Your Stuff
23 Confidential
How Many Databases Can a DBA Manage?
40
24 Confidential
After
Self Service
Policy
Foundation
Developers/Administrators
Database Team
IT
Before
Developers
DBAs IT
Tickets
Data Director Accelerates Productivity
25 Confidential
Data Director Architecture
vCenter
ESXi
Linux
DB Management Server
Data Director Application
T
TEMP SWAP LOG DATA
Shell Virtual Machines
Operating System
Database
Monitoring AgentsOperating System
Database
Monitoring Agents
Database Template Library
Operating System
Database
Monitoring Agents
26 Confidential
T
TEMP SWAP LOG DATA
Create Your Own Databases, Virtually
Linux
DB Management Server
Data Director Application
TEMP SWAP LOG DATA
Shell Virtual MachinesDatabase Template Library
Operating System
Database
Monitoring Agents
Operating System
Database
Monitoring Agents
New Database Based Linked to Parent Template
27 Confidential
A Data Director Database
Operating System
Database
Monitoring Agents
Stores data locally (inside the VM)
Uses binaries from linked clone disks on the parent template
Has a unique ID and IP address
Runs software and database processes locally (in the VM)
28 Confidential
Linux
Oracle 11.1
Monitoring Agents
DB Based on Oracle 11.1 TemplateDB Based on Oracle 11.2 Template
Upgrading or Patching a Database
Linux
DB Management Server
Data Director Application Oracle 11.1 Template
Linux
Oracle 11.1
Monitoring Agents
Oracle 11.2 Template
Linux
Oracle 11.2
Monitoring Agents
Linux
Oracle 11.2
Monitoring Agents
29 Confidential
TEMP SWAP LOG DATA
T
TEMP SWAP LOG DATA
DB Based on Oracle 11.1 Template
Cloning a Database
Linux
DB Management Server
Data Director Application Oracle 11.1 Template
Linux
Oracle 11.1
Monitoring Agents
Shell Virtual Machines
Linux
Oracle 11.1
Monitoring Agents
Empty DBVM
Linux
Oracle 11.1
Monitoring Agents
Exact Clone of DB
30 Confidential
Complex Operations Made Simple
Creating or cloning a database takes about 5 minutes.
31 Confidential
Administrators Are Still In Control
Standards and Best Practices are automatically enforced.
32 Confidential
Users Still Get What They Need
Users can still configure some options and parameters, guided by policy and best practices.
33 Confidential
Why You Should Care
Using Data Director, complex database operations are automated and simplified.1. Database Creation2. Database Cloning3. Data Movement4. Backup and Recovery5. Load Balancing6. Database Retirement Developers and Analysts can
create their own databases without an administrator.
34 Confidential
How Many Databases Can a DBA Manage with Data Director?
80?We break the direct relationship between DBAs and the number of databases under management.
35 Confidential
vFabric Data Director
Data Director will help you:1. Stretch Your Servers2. Liberate Your Licenses3. Double Your DBA Productivity4. Secure Your Stuff
36 Confidential
Database Security is Baked In
Concepts like database expiration are built into the provisioning process.
37 Confidential
Network Security is Baked In
Network Security is built into the provisioning process as well.
38 Confidential
Centralized DBaaS monitoring
All service level actions are closely monitored, logged, and tracked.
39 Confidential
A Real World Use Case
A Production Finance Database has data quality problems and an analyst needs to examine some highly sensitive data.
This is a very difficult challenge for:1. Security2. Compliance3. Database Operations4. System Administration
40 Confidential
TEMP SWAP LOG DATA
T
TEMP SWAP LOG DATA
DB Based on Oracle 11.1 Template
Linked Clones of a Database
Linux
DB Management Server
Data Director Application Oracle 11.1 Template
Linux
Oracle 11.1
Monitoring Agents
Shell Virtual Machines
Linux
Oracle 11.1
Monitoring Agents
Empty DBVM
Linux
Oracle 11.1
Monitoring Agents
Linked Clone of DB
∆The linked clone is a separate DB that shares the original storage and keeps a local copy of disk block changes.
41 Confidential
A Real World Use Case
Data Director can:•Create a linked clone of the original database that has an identical O/S and DB configuration.
•Ensure changes do not impact original DB.•Automatically discover and mask sensitive data.•Expire and delete the linked clone after 7 days.•Automatically remove any backups or snapshots.•Quickly create and apply a patch any databases with a similar configuration. Security
Compliance Database Operations System Administration
42
Summary
vFabric Data Director enables database-aware virtualization on VMware vSphere and provides database-as-a-service for heterogeneous databases and Hadoop
Reduce cost through database-aware virtualizationIncrease IT agilityAccelerate analytics and application development