enterprise hybrid cloud 4.1 - dell emc us · solution overview ... patching oracle in enterprise...
TRANSCRIPT
[DOCUMENT TYPE]
ENTERPRISE HYBRID CLOUD 4.1.1
Oracle Database as a Service
March 2017
Abstract
This solution guide describes how to quickly and effectively provision, manage, patch,
and migrate Oracle Database 12c as a service on Enterprise Hybrid Cloud. This
includes single-instance and RAC configurations.
H15813R
This document is not intended for audiences in China, Hong Kong, and Taiwan.
Copyright
2 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
The information in this publication is provided as is. Dell Inc. makes no representations or warranties of any kind with respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose.
Use, copying, and distribution of any software described in this publication requires an applicable software license.
Copyright © 2017 Dell Inc. or its subsidiaries. All Rights Reserved. Dell, EMC, and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be the property of their respective owners. Published in the USA March 2017 Solution Guide H15813R.
Dell Inc. believes the information in this document is accurate as of its publication date. The information is subject to change without notice.
Contents
3 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
Contents
Chapter 1 Executive Summary 5
Business case ....................................................................................................... 6
Solution overview .................................................................................................. 6
Document purpose ................................................................................................ 8
Audience ............................................................................................................... 8
Essential reading .................................................................................................. 8
We value your feedback ........................................................................................ 8
Chapter 2 Solution Architecture 9
Overview ............................................................................................................. 10
Key components ................................................................................................. 11
Software resources ............................................................................................. 12
Chapter 3 Provisioning Oracle DBaaS 14
Overview ............................................................................................................. 15
Preparing the Oracle DBaaS service ................................................................... 15
Deploying Oracle DBaaS .................................................................................... 15
Chapter 4 Oracle DBaaS Maintenance Operations 20
Overview ............................................................................................................. 21
Adding storage capacity for Oracle DBaaS ......................................................... 21
Adding and removing Oracle Enterprise Manager monitoring targets .................. 26
Adding vCPU to a virtual machine ....................................................................... 27
Adding memory to a virtual machine ................................................................... 28
Chapter 5 Monitoring Oracle DBaaS 29
Overview ............................................................................................................. 30
Oracle Enterprise Manager Database Express 12c ............................................. 30
Oracle Enterprise Manager Cloud Control 12c .................................................... 30
vRealize Operations Manager ............................................................................. 31
Chapter 6 PDB Migration 34
Overview ............................................................................................................. 35
PDB copy preparation ......................................................................................... 36
PDB migration without data ................................................................................. 37
PDB migration with data ...................................................................................... 39
Contents
4 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
Chapter 7 Automated Oracle Patching 42
Overview ............................................................................................................. 43
Patching mechanisms ......................................................................................... 43
Patching Oracle in Enterprise Hybrid Cloud ........................................................ 43
Chapter 8 Conclusion 45
Summary ............................................................................................................ 46
Features .............................................................................................................. 46
Chapter 9 References 48
Enterprise Hybrid Cloud documentation .............................................................. 49
VMware documentation ...................................................................................... 49
Oracle documentation ......................................................................................... 49
Other documentation ........................................................................................... 49
Chapter 1: Executive Summary
5 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
Chapter 1 Executive Summary
This chapter presents the following topics:
Business case ..................................................................................................... 6
Solution overview ............................................................................................... 6
Document purpose ............................................................................................. 8
Audience .............................................................................................................. 8
Essential reading ................................................................................................ 8
We value your feedback ..................................................................................... 8
Chapter 1: Executive Summary
6 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
Business case
While many organizations have successfully introduced virtualization as a core technology
within their data centers, the benefits have largely been restricted to the IT infrastructure.
Business units, application owners, end users, developers, and database administrators
(DBAs) have yet to experience the full benefits of virtualization, including increased agility,
mobility, and control.
These organizations must also manage a growing and fragmented database
infrastructure. In addition to supporting an increased number of production databases,
DBAs and development teams must be able to create and copy multiple database
environments to meet business needs such as development and testing, reporting, and
troubleshooting.
Public cloud providers have built technology and business models to meet end-user
needs for agility and control. Organizations are now under pressure to provide the same
service levels within the secure and compliant confines of the on-premises data center. As
a result, IT departments need to deliver cost-effective alternatives to public clouds that do
not compromise enterprise requirements for data protection, disaster recovery, and
guaranteed service levels.
Traditional on-premises infrastructure gives IT teams more control, but provisioning of
database environments can take weeks. Public clouds speed up provisioning, but do not
always meet business requirements for data protection, disaster recovery, and service
levels. For this Oracle database-as-a-service (DBaaS) solution, Enterprise Hybrid Cloud
4.1.1 provides on-premises cloud services to meet these business requirements.
Solution overview
This Oracle DBaaS solution enables customers to use Enterprise Hybrid Cloud to perform
the following tasks:
Self-provision Oracle DBaaS on Enterprise Hybrid Cloud as:
A single-instance Oracle Database 12c on Oracle Automatic Storage Management (ASM)
A single-instance Oracle Database 12c on file system storage
An Oracle Database 12c with Oracle Real Application Clusters (RAC) on Oracle ASM
This creates an Oracle 12c container database (CDB) with an optional pluggable
database (PDB) in a single-tenant configuration.
Maintenance operations:
Add disks to Oracle ASM disk groups for both single-instance and RAC databases
Add disks to file system-based single-instance Oracle databases
Add vCPU to a virtual machine (VM)
Add memory to a virtual machine
Add or removing Oracle Enterprise Manager monitoring
Chapter 1: Executive Summary
7 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
Monitor the complete Oracle DBaaS solution using Oracle Enterprise Manager Cloud Control 12c (OEM) and VMware vRealize Operations Manager
Migrate a PDB between Oracle 12c CDBs, with or without data
Automated patching of Oracle grid infrastructure and database
Enterprise Hybrid Cloud is an enterprise-class, multitenant, multisite, scalable platform
enabling IT organizations to deploy an on-premises hybrid cloud that delivers
infrastructure as a service (IaaS) to their business quickly. It also provides a framework
and foundation for add-on modules such as application services, database as a service
(DBaaS), platform as a service (PaaS), and cloud brokering.
This solution uses VMware vRealize Automation and VMware vRealize Orchestrator. It
provides configurable workflows to enable the automated deployment and management of
Oracle DBaaS.
Enterprise Hybrid Cloud is designed to deliver multitenancy and secure separation of
resources. Cloud computing requires the ability to isolate resources and deliver secure
access. Enterprise Hybrid Cloud is structured so that, if required, each tenant can be:
Logically separated using vRealize Automation business groups. In this solution, the Oracle business group is assigned dedicated compute, storage, and network resources for software license compliance.
Physically separated in a dedicated Workload Pod. In this solution, Oracle is restricted to dedicated VMware vSphere clusters with High Availability (vSphere HA)/Distributed Resource Scheduler (DRS). The Workload Pod can have its own servers, network, and storage resources, separate from all other tenants.
These dedicated, physically separate, clustered Workload Pods are mapped to the
compute resource available to the vRealize Automation business group through a
VMware vCenter endpoint (either dedicated or shared). This improves service availability,
and helps ensure software license compliance by restricting where the virtual machines
and software are running or installed.
vRealize Orchestrator integrates with vRealize Automation and enables process
automation when interfacing with third-party systems. Further, vRealize Orchestrator
workflows can be deployed as custom services or actions in vRealize Automation to
enable complex deployment and maintenance operations for Oracle DBaaS.
Oracle Database 12c delivers industry-leading performance, scalability, security, and
reliability on a choice of clustered or single servers running Microsoft Windows, Linux, or
UNIX. It introduces a new architecture, Oracle Multitenant, where one or more PDBs are
created inside a CDB.
The multitenant architecture supports the following configurations:
A single-tenant configuration, with one PDB plugged into a CDB, is available for no extra cost in all editions.
A multitenant option for up to 252 PDBs per CDB is an extra-cost option of Oracle 12c Enterprise Edition.
Enterprise
Hybrid Cloud
Oracle Database
Chapter 1: Executive Summary
8 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
Oracle Grid Infrastructure combines Oracle ASM and Oracle Clusterware into a single set
of binaries, separate from the database software. This provides all the cluster and storage
services required to run an Oracle RAC or single-instance database.
This solution uses the ASMLib support library for Oracle ASM running on Oracle Linux 6.x
using the Unbreakable Enterprise Kernel (UEK) Release 3.
Document purpose
This guide describes a solution that allows you to quickly and effectively provision Oracle
DBaaS on Enterprise Hybrid Cloud. It introduces the main features and functionality of the
solution and describes the architecture and key components required to provision,
manage, and monitor Oracle DBaaS on Enterprise Hybrid Cloud.
Audience
This guide is intended for Dell EMC customers and qualified Dell EMC partners. The
guide assumes that users who intend to deploy this Oracle DBaaS solution have the
necessary training and background to install and configure an end-user computing
solution based on Enterprise Hybrid Cloud and Oracle Database 12c. Users should also
be familiar with the infrastructure and database security policies of the customer
installation.
Essential reading
The following guides provide further information about various aspects of Enterprise
Hybrid Cloud:
Enterprise Hybrid Cloud 4.1.1: Administration Guide
Enterprise Hybrid Cloud 4.1.1: Concepts and Architecture Guide
Enterprise Hybrid Cloud 4.1.1: Reference Architecture Guide
Enterprise Hybrid Cloud 4.1.1: Security Management Guide
Enterprise Hybrid Cloud 4.1.1: Infrastructure and Operations Management Guide
Enterprise Hybrid Cloud 4.1.1 Availability and Data Protection for Oracle Database Solution Guide
We value your feedback
Dell EMC and the authors of this document welcome your feedback on the solution and
the solution documentation. Contact [email protected] with your
comments.
Authors: Allan Robertson, Ed Spaenij, Tom Hudgins, Liam Buckley, Reed Tucker
Oracle Grid
Infrastructure
Chapter 2: Solution Architecture
9 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
Chapter 2 Solution Architecture
This chapter presents the following topics:
Overview ............................................................................................................ 10
Key components ............................................................................................... 11
Software resources ........................................................................................... 12
Chapter 2: Solution Architecture
10 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
Overview
This Oracle DBaaS solution provides the following application-specific functions:
Automated deployment and management of Oracle Database 12c
Single-instance Oracle Database with Oracle ASM
Single-instance Oracle Database on file system
Oracle Database with Oracle RAC and ASM
Oracle DBaaS maintenance operations
Add capacity to Oracle Database
Add or remove Oracle Enterprise Manager 12c Agent
Hot-add vCPU to an Oracle Server
Hot-add memory to an Oracle Server
Oracle DBaaS monitoring
Oracle Enterprise Manager Database Express 12c
Oracle Enterprise Manager Cloud Control 12c
vRealize Operations Manager
PDB migration
Copy PDB with or without data between Oracle CDBs
Automated patching of Oracle grid infrastructure and database
This Oracle DBaaS solution has been built and validated on a number of iterations and
configurations of Enterprise Hybrid Cloud. The underlying physical environment is
abstracted from the application layer by virtual and software-defined components. The
architecture shown in Figure 1 is representative of the architecture and environments
where the Oracle DBaaS solution is deployed. It shows the main components in the
Automation Pod that are relevant to this solution.
Chapter 2: Solution Architecture
11 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
Figure 1. Enterprise Hybrid Cloud reference architecture with Oracle Workload Pod
Figure 1 also shows the Oracle Workload Pod, which is a dedicated VMware ESXi cluster
with vSphere HA, and with its own compute, storage, and network resources. This
provides improved service availability and restricts where the virtual machines and
software are running or installed, which in turn ensures software license compliance.
vRealize Orchestrator contains a workflow library and a workflow engine to create and run
workflows that automate orchestration processes. You run workflows on the objects of
different technologies that vRealize Orchestrator accesses through a series of plug-ins.
vRealize Orchestrator also presents an open architecture to allow you to plug in external
third-party applications to the orchestration software. The resulting extensibility is known
as Anything-as-a-Service (XaaS). You can access vRealize Orchestrator, the vRealize
Orchestrator workflows, and the objects that vRealize Orchestrator exposes through its
client interface, or through Web services.
This solution leverages these capabilities to provide Oracle DBaaS.
Key components
The following components of Enterprise Hybrid Cloud are essential in this Oracle DBaaS
solution:
VMware ESXi and VMware vCenter Server
VMware vRealize Suite:
VMware vRealize Automation
VMware vRealize Operations Manager
VMware vRealize Orchestrator
Chapter 2: Solution Architecture
12 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
For this solution, when used with Oracle Database 12c, these VMware vRealize
components deliver the following functionality:
Provisioning of Oracle DBaaS—RAC or single-instance—using vRealize Orchestrator packages as XaaS blueprints in the vRealize Automation portal
Service maintenance operations using vRealize Orchestrator packages as service blueprints and resource actions in the vRealize Automation portal
Optional monitoring of Oracle DBaaS using OEM Cloud Control 12c Release 2, which can be integrated with vRealize Operations Manager using a third-party plug-in for full stack monitoring
Note: For a full overview of components, refer to the Enterprise Hybrid Cloud 4.1.1: Reference
Architecture Guide.
Software resources
Table 1 lists the application software components and supporting services used in this
Oracle solution for Enterprise Hybrid Cloud. For a complete list of Enterprise Hybrid Cloud
software requirements, refer to the relevant Dell EMC E-Lab EMC Simple Support Matrix
at elabnavigator.emc.com.
Table 1. Software resources
Software Version Description
Operating system software
Oracle Linux Server 6.6
UEK3
Oracle Linux is a Linux distribution based on Red Hat Enterprise Linux (RHEL), repackaged and distributed by Oracle.
Application software
Oracle Database 12c Release 1 12.1.0.2.0 Oracle Database software including Oracle Enterprise Manager Database Express 12c
Oracle Grid Infrastructure 12c Release 1
12.1.0.2.0 Oracle Clusterware is shipped with Oracle Grid Infrastructure, which is a suite of software packages that includes Oracle ASM for databases. Oracle Clusterware is a generic, general purpose clustering solution for all applications.
Application monitoring software
Oracle Enterprise Manager Cloud Control 12c
12.1.0.4 Oracle integrated Enterprise IT Management solution
Third party management software
Chapter 2: Solution Architecture
13 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
Software Version Description
vRealize Operations Management Pack for Oracle Enterprise Manager
6.0.1.0 This management pack, available from Blue Medora, extends vRealize Operations Manager by integrating with Oracle Enterprise Manager and providing comprehensive visibility and insights into the health, capacity, and performance of Oracle Databases, Oracle Middleware, and Oracle business critical applications. It helps to detect capacity and performance issues so they can be corrected before they cause a major impact.
Note: This solution uses Oracle Linux Server 6.6, which is supported by both VMware and Oracle.
Chapter 3: Provisioning Oracle DBaaS
14 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
Chapter 3 Provisioning Oracle DBaaS
This chapter presents the following topics:
Overview ............................................................................................................ 15
Preparing the Oracle DBaaS service ............................................................... 15
Deploying Oracle DBaaS .................................................................................. 15
Chapter 3: Provisioning Oracle DBaaS
15 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
Overview
Enterprise Hybrid Cloud provides a foundation for the successful and consistent
deployment of Oracle DBaaS. This chapter describes the high-level process and
methodology required to successfully deploy the applications by using vRealize
Orchestrator with the vRealize Automation Service Catalog and the Enterprise Hybrid
Cloud self-service portal. The Oracle DBaaS solution delivers a fully automated product to
install and configure:
Single-instance Oracle Database with Oracle ASM
Single-instance Oracle Database on file system
Oracle Database with Oracle RAC and Oracle ASM
Preparing the Oracle DBaaS service
Before provisioning a VMware virtual machine with an Oracle Database from the vRealize
Automation Service Catalog, an Enterprise Hybrid Cloud administrator configures storage
policies, default disk sizes, and other configuration settings that are unique to each
Enterprise Hybrid Cloud environment.
Storage policies provide the means for an Enterprise Hybrid Cloud administrator to
classify different types of storage based on characteristics such as performance or
protection. For example, a Gold storage policy might provide higher performance than a
Silver storage policy. After the storage policies are configured, the end-user can select a
particular storage policy when requesting an Oracle service.
A database consists of several data groups: for example, DATA, REDO, and FRA. Each
data group has a number of disks of a certain size. The solution provides configuration
options to allow the Enterprise Hybrid Cloud administrator to control the number and size
of these disks, based on the requested database size. If the chosen storage type is ASM,
then the disks are Oracle ASM disks. If the storage type is file system, then the disks are
LVM Logical Volumes.
The solution provides a number of other configuration options that are used to tie the
solution to the current environment.
When the Enterprise Hybrid Cloud administrator has configured the Oracle DBaaS
solution, it is ready for end users to deploy the Oracle Database service.
Deploying Oracle DBaaS
Deploying an Oracle database server involves many steps. Performing these steps
reliably and repeatedly is a challenge. The process is even more involved if a RAC
configuration is required. This solution automates these steps so that users can easily
request an Oracle database server–either single-instance or RAC–with just a few mouse
clicks.
Storage policies
Disk sizing
Other system
settings
Chapter 3: Provisioning Oracle DBaaS
16 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
Figure 2 shows an Oracle DBaaS Request Form that has been requested from the service
catalog. In this example, the user has requested a 200 GB Oracle 12c CDB with PDB,
deployed on a two-node RAC on Oracle ASM. In Figure 3, the user has requested the
same options but deployed a single-instance Oracle Database on file system.
Figure 2. Deployment request for a 2-node Oracle RAC
Figure 3. Deployment request for a single-instance Oracle Database server
The automated Oracle DBaaS provisioning process includes the following steps, all driven
from vRealize Orchestrator:
1. Collect request inputs.
The service collects inputs from the user that will drive the installation and
configuration of the Oracle Database service.
Oracle DBaaS deployment inputs include:
Chapter 3: Provisioning Oracle DBaaS
17 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
System or cluster (RAC) name
Requested storage space (GB)
Passwords for the Oracle and grid users
Set up automatic backup? – Yes/No
Storage policy
Storage type – ASM/FS
Is this a RAC cluster – if storage type ASM was selected? – Yes/No
Number of nodes – if RAC
Create a PDB? – Yes/No
PDB name, if PDB is requested
Protect the VM (with RP4VM)? – if single-instance – Yes/No
Email address for notification
This user input controls the setup of the Oracle DBaaS service in the subsequent
steps.
2. Provision virtual machines.
A virtual machine is cloned from the blueprint template by requesting the
published blueprint from the vRealize Automation Service Catalog.
If this is an Oracle RAC deployment, the required number of virtual machines is
cloned based on the number of requested nodes.
3. Create database storage.
The storage policy selected dictates which vCenter Server datastores are
allocated to the system. Using this mapping along with the requested storage
size, virtual disks are created for each data group–DATA, REDO, and FRA–
independent of storage type. For a RAC deployment, the additional disk group
CRS is created. In a RAC deployment, the virtual disks are created on the first
node of the cluster as “multi-writer” and are then shared with the other nodes of
the cluster.
All disk groups are configured to have one disk controller, except the DATA disk
group, which is configured to have two controllers. The DATA disks are balanced
over the two disk controllers.
For each disk group, the solution calculates the required size and number of disks
based on the overall database size.
4. Install Oracle Grid software.
Oracle Grid software provides the platform for the single-instance restart and the
RAC clustering environment.
If the chosen storage type is file system, the disks created in the previous step are
formatted and added as logical volumes in a volume group in the Logical Volume
Manager.
If the chosen storage type is ASM, the disks created in the previous step are
formatted and labeled for their respective ASM disk group. In a RAC deployment,
Chapter 3: Provisioning Oracle DBaaS
18 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
the disks are scanned on the other nodes so that their ASM instances can see
them as well.
The grid software is then installed and configured, which includes running post-
installation scripts as the root user.
5. Install Oracle Database software.
The Oracle Database software is installed next and configured to use the
provisioned disk groups. Post-installation root scripts are also run to complete the
configuration.
6. Create database.
A CDB is created after the database software has been installed. If, in the
request, the user chose to create a PDB, then it is created inside the CDB.
7. Enable local monitoring with Oracle 12c EM Express.
8. Enable data protection.
If the user set up Automatic Backup in step 1, the Oracle system will be added to
the default backup schedule in Dell EMC Avamar.
If the user chose protection by RecoverPoint for Virtual Machines, the Oracle
System will be added to a consistency group in RP4VMs.
9. Notify the user.
When the service is ready for use, the user receives an email with the
configuration details. For example:
System Information:
Cluster Name: devcluster Number of Nodes: 2 DB Size: 200 GB Storage Policy: Silver Storage Type: Oracle ASM SCAN Name: devcluster-scan SCAN IP: 1.2.3.210 SCAN IP: 1.2.3.213 Domain Name: company.com Node 1: ora-125 Public IP: 1.2.3.207 Public VIP: 1.2.3.219 Private IP: 192.168.1.3 Node 2: ora-124 Public IP: 1.2.3.205 Public VIP: 1.2.3.220 Private IP: 192.168.1.2 GRID_BASE: /u01/app/grid GRID_HOME: /u01/app/12.1.0/grid
Chapter 3: Provisioning Oracle DBaaS
19 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
ORACLE_BASE: /u01/app/oracle ORACLE_HOME: /u01/app/oracle/product/12.1.0/dbhome_1 CDB Name: devcluster PDB Name: salesdb
Chapter 4: Oracle DBaaS Maintenance Operations
20 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
Chapter 4 Oracle DBaaS Maintenance Operations
This chapter presents the following topics:
Overview ............................................................................................................ 21
Adding storage capacity for Oracle DBaaS ..................................................... 21
Adding and removing Oracle Enterprise Manager monitoring targets ......... 26
Adding vCPU to a virtual machine ................................................................... 27
Adding memory to a virtual machine ............................................................... 28
Chapter 4: Oracle DBaaS Maintenance Operations
21 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
Overview
After the Oracle Database service has been provisioned, environment and service
changes are sometimes required. These activities, sometimes known as Day 2
operations, include routine maintenance tasks and changes to the virtual infrastructure.
These activities can be as simple as restarting the virtual machine, but they might also
include changes that can affect the availability or cost of the service, such as adding
vCPU, memory, or disks.
You can run or schedule all these machine actions from the Items tab in vRealize
Automation, assuming that the correct entitlements have been assigned. If an approval
policy has been created against a specific action, then that change is not applied until an
approver has authorized the change.
Using vRealize Automation Advanced Services, you can deploy customized vRealize
Orchestrator workflows as resource actions. These resource actions extend the
functionality of the standard machine actions to deliver complex automated processes
against the deployed virtual machine.
This solution uses vRealize Orchestrator workflows, configured as resource actions, to
provide the following capabilities:
Adding storage capacity
Adding or removing Oracle Enterprise Manager monitoring
Hot-adding vCPU to a virtual machine
Hot-adding memory to a virtual machine
Adding storage capacity for Oracle DBaaS
For this solution, you can add new disks for single-instance databases or for RAC
database deployments. If the database is running on ASM, add the disks to the selected
ASM disk group, which increases the capacity of that disk group. If the database is
running on the file system, add the disks as physical volumes to the logical volume that
stores the selected data type.
For this solution, the term “data group” is used to describe either the ASM disk group or
LVM volume group that stores a specific type of database data (DATA, REDO, FRA).
Manually adding storage to a database is not straightforward. Adding disks to an existing
ASM disk group involves a number of steps using different tools and commands, as
follows:
1. Provision new virtual disks to the virtual machine (the first node in the case of RAC). Log in to vCenter Server and create virtual disks on the datastore that corresponds to the disk group being modified. Create “thick” (eager zero) disks and, in the case of RAC, enable them as multi-writer.
2. Format and label the new disks. When the disks have been provisioned, log in to the virtual machine as root, identify the newly added disks, and format and partition them. Then label the disks properly so that they can be discovered as candidate disks by ASM.
Chapter 4: Oracle DBaaS Maintenance Operations
22 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
3. Scan the disks on other RAC nodes. In the case of a RAC deployment, the ASM driver on each node must scan the newly formatted and labeled disks so that they are visible to the ASM instance.
4. Add the new disks to the designated ASM disk group by running a command as the grid user.
Similar steps are required when adding disks that are managed by a Logical Volume
Manager.
Performing these steps manually involves running many complex commands and can be
tedious and error-prone. The Oracle DBaaS solution automates this process and provides
a portal interface that lets you simply request additional storage and leaves the details to
underlying workflows.
When adding new disks to a data group of an Oracle deployment, you are prompted for
the following information:
Data group name
The additional amount of storage desired
For clarity, the entry form shows the current storage size. When you enter the amount of
additional storage, the form shows the new total amount of storage that will be available.
The actual storage size might be greater than requested because the system adds fixed
size disks, determined by the administrator, to provide the requested storage.
Figure 4 shows an example of the request form.
Figure 4. Adding new disks to a disk group
The new disks are the same size as the existing disks in the data group.
The workflow creates the requested disks and, in the case of a RAC deployment, makes
them visible to all the nodes of the cluster. The disks are then formatted, labeled, and
added to the data group.
In the case of ASM, when the disks are added, data on the disks in the disk group is
automatically rebalanced across all the disks.
You can use the asmcmd tool to show the composition of ASM disk groups. Figure 5 and
Figure 6 show the configuration of the DATA disk group before and after new disks are
added to the group.
Chapter 4: Oracle DBaaS Maintenance Operations
23 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
After the initial build of the Oracle server, the composition of the ASM disk groups shows
that there are two disks in the DATA disk group and the storage size is 20 GB.
Figure 5. Two disks in the DATA ASM disk group
Chapter 4: Oracle DBaaS Maintenance Operations
24 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
After requesting an additional 10 GB be added to the DATA disk group, the list of ASM
disks reflects the change.
Figure 6. Two disks added to the DATA ASM disk group
Since disks are added in multiples of two and the disk size, determined by the
administrator, is 10 GB, two additional disks were added and the total storage size
increased to 40 GB.
If the database is stored on the file system, you can use LVM commands to show the
composition of the volume groups, as shown in Figure 7.
Chapter 4: Oracle DBaaS Maintenance Operations
25 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
Figure 7. Disks currently in the DATA data group
After requesting another 10 GB of storage space for the DATA data group, the logical
volume information is as shown in Figure 8. Note that storage for the DATA data group is
added in multiples of two disks (because two SCSI controllers are used); therefore, two
additional disks were added.
Chapter 4: Oracle DBaaS Maintenance Operations
26 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
Figure 8. Two disks added to the DATA data group
Adding and removing Oracle Enterprise Manager monitoring targets
You can add or remove an Oracle Database server from Oracle Enterprise Manager
(OEM) through a maintenance operation, as shown in Figure 9. The solution installs or
removes the Oracle Management Agent on the server and it adds or removes appropriate
monitoring targets. Chapter 5 provides further information about Oracle Database
monitoring.
Chapter 4: Oracle DBaaS Maintenance Operations
27 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
Figure 9. Adding or removing OEM 12c Agents
This process is fully automated and does not require further information from the user to
complete the action.
Adding vCPU to a virtual machine
You can hot-add extra vCPU resources to a virtual machine without restarting the virtual
machine.
To hot-add vCPU to a virtual machine in vRealize Automation:
1. In the Items tab, select the machine to which you want to add new vCPU.
2. From the Actions menu, select Add vCPU.
3. From the list box, select the new total number of vCPUs for the machine, as shown in Figure 10, and then click Submit.
Chapter 4: Oracle DBaaS Maintenance Operations
28 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
Figure 10. Adding vCPU to a machine
The preceding steps reconfigure the virtual machine with the new vCPU count, as shown.
The Oracle Database instance recognizes the change and reflects the new value of the
initialization parameter CPU_COUNT.
Adding memory to a virtual machine
You can hot-add extra memory to a virtual machine without restarting the virtual machine.
To hot-add memory to a virtual machine in vRealize Automation:
On the Items tab, select the machine to which you want to add memory.
1. From the Actions menu, select Add Memory.
2. Select the New total amount of memory value, as shown in Figure 11, and click Submit.
Figure 11. Adding memory to a machine
The preceding steps reconfigure the virtual machine with the new memory.
Chapter 5: Monitoring Oracle DBaaS
29 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
Chapter 5 Monitoring Oracle DBaaS
This chapter presents the following topics:
Overview ............................................................................................................ 30
Oracle Enterprise Manager Database Express 12c ........................................ 30
Oracle Enterprise Manager Cloud Control 12c ............................................... 30
vRealize Operations Manager .......................................................................... 31
Chapter 5: Monitoring Oracle DBaaS
30 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
Overview
This chapter describes Oracle Database environment monitoring, including stand-alone
and extended solutions for monitoring Oracle Database 12c, the guest OS, and the full
stack for the Oracle Workload Pod.
Oracle Enterprise Manager Database Express 12c
OEM Database Express 12c (EM Express) is a web-based tool for managing Oracle
Database 12c. It is built into the database and runs in the XDB schema inside the
database. EM Express is easy to configure and offers support for basic database
administration tasks such as storage and user management. When licensed to provide
features beyond those for basic administration, EM Express provides comprehensive
solutions for performance diagnostics and tuning. Figure 12 shows the EM Express
Database Home screen.
Figure 12. EM Express Database Home screen
For this solution, EM Express is enabled by default as part of the Oracle Database 12c
deployment process.
Oracle Enterprise Manager Cloud Control 12c
OEM Cloud Control 12c is Oracle’s integrated enterprise IT management product line,
which is widely used for managing and monitoring the Oracle Database estate. It is highly
configurable and has a number of partner plug-ins such as the DELL EMC Storage Plug-
in for Oracle Enterprise Manager (OEM) 12c.
Using standard Oracle Enterprise Manager procedures, the database server can be
registered with OEM Cloud Control 12c, as shown in Figure 13.
Chapter 5: Monitoring Oracle DBaaS
31 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
Figure 13. Host, database, and listener targets after Oracle Database 12c deployment
vRealize Operations Manager
vRealize Operations Manager is the main operations management component of
Enterprise Hybrid Cloud. It provides a simplified approach to operations management of
physical and cloud infrastructures. vRealize Operations Manager includes prebuilt and
configurable dashboards that use colored badges to provide insights and visibility into the
health, risk, and efficiency of your infrastructure. vRealize Operations Manager provides
realtime performance management and capacity optimization capabilities, as shown in
Figure 14.
Chapter 5: Monitoring Oracle DBaaS
32 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
Figure 14. Oracle relationships for virtual machine in vRealize Operations Manager
Blue Medora offers the vRealize Operations Management Pack for Oracle Enterprise
Manager, which you can use to monitor the Oracle DBaaS solution.
vRealize Operations Management Pack for Oracle Enterprise Manager is an embedded
adapter that uses Oracle OEM data to monitor Oracle environments and maps the
relationships between the interconnected Oracle and VMware layers.
Obtaining OEM metrics using vRealize Operations Manager
OEM metrics are available under Administration > Inventory Explorer > Adapter
Instances > OEM – Adapter Instance > OEM Adapter. Click the “start collecting” (green
arrow) icon highlighted in Figure 15 to show metrics. The overview information presented
shows the status of data collection through the OEM adapter.
Figure 15. OEM adapter data collection in vRealize Operations Manager
Select Oracle EM Managed Environment from the Oracle dashboards list to display heat
maps, which provide an overall quick visual health status of the Oracle Database instance
and related objects such as virtual machines, host systems, and datastores.
OEM integration
with vRealize
Operations
Manager
Chapter 5: Monitoring Oracle DBaaS
33 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
You can view Health, Risk, and Efficiency badges for individual objects by clicking the
heat map for the database instances, as shown in Figure 16.
Figure 16. vRealize Operations Manager badge icons
Figure 17 shows the compliance of the database instance, as reported in OEM, against
the environment rules using the color of the badge. It also gives an overview of the
database resources and metrics.
Figure 17. OEM Managed Environment dashboard
Chapter 6: PDB Migration
34 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
Chapter 6 PDB Migration
This chapter presents the following topics:
Overview ............................................................................................................ 35
PDB copy preparation ...................................................................................... 36
PDB migration without data ............................................................................. 37
PDB migration with data ................................................................................... 39
Chapter 6: PDB Migration
35 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
Overview
After a database server is created in Enterprise Hybrid Cloud, there are many ongoing
maintenance tasks to perform and operational requirements to fulfill.
This chapter shows how you can use a vRealize Orchestrator workflow to migrate an
Oracle 12c PDB from any source to an Oracle 12c CDB running in Enterprise Hybrid
Cloud.
The options available to a DBA for copying a PDB are:
Copy a PDB over DB Link, no data (metadata only: users, schema, and code)
Copy a PDB over DB Link, including data
Use a transportable tablespace
Clone a PDB from an RMAN CDB backup set
Duplicate a PDB using RMAN on an active CDB
Unplug a PDB from source and plug-in a PDB to destination using manifest file (XML)
In deciding which method to use, there are several factors to consider, such as:
Is all or part of the source database available during the process?
How accessible is the data on the source (read-only or read-write) during the process?
Are other tools needed (datapump, RMAN, SQL*Plus, SSH)?
What is the impact on performance?
What is the complexity?
Do data governance, privacy, protection, and ownership allow copying this data?
In most business environments, different teams or projects have a copy of a data set – for
example for development, testing, QA, and so on. However, to comply with governance,
privacy, and protection rules, this data usually needs to be restricted (subsetted) and
masked. Organizations have their own tools and procedures for these specific tasks,
which are outside the scope of this document.
Copying a PDB and optionally including the data is supported by the Oracle DBaaS
solution and made available to the end user through the VRealize Automation service
catalog.
The option that is the most efficient, the least complex, has the least impact, and is the
fastest for copying the PDB is the ”Copy a PDB over DB Link, …” option. It creates a
database link to the source database, and it copies the PDB metadata (and optionally the
data) over the link. It can be implemented in Oracle 12c by using only SQL.
PDB copy
options and
choice
Chapter 6: PDB Migration
36 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
PDB copy preparation
You must prepare the source PDB for the copy process. The source PDB can be on an
Enterprise Hybrid Cloud-managed server, or it can be on a non-Enterprise Hybrid Cloud-
managed server.
You can enable or disable the source PDB for the copy process. If you choose to enable
the source PDB for copying, a special user is created in the source CDB specifically for
the copy process. If you choose to disable the source PDB for copying, the user is
dropped from the source CDB.
When the Copy PDB function runs, the special user can log in and copy the metadata.
Additionally, if the copy is requested to include the data itself, the special user can bring
the source PDB temporarily into read-only mode for the duration of the actual data copy.
The Copy PDB: Enable-Disable source CDB workflow is made available in the Enterprise
Hybrid Cloud Service Catalog, as shown in Figure 18.
Figure 18. Source PDB preparation
The notification email address is used to confirm that the source database has been
prepared, as shown in Figure 19:
Overview
Request
Chapter 6: PDB Migration
37 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
Figure 19. Notification email
PDB migration without data
After you enable a source PDB, you can request a Copy PDB operation. When you
request the copy excluding the data, the source PDB will stay unchanged in read-write
mode. Any pre-existing database connections remain connected during this operation.
Figure 20 and Figure 21 show examples of the input forms.
Figure 20. PDB Migration Source Server Information Form
Overview
Request
Chapter 6: PDB Migration
38 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
Figure 21. PDB Migration Target Server Form
When you submit the request, the PDB is migrated to the target CDB within Enterprise
Hybrid Cloud. Because this request excluded the data, only the metadata is copied. This
operation is very fast and efficient.
The source pluggable database contains a schema owner ‘TESTER’, with two table
objects with data:
salesserv1$ sqlplus / as sysdba
SQL> alter session set container=sales1;
Session altered.
SQL> select owner, table_name, tablespace_name, status
2 from all_tables
3 where owner='TESTER';
OWNER TABLE_NAME TABLESPACE_NAME STATUS
---------- ---------- --------------- ----------
TESTER DEPT USERS VALID
TESTER EMP USERS VALID
SQL> select 'dept' as "TABLE", count(*) as count from tester.dept
2 union all
3 select 'emp',count(*) from tester.emp;
TABLE COUNT
----- ----------
dept 3
emp 6
Verification
Chapter 6: PDB Migration
39 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
You can verify that the newly created target pluggable database contains the matching
schema owner and objects, now without data, as follows:
ora-ch164$ sqlplus / as sysdba
SQL> alter session set container=sales2;
Session altered.
SQL> select username from all_users where username='TESTER';
USERNAME
--------------------------------------------------------------------------
TESTER
SQL> select owner, table_name, tablespace_name, status
2 from all_tables
3 where owner='TESTER';
OWNER TABLE_NAME TABLESPACE_NAME STATUS
---------- ---------- --------------- ----------
TESTER DEPT USERS VALID
TESTER EMP USERS VALID
SQL> select 'dept' as "TABLE", count(*) as count from tester.dept
2 union all
3 select 'emp',count(*) from tester.emp;
TABLE COUNT
----- ----------
dept 0
emp 0
PDB migration with data
After you enable a source PDB, you can request a Copy PDB operation. When the copy is
requested to include the data, this process temporarily brings the source PDB into read-
only mode. This happens only when the copy is being made, and only if it is requested to
include the data. The mode is changed back after the data copy has finished. Any pre-
existing database connections remain connected during this operation.
Figure 20 and Figure 21 show examples of the input forms.
Overview
Request
Chapter 6: PDB Migration
40 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
Figure 22. PDB migration source server form
Figure 23. PDB migration target server form
When you submit the request, the PDB–including data–is migrated to the target CDB
within Enterprise Hybrid Cloud. This transfers the data over a database link that is created
in the target database. This is fast and efficient for smaller databases.
The source pluggable database contains a schema owner ‘TESTER’, with two table
objects with data:
salesserv1$ sqlplus / as sysdba
SQL> alter session set container=sales1;
Session altered.
SQL> select owner, table_name, tablespace_name, status
Verification
Chapter 6: PDB Migration
41 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
2 from all_tables
3 where owner='TESTER';
OWNER TABLE_NAME TABLESPACE_NAME STATUS
---------- ---------- --------------- ----------
TESTER DEPT USERS VALID
TESTER EMP USERS VALID
SQL> select 'dept' as "TABLE", count(*) as count from tester.dept
2 union all
3 select 'emp',count(*) from tester.emp;
TABLE COUNT
----- ----------
dept 3
emp 6
You can verify that the newly created target pluggable database contains the matching
schema owner and objects, with their data, as follows:
ora-ch164$ sqlplus / as sysdba
SQL> alter session set container=sales2;
Session altered.
SQL> select username from all_users where username='TESTER';
USERNAME
--------------------------------------------------------------------------
TESTER
SQL> select owner, table_name, tablespace_name, status
2 from all_tables
3 where owner='TESTER';
OWNER TABLE_NAME TABLESPACE_NAME STATUS
---------- ---------- --------------- ----------
TESTER DEPT USERS VALID
TESTER EMP USERS VALID
SQL> select 'dept' as "TABLE", count(*) as count from tester.dept
2 union all
3 select 'emp',count(*) from tester.emp;
TABLE COUNT
----- ----------
dept 3
emp 6
Chapter 7: Automated Oracle Patching
42 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
Chapter 7 Automated Oracle Patching
This chapter presents the following topics:
Overview ............................................................................................................ 43
Patching mechanisms ...................................................................................... 43
Patching Oracle in Enterprise Hybrid Cloud ................................................... 43
Chapter 7: Automated Oracle Patching
43 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
Overview
Patching an Oracle database is an essential task, but it can be daunting given the myriad
patches and updates released on a regular basis. Since Oracle DBaaS end users may not
have experience in identifying and implementing a patch strategy, critical patches could
be ignored, putting systems and data at risk.
Oracle DBaaS includes functionality that lets you easily apply Oracle quarterly patches to
your deployed systems.
Patching mechanisms
Oracle provides both proactive and reactive patches with multiple delivery methods.
Proactive patches generally follow a scheduled release cycle—normally quarterly—and
supply a cumulative collection of fixes. Reactive patches are normally interim or single
fixes that are usually included in the next relevant proactive patch.
For our purposes, the main proactive patching methods include:
Security Patch Update (SPU)—(formerly called Critical Patch Update) this patch provides security fixes for Oracle products.
Patch Set Update (PSU)—a collection of patches that have been tested together and include SPUs as well as high-impact/low-risk critical bug fixes. Separate PSUs are supplied for the Oracle Database and Grid Infrastructure software.
Bundle Patch—in this case, the Database Proactive Bundle Patch (DPBP) is a collection of patches and is a superset of the PSU, spanning the Oracle Database and Grid Infrastructure software stack.
Each patch in these collections of patches has specific prerequisites and installation steps
that must be followed to apply the patch correctly. Patching methods cannot be mixed in
the same ORACLE_HOME. Changing the patching method requires a full roll-back of the
previous mechanism’s patches.
For this Oracle DBaaS solution, the DPBP has been chosen as the patching method. The
solution provides workflows to download and apply a selected DPBP. For a single-
instance Oracle database, this requires an outage. For RAC systems, patches are applied
in a rolling fashion, one node at a time, with little or no database downtime.
To have complete patching control, the DBA needs to understand the available patching
mechanisms and implement a process to manually apply the required compatible patches.
Patching Oracle in Enterprise Hybrid Cloud
As a best practice, perform a database and virtual machine backup before applying
patches.
To apply the latest quarterly DPBP to a deployed Oracle DBaaS system, just select the
system – a standalone system or any of the nodes of a RAC system – and choose the
Apply Quarterly Patch Bundle option, as shown in Figure 24.
Chapter 7: Automated Oracle Patching
44 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
Figure 24. Selecting the quarterly patch option
Select the desired quarterly patch version and enter your Oracle Support login credentials,
as shown in Figure 25. The requested DPBP is downloaded and automatically applied to
the system, patching the grid infrastructure and the Oracle database, depending on the
content of the DPBP.
Figure 25. Applying the quarterly patch option
When a RAC system is patched, the patch is applied in a rolling fashion so that the cluster
remains up during the process.
When the process completes, you receive an email summarizing the steps taken during
the application of the patch including the location of log files generated.
The Automated Oracle Patching capability of Oracle DBaaS significantly simplifies this
challenging task and helps keep deployed Oracle systems secure and operational.
Chapter 8: Conclusion
45 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
Chapter 8 Conclusion
This chapter presents the following topics:
Summary ........................................................................................................... 46
Features ............................................................................................................. 46
Chapter 8: Conclusion
46 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
Summary
Enterprise Hybrid Cloud enables customers to build an enterprise-class, scalable platform
for complete infrastructure service lifecycle management.
This solution incorporates the following concepts:
Self-service and automation
Workload-optimized storage
Security and compliance
Monitoring and service assurance
The integration of Oracle DBaaS into Enterprise Hybrid Cloud fully supports Oracle users
with a self-service environment. For IT, this results in an automated, repeatable process
that reduces errors and improves time-to-value.
For the end-user to be able to request a multi-node clustered database on-demand, using
the self-service portal is highly beneficial. It reduces significant time and effort otherwise
required to deploy a cluster manually. The user simply makes the request and then
receives an automated email with deployment details when the request is complete.
Features
This solution enables the deployment of Oracle DBaaS on Enterprise Hybrid Cloud. The
key features of this solution are as follows:
The Workload Pod for Oracle DBaaS improves management of Oracle licensing compliance.
Application developers and service users can self-provision Oracle DBaaS on Enterprise Hybrid Cloud as:
A single-instance Oracle Database with Oracle Automatic Storage Management (ASM) or on file system.
An Oracle Database with Oracle Real Application Clusters (RAC) and ASM.
This creates an Oracle 12c Container Database (CDB) with an optional Pluggable
Database (PDB) in a single-tenant configuration. The deployed system can be
optionally added to an automatic backup schedule.
The solution enables users to perform Oracle DBaaS maintenance operations:
Add storage capacity to the Oracle database – single-instance and RAC.
Migrate a PDB to an Oracle 12c CDB deployed on Enterprise Hybrid Cloud with or without data.
Add and remove Oracle DBaaS monitoring.
Hot-add virtual CPU and memory.
Apply Oracle Patch Set Updates (quarterly patch bundles) automatically on single-instance and RAC databases on file system or ASM storage.
Chapter 8: Conclusion
47 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
Enable monitoring of the complete Oracle DBaaS solution by using Oracle Enterprise Manager Cloud Control 12c (OEM) and VMware vRealize Operations Manager.
Chapter 9: References
48 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service Solution Guide
Chapter 9 References
This chapter presents the following topics:
Enterprise Hybrid Cloud documentation ......................................................... 49
VMware documentation .................................................................................... 49
Oracle documentation ...................................................................................... 49
Other documentation ........................................................................................ 49
Chapter 9: References
49 Enterprise Hybrid Cloud 4.1.1 Oracle Database as a Service
Solution Guide
Enterprise Hybrid Cloud documentation
See Essential reading for a complete list of Enterprise Hybrid Cloud documentation.
VMware documentation
Refer to the following on the VMware website:
VMware vRealize Automation documentation
VMware vRealize Operations Manager documentation
Oracle documentation
Refer to the following on the Oracle website:
Oracle Enterprise Manager Cloud Control 12c Advanced Installation and Configuration Guide
Oracle Database 12c Release 1 (12.1) Documentation:
Database Installation Guide for Linux
Grid Infrastructure Installation Guide for Linux
Real Application Clusters Installation Guide for Linux and UNIX
Automatic Storage Management Administrator's Guide
My Oracle Support documentation:
Oracle Database - Overview of Database Patch Delivery Methods (Doc ID 1962125.1)
Other documentation
Refer to the following documentation on the Blue Medora website:
vRealize Operations Management Pack for Oracle Enterprise Manager (OEM) Installation and Configuration Guide
vRealize Operations Management Pack for Oracle Enterprise Manager User Guide