information life cycle management avec oracle 12c

BASEL BERN BRUGG DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. GENEVA HAMBURG COPENHAGEN LAUSANNE MUNICH STUTTGART VIENNA ZURICH

Oracle 12cEmiliano Fusaglia Principal Consultant LS-IMSInformation Lifecycle Management

Agenda

2 11/26/2015

1. Introduction to ILMData ExplosionILM DefinitionILM ChallengerExisting ILM SolutionsOverview Oracle 12c ILM

2. Oracle 12c ILMHeat MapAutomatic Data Optimization

Oracle 12c ILM

Oracle 12c ILM3 11/26/2015

Introduction to ILM

Data Explosion

4 11/26/2015

Where did the data explosion come from?

Longer data retention driven by business need and new law enforcement.The more and more customer data becomes valuable and saved on CRM, ERP, DWH and Big Data systems.IoTCurrent trend shows that data doubles every 18 months!

Oracle 12c ILM

Information Lifecycle Management - Definition

5 11/26/2015

What does Information Lifecycle Management mean?

Information Lifecycle Management (ILM) refers to a wide-ranging set of strategies for administering storage systems on computing devices.

ILM comprises the policies, processes, practices, and tools used to align the business value of information with the most appropriate and cost effective IT infrastructure from the time information is conceived through its final disposition

Oracle 12c ILM

Information Lifecycle Management - Challenger

6 11/26/2015 Oracle 12c ILM

Information Lifecycle Management - Challenger

7 11/26/2015

More Data to manage without additional cost

Define ILM processesCompress Data without impacting performance

Distribute the data on multi-tiers devices

Oracle 12c ILM

Existing ILM solutions

8 11/26/2015

Application consolidationData compressionStorage TieringOffline ArchivesData Retention/Deletion

Which are the existing ILM solutions?Increase data density but probably not enough.Efficient, but can penalize the performance.Difficult for the Storage to identify the correct data to move. To query offline data can become highly inefficient.Loss of historical information.

Oracle 12c ILM

9 11/26/2015

Oracle 12c ILM

Oracle 12c ILM

Review of what was already possible in Oracle 11g

10 11/26/2015

Source: Oracle Corporation ILM Webpage

Oracle 12c ILM

Overview Oracle 12c ILM

11 11/26/2015

Source: Oracle Corporation ILM Webpage

Oracle 12c ILM

Overview Oracle 12c ILM

12 11/26/2015

Data Classification

Rules for data movement and compression

ILM Automatization

Oracle 12c ILM

Oracle 12c ILM

13 11/26/2015

Heat MapAsynchronously analyze the I/O issued on the database, and resource efficiently (<5% cost) it maintains the Data Heat Map.Recognize application I/O requests from system I/O requestsCan collect statistics at database, tablespace, segment and row level.

Automatic Data Optimization (ADO)Part of the Advanced Compression Option.Permits to define the data lifecycle policies using SQL and PL/SQL functions. Supports automated compression and storage tiering.Automated solution which enforces the defined policies .

Oracle 12c ILM rely on the following components:

Oracle 12c ILM

Oracle 12c ILM: Heat Map

14 11/26/2015

Enable Hot/Cold data classification :

PL/SQL API for querying Heat Map statistics:

ALTER SYSTEM SET HEAT_MAP = ON;

ALTER SESSION SET HEAT_MAP = ON;

SELECT tablespace_name, min_writetime, min_ftstimeFROM table(dbms_heat_map.tablespace_heat_map('EXAMPLE'))

Oracle 12c ILM

Oracle 12c ILM: Heat Map on Enterprise Manager

15 11/26/2015

Hot Data Warm Data Cold Data

Oracle 12c ILM

Oracle 12c ILM: Automatic Data Optimization (ADO)

16 11/26/2015

0101000011110101010101000010101010010000101010100101010101010010100011110101010101101

01001101101110100101010010101010101010101010101010101010101010101010101010101010101010101010101010101010011010100110100101010101010010101010101010101010101001110100101010100101010101010011010101011100101010100101001100101010101010010110011010101010010101010101010110100101010100101

0101010101011010101001010101010101010101010010101010010100101010100101010010101101011010100110101011111100101010010000000000001111110111111111111010100101000010100010100100110011111101000101001001010000001001111111010101111111110010000010100010100101001010010100101011011111010101001001010101001011110101011111110101010010101010010100111111111110101001010101000000000010101010001010101001010101010111010101001010101010010101010010101010101010101010101010101010101001010010101010101010101010101010101010010101010101010101010101010101010101010101010101010100101010101010101010101010101011111101000000110101010111010101010010101010101010010101001010101010001010101001010101010111010101001010101010010101010010101010101010101010101010101010101001010010101010101010101010101010101010010101010101010101010101010101010101010101010101010100101010101010101010101010101011111101000000

Hot Data Warm Data Cold Data

Advanced Row Compression 3x

ADO & Data Compression

*Columnar Query Compression 10x

*Columnar Archive Compression 15x

*Columnar Compression available on Exadata and other Oracle Storage (ZFS, Pillar, etc..) only.Oracle 12c ILM

Automatic Data OptimizationAdd compression and tiering policies to tables

Oldest Data Most Recent Data

Policy 1Policy 1

Policy 2Policy 2

Compress Partitions with Advanced Compression if they haven’t been modified in 30 days

Compress Partitions with Hybrid Columnar Compression if they haven’t been modified from in 180 days

Oracle 12c ILM

Automatic Data OptimizationA heat map tracks the activity of segments and blocks


Policy 1Policy 1

Policy 2Policy 2

Oracle 12c ILM

Automatic Data OptimizationPolicies are automatically applied to tables


Policy 1Policy 1

Policy 2Policy 2

If after 30 days partitions haven’t be modified they will be compressed using advanced row compression

Oracle 12c ILM



Policy 1Policy 1

Policy 2Policy 2

After 180 days of no modification, the oldest partition is identified to be compressed using Hybrid Columnar compression

Oracle 12c ILM



Policy 1Policy 1

Policy 2Policy 2

Oracle 12c ILM

Automatic Data OptimizationReduce storage footprint, read compressed data faster


Policy 1Policy 1

Policy 2Policy 2

Oracle 12c ILM

Automatic Data OptimizationAutomatically tier data to lower cost storage


Policy 1Policy 1

Policy 2Policy 2

Policy 3Policy 3

If the tablespace is nearly full then compress the oldest partition with Archive Hybrid ColumarCompression and move it to Tier 2 Storage

Oracle 12c ILM

Automatic Data OptimizationCompress data over it’s lifecycle


No CompressionAdvanced RowCompressionHybrid Columnar QueryCompression

Hybrid Columnar ArchiveCompression

3XCompressionOLTP10XCompressionReporting

15XCompressionCompliance

Oracle 12c ILM


25 11/26/2015

COMPRESS BASIC (alias Batch Compression)COMPRESS ADVANCED (alias OLTP Compression)

CREATE TABLE sales (prod_id NUMBER NOT NULL,cust_id NUMBER NOT NULL, ...)

PARTITION BY RANGE (time_id) ( PARTITION sales_2012 VALUES LESS THAN(TO_DATE(...))

ROW STORE COMPRESS BASIC,PARTITION sales_2013 VALUES LESS THAN (MAXVALUE)

ROW STORE COMPRESS ADVANCED);


Oracle 12c ILM


26 11/26/2015

Add row-level compression policy after 14 days of no modificationsCOMPRESS ADVANCED (alias OLTP Compression)


ALTER TABLE empILM ADD POLICY ROW STORE COMPRESS ADVANCED ROW AFTER 14 DAYS OF NO MODIFICATION;

ALTER TABLE sales MODIFY PARTITION sales_2011 ILM ADD POLICY COMPRESS FOR ARCHIVE HIGH SEGMENT AFTER 6 MONTHS OF NO ACCESS;

Add segment-level compression policy after 6 months of no modifications

Oracle 12c ILM


27 11/26/2015

ADO & Storage Tiering

2009 2010 2011 2012 2013 2014 CurrentYear

Sales TablePartitioned by Year

High End SSD DisksMid-Tier Storage DisksLow End Storage Disks$ $$ $$$$

Oracle 12c ILM


28 11/26/2015

Add Storage tier policyADO & Storage Tiering

ALTER TABLE sales MODIFY PARTITION sales_2011 ILM ADD POLICY TIER TO low_end_tablespace;

ALTER TABLE sales MODIFY PARTITION sales_2015 ILM ADD POLICY TIER TO high_end_tablespace;The partition movement occurs when the source tablespace has reached a capacity threshold. The threshold for activating tiering policies is based on two parameters: TBS PERCENT USED and TBS PERCENT FREE, which are controlled by the DBMS_ILM_ADMIN package, (default values 85% and 25%).

Oracle 12c ILM

Oracle 12c ILM - Summary

29 11/26/2015

All ILM features are Application Transparent.Heat Map statistics provide fine grained I/O classification. ADO policies permit to automate data movement and compression.Support to complex business rules for data archiving actions. Oracle Advanced Compression option is required.

Oracle 12c ILM

Emiliano FusagliaPrincipal ConsultantTel. +41-79-909 7213 [email protected]

11/26/201530 Oracle 12c ILM

information life cycle management avec oracle 12c

Data & Analytics