complete. soft1. hard1. - doag deutsche … · compression for sap better then expected stefan...

SOFT1. HARD1. COMPLETE.

The following is intended to outline our general

product direction. It is intended for inform

ation

purposes only, and m

ay not be incorporated into any

contract. It is not a commitm

ent to deliver any

material, code, or functionality, and should not be

relied upon in m

aking purchasing decisions.

The development, release, and timing of any

features or functionality described for Oracle’s

products remains at the sole discretion of Oracle.

Compression for SAP

better then expected

Stefan Menschel

Senior LeitenderSystemberater

BU Server Technology Germ

any

Konferenz 2010

Kompression

Allgemein

•verlustbehaftete Komprimierung

= Irrelevanzreduktion

Kompression

Beispiel : Irrelevanzreduktion

�verlustbehaftete Datenkomprimierung= Irrelevanzreduktion

keine fehlerfreie Rekonstruktion möglich !

RAW

JPG

Kompression

Allgemein

•verlustfreie Komprimierung

= Redundanzreduktion

•verlustbehaftete Komprimierung

= Irrelevanzreduktion

Kompression

Beispiel : Redundanzreduktion

KOMPRESSION = REDUNDANZREDUKTION

Kompression

Beispiel : Redundanzreduktion

KOMPRESSION = REDUNDANZREDUKTION

RE=1, SS=2, ION=3, DU=4

KOMP123 = 14NDANZ14KT3

HR

CRM

ERP

Data

Warehouse

Data

Mart

Data

Mart

Legacy

Applications

Data

Mart

eMail

Kompression

Redundanzreduktion

7z

ACE

ARJ

bzip2

gzip

rar

ZIP

LHA

WinRK

Datenkompression

Redundanzreduktion

�verlustfreie Datenkomprimierung = Redundanzreduktion

O-ACO

IndexKey

Compression

Table

Compression

Oracle Index Key Komprimierung

Beispiel: RedundanzreduktionfürMulti-Column Index

1A

X1

A1

ROWID01

1A

X1

B2

ROWID02

1A

X2

A3

ROWID03

1A

Y1

B4

ROWID04

1A

Y3

C5

ROWID05

1A

Y3

C6

ROWID06

1A

Y3

D7

ROWID07

1B

X1

A1

ROWID08

1B

X1

A2

ROWID09

1B

X1

C3

ROWID10

1B

X3

A4

ROWID11

1B

X3

C5

ROWID12

1B

X3

C6

ROWID13

Oracle Index Key “Komprimierung”

Beispiel: Prefix = 1

1A

X1

A1

ROWID01

1A

X1

B2

ROWID02

1A

X2

A3

ROWID03

1A

Y1

B4

ROWID04

1A

Y3

C5

ROWID05

1A

Y3

C6

ROWID06

1A

Y3

D7

ROWID07

1B

X1

A1

ROWID08

1B

X1

A2

ROWID09

1B

X1

C3

ROWID10

1B

X3

A4

ROWID11

1B

X3

C5

ROWID12

1B

X3

C6

ROWID13

Prefix

Suffix

12 values

eliminated

12 values

eliminated

1A

X1

A1

ROWID01

1A

X1

B2

ROWID02

1A

X2

A3

ROWID03

1A

Y1

B4

ROWID04

1A

Y3

C5

ROWID05

1A

Y3

C6

ROWID06

1A

Y3

D7

ROWID07

1B

X1

A1

ROWID08

1B

X1

A2

ROWID09

1B

X1

C3

ROWID10

1B

X3

A4

ROWID11

1B

X3

C5

ROWID12

1B

X3

C6

ROWID13

Prefix

Suffix

22 values

eliminated

22 values

eliminated



1A

X1

A1

ROWID01

1A

X1

B2

ROWID02

1A

X2

A3

ROWID03

1A

Y1

B4

ROWID04

1A

Y3

C5

ROWID05

1A

Y3

C6

ROWID06

1A

Y3

D7

ROWID07

1B

X1

A1

ROWID08

1B

X1

A2

ROWID09

1B

X1

C3

ROWID10

1B

X3

A4

ROWID11

1B

X3

C5

ROWID12

1B

X3

C6

ROWID13

Prefix

Suffix

30 values

eliminated

30 values

eliminated



1A

X1

A1

ROWID01

1A

X1

B2

ROWID02

1A

X2

A3

ROWID03

1A

Y1

B4

ROWID04

1A

Y3

C5

ROWID05

1A

Y3

C6

ROWID06

1A

Y3

D7

ROWID07

1B

X1

A1

ROWID08

1B

X1

A2

ROWID09

1B

X1

C3

ROWID10

1B

X3

A4

ROWID11

1B

X3

C5

ROWID12

1B

X3

C6

ROWID13

Prefix

Suffix

28 values

eliminated

28 values

eliminated



1A

X1

A1

ROWID01

1A

X1

B2

ROWID02

1A

X2

A3

ROWID03

1A

Y1

B4

ROWID04

1A

Y3

C5

ROWID05

1A

Y3

C6

ROWID06

1A

Y3

D7

ROWID07

1B

X1

A1

ROWID08

1B

X1

A2

ROWID09

1B

X1

C3

ROWID10

1B

X3

A4

ROWID11

1B

X3

C5

ROWID12

1B

X3

C6

ROWID13

Prefix

Suffix

15 values

eliminated

15 values

eliminated



1A

X1

A1

ROWID01

1A

X1

B2

ROWID02

1A

X2

A3

ROWID03

1A

Y1

B4

ROWID04

1A

Y3

C5

ROWID05

1A

Y3

C6

ROWID06

1A

Y3

D7

ROWID07

1B

X1

A1

ROWID08

1B

X1

A2

ROWID09

1B

X1

C3

ROWID10

1B

X3

A4

ROWID11

1B

X3

C5

ROWID12

1B

X3

C6

ROWID13

Prefix

Suffix0 values

eliminated

0 values

eliminated



Tabellen-Komprimierung

Smith

John

3

Doe

Jane

4

Doe

Jane

2

Doe

John

1

LAST_NAME

FIRST_NAME

ID

Employee Table

uncompressedblock

1•John•Doe 2•Jane•

Doe 3•John•Smith

4•

Jane •Doe

Free Space

Header

INSERT INTO employeeVALUES (5,'Jack', 'Smith');

COMMIT;

John=�|Doe=�|Jane=�|Smith=�

Header

Doe

Jane

4

Smith

John

3

Smith

Jack

5

Doe

Jane

2

Doe

John

1

LAST_NAME

FIRST_NAME

ID

Employee Table

1•John•Doe 2•Jane•

Doe 3•John•Smith

4•

Jane •Doe

Free Space

1•�

•�2•�

•�3•�

•�4 •�

•�

5•Jack•�

Free Space

compressedBlock

Block-local

Information

Block-local

Information

Oracle Kompression

Funktionalität

•LokaleSym

boltabelle

fürjedenDatenblock

•gehaltenim

Header des Datenblockes

more data per

block

more data per

block

Redundanzreduktion

Uncompressed

Block

Compressed

Block

partial

Compressed

Block

Compressed

Block

Empty

Block

Legend

Header Data

Free Space

Uncompressed Data

Compressed Data

Oracle TabellenKomprimierung

Methode

Oracle 11.2

Oracle 10.2

Advanced Compression Option

•OLTP Table Compression

•SecureFiles (LOB) Compression

•RMAN Backup Compression

•Expdp Compression

•Data Guard Network Compression

(SAP Note 1431296)

•Table Compression (direct load <SAP BI �

ODS/PSA –Tables>)

•Index Key Compression (since 10gR2 �

SAP Note 1109743)

•SecureFiles

•Deferred Segment Creation

•Dictionary only ADD COLUMN

Oracle Database 11.2

Compression + Storage Efficiency

Redundanzreduction

SecureFiles

die neuen LOBs

•signifikantschnellere

Wiedergabeim

Vergleichzum“alten”LOB

•erhöhterTransaktionsdurchsatz

durchgeringere

“Buffer Gets”

•vielbessere

Perform

ance im

VergleichzumBasicFile

•bessere CPU Auslastung

•Komprimierung inline & outline

SAP VBDATA Throughput (Insert/Read/Delete)

0

0,51

1,52

2,5

12

48

16

32

64

row size in KB

Performance

Improvement Factor

LONGs (9.2,10.2)

LOBs (10.2,11.2)

Securefiles 11.2

Deferred Segment Creation

Storage Efficiency-ObjectSpace Allocation

prior Oracle 11.2

CREATE TABLE <table_name> …

Oracle 11.2



Storage Efficiency-ObjectSpace Allocation

prior Oracle 11.2


Oracle 11.2


INSERT INTO <table_name> …


•leere

Objekte(Tabellen, Indizes, Partitionen)

benötigenkeinenSpeicherplatz

•50-60% allerSAP R/3 Objektesindleer

•50,000 –100,000 Objekteim

SAP BI sindleer

•schnellere

SAP DatenbankInstallation

Dictionary Only Add Column

Storage Efficiency-Object Space Allocation

prior Oracle 11.2

ALTER TABLE <table_name>

ADD column …

Oracle 11.2


ADD column …


Storage Efficiency-Object Space Allocation

prior Oracle 11.2


ADD column …

Oracle 11.2


ADD column …

UDPDATE <table_name>

SET col4 = 111

WHERE id = 2;

•Anlegen neuer Columns mit DEFAULT values and

NOT NULL

•bei S

AP upgrades

•oft genutzt im BW bei C

ube Änderungen

•Cube Änderungen bis zu 10x schneller

•Faktor 10-20 bessere Perform

ance bei B

W während des

ADD Column Prozess

•Speicherplatzersparniss


•Oracle IndexKey Compression

(SAP Note : 1109743)

•Oracle Table compression

(SAP BI �

PSA –ODS )

(SAP Note : 701235 )

•Oracle OLTPTable compressionfür(alle) Tabellen

(SAP Note : 1436352 )

Oracle Komprimierung

PositionierungbeiSAP

10.2.0.x

10.2.0.x

11.2.0.x11.2.0.x

Speicherplatzverteilung

Beispiel: Zuweisungim

SAP ERP

55%

12%

33%

Index Data

Structured Data

Unstructured Data

Efficient use of disk space (“implicit compression”):

Internal data representation, Object space allocation

Index Key

Compression

(since 10.2)

OLTP Data

Compression

SecureFiles

Compression

Ziel :

Redundanzreduktion

Oracle KomprimierungfürSAP

howto-1

Step 1

Upgrade existing database to Oracle 11.2

Upgrade from 9.2.0.8

�11.2.0.2

Patchset from 10.2.0.2

�10.2.0.4

Upgrade from 10.2.0.4

�11.2.0.2

(SAP Note 1431800 = Central Technical N

ote)

Step 2

Install SAP BR*Tools 7.20 Patch 3

(SAP Note 1430669 = BR*Tools support for Oracle 11g)

Step 3

Create new Tablespaces

PSAP<sid>

�PSAP<sid>_NEW

(LMTS +compress for OLTP)

extend PSAPUNDO + PSAPTEMP


howto-2

Step 4

compress tables and indexes

(SAP Note 1431296 + 1464156 )


howto-2

Step 4


(SAP Note 1431296 + 1464156 )

Example :

CLOB and BLOB -tables are converted and compressed onlineto SecureFile LOB

brspace -u / -f tbreorg -a lob2lob-o SAP<sidUSR> -s PSAP<oldTS> -t allsel -n

PSAP<newTS> -c ctablobind -lc medium –ic ora_proc -SCT

ctablobind

= compress tables, lobs and indexes

Medium

= LOB compression degree

ora_proc

= index evaluation procedure (sap_proc, val_cm

d)

SCT

= skip compressed tables


howto-2

Step 4


(SAP Note 1431296 + 1464156 )

Example :

CLOB and BLOB -tables are converted and compressed onlineto SecureFile LOB

brspace -u / -f tbreorg -a lob2lob-o SAP<sidUSR> -s PSAP<oldTS> -t allsel -n

PSAP<newTS> -c ctablobind -lc medium –ic ora_proc -SCT

oldTS

newTS

ctablobind

= compress tables, lobs and indexes

medium

= LOB compression degree

ora_proc

= index evaluation procedure (sap_proc, val_cm

d)

SCT

= skip compressed tables

newTS


brspacecommands

CREATE TABLE "SAPSID"."DBTABLOG#$"

( "LOGDATE" VARCHAR2(8) DEFAULT '00000000' N

OT NULL ENABLE,

"LOGTIME" VARCHAR2(6) DEFAULT '000000' N

OT NULL ENABLE,

"LOGID" VARCHAR2(18) DEFAULT ' ' N

OT NULL ENABLE,

"TABNAME" VARCHAR2(30) DEFAULT ' ' N

OT NULL ENABLE,

"LOGKEY" VARCHAR2(250) DEFAULT ' ' N

OT NULL ENABLE,

"HOSTNAME" VARCHAR2(20) DEFAULT ' ' N

OT NULL ENABLE,

"USERNAME" VARCHAR2(12) DEFAULT ' ' N

OT NULL ENABLE,

"TCODE" VARCHAR2(20) DEFAULT ' ' N

OT NULL ENABLE,

"PROGNAME" VARCHAR2(40) DEFAULT ' ' N

OT NULL ENABLE,

"OPTYPE" VARCHAR2(1) DEFAULT ' ' N

OT NULL ENABLE,

"VERSNO" VARCHAR2(2) DEFAULT ' ' N

OT NULL ENABLE,

"LANGUAGE" VARCHAR2(1) DEFAULT ' ' N

OT NULL ENABLE,

"DATALN" NUMBER(5,0) DEFAULT 0 NOT NULL ENABLE,

"LOGDATA" BLOB

)

PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255

COMPRESS FOR OLTPLOGGING

STORAGE(INITIAL 1782579200 NEXT 1048576 MINEXTENTS 1 MAXEXTENTS 2147483645

PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1

BUFFER_POOL DEFAULT FLASH_CACHE DEFAULT CELL_FLASH_CACHE DEFAULT)

TABLESPACE "PSAPSIDNEW" LOB ("LOGDATA")

STORE AS SECUREFILE( TABLESPACE "PSAPSIDNEW" ENABLE STORAGE IN ROW

CHUNK 8192 RETENTION CACHE COMPRESS MEDIUM


PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT FLASH_CACHE

DEFAULT CELL_FLASH_CACHE DEFAULT)) ;

CREATE UNIQUE INDEX "SAPSID"."ZZA02A~0#$" ON "SAPSID"."ZZA02A#$"

("RCLNT", "RYEAR", "DOCNR", "RLDNR", "RBUKRS", "DOCLN")

PCTFREE 1 INITRANS 2 MAXTRANS 255 COMPUTE STATISTICS COMPRESS 5


PCTINCREASE 0 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT FLASH_CACHE

DEFAULT CELL_FLASH_CACHE DEFAULT)

TABLESPACE "PSAPSIDNEW " ;


brspacelogfile

BR1142I Tables with the longest duration of reorganization for owner SAPSID

Pos. Owner Table

Rows

Duration [m:s]

1 SAPSID DBTABLOG

23.620.410 97:59

2 SAPSID CDCLS

7.600.710 32:30

3 SAPSID BALDAT

4.418.060 24:58

4 SAPSID BSIS

93.993.661 134:18

5 SAPSID ZZA04A

34.228.061 50:29

6 SAPSID COEJ

16.960.215 48:48

7 SAPSID COEP

24.014.700 45:01

8 SAPSID REGUH

12.695.140 36:15

9 SAPSID FAGLFLEXA

17.427.070 24:28

10 SAPSID BKPF

9.517.393 23:28


howto-3

Step 5

drop old tablespace

oldTS

newTS

Step 6

rename new tablespace to old tablespace

oldTS


Empfehlung: do not compress

•compress tables with more than 255 columns

(doesn‘t work)

(e.g. VDBEPI, DGTMD, RSEUMOD)

•SAP pool tables

(ATAB, UTAB)

•SAP cluster tables

(CDCLS, RFBLG)

•INDX-type tables

(BALDAT, SOC3)

•ABAP source and ABAP load tables

(REPOSRC and REPOLOAD)

•update tables

(VBHDR, VBDATA, VBMOD, VBERROR)

•RFC tables

(ARFCSSTATE, ARFCSDATA, ARFCRSTATE, TRFCQDATA,

TRFCQIN, TRFCQOUT,TRFCQSTATE, QRFCTRACE, QRFCLOG)

compressed by SAP

not recommended

Oracle Komprimierung

Ergebnisse

•einfach

zuimplementierenmitBR*Tools

•alle

leerenObjekte(Tabellenund Indizes) sindim

Anschluss

Deferred Segments

•online

Ergebniss: PoC Kompression SAP/ERP

After Reorg / Before Compress

34

%

65

%

1%

Ind

ex

Da

ten

(G

B)

Str

uk

turi

ert

e D

ate

n (

GB

)

Un

stru

ktu

rie

rte

Da

ten

(G

B)

359 GB

359 GB 8 GB

8 GB

187 GB

187 GB

Index Data

Structured Data

Unstructured Data837 GB

before Reorg

554 GB

after Reorg

Ergebnis: PoC Kompression SAP/ERP

Nach IndexKey und Tabellen Komprimierung

All

ok

iert

er

DB

Pla

tte

np

latz

(S

AP

/ER

P)

23

%

30

%

1%

46

%

Ind

ex

Da

ten

(G

B)

Str

uk

turi

ert

e D

ate

n (

GB

)

Un

stru

ktu

rie

rte

Da

ten

(G

B)

Fre

ier

Pla

tz

165 GB

165 GB

6 GB

6 GB

125 GB

125 GB

258 GB

258 GB

Index Data

Structured Data

Unstructured Data

Free Space

187 GB

187 GB

359 GB

359 GB

8 GB

8 GB

FREE

Ergebnisse

POC Kompression -Details

Table

Index

•erreichte Einsparung durch Kompression = 46%

•größte Einsparung durch

•Table -Compression (75%)

•IndexK

ey -Compression (24%)

•verbesserte read/write Perform

ance 10-15%

DB –Size

before

Reorganisation

in GByte

Oracle 10.2

DB –Size

after

Reorganisation

in GByte

Oracle 10.2

Saving

with

Reorganisation

in %

Oracle 10.2

DB –Size

after

Compression

in GByte

Oracle 11.2

Saving

with

Compression

in %

Oracle 11.2

Saving

with

Compression

in GByte

Oracle 11.2

overall-Saving

in %

Oracle 11.2

837 GB

554 GB

34%

296 GB

46%

258 GB

65%

Ergebnis: PoC Kompression SAP/ERP

Summary

More Information

http://www.oracle.com/sap

http://www.sdn.sap.com/irj/sdn/ora

email: [email protected]

SOFTWARE. HARDWARE. COMPLETE.

complete. soft1. hard1. - doag deutsche … · compression for sap better then expected stefan...

Documents