may 26, 2010stockage mutualisé hdb – tdb the world of the database
TRANSCRIPT
May 26, 2010 Stockage mutualisé
HDB – TDB
The world of the Database
• Plan :– HDB size– TDB size– Infrastucture & security strategy
May 26, 2010 TANGO MEETING
HDB size
• 8835 attributs are in archiving
• 250 inserts per second
Period Quantity
> 1 hour 962
30 minutes 137
16 minutes 187
15 minutes 1208
10 minutes 452
8 minutes 1
6 minutes 1
5 minutes 12
3 minutes 50
1 minute 3650
30 secondes 463
10 secondes 1712
May 26, 2010 TANGO MEETING
evolution
May 26, 2010 TANGO MEETING
• Grows 40G per month
HDB size
• Database size 1.1 To (1.7 To used)
May 26, 2010 TANGO MEETING
TDB size
• 6512 attributs are in archiving
• Should have 6400 inserts per second, but we use temporary files.
Period Quantity
> 1 hour 254
15 minutes 203
10 minutes 545
1 minute 333
30 secondes 1
10 secondes 317
5 secondes 5
4 secondes 197
2 secondes 645
1 seconde 2116
500 ms 1886
100 ms 10
May 26, 2010 TANGO MEETING
TDB size
• TDB database : – Grows 21G per day– 31 days kept online– 78 000 files inserted per day (~3 sec
for a file containing 70000 rows).
May 26, 2010 TANGO MEETING
Architecture
• Before :
May 26, 2010 TANGO MEETING
HDBTDB
TemporaryDataBase
HdbArchiversTdbArchivers
HistoricalDataBase
May 26, 2010 TANGO MEETING
EMC disk array
Futur NAS EMC CelerraSecours
Réseau RCM
NAS EMC CelerraPrimaire
Réseaux RES & REEMC Clariion
Contrôleurs de disque
FC et SATA
EMC ClariionTiroirs de
disques SATA
EMC ClariionTiroirs de
disques FC
Switchs EMC FC
RGI1 room
NAS EMC CelerraPrimaire
Réseau RCM
NAS EMC CelerraSecondaire
Réseaux RES & REEMC Clariion
Contrôleurs de disque
FC et SATA
EMC ClariionTiroirs de
disques SATA
EMC ClariionTiroirs de
disques FC
Switchs EMC FC
RGI2 room
Racks EMCRacks EMCClariion CX4-240 + 1 x NAS Celerra NS42GClariion CX4-240 + 1 x NAS Celerra NS42G
+ 2 x switchs FC+ 2 x switchs FC
Racks EMCRacks EMCClariion CX4-240 + 2 x NAS Celerra NS42GClariion CX4-240 + 2 x NAS Celerra NS42G
+ 2 x switchs FC+ 2 x switchs FC
SAN FC & NAS SATA
Disk Array
• New storage configuration :– SAN (Fiber Channel 400Go disks)
• HDB : 3 To RAID5 (11 disks)• TDB : 1,5 To RAID10 (10 disks)• TEST : 1 To RAID4 (5 disks)
– NAS (SATA 1To disks)
• BACKUP : 3 To RAID6 (~ 8 disks)
– NAS (Fiber Channel 400Go disks)
• TDB_files : 1 To RAID5 (~ 6 disks)
May 26, 2010 TANGO MEETING
Cluster OracleCluster Oracle
Actual Architecture
• Now :
May 26, 2010 TANGO MEETING
Futur NAS EMC CelerraSecours
Réseau RCM
NAS EMC CelerraPrimaire
Réseaux RES & REEMC Clariion
Contrôleurs de disque
FC et SATA
EMC ClariionTiroirs de
disques SATA
EMC ClariionTiroirs de
disques FC
Switchs EMC FC
NAS EMC CelerraPrimaire
Réseau RCM
NAS EMC CelerraSecondaire
Réseaux RES & REEMC Clariion
Contrôleurs de disque
FC et SATA
EMC ClariionTiroirs de
disques SATA
EMC ClariionTiroirs de
disques FC
Switchs EMC FC
NAS
TEST (1To) TDB_files (1To) BACKUP (3To)HDB (3To)TDB (1.5To)
SAN
RCM networkRCM network
HdbArchivers TdbArchivers Degrad server
ADT-APT-AMT
HDB Backup strategy
• Logical Backup :– Every 4 hours : synchronisation between HDB and
degrad databases (configuration tables)– Every day : Export (Dumpfile) of configuration
tables (ADT,APT,AMT)
• Physical Backup :– RMAN (Recovery Manager)
• Every day, Bkp RW, 15 Go (40 minutes)• every 2 months, Bkp full, 300 Go (5 hours)
– Copy Backup• Ponctually, copy the backup to another media
(band)
– Test backup• Ponctually, I restore the backup on test server. (3/4
times per year)
May 26, 2010 TANGO MEETING
Question ?
May 26, 2010 TANGO MEETING