unix storage presentation

8/13/2019 Unix Storage Presentation

1/25

2004 Capgemini Energy LP. All Rights Reserved. Proprietary and Confidential.

Welcome to Capgemini Energy a !"siness servicecompany that #ill aim to deliver yo"r immense depthof "tility ind"stry $no#ledgeand !"siness service s$ills to energy and "tilityc"stomers across %orth America.

Unix Storage

Introduction PresentationMay 4, 2005


2/25


IntroductionScope

Storage Concepts

Storage Topology Internal SCSI Disks External RAID

External SSA NFS SAN NAS Virtual

Working it! "DS co##and utilities

$olicies% &uidelines and $rocedures


3/25


Scope

Scope

T!is presentation co'ers Storage standards% design andconcepts in t!e C&E en'iron#ent(

T!is presentation is not designed as a tutorial on Storageoperations(

T!is presentation ill co'er necessary co##and sets toco##unicate it! t!e C&E storage group(


4/25


Redundancy

"ig! A'aila)ility

Disaster Reco'ery

Storage Concepts


5/25


$urpose o* storage redundancy is )usiness continuity( T!is is used topre'ent one or #ore *ailures o* !ard are or so*t are resulting in data

loss(

T!e co##on understanding o* storage redundancy is to utili+e*unctionalities o* t!e di**erent RAID le'els ,-./-0 or so*t are )asedtec!nology suc! as data replication copies(

Storage Redundancy can )e 'ie ed in t!ree le'els1 Standalone Ser'er Clustered En'iron#ent , Spanning #ultiple ser'ers 0 Disaster Reco'ery En'iron#ent , Spanning #ultiple sites 0

Eac! o* t!e t!ree le'els o* Storage Redundancy can )e o)ser'edit!in t!e C&E en'iron#ent and2or its clients(

Storage Redundancy


6/25


Storage "ig! A'aila)ility

$urpose o* storage !ig! a'aila)ility is )usiness continuity

and2or disaster reco'ery( T!is is used to pre'ent one or #ore*ailures o* !ard are or so*t are resulting in data loss(

T!e co##on understanding o* storage !ig! a'aila)ility isredundancy it!in a cluster o* ser'ers !en 'ie ed *ro# aser'er centric aspect and cluster o* storage array units *ro# astorage centric 'ie (

Storage "ig! A'aila)ility can )e 'ie ed *ro# t!ese aspects1 3ultiple ser'ers accessing single storage de'ices Storage Arrays #irroring across #ultiple *ra#es or it!in a

single *ra#e( Single or #ultiple ser'ers accessing #ultiple storage

de'ices(

Eac! o* t!ese aspects o* "ig! A'aila)ility can )e *ound it!int!e C&E en'iron#ent or t!at o* its clients


7/25 2004 Capgemini Energy LP. All Rights Reserved. Proprietary and Confidential.

$urpose o* storage disaster reco'ery is dri'en )y )usinessre4uire#ents( T!is is used to pre'ent one or #ore *ailures o*

!ard are or so*t are resulting in data loss at a site to site le'el(

T!e co##on understanding o* storage disaster reco'ery isredundancy )et een sites *or ser'ers and storage arrays(

Storage Disaster Reco'ery can )e 'ie ed *ro# t!ese aspects1 3ultiple ser'ers replicating single storage de'ices across #ultiplesites( 3ultiple ser'ers replicating transaction c!anges across #ultiple

sites( Storage Arrays replicating across #ultiple *ra#es across di'erse

locations( ,Site to Site replication0

Replication can )e sync!ronous or async!ronous

Eac! o* t!ese aspects o* Disaster Reco'ery can )e *ound it!in t!eC&E en'iron#ent or t!at o* its clients

Storage Disaster Reco'ery



Internal SCSI Disks

External RAID

External SSA

NFS

SAN

NAS

Virtual

Storage Topology



Internal SCSI disks are used in t!e C&E AI5 en'iron#ent *or storageo* t!e AI5 operating syste#(

6ne or #ore internal SCSI disks #ay exist in an enclosure

In syste#s !ere #ore t!an one internal SCSI disk exists% so*t are#irroring is used to replicate t!e AI5 operating syste#(

In standalone data)ase syste#s not connected to t!e SAN% striping#ay )e used *or en!anced per*or#ance

7uoru# re4uire#ents is generally not a consideration due to t!e C&Een'iron#ent strategy

Current arc!itectural direction is to utili+e external disk tec!nology *or)ot! Application and 6perating Syste# 'olu#es(

Storage Internal SCSI Disks



T!is seg#ent re*ers to raid con*igurations outside o* t!e SANen'iron#ent

Raid is used on I83 SCSI external units( ,T9:0

Current Raid le'els utili+ed it!in t!ese constraints is -% / and ;(

T!is con*iguration is currently used on legacy en'iron#ents and onnon.production syste#s in a standalone #ode( ,not !ig!ly a'aila)le0

Storage External RAID


11/25


Storage External SSA

SSA is direct attac!ed storage and is currently utili+ed only in

Non."A en'iron#ents(

SSA is utili+ed in de'elop#ent as ell as productionen'iron#ents(

SSA pro'ides #ultiple pat!s to an SSA disk and pro'idesredundant loops to an SSA dra er to pro'ide a "ig!ly A'aila)leDisk su)syste#(

SSA is currently not t!e desired direction o* C&E *or its storagesolutions and ill )e p!ased out as ti#e passes(

T!ere are currently only a)out < SSA dra ers utili+ed it!in t!eC&E en'iron#ents(


12/25


Storage NFS

NFS Net ork File Syste#( Storage pro'ided )y ot!er ser'ers

across t!e net ork( ,Non.NAS storage0

NFS storage re4uire#ents are )ased on applicationre4uire#ents(

NFS storage presentation !appen *ro# =nix to =nix% Windo sto =nix and =nix to Windo s(

NFS 'ersion : and > are utili+ed )ased upon 6perating Syste#li#itations

NFS is utili+ed )y NI3 to pro'ide installation% patc!ing and CDi#age presentation(


13/25


Storage SAN

Current SAN en'iron#ent utili+es "itac!i ??@-s and ?;@;s

it!in t!e #idrange =nix en'iron#ent( T!ere is currently o'er:- Tera)ytes it!in t!is en'iron#ent(T!e s itc! connecti'ity )et een storage arrays and syste#sare Cisco and 8rocade(T!e storage su)syste#s are #anaged and #aintained )y t!eC&E Storage 3anage#ent &roup(

Eac! syste# utili+es redundant pat!s t!roug! t!e SAN *a)ric topro'ide !ig! a'aila)ility in t!e e'ent o* a !ard are *ailure(Disk #irroring is generally not done it!in t!e SANen'iron#ent(Ser'er )ased striping is not per*or#ed )ecause t!e SANen'iron#ent is already per*or#ing t!is action(T!e current direction is *or all storage to reside on t!e SANen'iron#ent% including )oot 'olu#es(


14/25


Storage NASNet ork Attac!ed Storage ,NAS0 $ro'ides storage across t!eet!ernet net ork utili+ing NFS and S38 protocols(

Net ork File Syste# ,NFS0 Ser'er 3essage 8lock ,S380NAS Storage pro'ides a #ec!anis# *or #ultiple #ac!ines to !a'esi#ultaneous access to progra#s% applications% and dataNAS storage is #anaged and #aintained )y t!e C&E Storage3anage#ent &roup

NAS Storage is utili+ed )y ser'ers running AI5% Solaris% inux%Windo s Access to NAS Storage is dependent upon )usiness andapplication re4uire#entsT!e arc!itectural direction *or NAS is non.production en'iron#entsC&E currently utili+es NAS *or )ot! application and data)asestorage(


15/25


Storage Virtual

Virtual Storage is storage presented to 'irtual I26 ser'ers

!ic! in turn present t!is storage !olly or partially to aVirtual $AR(In t!is scenario Virtual I26 Ser'ers act as t!e SAN or storage#anage#ent su)syste# in storage presentation to $ARs(Virtual I26 Ser'er is an AI5 )ased plat*or# t!at runs it!in an

$AR and is restricted to t!e $o er ; tec!nology at t!is ti#e(

$!ysical storage is presented to t!e Virtual I26 Ser'er !ic!in turn reallocates t!e storage to t!e 'irtual $ARs(T!e $!ysical storage can )e SAN% internal or external disks(Virtual storage presentation is 'ie ed )y t!e 'irtual $AR as astandard ,'irtual0 SCSI dri'e(

T!e Virtual I26 Ser'er can present entire disks or logical'olu#es as storage to a 'irtual $AR(


16/25


Working it! "DS Co##and =tilities

Eac! disk in t!e AI5 en'iron#ent !as a 'ariety o* identities(

T!ese identities are used *or di**erent purposes( T!eidentities include1 ocation Code $VID "disk Na#e D 3 Na#e World Wide Na#e ,WWN0 DEV

To deter#ine eac! o* t!e disk identities re4uires kno ledge o*#ultiple tools% )ot! AI5 and "itac!i utilities(

Co##unication it! t!e Storage 3anage#ent tea# illre4uire WWNBs and DEV in*or#ation *or eac! disk(


17/25


Working it! "DS Co##and =tilities ,cont08are #etal installations and #aintenance )ooting ill re4uirekno ledge o* location codes(

Volu#e group #anage#ent ill re4uire kno ledge o* $VIDBs%"disk na#es% and D 3 na#es(T!e standard AI5 utilities lsp' % lsde' % lsattr % and lsc*gpro'ide so#e o* t!is in*or#ationT!e "itac!i "D 3 utilities exist in t!e directory

2usr2Dyna#ic ink3anager2)in on eac! SAN attac!ed syste#(T!e pri#ary "D 3 tool *or o)taining disk in*or#ation is

dlnk#gr ("itac!i D 3 utilities is an older "DS Co##and utility t!at stillexists it!in t!e C&E en'iron#ent and !as a separate set o*co##and utilities

Exa#ple scripts to generate t!is disk identi*ication in*or#ationexist at t!e *ollo ing =R 1 !ttp122eper*(tu(co#2&lo)alSysAd#in2AI52dl#*dr'#ap(s!t#l


18/25


dlnk#gr "elp

6)taining !elp *or t!e dlnk#gr co##and is not intuiti'elyo)'ious1

dlnk#gr 'ie .!elp

'ie 1 For#at

dlnk#gr 'ie .sys .s*unc G .#sr' G .adr' G .pdr' G .lic H .tH dlnk#gr 'ie .pat! .c .stna#eH .srt lu G cpJH .tH dlnk#gr 'ie .pat! .!de' "ostDe'iceNa#e H .stna#eH .srt pn G lu G cpJH .tH dlnk#gr 'ie .pat! .ite# pnH dnH luH cpH typeH icH ieH dnuH !d .!de' "ostDe'iceNa#e H .stna#eH .srt pn G lu G cpJH .tH dlnk#gr 'ie .dr' .tH


19/25


dlnk#gr 6utput

T!e *ollo ing is exa#ple output *ro# t!e dlnk#gr co##andpresenting D 3 Fi)re Dri'e to AI5 !disk relations!ips it!associated DEV nu#)ers(

dlnk#gr 'ie .dr'$at!ID "De'Na#e De'ice DEV------ dl#*dr'/ !disk/ ??K-2??@-(/-- dl#*dr': !disk: ??K-2??@-(/>/:K(--A------9 dl#*dr'> !disk/@ ??K-2??@-(/>/:K(--A/-----; dl#*dr'> !disk> ??K-2??@-(/>/:K(--A/-----< dl#*dr'9 !disk/? ??K-2??@-(/>/:K(--A:-----K dl#*dr'9 !disk9 ??K-2??@-(/>/:K(--A:

-----@ dl#*dr'; !disk:- ??K-2??@-(/>/:K(--A>-----? dl#*dr'; !disk; ??K-2??@-(/>/:K(--A>----/- dl#*dr'< !disk:/ ??K-2??@-(/>/:K(--A9----// dl#*dr'< !disk< ??K-2??@-(/>/:K(--A9


20/25


D 3 Co##and =tilities

T!e co##ands utili+ed in t!e D 3 utility set are1 c*all'pat! extend'g9'p ls'pc*g #k'g9'p rest'g9'p sa'e'g9'p 'p:!d !d:'p

T!e utility ls'pc*g is #ost co##only used to see i* redundantpat!s are a'aila)le and =N identi*ier in*or#ation(

A sa#ple output o* t!e co##and1'pat!- ,A'ail p' egate/'g0 "ILR9;-:?98-E


21/25


Storage $oliciesStorage policies *or t!is presentation denote policies related to t!e

AI5 en'iron#ent(

All syste#s )oot *ro# SAN and #ay or #ay not !a'e an internal disk#irror(

All storage re4uired )y application and data storage is external to t!eser'er(

All Ser'ers !a'e redundant pat!s to t!e storage(

Root Volu#e &roup #irrors #ay )e acco#plis!ed )y AI5 or )y t!eStorage Array(

Application Volu#e groups ill rely on Storage Array internalredundancy in place o* #irroring(

All NFS #ounts s!ould )e presented )y NAS de'ices


22/25


Storage &uidelinesSAN."DS ??@- Storage Arrays are utili+ed *or $roductionen'iron#ents only(

SAN."DS ?;@; ,SATA0 Arrays are utili+ed *or De'elop#ent and Testen'iron#ents(

NAS Storage is presented !ene'er a *ile s!are is needed )et een=nix syste#s and also pro'ides non.production storage *or ser'ers(

I* an internal disk exists on a ser'er% t!e pre*erred )oot de'ice is t!eexternal attac!ed storage( , exception is NAS 0


23/25


Storage $rocedures

Storage $rocedures

Storage Re4uests

ead Ti#e

C!ange Control

I#ple#entation Docu#entation

Storage Recla#ation

For Furt!er storage procedures and exa#ples1 !ttp122eper*(tu(co#2&lo)alSysAd#in2storage2procedures(s!t#l
http://eperf.tu.com/GlobalSysAdmin/storage/procedures.shtmlhttp://eperf.tu.com/GlobalSysAdmin/storage/procedures.shtml


24/25


"elp*ul inks

"D 3 *or AI5 Re*erence !ttp122eper*(tu(co#2&lo)alSysAd#in2Storage
http://eperf.tu.com/GlobalSysAdmin/Storagehttp://eperf.tu.com/GlobalSysAdmin/Storage

unix storage presentation

Documents