what have san´s and the maldives in common? · = multi-purpose-server = dasd = switch (16-32...
TRANSCRIPT
1
Building Large Fabrics
or ...
... what have SAN´s and the Maldives in common?
2
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
Daily Business
• Today: more than 50% of all SAN-Design discussion are about
WhyWhy ??
R E D E S I G NR E D E S I G N
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
Do you know the Maledive effect?
• 180 K people on 298 sq.km• 2000 Islands• 760 km N/S, 130 km W/E• Total 5180 sq.km
3
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
... here it comes ...
SAN -Island
SAN -Island
Backup SAN
SAN -Island
FICON
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
... SANs grow …
4
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
Fabric with 16-Port SwitchesE10k
12345678E10k
12345678E10k
12345678E10k
12345678
RAID RAID RAID RAID
16 Port Switch
16 Port Switch
16 Port Switch
16 Port Switch
16 Port Switch
16 Port Switch
16 Port Switch
16 Port Switch
16 Port Switch
16 Port Switch
16 Port Switch
16 Port Switch
16 Port Switch
16 Port Switch
16 Port Switch
16 Port Switch
16 Port Switch
16 Port Switch
16 Port Switch
16 Port Switch
JBOD JBOD JBOD JBOD JBOD JBOD JBOD JBOD JBOD JBOD JBOD JBOD
224 / 320 Ports useable70% Ports useable
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
Fabric with 64 Port Directors
RAID RAID RAID RAIDJBOD JBOD JBOD JBOD JBOD JBOD JBOD JBOD JBOD JBOD JBOD JBOD
E10k12345678
E10k12345678
E10k12345678
E10k12345678
128 / 128 ports useable è 100%
64 Ports
64 Ports
All RAID Links consists 6 Fibre Channel connections
5
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
FC-Switch or FC-Director ?
• 64 installed ports• 64 usable ports• Upgrade steps: per port card (4 ports)• Cost relation per usable port : 1,5*
• Purchase• Maintenance
• 100% non-blocking• FCP and FICON support• Heat output: factor 1
(1.672 BTU per hr. ð64 ports )
• 99,999% availability
• 64 installed ports• 40 usable ports• Upgrade steps: per unit (16/32 ports)• Cost relation per usable port: 1,6*
• Purchase• Maintenance
• max. 80% blocking• only FCP support• Heat output: factor 1,35
(1.412 BTU per hr. ð40 ports )
• 99,99% availability
*Purchase price per installed port: Switch factor 1 vs. Director factor 1,5
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
Islands oder Large Fabrics ?
?
6
SAN Architectures
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
1-Tier Switch SAN
Availability 99,9%X Hardware Failure redundant (partial) X Logical FailureX Online Maintenance redundant (partial)
ConnectivityüAny to any• 32 Ports max
Performance - Best• 0 Hop, single latency• no interfabric routing
Scalability - limited• Limited to switch portcount• Today: 8-32 Ports• > 32 Ports – add. switches
7
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
1-Tier Dual Fabric Switch SAN
Availability 99,99%X Hardware Failure redundant (partial) üLogical Failure redundantX Online Maintenance (partial)• Path Failover Software needed
ConnectivityüAny to any• 64 Ports max
Performance - Best• 0 Hop, single latency• no interfabric routing
Scalability - limited• Limited by Portcount • Today: 16-64 Ports• >64 Ports – add. switches
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
1-Tier Director SAN
Availability 99,999%üHardware Failure X Logical FailureüOnline Maintenance• Path Failover Software needed
ConnectivityüAny to any• 140 Ports max
Performance - Best• 0 Hop, single latency• no interfabric routing
Scalability - limited• Limited to Portcount• Today: 24-140 Ports• >140 Ports – Add. Director
8
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
1-Tier Dual Fabric Director SAN
Availability >99,999%üHardware Failure üLogical FailureüOnline Maintenance• Path Failover Software needed
ConnectivityüAny to any• 280 Ports max
Performance - Best• 0 Hop, single latency• no interfabric routing
Scalability - limited• Limited to Portcount• Today: 48-280 Ports• >280 Ports – Add. Director
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
2-Tier Dual Fabric SAN
Backbone Availability>99,999%üHardware Failure ü Logical FailureüOnline Maintenance• Path Failover Software needed
Connectivityü Anyto any• Example up to 384 ports (6064)• Example up to 856 ports (6140)
Performance - High• 1 Hop, Double latency• Simple interfabric routing
Scalability - Large• Director Backbone „Port on demand“• 1st Tier switches or directors• Scalabil up to very large portcounts• Perfect conditions for island consolidation
9
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
Island consolidation
Concepts
10
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
What should be considered ...
• Define your requirements- Availability, Connectivity, Bandwith, Backup, Management
• Define your SAN-Topology – Logical Design- No. of Layer- Meshed- / Backbone Structure
• Define your Partner – Physical Design- Open approach – Interoperability support- Experience – References - Service
• Define your Projectmanagement- Planning / implementation / documentation
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
Define your requirements
They drive your network design needs
• Application Uptime-Network Availability-Data Protection-Network Performance
• Information Sharing-Distance Requirements-Any to any connectivity
• Data Growth Expectations- Scalability Needs- Choice of Building Block- Management Approach
• Location of Data-Consolidation / Distributed-MAN /WAN connectivity-Network Performance
• Amount of Data-Capacity needs-Management
11
Case study 1
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
Theory ...
12
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
Practice in 2001
64
932
64
932 32
64
932
64
932 32
64
932
64
932 32
Location 1
Location 2 Location 3
4 4
2
Migration
3244
44
TEST
32
2
32
6 4
32
9
ED-5000
ES-1000
ES-3032
ED-6064
3232
3 2 32
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
Concept Finance „Production“ 2002
64
932 3232
99
64
932 3232 99
64
932 3232
99
64
932 3232 99
64
93 2 3232 99
64
932 3232 99
Location 1
Location 2 Location 3
4 4
2
Migration
3244
44
TEST
32
2
3 2
64
3 2
9
ED-5000
ES-1000
ES-3032
ED-6064
32323232
32 32 32
13
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
Concept Finance „SAP“ 2001
64
9
646464
9
64
9
64
9
Location 1
Location 2 Location 3
4 4 44
4
32
6 4
32
9
ED-5000
ES-1000
ES-3032
ED-6064
4
9 9
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
6464
9 99
Location 3
64
6 4 9 99
64
64
6464
9 99
64
9 99
64
9 99
Location 1
Location 2
4 4
2
Migration
3244
44
TEST
32
2
3 2
64
3 2
9
ED-5000
ES-1000
ES-3032
ED-6064
64
64 9 99
6 4
64
32
6 4
64
64
6 4
Concept Finance „Production“ 2002
14
Case study 2
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
Concept Finance in Germany (1)
• 2 Layer principle- Concept of 2 independent SANs- Each across multiple locations- Global switches
-Backbone Switch on each location-Connection to other locations (ISLs)
- Local switches-Consolidation Switches-Connection only to the backbone (ISLs)
• 3 Classes of ports- High end – direct on global switches (ED-5000)- Midclass 1 – direct on local switches (ES-3016)- Midclass 2 – FCAL (ES-1000 at global switches)
15
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
SCSI-DASD
BRIDGE
= MULTI-PURPOSE-SERVER
= DASD
= Switch (16-32 Ports)
= SWITCH-DIRECTOR (32 Ports)
= HUB
Standort B
Legende
global
global
Standort AStandort C
= FILESERVER
TAPE
TAPE
Blueprint
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
1.Location
2.Location
3.Location
global Backbone A
local Switches A
global Backbone B
local Switches B
SAN A = 10 Switches
SAN B = 9 Switches
Concept Finance (1)
16
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
Concept Finance (1)
1.Location
2.Location
3.Location
global Backbone A
local Switches A
global Backbone B
local Switches B
SAN A = 7 Switches
SAN B = 6 Switches
McDATA CONFIDENTIALMcDATA CONFIDENTIAL
Avoid the Island impact in your SAN and you will find some time to think
about important issues …