2 - bts 2013 networking v1

© 2013 IBM CorporationThis document is for IBM and IBM Business Partner use only

Client Technical Specialist

IBM System Storage

Networking

Storage Area Network

Revisão: 19/02/2013

IBM System Storage


Agenda

Tecnologias de Storage Networking Componentes físicos de Fibre Channel

• LW,SW,MM,SM• Transceiver

Storage Area Network• Definição• Terminologias, definições utilizadas

5̵ HBA, Frame, Multipath, Routers, FCIP, etc5̵ Exemplo de D/R5̵ NPIV5̵ Como nasce uma SAN ?

Portfolio de produtos SAN• Entry, Midrange, Enterprise

5̵ eConfig, features de switches• Diferença entre switch e Director• DWDM, CWDM• Exemplo de D/R com Routers

Introdução a Datacenter Convergence Network• Motivadores• Topologia• Produtos

2

IBM System Storage


Agenda

Tecnologias de Storage Networking

3

IBM System Storage

© 2013 IBM CorporationThis document is for IBM and IBM Business Partner use only4

Tecnologias de redes de storage

Ethernet EthernetEthernet

Ethernet

Ethernet

Ethernet

Ethernet

Ethernet

Ethernet

EthernetEthernet

Ethernet

LAN

Fibre ChannelFibre Channel

Fibre Channelv

Fibre Channel

Fibre Channel

Fibre ChannelFibre ChannelFibre Channel

SAN

LUN 1

iSCSI Disk

iSCSI Driver

N series

Gateway

DAS

Tape Library

DAS

N series

WAFL

LUN

LUN

WAFL

CIFS / NFS

Client

CIFS / NFS

Server

LUN 1

Virtual Disk

Txt

Bloco

Bloco

V7000

DS3500

DS5000

DS5000

SVC

Virtual disk

FCIP

Multiprotocol router

NAS

iSCSI

FCoE

IBM System Storage


Agenda



5

IBM System Storage


O cabo de fibra ótica (1) Um cabo de fibra possui 3 componentes físicos Core

• Núcleo de vidro ou plástico onde a luz se propaga• Diametros de 5microns à 1000 microns ( 1 micron = 10-6 metros)

Cladding• Revestimento para refletir e manter a luz dentro do núcleo

Coating• Capa de revestimento para manter a integridade física do cabo de fibra

Cabo de fibra possui 2 núcleos (transmissão e recepção)

Core

Cladding

Coating

Cabo

duplex

IBM System Storage


Aspectos físicos da Luz na fibraEfeitos que limitam o comprimento do cabo ótico

•O comportamento do feixe de luz depende do meio de propagação.

•A fibra ótica possui uma geometria cilindrica não-perfeita

•O feixe de luz gerado por um LED ou Laser

•Se modifica e se degrada.

•Emerge distorcido e defasado.

•Por que o feixe se modifica/degrada?

•Atenuação – o material da fibra absorve a luz ( impurezas na fibra )

•Potência do pulso – limitado a ½ watt devido a efeitos não lineares se utilizado maior.

•Efeitos: A polarização da luz modifica devido ao cilindo não ser perfeito

Dispersão cromática: Lambdas do pulso viajam com diferentes velocidades Pulso disperso na saida

Dispersão modal: Lambdas do pulso emergem em tempos diferentes. Maior a fibra, maior a diferença entre os tempos de saida dos lambdas

Os efeitos limitam

o comprimento do cabo ótico

50 microns = 50x10-6

m

9 microns = 9x10-6

m

IBM System Storage


Single Mode / Multi Mode O diâmetro do núcleo interfere no modo de propagação da luz

• Em núcleos de 5-10 microns, a luz tende a se propagar ao longo do eixo, sem desvios • O feixe de luz não se desvia do eixo ao longo da fibra • Comportamento único do feixe de luz, um modo único de propagação• Derivação do nome Single Mode.

• Núcleos com diâmetros de 50-60 microns causam efeitos diversos no feixe de luz• O feixe tende a se afastar do eixo central em direção ao Cladding. • O Cladding devolve o feixe de luz para dentro do núcleo de fibra.• Cladding é construido com menor indice de refração que o núcleo e se comporta como espelho.• O feixe de luz possui vários modos de propagação; deriva o nome da fibra Multi Mode

1 fio de cabelo

17 – 70 microns

0,070 mm

0,000070 m

9 microns = 9x10-6

m

SM CORE

50 microns = 50x10-6

m

MM CORE

IBM System Storage


O que é uma fibra ótica Shortwave / Longwave

•Luz tem comportamento de onda. Define-se

•Frequencia

•Período

•Comprimento da onda (lambda)

•Certos Lambdas são utilizados na indústria por terem baixa atenuação do feixe de luz. São utilizados 3:

•850 microns

•Tecnologia de receptores e transmissores mais barata

•Apresenta a maior taxa de atenuação

•Utilizado em fibras Multi Mode

•Referenciado como Shortwave

•1300 e 1550 microns

•Utilizado em fibras Single Mode

•1550 microns – menor atenuação dos 3 lambdas e a tecnologia mais cara.

•Referenciado como Longwave

Lambda(comprimento da onda)

IBM System Storage


Padronização Padrões internacionais definem categorias de cabos de fibra ótica

• OM1, OM2, OM3, OM4, OS1, OS2• Padrão referência Ox: OM = MultiMode OS = SingleMode (letra O: Optical)

A categoria define a 'Performance de transmissão da fibra ótica'• Tipo de luz (origem LED ou Laser)• Comprimento (lambda) da onda da luz• Métrica: dB/Km ( coeficiente da atenuação da luz na fibra)

LED e Laser são usados nas categorias. Exemplos:• OM1, OM2 utilizam LED como transmissor da luz• OM3, OM4 utilizam Laser

9125 5062.5

OM1 OS1

OS2

OM2

OM3

OM4

850 nm & 1300nm 1310nm & 1625nm

IBM System Storage


Aplicação da teoria:

Transceivers• IBM SAN Switch SAN24B-5 - (#2802) 8 Gbps SW SFP+ TransceiverSummary: This feature provides one shortwave SFP+ transceiver, designed to provide Fibre Channel connections at distances up to

21 meters while using the appropriate 62.5/125 micron (62.5u) OM1 fiber optic cable, and 50 meters while using the appropriate 50.0/125 micron (50u) OM2 fiber optic cable. The OM3 50 micron optical fiber cable can support distances up to 150 m.

Cabos• (#5605) Fiber Cable LC/LC 5 m Multimode 50 Micron (OM2)• (#5625) Fiber Cable LC/LC 25 m Multimode 50 Micron (OM2)• 50.0/125 micron (OM2) for distances up to

5̵ 300 meters at 2 Gbps speed, 5̵ 150 meters at 4 Gbps, 5̵ 50 meters at 8 Gbps

• (#5810) OM3 cable LC/LC 10 m• Summary: This feature provides a third generation multimode fiber cable with a 50 micron

core, suitable for 10GE links. The OM3 50 micron optical fiber cable has been developed according to the newest 10 Gbps standards and allows data transmission over a distance up to maximum 300 m at 850 nm.

Tipo Diâm Distância

OM1 62.5 21

OM2 50 50

OM3 50 150

IBM System Storage


Tipos de conectores A fibra ótica é referenciada pelo modo que a luz se propaga relativamente ao seu eixo. Conhecidas como Multi-Mode e Mono-Mode. Principais caracteristicas: Multi-Mode:

• Luz de comprimento de onda (lambda) curto (shortware)• 50/62.5 microns• Ideal para curtas distancias • Mais economica• Utiliza conectores mais baratos

Single-Mode• A luz trafega pelo eixo longitudinal (único modo)• Usada em requerimentos de baixa perda de sinal• Requerimentos de distancias longas • Não utiliza repetidores de sinal de luz• 9 microns

Conector• Utilizado para conectar o cabo de fibra nos transceivers/equipamentos• Vários tipos de conectores no mercado• O que difere são tamanho e o aspecto mecanico de conexão

IBM System Storage


Transceiver Converte sinais elétricos em óticos e vice-versa Componente onde encaixa o conector LC/SC Combina a função de transmissão e recepção de sinais entre dois equipamentos Conhecido como GBIC ou SFP

• Gigabit Interface Converter• Small-Form Factor Pluggable (conhecido como mini-GBIC)

Vários tipos disponíveis na indústria:• 850 nm 550m MMF (SX) (SW), • 1310 nm 10km SMF (LX) (LW), • 1550 nm [40 km (XD), 80 km (ZX), 120 km (EX or EZX)],

O fabricante especifica a velocidade nominal (Gbps) e a distância suportadas

Exemplos de transceivers de mercado

Rx

Tx

Tx

Rx

•Brocade 100 Gbps 10x10 (10KM, 2KM) Optical Transceiver (PDF, 591.1 KB)

•Brocade 100 Gbps LR4 (10KM) Optical Transceiver (PDF, 590.5 KB)

•Brocade 10 Gbps Direct Attached SFP+ Copper Cable (PDF, 732.3 KB)

•Brocade 10 Gbps ER Optical Transceiver (PDF, 754.6 KB)

•Brocade 10 Gbps Fibre Channel LWL (10 KM) Optical Transceiver (PDF, 576.3 KB)

•Brocade 10 Gbps Fibre Channel SWL Optical Transceiver (PDF, 576.4 KB)

•Brocade 10 Gbps LRM XFP Optical Transceiver (PDF, 743.7 KB)

•Brocade 10 Gbps LR Optical Transceiver (PDF, 940.5 KB)

•Brocade 10 Gbps SR Optical Transceiver (PDF, 945.6 KB)

•Brocade 16 Gbps LWL (10 KM) Optical Transceiver (PDF, 578.1 KB)

•Brocade 16 Gbps SWL Optical Transceiver (PDF, 575.8 KB)

•Brocade 1Gbps Electrical Transceiver (PDF, 908.2 KB)

•Brocade 4×16 Gbps SWL Optical Transceiver (PDF, 578.6 KB)

•Brocade 4 Gbit/Sec ELWL (30 KM) Optical Transceiver (PDF, 281.2 KB)

•Brocade 4 Gbit/Sec LWL (10 KM) Optical Transceiver (PDF, 281.2 KB)


•Brocade 4 Gbit/Sec SWL Optical Transceiver (PDF, 948.9 KB)

•Brocade 8 Gbit/Sec ELWL (25 KM) Optical Transceiver (PDF, 228.5 KB)


•Brocade 8 Gbit/Sec SWL Optical Transceiver (PDF, 949.9 KB)

•Brocade 8 Gbps SWL Mini Optical Transceiver (PDF, 878.8 KB)

IBM System Storage


Exemplo de características operacionais de transceivers2498+05 IBM System Networking SAN24B-5

(#2601) 16 Gbps SW SFP+ TransceiverSummary: This feature provides one shortwave 16 Gbps SFP+ transceiver, designed to provide Fibre Channel connections at distances up to 15 meters while using the appropriate 62.5/125 micron (62.5u) OM1 fiber optic cable, and distances up to 35 meters while using the appropriate 50.0/125 micron (50u) OM2 fiber optic cable. The OM3 50 micron optical fiber cable can support distances up to 100 m.

(#2611) 16 Gbps 10 km LW SFP+ TransceiverSummary: This feature provides one longwave 16 Gbps SFP+ transceiver, designed to provide Fibre Channel connections at distances up to 10 km (6.2 miles), while using the appropriate 9.0/125 micrometer single mode fiber optic cable.

(#2802) 8 Gbps SW SFP+ TransceiverSummary: This feature provides one shortwave SFP+ transceiver, designed to provide Fibre Channel connections at distances up to 21 meters while using the appropriate 62.5/125 micron (62.5u) OM1 fiber optic cable, and distances up to 50 meters while using the appropriate 50.0/125 micron (50u) OM2 fiber optic cable. The OM3 50 micron optical fiber cable can support distances up to 150 m.

(#2821) 8 Gbps 10 km LW SFP TransceiverSummary: This optional feature provides a longwave 8 Gbps SFP fiber optic transceiver, and is designed to support 2, 4, or 8 Gbps Fibre Channel connections at distances up to 10 km (6.2 miles), while using the appropriate 9.0/125 micrometer single mode fiber optic cable.

(#2881) 8 Gbps 25 km ELW SFP TransceiverSummary: This optional feature provides a longwave 8 Gbps SFP fiber optic transceiver, and is designed to support 2, 4 or 8 Gbps Fibre Channel connections at distances up to 25 km (15.625 miles), while using the appropriate 9.0/125 micrometer single mode fiber optic cable.

IBM System Storage


Auto-negociação da taxa de transferência

• SFPs seguem padrões e normas da indústria.SFP+ mechanical ( SFF-8432)Especificações óticas e elétricas ( FC-PI-4)

• Operam em diferentes taxas de transferência de dados2.125 Gbps4.25 Gbps8.5 Gbps

Auto-negociam com seu par a taxa de transferência de dados Lado A (8Gbps) ------------ Lado B (4Gbps) taxa resultante: 4Gbps Lado A (8Gbps) ------------ Lado B (2Gbps) taxa resultante: 2Gbps

• Especificam o comprimento de onda (Lambda)Exemplo: 850nm

SAN24B-4 Express

Host

HBA

8Gb

IBM System Storage


Agenda





17

IBM System Storage


O que é uma Storage Area Network (SAN) ?

É uma rede de alto desempenho, cuja principal finalidade é permitir que dispositivos de armazenamento se comuniquem com sistemas de computação e storage-com-storage

18

Referência: SNIA

http://www.snia.org/education/storage_networking_primer/san/what_san

SAN elimina ilhas e promove

Consolidação e Virtualização

IBM System Storage


Application

I/O request

File system

Logical layer

Physical layer

Server1

File

I/O

Device Drivers

Block I/O

Block

I/OFC HBA

driver

V7000, N Series, DS3500, DS5000, .....

Fiber Channel

HBA

Server1

Server2

Server3

Server1

Local

Block

I/O

O que é uma SAN ?

19

HBA

driver

HBA

SAN

switch

IBM System Storage


Application

I/O request

File system

Logical layer

Physical layer

Server1

File

I/O

Device Drivers

iSCSI

client

Block I/O

Block

I/OHBA

driver

TCP/IPHBA

NIC

LAN

(IP network)

V7000, N Series, DS3500, DS5000

Outros Servidores

Adaptador

iSCSI

iSCSI driver

TCP/IP

GbE Server1

Server2

Server3

Server1

Local

Block

I/O

O que é uma IP SAN ?

20

IBM System Storage


Terminologia utiliza em Storage Area Network

HBA FC frame Software multipath Zoning LUN Masking Inter Switch Link (ISL) Trunking Fabric Fabric topology

• Cascaded• Ring• Meshed (partial,full)• Core/edge

Switch Router Core switch Edge switch SPOF FC port

• N_port• F_port

NPIV21

Sistema Discos

Alguns termos utilizados em SANAlguns termos utilizados em SAN

24 ports

8 ports

ISL

HBA

switch

HBAHBA HBA HBAHBA

switch

24 ports

ISL

HBA

switch

SAN

LUN

1 LUN

2 LUN

3

router

switch

WAN

SAN

remota

Tape Library

IBM System Storage


Host Bus Adapter (HBA)

Servidor conecta-se ao storage externo usando HBAs

Device Driver é o interface entre o SO e o device periférico

• Printer,Disco, Tape,

Multipath software é comumente usado em arquitetura de redes SAN

• Prove redundancia dos caminhos e failover

• Pode fazer load balancing

Hierarquia dos componentes

22

HBA 1 HBA 2

Aplicativos

Sistema Operacional

Gerencia

Banco de Dados

Sistema de Arquivos

Gerencia

de VolumesSoftware de failover/multipath

Device Driver

NIC

USB

PARALELA

Etc...

IBM System Storage

© 2013 IBM CorporationThis document is for IBM and IBM Business Partner use onlyThis educational piece is intended for your use in selling. It is NOT a deliverable for your

customers.

Server

Storage

HBA

SAN Switch

Legenda

SFP

HBA

Comando SCSI

Dados FC SCSISCSI DataDataFC SCSISCSI DataDataSCSISCSI DataData

FC packets FC SCSISCSI DataDataFC SCSISCSI DataDataSCSISCSI DataData

FC frames

SFPSFP

HBA

Usado para formatar e empacotar dados e

comandos SCSI em frames Fibre Channel para

transmissão via FC ou FC-SAN

SFP SFP

SFP

SFP

SFPSFP SFP SFP

23

Dados,

Comandos

IBM System Storage


This educational piece is intended for your use in selling. It is NOT a deliverable for your

customers.

Servidor Host

SAN Fabric

LUN #1 Path 1LUN #1 Path 2

LUNLUN

MPIO

Varias imagens Uma LUN!

Software de multipath

24

http://www-1.ibm.com/servers/storage/san/b_type/h16/

http://www-1.ibm.com/servers/storage/san/b_type/h16/

IBM System Storage


Terminologia usada em Business Continuity / Disaster Recovery

WAN routers• SAN and WAN routers for island interconnection• Fibre Channel over IP, FCIP• Metro and Global business continuity

5̵ Data compression and tape acceleration

RouterRouter

Servers

switch switch

V7000 LTO drives

Production Site Backup Site

WAN

IPIPIPIPTCPTCP

FCIPFCIPFCFC

SCSISCSI DataData

TCPTCPFCIPFCIP

iFCP

FCFCSCSISCSI DataDataSCSISCSI DataData

FC packets over TCP/IP

IBM SAN06B-R router

IBM System Storage


Uma solução D/R limitada ( sem redundância entre localidades)

26

4 SAN Fabrics (2 per site including one using the inter-site backbone)• On SAN Fabrics Brown & Purple, you can have up to 12 Host/Device/ISL/N-Ports

connections because 4 ports would be provisioned for each Storwize V7000 A single FC-IP routing backbone

• A single Multi-Protocol Router per site Recovery site SAN Fabric that is using the MP-Router needs to also include the inter-site VEX/VE pair of ports (backbone)

The whole SAN Fabric Purple becomes the BackBone

• Has some scalability issues, ..., also any event in the WAN (IP or MPR) can affect the devices on this local SAN Fabric Purple

SAN Fabric Purple

SAN Fabric GreenSAN Fabric Blue

SAN Fabric Brown

19 2318 2217 2116 2011 159 13 10 148 123 71 5 2 6402498-B24

SAN24B-4

GE 0 1

8 9 10 11 12 13 14 15 0 1 2 3 4 5GE0 1 2 34 5 6 7

SAN06B-R

SAN06B-R

GE 0 1

8 9 10 11 12 13 14 15 0 1 2 3 4 5GE0 1 2 34 5 6 7

SAN06B-R

SAN06B-R

19 2318 2217 2116 2011 159 13 10 148 123 71 5 2 6402498-B24

SAN24B-4

Storwize V7000 Storwize V7000

WANFC-IP tunnel

VEVEX

LUN LUN

dado

IBM System Storage


Solução BC/DR com FCIP usando Qlogic ISR6142

Solução requer RPQ sistemas DS3000, DS5000 As SANs não são ‘merged’

27

IBM System Storage


Solução BC/DR com FCIP usando Qlogic ISR6142 Solução requer RPQ sistemas DS3000, DS5000 SANs merge Observação If you are using “E-Port extension” configuration, connect the iSR6142 ports as shown in the diagram appropriate diagram

from Appendix A, the “E-port extension” section. Take the following cautions for E-port extension configurations. • NOTE: the FC switches must be switches from the same manufacturer and must be compatible. The switch ports connected to the

router might need to be set to e-port. The FCIP link between the FC switches becomes an Inter Switch Link (ISL); consequently, the switches are merged (SANs). For the ISL to function correctly, the switches must be in auto-domain ID mode or have been assigned different domain IDs. In addition, the zone names on the switches must be unique; the switches cannot have identical zone names before connecting the routers.

28

IBM System Storage


Virtual

Machine

1

Virtual

Machine

2

O que é NPIV ( N_port ID virtualization ) ?

Problema• Hypervisor consolida múltiplos Hosts (virtual servers)• Um host utiliza uma /duas FC HBAs para endereçamento dos

devices externos.• O número de HBAs multiplica-se em razão direta do número dos

hosts

Solução• N-Port ID Virtualization (NPIV) habilita uma porta física aparecer como

várias portas FC distintas• Storage e Host utilizam os NPIVs definidos e que são únicos.• WWPN virtuais são criados• WWPN é usado para segregar uma LUN acesso da VM

5̵ Lun Masking e Zonning.

Requerimentos• O switch deve suportar NPIV• A HBA deve suportar NPIV• Hypervisor (VMWare, MS HyperV, etc também devem suportar NPIV.• O Sistema Operacional também deve suportar NPIV

29

FC-switch

HBA

Virtual

Machine

3

V_port with

NPIV

ESX Server

Virtual SCSI

Adapter

V_port with

NPIV

Virtual SCSI

Adapter

V_port with

NPIV

Virtual SCSI

Adapter

Storage System

IBM System Storage


Questões básicas sobre uma nova SAN (Fabric)

iSCSI, NAS, SAN ?

XDual Fabric ?

Core/Edge ?

•What technology should I propose?

2,4,8 Gbps

LW, SW, Ficon, FCP

•Should I build in high availability?

No SPOF, SPOR (Single Point of Failure / Repair)

•Should I use a Director or a Switch?

•Should I propose Brocade® or Cisco®?

•Multi-path failover software?

IBM System Storage


A simple direct-connect configuration• One link per server• Up to four servers per DS5020• No redundancy

5̵ Failure of one component (i.e. HBA, fibre, SFP) means loss of access to data

What happens when want to connect fifth server?

IBM TotalStorage SAN b-typeEntry SMB Infrastructure Simplification Solution

Storage consolidation and high availability server clustering solution

DS5020 disk storage

http://www-03.ibm.com/servers/storage/san/b_type/

Server

#1

Server

#2

Server

#3

Server

#4 Add a SAN switch to increase connectivity

– Add up to ten more servers

•For a total of fourteen

– Single Points of Failure remain

So, how do you fix the single points of failure?

Server

#5

Build in redundancy

– Cluster servers for application availability

– Add a second switch

– Dual HBAs per server

– Redundant switch fabrics (no ISLs)

– Base is 16 ports scalable to maximum of 32 ports with two switches

– Can cascade more switches for additional scalabilitySAN24B-4SAN24B-4

http://www-03.ibm.com/servers/storage/san/b_type/

IBM System Storage


Agenda







32

IBM System Storage


Fibre Channel switches and directors

33

IBM System Storage


IBM System Storage Networking Portfolio

Entry Level Midrange Enterprise Class

Cis

co

Bro

ca

de

SAN24B-4 Express

SAN24B-5

SAN80B-4

MDS 9148

SAN40B-4

MDS 9222i

SAN06B-R

MDS 9509

MDS 9506

MDS 9513

SAN384B

Converged

Converged Switch B32

VDX 6730 Converged Switch

SAN768B

MDS 9124

Express

SAN32B-E4

CISCO Fabric Manager

IBM Datacenter Fabric Manager

DCFM

SAN48B-5

34

IBM System Storage


Lista de switches disponíveis no e-Config em 03/Dez/2012

35

IBM System Storage


IBM Entry Switch Portfolio

Cisco MDS 9124 Express (2053-424 )

•8-16-24 ports; 8,4 Gbps

•Shortwave, longwave SFPs

•Full member of Cisco SAN fabricMDS 9124

IBM System Storage SAN24B-5 (2498-F24) •

8-16-24 ports-on-demand; 16 and 8 Gbps

Em 1/out/2012 o MDS9124 não suporta 8Gbps

IBM System Storage SAN24B-4 (2498-B24)•

8-16-24 ports-on-demand; 8, 4, 2, 1 Gbps•

Shortwave, longwave, extended distance SFPs•

Full Fabric, Extended Distance and other options

SAN24B

IBM System Storage


O valor da carta de anúncio do produto (HW & SW description)

enables real-time proactive awareness of the health, performance, and

security of each switch

extends SAN fabrics beyond the FC standard 10 km by optimizing the internal switch buffers to help maintain

performance on ISLs at distances up to 500 km.

performance monitoring capability to help identify end-to-end bandwidth usage by host/target pairs and is designed to provide information for

capacity planning.

37

IBM System Storage


Cartas de Anúncio e Manual de Vendas

Manual

De

Vendas

Explica as Features codes

V7000

http://www-01.ibm.com/common/ssi/index.wss?buttonpressed=DET002PT005&DET015PGL002=DET001PEF012&submit.x=26&submit.y=14

IBM System Storage


Por que é importante usar o manual de vendas ?

Switch B40 – caracteristicas , buffers, etcAdaptive Networking (#7806, #7406, and #7206): Adaptive Networking provides a set of capabilities allowing high-priority connections to obtain the bandwidth

necessary for optimum performance, even in congested environments. The Quality of Service (QoS) SID/DID Prioritization and Ingress Rate Limiting features are the first components of this license option and are available on all 8 Gbps platforms.

Integrated Routing (#7807 and #7407): Integrated Routing allows any port in a SAN768B, SAN80B-4, and SAN40B-4 to be configured as an EX_port

supporting FCR. Integrated routing is FCR support on the 8 Gbps ports as a native capability, hence they are referred to as native

EX_ports. This eliminates the need to add a routing blade or use the SAN18B-R for FCR purposes, and also provides double

the bandwidth for each FC Router connection when connected to another 8 Gbps-capable port.

IBM System Storage


IBM Midrange Switch Portfolio

(2417-C48)

IBM System Storage SAN40B-4

•24-32-40 ports-on-demand; 8, 4, 2, 1 Gbps

•Shortwave, longwave, extended distance SFPs

•Full Fabric, Extended Distance and other options

Cisco MDS 9148 for IBM System Storage •

16-48 ports; 8, 4 Gbps, also 2 10 Gbps ISL links•

Shortwave, longwave SFPs•

can be used as the foundation for small, stand-alone SANs,

top-of-rack or as an edge switch in larger core-edge SAN infra-

structures.

(2498-B40 / 249840E)

Em 1/Out/12, o MDS 9148

suporta 4 e 8 GbpsObservar SFPs de 30Km

IBM System Storage


IBM Upper-Midrange Switch Portfolio

(2498-F48)


•24-36-48 ports-on-demand; 16, 10, 8, 4, 2 Gbps


•Integrated FCR routing

•Data compression and encryption

(2498-B80)


•48-64-80 ports-on-demand; 8, 4, 2, 1 Gbps


•Extended Distance and other options

New

IBM System Storage


IBM SAN Enterprise Directors – 2 modelos Backbone

Características chave !• Fabric backbones

• Breakthrough performance

• Scalability

• Energy efficiency

• Long-term investment protection

• Open systems

• System z®

• Fabric-based encryption

• I/O consolidation

• Data protection

• Disaster recovery solutions

• Designed to perform at greater than 99.999 % uptime

• Data Center Fabric Manager (DCFM)

• Midsize enterprise fabric core

• Large enterprise edge or application engine

• Up to 4 horizontal blades

• Up to 256 FC ports (total 288 with ICLs)

• 1,2,4,8 Gbps

• FC, FCoE, FICON, FCIP Interfaces

IBM SAN768B (2499-384) Novo: SAN768-B2

IBM SAN384B (2499-192) Novo: SAN384B-2

• Large enterprise fabric core

• Up to 8 vertical blades

• Up to 512 FC ports (total 576 with ICLs)

• 1,2,4,8 Gbps

• FC, FCoE, FICON, FCIP Interfaces

Single chassis:

SAN768B-2 - up to 384 using 48-port blades 16Gbps

SAN384B-2 - up to 192 using 48-port blades 16Gbps

Using 64-port 8Gbps:

SAN768B-2 up to 512 ports

SAN384-B-2 up to 256 ports

IBM System Storage


SAN b-type Directors suportam blades com criptografia

SAN768B/SAN384BOverview

16-port 8 Gbps blade for the IBM System Storage SAN768B and SAN384B backbone family• Up to 4 blades per chassis

Dual ethernet ports for re-keying/HA synchronization Smart Card reader for ignition key protection Quorum authorization for sensitive operations FIPS 140-2 Level 3 validated cryptographic module

FC #3895

IBM System Storage


IBM Enterprise Director Portfolio – Cisco

Cisco MDS 9506 for IBM System Storage (2054-E04*/2062-D04 WFM)

Blades: 12-24-48 port FC switching with 8/4/2/1 Gbps (192 ports maximum);

4 slots for blades

Cisco MDS 9509 for IBM System Storage (2054-E07*/2026-D07 WFM)


7 slots for blades

Cisco MDS 9513 for IBM System Storage (2054-E11*/2062-E11 WFM)


11 slots for blades

18/4 Multiservice Module (18+4); 32-port Storage Services;

8-port IP; 4-port 10 Gbps FC switching for ISLs and distance extension

Shortwave, longwave, CWDM extended distance, GbE SFPs

FICON w/CUP, Extended Distance and other options

Em 1/Out/2012 não suporta 16Gbps, suporta 10Gb FCoE

IBM System Storage


Four

GbE IP

Four

GbE IP

Servers

Cisco 9222i ou

SAN06B-R

Cisco 9222i

DS5000 series LTO drives

Production Site Backup Site

WAN

Midrange Business Continuity Solution

Connectivity needed to off-site location for backup and Business Continuity

IP links are preferred for lower-cost connectivity

Simplicity is highly desirableIPIPIPIP

TCPTCP FCIPFCIP FCFC SCSISCSI DataDataTCPTCP FCIPFCIP

iFCP

FCFC SCSISCSI DataDataSCSISCSI DataData

FC packets over TCP/IP

IBM System Storage


Exemplo de caso de Business Continuity ( caso real )

Paulista

IBM System Storage


Cisco MDS 9222i Multiservice Modular Switch ( FCIP + FCP )

Cisco MDS 9222i for IBM System Storage (2054-E01)•

18 FC ports - 4, 2, 1 Gbps + 4 GbE ports; 3U height•

Shortwave, longwave SFPs•

One slot for one additional blade•

12, 24 or 48-port 4 and 8 Gbps switch blades or •

14/2 Multiprotocol Services Module•

See Cisco MDS 9222i

Cisco MDS 9000 Family Multiservice Module

(Feature Code 2250 for Cisco MDS 9500 directors)•

18 x (4/2/1)Gbps FC ports + 4 x GbE ports•

Shortwave, longwave, CWDM extended longwave SFPs•

Optional FCIP•

See Cisco 18/4 Multiservice Module

Blade para Director

http://www-03.ibm.com/systems/storage/san/ctype/9222i/

http://www.cisco.com/en/US/products/ps5991/products_data_sheet0900aecd80694b27.html

IBM System Storage


* Note: Hotlinks work when slide is viewed in “Slide Show” mode

IBM Router Portfolio – b-type

8 Gbps FC Routing Blade for SAN384B and SAN768B•

Twelve 8 Gbps Fibre Channel and ten IP ports (1 or 10 GbE)•

Appropriate shortwave, longwave and IP SFPs•

SAN384B Hotlink, SAN768B Hotlink

2005-R06

IBM System Storage SAN06B-R (2498-R06)•

8, 4, 2 and 1 Gbps Fibre Channel; each port auto-negotiates to

either 8, 4 or 2 Gbps or 4, 2 or 1 Gbps•

Base is 4 FC + 2 IP ports; upgrade to 12 FC + 6 IP ports•

1 Gbps Ethernet GbE line-rate performance on all IP ports•

See SAN04B-R Hotlink

10 Gbps FCoE Routing Blade for SAN384B and SAN768B•

Ten Gb CEE 24-port blade•

Appropriate shortreach and longreach SFPs•

SAN384B Hotlink, SAN768B Hotlink

http://www-03.ibm.com/servers/storage/san/b_type/san384b/


http://www-03.ibm.com/systems/storage/san/b-type/san04b-r/index.html



IBM System Storage


IBM System Storage SAN32B-E4 Encryption Switch Overview

32 ports 8Gbps standalone encryption switch• 2U enclosure, dual hot-plug fans and power

Dual ethernet ports for re-keying/HA synchronization Smart Card reader for ignition key protection Quorum authorization for sensitive operations FIPS 140-2 Level 3 validated cryptographic module

50

Por que criptografia?

Protecting Data is a legal requirement in the US and in most countries around the world

•Privacy and data integrity are important compliance challenges today

•Numerous Federal and Industry legislation mandates require customers to meet regulatory compliance

•HIPAA – Healthcare regulations

•GLBA - Gramm-Leach-Bliley Act – Consumer privacy data integrity and notifications

•PCI – Financial Industry, retail card processors etc.

•HSPD-12 – Homeland Security Presidential Mandate - 12

•California SB-1386 – Deals with protection of consumer data

IBM System Storage


SAN48B-5 – Principais novidades: 16 Gbps, Criptografia 48×16 Gbps Fibre Channel front-end ports that support 2, 4, 8, 10, and 16 Gbps speeds

• 24-port base switch with 12 Ports On Demand (POD) license Dual-power supplies with integrated fans Ethernet, console, and USB management ports Support for in-flight encryption and compression on all ports

Integrated high-performance metro connectivity Native Fibre Channel extension support

• Native 10/16 Gbps Fibre Channel over DWDM or dark fiber up to 100 km

Integrated advanced extension support• In-flight data encryption at wire speed• In-flight data compression at wire speed• Up to two ports per switch

Backup and Replication over MAN

51

Front View

Back View

1U

16 Gbp Inter-Switch Links (ISLs)

•Consolidate up to four 4 Gbps ISLs in a single 16 Gbps ISL

128 Gbps high-performance, resilient frame-based trunk

•Combine up to 8 x 16 Gbps links in a single trunk

•Combine up to 32 x 4 Gbps links in a single trunk

IBM System Storage


Terminologia utilizada em solução SAN (Enterprise)

Core-edge SAN architecture• Edge switch for device concentration• SAN and WAN routers for island interconnection• Core Director

5̵ High availability design (like DS8000)5̵ Bladed design Core Directors

SAN router

Core-edge (tiered) SAN architecture

Edge switch

WAN router

Edge switch

SAN

Multiplexers

–Dense Wave Division Multiplex

–Coarse Wave Division MultiplexRef: www.padtec.com.br

IBM System Storage


Agenda







Introdução a Datacenter Convergence Network• Motivadores• Topologia• Produtos

53

IBM System Storage


Abordagem tradicional: diferentes redes de comunicação

Vantagens• Tráfego isolado de dados• SAN

5̵ baixa latência5̵ Segurança (lossless)

• Administração independente

Desvantagens• Recursos sub-utilizados• Custos duplicados

5̵ CapEx5̵ OpEx

• Complexidade de gerenciamento5̵ Mais adapters5̵ Mais cabos5̵ Mais pontos de falha5̵ Provisionamento lento5̵ Dupla redundância

54

IBM System Storage


Convergência: uma opção Enterprise

Velocidade Eth contribui para

• adoção FCoE5̵ Eth: 10, 40, 100 Gbps5̵ FC: 2, 4, 8, 16 Gbps

• utilização de iSCSI Suporta File I/O Integração com tecnologia

atual

55

Gateway

iSCSI

Storage

Array

NFS/CIFS NASFC Arrays

FCoE

Fibre Channel

Loss-Less

Ethernet

Gateway

FCoE

Storage Array

IBM System Storage


Por que FCoE é interessante ?

1. Velocidade de transmissão de dados

• Ethernet é capaz e excede as velocidades de Fibre Channel.

2. Ethernet foi reconstruido com atributos do Fibre Channel

• Criado o protocolo 'Data Center Bridging Protocol'

• Possui baixa latência

• É um protocolo lossless ( entrega os pacotes de forma ordenada)

3. Outros motivadores

• Suporta ambientes virtualizados

• Aumenta as taxas de utilização

• TCO

5̵ Instalação

5̵ Gerenciamento

5̵ Operação

5̵ aquisição

56

IBM System Storage


Componentes do protocolo FCoE

Fibre Channel on Network Media

• www.t11.org

• FC-BB-5 (FC-BB-E)

FC over Ethernet

DataCenter Bridge Protocol (DCB)

• Lossless Ethernet

• IEEE 802.1

• Priority Flow Control (PFC)

• Enhanced Transmission Selection Protocol (ETS)

• Datacenter Switching Protocol ( DCBX)

FCoE Standards

IBM System Storage


FCoE Network Layering - FCoE Frame

Baseado no modelo FC FC é encapsulado no Ethernet Não existe fragmentação de frames

FC• Jumbo Eth frames• Frame FC fica intacto

Serviços herdados do FC• Zoning• Multi-pathing• WWN-structure• Name services

Source: IBM Redbooks

http://www.redbooks.ibm.com/redbooks/pdfs/sg247986.pdf

http://www.redbooks.ibm.com/redbooks/pdfs/sg247986.pdf

IBM System Storage


Componentes básicos do FCoE

Full Fabric FC/FCoE Forwarder• Ponto de encontro de gerenciamento da

rede• Atende requests de Fabric Login

(FLOGI)5̵ Assinala um ID (FCID) para o N-node

• Gerencia zoning• Encap/Decap FC/FCoE• Registered State Change Notification

(RSCN)5̵ Mantém status dos devices conectados

Converged Network Adapter (CNA)• Mantém o tráfego FC e Ethernet• 2 portas

Exemplo: Switch CN4093 do

PureFlex

IBM System Storage


PureFlex CN4093 em modo Full Fabric (End-to-End FCoE)

CNA

C

N

4

0

9

3

CN4093 Flex System Fabric Converged Switch

In Full Fabric mode

C

N

4

0

9

3

Valores:

• Conexão direta entre o ínternal storage node' e 'compute node' via midplane em modo FCoE

• Integração do storage com servidor

Black line is FCOE

Green line is Ethernet

Storage node

LOM or CN4054

(pNIC, vNIC

mode)

Ethernet Network

Ex: G8264/G8316

IBM System Storage


PureFlex CN4093 em modo Full Fabric (End-to-End FCoE)

CNA

C

N

4

0

9

3

CN4093 Flex System Fabric Converged Switch

In Full Fabric mode

C

N

4

0

9

3

Valores:

• Redução de complexidade e custo com a remoção de switches SAN Cisco/Brocade

• Ideal para novos ambientes com storage

• Remove a necessidade de cabos FC e rede

Black line is FCOE

Green line is Ethernet

LOM or CN4054

(pNIC, vNIC

mode)

Ethernet Network

Ex: G8264/G8316

Ext. FCoE

Storage

IBM System Storage


Adapter IO Convergence

10 Gb Ethernet

InfiniBand

8Gb Fibre Channel

10Gb CEE10Gb CEE

10Gb CEE10Gb CEE

Converged Network Adapter

BladeCenter

Server

IBM System Storage


Exemplo: Brocade 10Gb CNA for IBM System x. The Brocade 10Gb CNA for IBM System x is a PCI Express 2.0 x8 10Gb Converged Network

Adapter with two SFP+ cages. The adapter can support either an SFP+ Multimode Fiber SR optical module or an SFP+

active copper cable. This adapter supports 10 Gbps per port maximum bidirectional throughput for high-bandwidth

storage (SAN) and networking (LAN) traffic, with full hardware offload for Fibre Channel over Ethernet (FCoE) protocol processing.

The PCI Express low profile form factor adapter can be used in either a standard PCI-E slot or a low profile PCI-E slot.

Did You Know?

Convergence of SAN and LAN traffic on a single adapter and wire helps lower the total cost of ownership (TCO) by reducing the reduced hardware, power, cooling, management, and maintenance costs. It offers investment protection by providing seamless compatibility with existing Fibre Channel (FC) Storage, ethernet networks, driver software, and management applications.

Description Part number Feature code Brocade 10Gb CNA for IBM System x 42C1820 1637 Brocade 10Gb SFP+ SR Optical Transceiver 49Y4216 0069

Em 3/12/2012

compativel com x3650 M4

e com as máquinas eX5

IBM System Storage


FCoE “Top of Rack” Switches

IBM Converged Switch B32

– High density design with 32 ports in a 1U enclosure

– 24 ports FCoE and 8 ports 8Gbps FC

10 GbE FCoE switch with LAN and native Fibre Channel ports

Supports multiple protocols including Fibre Channel over Ethernet (FCoE), iSCSI

and NAS

Ideal for customers looking to connect to existing Brocade SANs

Models:

1U Brocade VDX 6730-32 with 24 x 10 GbE LAN ports and 8 x

8 Gbps native FC ports

2U Brocade VDX 6730-76 with 60 10 GbE LAN ports and 16x 8

Gbps native FC ports

IBM System Storage


Projections for Storage of the Future

Fiber Channel will not go away• Many clients have installations and need ROI• New deployments are leveling out

Ethernet Storage has been on the rise and will continue• NAS and iSCSI will lead the way

66

IDC – WW Enterprise Storage Systems 2011-2015 Forecast May 2011, IDC #228255 (In Billions)

IBM System Storage


Redbooks – www.redbooks.ibm.com

Storage and Network Convergence: FCoE and iSCSI• SG24-7986-00• Draft Fev/2012

Introduction to Storage Area Networks

67

IBM System Storage


Fim

2 - bts 2013 networking v1

Documents

lto drivesbackup site

ibm business partner

feixe de luz

diferena entre switch

ibm system storage

converged network adapter

cwdm exemplo de

definies utilizadas hba