switchingpanorama day1 part4 nexus access

Cisco Confidential © 2011 Cisco and/or its affiliates. All rights reserved. 1

Nexus Fixed Switching (N5K/2K/3K/6K) Update

Tomasz Kulakowski

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 4

Maciej

Konieczny

Krzysztof

Baczyński

Grzegorz

Gondek

Tomasz

Kułakowski

Krzysztof

Banel

Territory PSS Team SE Team

Ent-Finance

Central Govt

Service Provider

Ent-Energ,O&G

Local Govt

+ MOI & TP

Partner Led

MM Accounts

Grzegorz

Dobrowolski, PSM

© 2006 Cisco Systems, Inc. All rights reserved. Cisco Confidential Presentation_ID 5

Market share

Cisco's market share in the fast growing 10GbE market segment stands at 66.8% in 2Q12

http://www.idc.com/getdoc.jsp?containerId=prUS23656412


Nexus 2000

1GE Rack Mount Servers

Nexus 2000


Nexus 4000/B22H

10GE Blade Switch w/ FCoE

(IBM/Dell)

Cisco UCS

Nexus 2000

1 & 10GE Blade Servers w/ Pass-Thru


Direct Attach 10GE

Core Distribution

Nexus 7000 MDS 9000

LAN SAN

Unified Access Layer

Nexus 5x00, 6x00

UCS Compute Blade & Rack

Architektura Data Center

Nexus 1000V


Unified Fabric Ethernet Enhancements VN-Link Distributed Access Fabric

Fibre

Channel

Traffic

Etherne

t

Virtual Port Channel (VPC)

Layer 2 Multipath (TRILL & ETRILL)

Priority Flow Control (PFC) IEEE 802.1Qbb

Bandwidth Management IEEE 802.1Qaz

VN-Tag Port Extension+ SR-IOV

Network Interface Virtualization (NIV)

Port Profiles

Adapter FEX

VM-FEX

Nexus 2000 and Fabric Extender Technology

Centralized Control and Mgmt with Distributed Forwarding

VN-Tag Enabled Port Extension

Low Latency Cut-Thru Switching

Native Fibre Channel supporting full SAN Fabric Capabilities

FCoE enabled - T11 FC-BB-5

Data Center Bridging Exchange Protocol (DCBX)

Ingress Queuing, Virtual Output Queues and Lossless Fabric

Nexus 5000 and 2000 Virtualized Data Center Access


Data Center Access Switching Family Overview Nexus 5000 and 2000 Series Switches

Cisco® Data Center Network Manager (DCNM) and Fabric Manager

64-port Layer 3 Switch 48 fixed ports 1/10GE

4 fixed 40GE/10GE

Nexus 3000/3500

Nexus 2232 FEX

32 1/10 GE Ethernet/FCoE

8 10 GE DCB/FCoE uplinks

Nexus 2224/2248 FEX

48 Fixed 100M/1GbE ports

4 Fixed 10GbE uplinks

Nexus 6004K

96/48-port Switch 32/48 fixed ports 1/10GE/FCoE/DCB

1/3 Expansion Module Slot

Nexus Blade Switches

Nexus 5548/5596UP

96/48-port Layer 3 Switch 48 fixed 40G ports (or 4x10G)

4 Expansion for 12 port modules


Nexus 5000 Series Switches

Nexus 5548UP 1RU Unified Ports Switch

Nexus 5596UP 2RU Unified Ports Switch

Nexus 5548 Layer 3 Daughter Card

Nexus 5596 Layer 3 Expansion Module

Nexus 5500 Unified Ports

Expansion Module


Flexible and Scalable Deployment options

Flexible

Scalable

• 10GBase-T Ecosystem (Intel, Panduit, Commscope)

• Support existing Fiber GEM and new Copper GEM

• 96 Access Ports for Direct Server Attach

• Up to 68 10GBase-T Ports per chassis

• SFP+ Ports supporting FEX Technology

Functionality

• Hardware (10GBase T Ports) FCoE capable**

• Software leverages NX-OS L2/L3 feature set

* Compatible with 5596T Chassis Only

** Under Investigation

Slot 1

32 x 10GBase-T 16 x SFP+ Ports

2 RU Slot 2 Slot 3

NEXUS 5596T SWITCH New

12 x 10GBase-T Ports GEM module*

New


Unified Port Extends FC Connectivity

Fibre Channel

Traffic

Ethernet

Converged Port • 10GE port capable of DCB • LAN and SAN on the same wire • Can run converged, LAN only or FCoE only

• Available on all N5000 and N5500

• Reduces number of physical ports, interconnect, adapters, switches

Fibre Channel

Traffic

Ethernet

or Fibre Channel

Traffic

Fibre Channel

Any Unified Port can be configured as

Native Fibre Channel

FC Eth

Ethernet:

1/10GbE, FCoE, iSCSI, NAS

Unified Port • Configure as native FC port or Converged Port • Assignable per port • 8/4/2/1Gbps FC

• Available on N5500 UP version

• Benefits of converged plus flexibility of port assignment


N5500 L2/L3 Architecture Details

Carmel Carmel Carmel Carmel Carmel Carmel

48 Fixed Ports

Sunnyvale (Fabric)

Module Slot (L2/L3)

Module Slot (L2/L3)

Module Slot (L2/L3)

N5596

8 8 8 8 8 8

Module Slot (L2) Carmel Carmel Carmel Carmel

32 Fixed Ports

L3 Daughter Card Slot

N5548

8 8 8 8

Sunnyvale (Fabric)

Carmel – lookup ASIC

Sunnyvale – crossbar fabric ASIC

160G bandwidth per L3 daughter card/Module shared by all ports in the box, 240Mpps

N5548 chassis configuration:

32/48 x10GE L2

32/48 x10GE with 160G L3

N5596 chassis configuration:

No L3 module L2: 96x10GE L3: No

1xL3 module L2: 80x10GE L3: 160G


10 Gigabit Ethernet for Server Connectivity

Cable Transceiver Latency (link)

Power (each side) Distance

Connector (Media)

Twinax ~ 0.1ms ~ 0.1W <10m SFP+ CU* copper

MM OM2 MM OM3

~ 0 1W 82m 300m

SFP+ SR MMF,short reach

MM OM2 MM OM3

~ 0 1W 10m 100m

SFP+ USR - FET MMF, ultra short reach

Cat6 Cat6a/7 Cat6a/7

2.5ms 2.5ms 1.5ms

~ 6W*** ~ 6W*** ~ 4W***

55m 100m 30m

RJ45 10GBASE-T copper

100Mb 1Gb 10Gb

UTP Cat 5 UTP Cat 5

MMF, SMF

10Mb

UTP Cat 3

Mid 1980’s Mid 1990’s Early 2000’s Late 2000’s

UTP Cat6a

MMF, SMF

TwinAx, CX4

Standard

SFF 8431**

IEEE 802.3ae

none

IEEE 802.3an

*** As of 2008; expected to decrease over time

10G Options

* Terminated cable ** Draft 3.0, not final

Twinax 15m X2 CX4 copper

IEEE 802.3ak 4W ~ 0.1ms

In-rack X-rack

Across racks

~50% power savings with

EEE


5548P 5548UP 5596UP 5596T

Fiber

GEM ✔ ✔ ✔ ✔

Cu GEM

(12p) ✔


4p QSFP+

Includes 4x QSFP+ interfaces per expansion module

Each QSFP+ interface supporting 4x 10GE interfaces

Supported on all Nexus 5500 Series Chassis – 5548P, 5548UP, 5596UP and 5596T

No 40GE PHY on the GEM.

8 wires of 4x10GE interfaces are routed into QSFP+ cage

Target Q2CY13


Extender/multiplexer Distributed Access Fabric (DAF)

Nexus 5000 Virtualized chassis

+

Nexus 5000 / UCS interconnect

Nexus 2000 / UCS blade switch-extender

= Sup

Sup

Odzielenie warstwy 1 przełącznika od 2 (Layer 2)


Operational simplicity

Cost effective solution

Cabling simplicity

Architecture flexibility

Policy consistency across large number of ports

Highly scalable platform with predictable low latency

NX-OS Feature richness

Physical view (Efficient cabling)

Logical view (efficient management)

Fabric Extender architecture: Operational simplicity at scale for POD access designs


In Layer 2 Mode, with NX-OS release 5.0(3)N1(1), each Nexus 5500 is capable of supporting up to 24 Nexus 2000 Series Fabric Extenders

In Layer 3 Mode (L3 License installed), each Nexus 5500 is limited to supporting up to 16 Nexus 2000 Series Fabric Extenders, 16 per a N5K vPC pair. For active/active Nexus 2000 vPC uplinks this is also a total limit for N5Ks.

16 x FEX

24 x FEX


Nexus 2248TP-E Fabric Extender overview

48 x 100/ 1000 Host interfaces

4x 10 GE Fabric

interfaces

Redundant, hot-swappable power

supplies

Hot-swappable fan tray

Beacon and status LEDs


Nexus 2232 PP Fabric Extender overview

32 x 1 GE/10GE Host interfaces

8x 10 GE Fabric

interfaces

Redundant, hot-swappable power

supplies

Hot-swappable fan tray

Beacon and status LEDs


N2K-C2232TM-10GE 32 host ports 1/10GBASE-T (uplink module with 8 10GE

ports)

N2K-C2148T-1GE 48 host ports 1GT (4

10GE uplinks)

N2K-C2232PP-10GE 32 host ports 1/10GE/FCoE

(8 10GE uplinks)

N2K-C2248TP-1GE 48 host ports 100/1GT (4

10GE uplinks)

N2K-C2224TP-1GE 24 host ports 100/1GT (2

10GE uplinks)

FET-10G Fabric Extender Transceiver

N5K parent vPC FEX

Simplified operations

ISSU 100M/1G/10G

FCoE

FEX Pre-provisioning Port profiles

2248TP-N7K parent FEX scaling

N5500 parent

10GT on FEX 2232PP-N7K parent 2224TP-N7K parent

Adapter FEX VM FEX

F2 FEX Support Enhanced vPC

1HCY11 2HCY10 1HCY10 1HCY09 2HCY11

N2K-C2248TP-E-1GE

Server Ports: 48 ports 100M/1GT

Uplink Ports: 4 ports 10GE

32MB buffer

Nexus B22 Blade FEX For HP Blade Servers

16 host ports 1/10GBASE-T (uplink module with 8 10GE

ports)


Unified access platform for any POD designs - across rack, blade, 100M, 1G, 10G, FCoE, copper, Fiber, ToR and EoR architectures, Layer 2/Layer 3 solutions, traditional or virtualized workloads

Nexus

2000

100M/1GE Rack

Mount Servers

Nexus

2000

1/10GE/FCoE

Rack Mount

Servers

Cisco

UCS

Nexus 7000

Un

ifie

d A

cces

s L

ayer

Nexus 5000/5500

1/10GE/FCoE

UCS Compute

Blade

1/10GE/FCoE

Third Party

Blade Servers

Nexus

2000

Par

ent

Sw

itch

1/10G/FCoE

UCS Compute

Rack

Nexus

2000

UCS


Model Nexus 2248TP Nexus 2248TP-E Nexus 2232PP Nexus 2232TM Nexus 2232TM-E

Product Shipping Yes (Q2CY10) Yes (Q4CY11) Yes (Q2CY10) Yes (Q3CY11) Yes (Q3CY12)

Form Factor 1 RU 1 RU 1 RU 1 RU 1 RU

Uplink Ports 4x 10GbE SFP+ 4x 10GbE SFP+ 8x 10GbE SFP+ 8x 10GbE SFP+ 8x 10GbE SFP+

Uplink Transceivers Supported

Copper CX-1 (passive): 1m, 3m, 5m. Copper CX1 (active): 7m, 10m Optical: FET, SR, LR

Host Facing Ports 48x 100/1000BASE-T RJ45

48x 100/1000BASE-T RJ45

32x SFP/SFP+ (1/10G) 32x 1/10GBASE-T RJ45 32x 1/10GBASE-T RJ45

FCoE N/A N/A Yes No Capable

Buffer Ingress buffer (Host Network/H2N): 480KB per port group (8) Egress buffer (N2H): 800KB per port group (8)

32MB shared buffer

Ingress buffer (Host Network /H2N): 1280KB per port group (8) Egress buffer (N2H): 1280KB per port group (8)



Typical Power 95W 95W 210W 280W@30M, 350W@100M

210W@30M, 240W@100M

Enhanced Counters Standard Enhanced Standard Standard Standard

Parent Switch Nexus 5K, Nexus 7K Nexus 5K, Nexus 7K Nexus 5K, Nexus 7K, UCS FI

Nexus 5K, Nexus 7K Nexus 5K

Number of FEX 24 FEX per N5500 48 FEX per N7K

24 FEX per N5500 48 FEX per N7K



24 FEX per N5500

100M/1GE platform 1/10GE platform


• 48 ports 100M/1G-BaseT Enhanced Fabric Extender

48x 100/1000M host/downlink interfaces

4x 10GE on network/uplink interfaces

32MB shared buffer

Upstream N5K or N7K parent switch supports various FEX (mix-and-match)

Choice of airflow and AC/DC power

• Design scenario:

High density 100M/1G access

Cost effective 100M/1G solution

Virtualization

Buffer optimized for specific Data Center workloads such as Big Data, Hadoop and Distributed Storage

48 100/1000 RJ45 Downlinks

4 10GE SFP+ Uplinks

Key differences from N2248TP:

• Optimized Buffers

• Enhanced counters

Same

price as

2248TP,

enhanced!


Source: Crehan Research (Q1CY12)

35 136 713

3 248

8 287

13 422

17 462

2 664

5 565

10 603

13 830

15 260

12 828

9 571

0

5 000

10 000

15 000

20 000

25 000

30 000

2010A 2011A 2012E 2013E 2014E 2015E 2016E

Ethernet Datacenter 10GB Ports 000's

SFP+

Base-T

10GBASE-T is fast growing


• The first full quarter of shipments for the Intel "Romley" and "Sandy Bridge" server platforms helped drive the 10G Ethernet server adapter and LAN-on-Motherboard (LOM) segment to strong results in Q2, with ports increasing almost 20% from Q1 and over 50% from last year, according to Crehan Research. Within this, 10GBASE-T saw "dramatic growth," according Seamus Crehan, principal of Crehan Research, with Q2 port shipments exceeding all cumulative 10GBASE-T shipments up to this point.

http://www.networkworld.com/community/blog/romley-servers-ciscos-help-drive-10gbase-t-explosion

http://www.networkworld.com/news/2012/021312-intel-romley-256084.html

http://www.networkworld.com/news/2012/051512-intel-server-chips-259294.html

http://www.networkworld.com/news/2012/051512-intel-server-chips-259294.html

http://www.networkworld.com/news/tech/2011/080911-10gbaset.html




Server

N2K (10GbT) N2K (SFP+) $281

$210

$1427

Customer

Spend on

SFP+/por

t (GPL)

$936

Downlinks

(Twinax vs. Cat6A)

Adapter

$281

$20

$1237

Customer

Spend on

10GbT/po

rt (GPL)

$936

Server


• What is same as 2232TM? • Form Factor, ports, power supplies, etc.

• Cabling options and distance supported

• Port to port latency

• What is different? • A newer and better 10GBase-T PHY (40nm)

• Better BER characteristics expected – qualification underway

• Reduction in power consumption

32 1G/10GT Downlinks

8 10GE SFP+ Uplinks

Shipping!


IEEE 802.3.an standard

Structured Copper Cabling with RJ45 connectors

Supports 10Gbps throughput for up to 100 meters or 330 feet

Leverages Category 6, Category 6A, and Category 7 type cabling

Cable Transceiver Latency

Power (each side) Distance Technology

Twinax ~0.25ms ~0.1W 5m SFP+ CU Copper

MM OM1 MM OM3

~0.1ms 1W 33m 300m

SFP+ SR short reach

SMF ~0.1ms 1W

10km SFP+ LR long reach

Cat6/6a/7 Cat6/6a/7

~3ms ~3ms

~6.2W ~4.5W

100m 30m

10GBASE-T – 65nm

Same cabling considerations as with Catalyst switches:

http://www.cisco.com/en/US/prod/collateral/switches/ps5718/ps6021/white_paper_c11-609513.html

2232

PP

Cat6/6a/7 Cat6/6a/7

~3.9W ~3.3W

10GBASE-T – 40nm

22

32

TM

22

32

TM

-E

~3ms ~3ms

100m 30m







• BER characteristics improving with newer generations of PHYs

• 40nm PHYs (2012) better than 65nm PHYs (2011)

• FCoE support need ~10-15 – No single standard

• Working with the ecosystem to define requirement and test

• Adapter vendors: QLogic, Emulex, Intel, Broadcom

• Storage vendors: EMC, NetApp

• FCoE not supported on Nexus 2232TM

• BER testing underway for Nexus 2232TM-E no FCoE support at FCS

• Targeting Harbord software release for up to 30M distance

• Targeting later release for up to 100M distance


Nexus 2232TM/TM-E Architecture

10G-T

PHY 10G-T

PHY

10G-T

PHY

10G-T

PHY

10G-T

PHY

10G-T

PHY

SFP+

physics

SFP+

physics

SFP+

physics

SFP+

physics

Host Interfaces

Network Interfaces

1 32

SFP+

physics

SFP+

physics

SFP+

physics

SFP+

physics

1 8

Woodside ASIC


• 1G/10G SFP+ Fabric Extender

48x 1/10GE SFP+ host interfaces

4x QSFP (16x10GE SFP+) on network interfaces

Front-to-back airflow and back-to-front airflow

N5500 parent switch at FCS

Additional uplink buffers (2x16MB)

• Design scenarios:

High Density 10GE SFP+ ToR

Connectivity Flexibility

Virtualized environments

Storage consolidation (FCoE, iSCSI, NFS…)

Predictable Low latency across large number of ports

48 1G/10GE SFP+ Downlinks 4 QSFP+ Uplinks

Q1CY13


• Support for Nexus 5500 and 6000 at FCS

• Up to 24 FEX per N5K/6K parent switch

• Up to 1152 10GE interfaces managed through upstream parent switch

Cisco Nexus® 6000

+

Cisco Nexus® 2000 FEX

24xFEX

Cisco Nexus® 5500

Q1CY13


FEX Connectivity for the Blade Server Ecosystem

• Extends FEX connectivity into blade chassis

• Cisco Nexus 5000 Switch is a single management point for all the blade chassis I/O modules

• End-to-end FCoE support

• 50% decrease in blade chassis I/O modules

• 66% decrease in blade management points

• Blade & rack networking consistency

• Increased network resiliency

FEATURES

BENEFITS:

Cisco Nexus B22 HP

Cisco Nexus B22 F

Shipping!

Cisco Nexus B22 Dell


• 16 x 10 GE server interfaces

• 8 x 10 GE network interfaces

• Host vPC (virtual Port-Channel)

• DCB and FCoE in 10G mode

• Upstream Nexus 5000 supports FEX mix & match

• 8 QoS queues (6 configurable)

• Fabric link interconnects:

Fabric Extender Transceiver (FET)

1/3/5M Twinax, 7/10M active Twinax,

SR, LR, ER

NX-OS version 5.2(1)N1(1) or

greater for the Nexus 5000/5500

Requires upstream Nexus 5000/55xx

Blade Enclosures: Primergy BX900/BX400, Dell M1000e chassis


HP with Cisco Nexus B22

LAN SAN A SAN B

Chassis 1 Chassis 4

LAN

MGMT

Chassis 1 Chassis 1

LAN SAN A SAN B

HP Virtual Connect FlexFabric

MGMT

Chassis 1 Chassis 2 Chassis 3 Chassis 4

HP + Cisco Nexus B22 Advantages

• True End-to-End 10Gb FCoE

• Quality of Service (QoS)

• Proven Layer 3 Cisco Reliability

• Better Solution Visibility/Troubleshooting

• Favorable TCO to Virtual Connect

• Simplified cabling

Why?

• Cisco Nexus B22 brings true FCoE

outside of the chassis. Virtual Connect

FlexFabric is FCoE only within an

enclosure and has many key limitations

(proprietary, no QoS, lack of

troubleshooting, spanning tree issues,

limited policy settings).

N5K

Convergence only

inside each chassis

Network Devices 8 20

Chassis Management Devices 8 20

Offers 10Gb FCoE to

Nexus N5K

Network Devices 2 2

Chassis Management Devices 8 20

Chassis 10 Chassis 10

…160 blades …160 blades


Existing Bundles

except N5548P and

N2232TM Bundles

to continue through

FY13

Repricing action for the

following Bundles :

• N5596UP-6N2248TF ($82,000 $81,000)

• N5596UP-6N2248TP ($74,500 $73,500)

• N5596UP-4N2232PF ($79,000 $74,000)

• N5548UPM-4N2232PF ($78,000 $74,000)

Simplified Bundle

Strategy

ANY GiG FEX Bundles (w/ N2232T8F-E options for

10GBASE-T Upsell)

Introduction of 2 new

configurations:

• N5548UPL3-2N2248TF

• N5596UPMM-12N2248T

ANY FEX Bundles


55 55

Nexus 3064-E 28-Port 1RU Switch

Nexus 3048TP 48-Port 1RU Switch

Nexus 3016Q 96-Port 2RU Switch

Nexus 3064-X Integrated Phy

vPC, Precision

Time Protocol,

Configurable Control

Plane Policing

Power-on

auto-provisioning,

Encapsulated Remote

Switched Port Analyzer

Wired-network rate

L2/L3 feature set,

IPv4/v6

User programmable:

python scripting,

EEM, NETCONF

Cisco Nexus® 3000 Series

Robust Cisco® NX-OS with Differentiated Feature Set

Customers

Industry’s leading

Ultra Low Latency

Platform

Nexus 3548 48-Port 1RU Switch

Latency: 250 – 300 ns !!

Roadmap


Nexus 3548 Specifications Algorithm Boost Features

• Ultra Low Latency – <300ns

• Active Buffer Monitoring

• NAT @ Ultra Low Latency

• Intelligent Traffic Mirroring

• IEEE-1588 PTP w/Pulse Per Second

• 48x SFP+ – 100M / 1G / 10G / 40G

• Line rate L2/L3, Unicast & Multicast

• 18MB Packet Buffer

• 32K IPv4 Route, 64K Host, 8K MC

• 4K Flexible ACL / QoS


100M* 1G 10G 40G*

* Roadmap; Not at FCS


Nexus 3064-X Nexus 3548

800ns-1.2us Latency

16K IPv4 UC Routes

16K IPv4 Hosts

8K IPv4 MC Routes

2K+1K Fixed ACL

9MB Packet Buffer

Buffer Snapshots

Cisco SoC

• L2/L3

• 960Gbps

190 ns Latency

32K IPv4 UC Routes

64K IPv4 Hosts

8K IPv4 MC Routes

4K Flexible ACL

18MB Packet Buffer

Active Buffer Monitoring


Twinax QSFP+ to SFP+ Octopus 1m/3m/5m

Optical QSFP+ to SFP+


Raising the Bar… Again!

Enables High Performance Networking through Cisco Custom Silicon

Performance

Highest density line rate,

low power per port 10G/40G

Ethernet/FCoE switch

in the industry!

Integrated Layer 2 and

Layer 3 feature-set

First 40G FCoE Switch

Versatility

Wide range of deployment options

High density FEX aggregator

Large Scale Fabrics

Leaf-Spine Architecture

Latency

Low Latency at scale

~ 1 microsecond latency for

all ports, cut through switching

Flexibility

Configurable port speeds with

true 40GE flows or 4 x 10GE flows

Modularity provides future

expansion capabilities


Form-factor / Power

4RU; 17.5” W x 30” D

96 Line rate 40G ports or

384 Line rate 10G ports

Power per 40G port:

Max: ~31W & Typical: ~25W

F2B and B2F airflow SKUs

Unique Innovations

ECN for handling in-cast traffic

Optimized multicast

scheduling/replication

Supports flexible resource carving

(TCAM, Buffers)

Latency Analytics with conditional

SPAN, ERSPAN, IPFIX,

Sampled Netflow

26MB shared buffer per

12x 10GE ports or 3x 40GE ports

Unmatched scale & features

FCoE, NAT, Line rate SPAN/ERSPAN

1024 way ECMP, 16K VLANs, 4K ACL

Layer 2 Multi-Path (Fabric Path, TRILL)

IPv4 & IPv6 Unicast & Multicast Routing

256K MAC/IP Host Tables with flexible

carving

32K LPM & 32K mroutes


• Port side exhaust at FCS

• Port side intake post FCS

• Different PS and Fan modules are required for different air flow directions

17.3” (w) x 30.0” (d)


Feature Scale*

ECMP 1K

VRFs 4K

SPAN 31, 16 can be ERSPAN

CPU Quad Core

FEX 24 at FCS; larger scale post FCS

VDC 8 – post FCS

Segment ID Uses the 16K BD

VLAN translation 16K ingress/16K egress

LIFs 8K per ASIC

*SW support varies

Feature Scale*

Latency ~1us

MAC table 256K MAC/ARP (flexible)

IP Unicast Routes 32K (v4) or 8K (v6)

IP Hosts 128K (v4) or 64K (v6)

IP Multicast routes 32K (v4) or 16K (v6)

Bridge Domains 16K

ACLs 4K flexible

Port Channels 192

IGMP Snooping groups 32K


40G QSFP+

Interfaces

40G QSFP+

Interfaces

10GE SFP+

interfaces

10GE SFP+

interfaces

40GBASE-SR4 40GBASE-SR4

40GBASE-SR4

1m,3m,5m Passive

7m, 10m, Active

QSFP to QSFP

100m SR4

300m CSR4

QSFP to QSFP

100m SR4

300m CSR4

QSFP to 10GE

breakout

7m, 10m, Active

QSPP to 10GE breakout


QSFP 10KM

SFP+ 300m

SFP+ 300m

FEX

Type Distance

QSFP-40G-LR4* 10KM with SMF

QSFP-40G-SR4 100m with OM3

150m with OM4

QSFP-40G-CSR4 300m with OM3

400m with OM4

QSFP-4x10G-AC7M 7m

QSFP-4x10G-AC10M 10m

QSFP-H40G-1M 1m

QSFP-H40G-3M 3m

QSFP-H40G-5M 5m

QSFP-H40G-AC7M 7m

QSFP-H40G-AC10M 10m

QSFP QSFP 10KM

Nexus

2248PQ-10G

* Target Q2 CY13

Harbord Maintenance (Q2CY13)

QSFP

QSFP

QSFP


FEXlink

L2

L3

FabricPath

• 24xFEX per N6004 in L2 mode

• 24xFEX per N6004 in L3 mode

• 4K VLAN

• 115K MAC

• 32K summary routes

• 8K mroutes

• 115K ARP/host routes

• 128 switch ID

• 4K VLAN

• 256 OSPF peers

• 256 BGP peers

• 256 EIGRP peers

• 256 PIM Peers

• 500 HSRP groups

• 4K VRF

• 64K STP logical interfaces

• 8K IGMP snooping entries

• 2 Topologies

• 4 multi-destination trees

ACL

SPAN

• 16 Bi-directional SPAN

• VACL 1024 ACE

• IFACL 1152 ACE

• QoS ACL 448 ACE

• RACL 1024 ACE

* Single dimension scalability. Multi-dimension scalability will be provided at FCS


Nexus 55xx Nexus 6004

Latency ~1.8us ~1us

MAC table 32K 256K MAC/ARP (flexible)

LPM Routes 16K 32K

Hosts 16k 128K

Multicast route 8K 32K

Bridge Domains 4K 16K

ACLs 4K flexible 4K flexible

IGMP Snooping groups 4K 32K

ECMP 64 way 1K

VRFs 1K 4K

SPAN 4 31, 16 can be ERSPAN

Buffer 640K per port dedicated 25MB per 3 QSFP

VDC N/A 8


Customer Requirements: Decision Points

Decision Criteria in the Aggregation/Spine

Nexus 7000 and Nexus 6000: DC Considerations

Virtualization Scalability DCI/Mobility Environmentals

L4-7 Services High Availability Latency Investment Protection

Recommended when:

Scale and Flexibility

(100M/1G/10G/40G/100G/UP*)

Highest Availability (HA)

Investment Protection

Multi-Protocol / Services

FEX, VDC, OTV, MPLS/VPLS,

LISP

Recommended when:

High density compact

10G/40G/100G*/UP*

Low footprint & low power

Low latency & jitter

Advanced FEX Features

Nexus

7000

Series

17 to 42 Tbps

Nexus

6004

Up to 7.68 Tbps

Lead Platform: Modular, High-End Solution Fixed, Mid-Range Solution

* Roadmap


Nexus 5k/2k

Nexus 7K

Boundary Node:

Nexus 7K

Nexus 5500

Nexus 6004 + N2200

Nexus7k/ Nexus 6004 FabricPath

Spine

ASR9K MPLS/

Nexus 5500 + N2200

Nexus 6004 + N2200 Edge

slot 1

slot 2

slot 3

slot 4

slot 5

slot 6

slot 7

slot 8

blade1

blade2 blade3

blade4 blade5

blade6 blade7

blade8

slot 1

slot 2

slot 3

slot 4

slot 5

slot 6

slot 7

slot 8

blade1

blade2 blade3

blade4 blade5

blade6 blade7

blade8

slot 1

slot 2

slot 3

slot 4

slot 5

slot 6

slot 7

slot 8

blade1

blade2 blade3

blade4 blade5

blade6 blade7

blade8

slot 1

slot 2

slot 3

slot 4

slot 5

slot 6

slot 7

slot 8

blade1

blade2 blade3

blade4 blade5

blade6 blade7

blade8

slot 1

slot 2

slot 3

slot 4

slot 5

slot 6

slot 7

slot 8

blade1

blade2 blade3

blade4 blade5

blade6 blade7

blade8

slot 1

slot 2

slot 3

slot 4

slot 5

slot 6

slot 7

slot 8

blade1

blade2 blade3

blade4 blade5

blade6 blade7

blade8

FCoE

Nexus 7K/ Nexus 6004

Large Scale Fabric (L2/L3)

NAS/iSCSI

FEX Architecture

AGG

Access

CORE

L3

L2

FCoE

FC

B A

Nexus 6004 40GE/10GE

FCOE

Multi-Hop FCOE

Nexus 7K/ Nexus 6004

Thank you.

switchingpanorama day1 part4 nexus access

Documents