deployment options for avaya dtor


#AvayaATF

Deployment Options for Avaya DToRRandy CrossDirector, PLM@cross_randy

Paul UnbehagenChief Architect@punbehagen


©2013 Avaya Inc. All rights reserved

February 26-28, 2013 | Orlando, FL

It’s a truce!

• A friendly competition among presenters• Help us both win @punbehagen & @cross_randy

• Tweet this session with #AvayaATF and #DToR• You could win a iPad Mini…

• If you don’t have a twitter account…• Get one, you can delete after the show

• If you’re not sick of us after this, we’ll see you at the bar in a few hours

3



February 26-28, 2013 | Orlando, FL4

Agenda

• Introduction• History Discussion• A new DNA for the Data Center

• Design around real traffic flows



Evolution of the Data Center

Once, Campus-class was good enough

• 20-30 microseconds for every hop

• Modern applications have an average of 8 transactions

Traditional networks are designed for north/south traffic – ToR Switches interconnected by the Core or Aggregation…

Rack 1 Rack 4Rack 2 Rack 3

5



Evolution of the Data Center

Traffic patterns were traditionalWhat this meant:

Application traffic traverses multiple Switch hops – Access / Core / ToR / Core / Access

Uplinks were more important than Inter-Rack capacity

Racked Servers

Traditionally:The North-South to East-West ratio has been 80:20

Top-of-RackSwitches

6




What’s the approach of the “Big 2”..?

• Cisco’s Vblock “marketecture” was the first salvo• HP responded by purchasing 3COM/Huawei assets• Both offered “end-to-end” architectures

• Server/Storage/ToR/EoR/Core• The explosion of Virtual Machines has changed

everything• What’s next..?

• Collapsed 2-Tier architecture and “Fabric”• Why..?

• Better L2 scale, overcoming STP & VLAN limits• Scalable support for L3 & VRFs

7



Cisco’s “Classic” Hierarchical Model

Spot the real difference between these two designs..?

All Access traffic flows via Aggregation/Distribution and/or Core

Courtesy: Cisco SystemsEnterprise Campus 3.0 Architecture

Courtesy: Cisco SystemsData Center Architecture Overview

Enterprise Campus Data Center

8



HP’s 2-Tier Network Design An Improvement..?

Switch Clustering has done this for the last 12 years..!

2-Layer may reduce cost, but all traffic still goes to Core9




Avaya Fabric DToRThe new DNA for your Data Center

• Avaya Fabric Connect provides the new DNA for your Data Centre Network.

• Enabling unparalleled scalability and low latency interconnect to address East-West traffic requirements

• Fabric Connect Stacking supports 2-32 switches offering up to 512 10GE ports with 20Tbs Fabric.

• Fabric Connect Mesh supports 4-480 switches offering up to 15,360 10GE ports with 262.5Tbs Fabric.

Avaya Fabric Connect – the new DNA for your Data Centre Network

Sidney Duffy

10




Introducing the Virtual Services Platform 7000Overview & Highlights

• Perfect for Today• Versatile support for 1 or 10 Gigabit

Ethernet• Distributed Top-of-Rack delivers

Industry’s fastest virtual backplane• Fabric networking delivered directly

to the Server• Media Dependent Adaptor flexibility• Lossless hardware & software

architecture• Front-back or back-to-front cooling• Small form-factor & energy-efficient

• Future-Ready for Tomorrow• Seamless integration of 40/100G• Data Centre Bridging-ready to

integrate Storage Convergence

11

Wire-speed performance Delivering mass 1/10 Gigabit

today Optimizes application performance Future-proofed for 40/100

Gigabit & Storage convergence (SDSN)

Highlights



Distributed Top-of-Rack

Two Operational modes for true deployment flexibility

Fabric-mode DToRFlexible Interconnect: up to 200 Switches

(6,400 10GbE Ports & 112Tbps)

Stack-mode DToRStructured Interconnect: 8 Switches

(256 10GbE Ports & 5.12Tbps)

Row A

Row B

Row C

Row D

From small to very large—D-ToR can handle it!12




Avaya Fabric DToRWinning on Throughput & Latency

• Avaya Fabric Connect provides more throughput than competing solutions.• Competitors offer 128Gbps stacking or 4x40GE

(160Gbps) links.• FI Stacking up to 20Tbs and Fabric Connect Mesh

supports up to 262.5Tbs.• Avaya Fabric Connect provides lower latency than

competitors. • “Ultra Low Latency” competitor provides

7.9uS latency (ToR-Distribution-ToR)• Fabric Connect Stacking provides latency of 2.1uS –

5.3uS (4 hop maximum in stack of 8)

13

AVAYA WIN

AVAYA WIN




Avaya Fabric DToRWinning on Price

• Avaya Fabric DToR provides cost effective means to interconnect ToRs vs typical Fat Tree designs of 4 - 20x lower cost.

• Typical Fabric Connect deployment costs with 640Gbps for $6,780• 4 x 3m Fabric Connect cables (640Gbps) per VSP 7000 with MSRP $6,780. • Fabric Connect cables range from $995 for 0.46m to $8,995 for 100m.

• Competing designs with 160Gbp from $27,150 - $142,150• Competing ToR limited to 160Gbps due to 4 x 40GE ports per ToR.• Due to placement of ToR to Core or Distribution switches require longer cable

runs• 8 x 40GBASE-SR4 @ $1,100ea + 8 x Fibre @ $250ea = $12,150

• Require 8 modular ports at costs from $1,875 ea to $ 16,250ea• Arista (standalone) $1,875/port• Cisco Nexus 7000: $9,940/port• Juniper (standalone) $2,306/port, QFX3008 $7,226 - $16,250/port• HP (no offering)

14

Avaya Fabric Connect – the new DNA for your Data Centre Network

AVAYA WIN




VSP 7000 Fabric DToRFabric Interconnect Stacking

• Fabric Stack Mode, in which up to 8 units create a DToR (distributed Top of Rack) delivering up to 5Tbps using two Fabric Connect cables in parallel between each switch.

• For Fabric DToR Stack operation, the stack operates in the same manner as other Avaya stackable products and features many of the associated benefits of Stacking

• Single IP Address Management for Fabric Connect Stack.• Hot Swap Unit replacement with AUR, DAUR, AAUR.• Hot Unit Insertion with NUQC.• Distributed uplinks with DMLT and LAGs.

• For Fabric Connect Stack operation each pair of the Up/Down ports should be thought of as a single connection between each switch.

• You will need 2 Fabric DToR Cables between each switch to form full adjacency and the top port on the Up must be connected to the top Down port on an adjacent switch and similarly for the bottom connector

15



Distributed ToR

How to address the new traffic needs

DToR costs just 1 microseconds Switch hop

Distributed ToR is specifically designed for east/west traffic – ToR Switches directly interconnected…

WebVM

WebVM

AppVM

D/BVM

16



VM Evolution – The Need For Scale & Flexibility

APP A

Physical Servers

Rack 1

APP B

APPs A-HPer

Rack

Virtual Servers

APPsI-PPer

Rack

Rack 1 Rack 2

While application scale & server utilization is poor, network complexity is simple

Server virtualization brings scale and efficiency to applications. VMs become essentially “jailed” and network flexibility is reduced.

Members of the same VM domain must remain in the same subnet

VM Mobility is seriously limited. What is the alternative…?17



Distributed Top-of-RackStack-mode DToR

Structured Interconnect: 8 Switches 256 10GbE Ports

Fabric-mode DToRFlexible Interconnect: up to 200 Switches

6,400 10GbE Ports

North-South/Core-ToR Interconnects

Fabric Connect Core

DistributedData Center

VSP 9000

ERS 8800

VSP 7000

SDSN

SDSN

SDSN

Scaling Concerns

18




VSP 7000 Avaya Fabric Connect Fabric DToR Mesh

• Avaya’s FI Mesh delivers unmatched scalability to address low latency East-West requirements in the Data Centre

• Switches in the Mesh are managed through COM & VPS providing unified provisioning.

• Fabric Connect Mesh is scalable from 4 to 480 switches per region.

• Providing low latency fabric.• Fabric is scalable up to 262.5Tbps.• Extensible up to 15,360 10GE ports.• Designed to enable either 24/32/48/56/64

10GE ports per rack.• Fabric DToR ports interconnect each VSP7000:

• Can use mix of different Fabric DToR cable lengths.

• Optimum performance will be achieved when the same colour designated ports are connected to one another.

Avaya Fabric Connect Mesh – Low Latency Data Centre Grade Fabric Scalable to 262.5Tbps

Sidney Duffy

19




VSP 7000 - VSP 9000Avaya Fabric Connect DToR Mesh

• Extending the FI Mesh of the VSP 7000 can be easily achieved through adding VSP 9000 (or ERS 8800).

• VSP 9000 are connected to the VSP 7000 via high speed connections to handle traditional North-South traffic.

• VSP 9000 provide advanced services to the Fabric Connect Mesh.

• Routing Services for Fabric Connect Mesh VSNs.

• Connectivity between different Fabric Connect Mesh regions.

20

Extending Avaya Fabric Connect Mesh with VSP 9000

Sidney Duffy



VSP 7000 Fabric DToRFabric DToR Mesh

21

Rack Rack Rack Rack Rack Rack Rack Rack

Rack Rack Rack Rack Rack Rack Rack Rack



VSP 7000 Fabric Interconnect MeshMesh Architecture Reference

Logical Pod of 16 Racks (32 switches, 1024 10GE ports) 17.5Tbps Interconnect

RackRack Rack

Blue Interconnect (80Gbps)Interconnect 2 switches in same rack (could be leveraged for IST in future release)

Interconnect top switch to top switch is adjacent row in DCInterconnect bottom switch to bottom witch is adjacent row in DC

(The connection to adjacent rows are shown in parallel in this reference design. These connections could be run from top switch in switch in row N to top switch in row N-1 and then bottom switch in row N to bottom switch in row N+1)

Back Interconnect (240Gbps)Interconnect top switch in rack N to top switch in adjacent (N-1) rack

Interconnect bottom switch in rack N to bottom switch in N+1 rack

Red Interconnect (160-240Gbps)Interconnect top switch in rack N to top switch in adjacent (N+1) rack

Interconnect bottom switch in rack N to bottom switch in N-1 rack

22



VSP 7000 vToR (Virtual ToR)Fabric DToR Stacking Reference

Non-Resilient Server connections 32 x10G ports per Rack / 256 10GE ports per Pod5Tbps East-West Bandwidth

ToR

32 Servers per Rack

FI Stacking (10.1)

23



VSP 7000 DToR Fabric DToR Stacking Reference

Fully Resilient 32 x10G ports per Rack / 512 10GE ports per Pod10Tbps East-West Bandwidth

FI Stacking (10.1) Switch Clustering (10.2)

ToR Cluster

1ToR Cluster

2

IST`

32 Servers

per RackDual

Attached

24




Technology Evolution

25

Completely unique solution to the real DC problem

• A modern 3-D design, instead of the antiqued 2-D approach

• From islands to virtual modularity

• Meeting the traffic model of modern cloud computing

• Bandwidth where you need it, when you need it

• True, extensible virtualization for Networking, Compute, and Storage

Unshackle the DC


Thank you!#AvayaATF

26

@cross_randy@punbehagen

deployment options for avaya dtor

Documents