new idc architecture
TRANSCRIPT
1 2014�1�21����
Data Center Cloud Architecture
2 2014�1�21����
Limitations)of)Legacy)Data)Center)Architecture)
4:1)
4:1)
4:1)
8us)
50us)
50us)
Access%
Aggregation%
Core%
80% North-South Traffic
Oversubscription: from 64:1 to 200:1 Inter-rack latency: 75 to 150 microseconds Scale: Up to 20 racks
3 2014�1�21����
3)
Cloud Networking Model
Client)
Compute) Cache) Database) Storage)
1)
1)
2)
3)
2)
Client)Request)
Lookup)&)Analytics)
Server)Response)
• )Request)+)Response)=)20%)traffic)• )Lookup,)Analytics,)Storage)=)80%)traffic)(interLrack))• )NonLblocking,)2Ltier)designs)optimal)for)such)traffic)
4 2014�1�21����
1/10 Gb Non-blocking (wirespeed) leaf switches
High performance hosts (VMfarms, IP Storage, Video Streaming, HPC, Low-latency trading)
Non-Blocking Spine
Core Routers
10Gb - 40Gb - 100Gb Spine
Arista Cloud Networking for Next-Gen Data Centers
10 Gb Spine switches
5 2014�1�21����
Benefits of Cloud Networking with Arista Switches
80% Traffic East-West
Oversubscription: None Inter-rack latency: 2 to 5 microseconds Scale: hundreds of racks
6 2014�1�21����
Consistent Cloud Networking Designs – L2, L3, VXLAN
Layer 2 MLAG 1000’s of nodes
Layer 3 ECMP Leaf-Spine 10K+ nodes
L2 over L3 100K+ nodes
Arista)2LTier)Architecture:)Seamless)Exponential)Scaling)
7 2014�1�21����
ECMP – Layer 3
...
...
Three%ways%to%Scale:%%Layer12,%Layer13%and%VXLAN%
VXLAN – Layer 2 over Layer3
...
...
Controller%
• All Active Multipath for L2 and L3 • Standards based protocols (LACP) • Simplifies or eliminates the Spanning Tree topology • Simple to understand and easy to engineer traffic
• All Active Multipath using ECMP (up to 32-way) • Standards based protocols (OSPF, BGP) • Eliminates L2 for exceptional scalability and fault tolerance • Exceptional scale with consistent performance in 2 tiers
• Best of both worlds • All Active Multipath using ECMP (up to 32-way) • Single L3 network for all applications
• L2 extensions for stateful VM – VM over Layer 3 • Extends L2 with exceptional scalability (16M Virtual NWs) • Cloudburst over Public infrastructure
MLAG Spine – L2
...
8 2014�1�21����
Exponential Cloud Scaling with Two Tiers
8 Spine Arista 7508
1 2 7 8
576 Leaf Arista 7050S
Scales to 27,648 x 10G nodes 3:1 oversubscribed
1 576
...
... 16 16 16 16
48 48 48 48
MLAG Spine – L2
...
32 Spine Arista 7508E
1 2 31 32
1152 Leaf Arista 7050SX
Scales to 110,592 x 10G nodes 3:1 oversubscribed
1 1152
...
... 32 32 32 32
96 96 96 96
* Assume 10VMs per real server
2 Way 8 Way 32 Way
10G Ports 6,912 27,648 110,952 VMs * 69,000 270,000 1,100,000
Tenants ~50K ~250K ~1M+ Latency Under 5us Under 5us Under 5us
9 2014�1�21����
What Scale Can You Achieve: L2
Scale using standard L2/L3 Protocols (LACP, OSPF, BGP)
600#
1152#
1440#
4224#
8832#
13440#
27264#
0# 5000# 10000# 15000# 20000# 25000# 30000#
7124#Leaf/7050064#Spine#
7050#Leaf/7050052#Spine#
7050#Leaf/7050064#Spine#
7050#Leaf/7504#Spine#
7050#Leaf/7508#Spine#
7050#Leaf/75040Gen2#Spine#
7050#Leaf/75080Gen2#Spine#
10GbE&nodes&interconnected&
10G&nodes:&Scale&with&Arista&Leaf/Spine&Design:&L2&MLAG&
10 2014�1�21����
What Scale Can You Achieve: L3
Scale using standard L2/L3 Protocols (LACP, OSPF, BGP)
1200$
2304$
2880$
8832$
18048$
27264$
54912$
0$ 10000$ 20000$ 30000$ 40000$ 50000$ 60000$
7124$Leaf/7050164$Spine$
7050$Leaf/7050152$Spine$
7050$Leaf/7050164$Spine$
7050$Leaf/7504$Spine$
7050$Leaf/7508$Spine$
7050$Leaf/75041Gen2$Spine$
7050$Leaf/75081Gen2$Spine$
10GbE&nodes&interconnected&
Scale&with&Arista&Leaf/Spine&Design:&L3&ECMP&
11 2014�1�21����
2 Spine Arista 7508
1 2
72 Leaf Arista 7050S-64 Arista 7150S-64
32 32 32 32
32 32 32 32
Scales to 2,304 x 10G nodes non-oversubscribed
1 72 ...
16 Spine Arista 7508
1 2 15 16
576 Leaf Arista 7050S-64 Arista 7150S-64
32 32 32 32
32 32 32 32
Scales to 18,432 x 10G nodes non-oversubscribed
1 576
...
...
2 Spine Arista 7508
1 2
144 Leaf Arista 7050S-64 Arista 7150S-64
16 16 16 16
48 48 48 48
Scales to 6,912 x 10G nodes 3:1 oversubscribed
1 144 ...
16 Spine Arista 7508
1 2 15 16
1152 Leaf Arista 7050S-64 Arista 7150S-64
Scales to 55,296 x 10G nodes 3:1 oversubscribed
1 1152
...
... 16 16 16 16
48 48 48 48
Building Scalable DC Architecture Using Arista Leaf / Spine
12 2014�1�21����
Cloud Model: Start Small; Scale as You Grow
• Simply%add%a%block%from%the%template%to%scale%
• Each%block%is%in%an%independent%cluster%that%includes%servers,%storage,%database%&%interconnects%
• Each%cluster%can%be%used%for%a%different%type%of%service%
• Homogenous%design%implies%capacity%can%be%added%just%in%time%
%
Cluster 1 Cluster 2 Cluster 3 Cluster 4 Cluster 5 Cluster 6 Cluster 7 Cluster 8
Leaf Spine
13 2014�1�21����
Microsoft’s 4th generation DC
• 40 racks at a time
• Modular, containers
14 2014�1�21����
MLAG
LAG 7148S
7050-64
……
POD-4
MLAG
LAG 7148S
7050-64
……
POD-3
MLAG
LAG 7148S
7050-64
……
POD-2
Template Based Design Cloud
……
POD-1
4 x 10G
MLAG
LAG 7148S
7050-64
Public Cloud
MLAG
LAG 7148S
7050-64
……
POD-3
MLAG
LAG 7148S
7050-64
……
POD-2
MLAG
LAG 7148S
7050-64
……
POD-1
DMZ Private Cloud
MLAG
LAG 7148S
7050-64
……
POD-2
MLAG
7148S
7050-64
……
POD-1
LAG
15 2014�1�21����
Single Rack POD Design
16 2014�1�21����
2 Rack POD Design
17 2014�1�21����
8 Rack POD Design
18 2014�1�21����
28 Rack POD Design