qfabric deep dive - home - j-net...
TRANSCRIPT
QFABRIC DEEP DIVE Masum Mir Director, Product Line Management Campus & Data Center Business Unit
2 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
AGENDA
Vitalizing the DC network for Virtualized servers
How do we design DC network with QFabric
3 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
NETWORK & RESOURCE POOLS IN DATA CENTER
USERS/TENANTS
Tenant-1
Tenant-2
Tenant-3
Tenant-450
Compute & data pools Virtualized workloads
Servers & compute capacity outpacing infrastructure growth Network needs to enable flexible resource pools and scale on the same time
Core IT System
4 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
PERFORMANCE OBSTACLES IN THE ARCHITECTURE
Ethernet
Servers NAS
Multi Tier Architecture
Scale
Latency Scale vs. Latency
Scale
Bandwidth Scale vs. Bandwidth
Location dependent adjacencies & tenancy Silo of compute, storage & service resources
1 2 3 4
1 2
1 2
1 3
1 3
1 4
1 4
>100 µSec
100:1 OS Red Network
Green Network
5 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
IMPROVING APPLICATION PERFORMANCE AT SCALE
Scale
Latency
Scale
Bandwidth
Traditional design
QFabric
Traditional design
QFabric
Ethernet
Servers NAS
Multi Tier Network>100 µSec
100:1 OS
<5 µSec
Wirespeed 3:1 OS 6:1 OS
Servers NAS
1 2 3 4
1 2
1 2
1 3
1 3
1 4
1 4
1 2
1 2
1 3
1 3
1 4
1 4
Scale vs. Latency
Scale vs. Bandwidth
6 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QFABRIC MAINTAINING NETWORK BOUNDARY & ISOLATION
VM VM VM
VM VM VM
VM VM VM
Tenant B
VM VM VM
VM VM VM
VM VM VM
Tenant A
VM VM VM
VM VM VM
VM VM VM
Tenant C
Blue Network
Red Network
Green Network
QFabric Director
DB
Fabric Admin
Admin A Admin Broot@qfabric> show chassis hardwareBBAK0421:--------------------Hardware inventory:<details>
TOR:Rack23xe-0/0/47 {unit 0 {
family inet {address 10.1.1.254/24;}
}}
7 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QFABRIC EFFICIENCY GAIN WITH LARGER & AGILE COMPUTE POOL
VMVM VM
VMVM VM
VMVM VM
Tenant B
VMVM VM
VMVM VM
VMVM VM
Tenant A
VMVM VM
VMVM VM
VMVM VM
Tenant C
Blue Network
Red Network
Green Network
VR-A
VR-B
VR-C
Servers Storage Idle Servers Can optimize Power
8 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QFABRIC EFFICIENCY GAIN WITH STORAGE CONVERGENCE
VMVM VM
VMVM VM
VMVM VM
Tenant B
VMVM VM
VMVM VM
VMVM VM
Tenant A
VMVM VM
VMVM VM
VMVM VM
Tenant C
Blue Network
Red Network
Green Network
VR-A
VR-B
VR-C
Servers NAS FC Storage
FC SAN -A
FC SAN -B
FC
FC
FCoE
FCoE
9 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QFABRIC SIMPLIFYING NETWORK OPERATION AT SCALE
Traditional QFabric
Aggregation Switches
Core Switch
Generic Switch …
..…
Management System Management System
Many devices to manage Multiple OS to manage
Many device and OS to integrate & orchestrate
Single system to manage Single OS
Single system to integrate & orchestrate
OS 4.0 OS 5.0
OS 4.0 OS 5.0
OS 12.3 OS
12.4
OS 12.2 OS
12.4 OS 4.0 OS 5.0
OS 12.3 OS
12.4
11.3
OS 12.3 OS
12.4
OS 12.3 OS
12.4 OS
12.3 OS
12.4
QFabric Director
DB
Fabric Admin
Admin A Admin Broot@qfabric> show chassis hardwareBBAK0421:--------------------Hardware inventory:<details>
TOR:Rack23xe-0/0/47 {unit 0 {
family inet {address 10.1.1.254/24;}
}}
10 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION
Network Application Platform
QFabric Director
Standard API (SNMP, Syslog, NETCONF, etc)
Management System (3rd Party)
Management Client
Management Console
Admin
Admin
CLI/GUI
GLI/GUI
VM1 VM2
Virtual n/w
VM2 VM3VM1Server Admin
Network Admin
Virtual Control
11 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QFABRIC END TO END INFRASTRUCTURE DESIGN
vGW
SRX
MX
QFabric
SRX
MX
VRF-A
VRF-B VRF-C
VMVM VM
VMVM VM
VMVM VM
VR-A
VMVM VM
VMVM VM
VMVM VM
VR-B
VMVM VM
VMVM VM
VMVM VM
VR-C
THE vGW ENGINE
VM VM1 VM2 VM3
VMWARE DVFILTER
VMWARE VSWITCH OR CISCO 1000V
ESX Kernal
ES
X H
ost
THE vGW ENGINE
VM VM1 VM2 VM3
VMWARE DVFILTER
VMWARE VSWITCH OR CISCO 1000V
ESX Kernal
ES
X H
ost
THE vGW ENGINE
VM VM1 VM2 VM3
VMWARE DVFILTER
VMWARE VSWITCH OR CISCO 1000V
ESX Kernal
ES
X H
ost
THE vGW ENGINE
VM VM1 VM2 VM3
VMWARE DVFILTER
VMWARE VSWITCH OR CISCO 1000V
ESX Kernal
ES
X H
ost
THE vGW ENGINE
VM VM1 VM2 VM3
VMWARE DVFILTER
VMWARE VSWITCH OR CISCO 1000V
ESX Kernal
ES
X H
ost
vGW
12 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
DATA CENTER INTERCONNECT
WAN & Core
SRX5800
MX Series
Servers NAS FC Storage
SRX5800
MX Series
Servers NAS FC Storage
SRX5800
MX Series
Servers NAS FC Storage
SRX5800
MX Series
Servers NAS FC Storage
13 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QFABRIC : QFX3000-M VS QFX3000-G
Latency ~3us end-end Latency ~5us end-end
768-6,144 10G ports 48-768 10G ports
Small QFabric/Interconnect Modular chassis QFabric/Interconnect
Managed & operated as 1 switch
Runs Junos
Common QFabric/Node (QFX3500, QFX3600) & Director (QFX3001)
Storage Convergence: Lossless & DCB supported. FCoE & FC-Gateway
14 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QFABRIC FUNCTIONAL ELEMENTS
Interconnect
Fabric switches
Node
I/O devices
Director
Control devices
15 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QFABRIC DATA & CONTROL PLANE
QFabric Data Plane QFabric Control Plane
16 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QF/Director (QFX3100)
CPE CPE
8 x 10GbE LAG
DESIGN EVOLUTION WITH QFABRIC
QFX3500
QFX3500
40G Fabric Links
QFX3500 QFX3500
Dual Homed Server Active-Active
17 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QF/Director (QFX3100)
CPE CPE
DESIGN EVOLUTION WITH QFABRIC
QFX3500
QFX3500
40G Fabric Links
QFX3500 QFX3500
Dual Homed Server Active-Active
QFX3500 QFX3500
40GbE
18 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
QF/Director (QFX3100)
CPE CPE
DESIGN EVOLUTION WITH QFABRIC
QFX3500
QFX3500
40G Fabric Links
QFX3500 QFX3500
Dual Homed Server Active-Active
QFX3500 QFX3500 QFX3500 QFX3500
40GbE
19 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
ARCHITECTURE MIGRATION TO QFABRIC
QFX3500
QFabric
Pod 1 Pod 2 4
20 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
DESIGN EXAMPLE (5K PORTS, 75% GBE, 25% 10GBE)
EX4200 #1
EX4200 #10
EX4200 #79
3,750 x 1GbE @ 2:1 OS 1,250 x 10GbE @ 3:1 OS
MX
Security/Services
MPLS
QFabric
VC#1 VC#8
12 x 10GbE
21 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
DESIGN EXAMPLE (5K PORTS, 25% GBE, 75% 10GBE)
EX4200 #1
EX4200 #10
EX4200 #26
1,250 x 1GbE @ 2:1 OS 3,750 x 10GbE @ 3:1 OS
MX
Security/Services
MPLS
QFabric
VC#1 VC#3
32 x 10/40GbE
23 Copyright © 2012 Juniper Networks, Inc. www.juniper.net
SLIDE TITLE HERE, ALL CAPS, WITH ENOUGH ROOM FOR TWO LINES
Click to edit Master text styles Second level Third level
– Fourth level - Fifth level