How Will Networks of the Future EffectHow Will Networks of the Future Effect Infrastructure Decisions Today?

Nathan Benton, RCDD, DCDCNathan Benton, RCDD, DCDCTechnical Director – North American Region

CommScope, Inc.

Registered Communications Distribution DesignerRegistered Communications Distribution DesignerMS Business IT – Information Assurance

Agenda

Why Are We Even Having This Discussion?

History of Change Until Now

F t T h lFuture Technology

802.11ac Wi-Fi

400Gb/s and 1Tb/s Ethernet

Leaf and Spine Data Center Architecture

10G D i F d10G Design Freedom

H Did W G H ?How Did We Get Here?

The History of Changey g•10Base-2 Network Architecture•Hardware driving Infrastructureg•Bus Topology

•Thinnet (coax) Cabling – RG-58•BNC Connectors•BNC Connectors•T-connector and Terminators

The History of Change•100Base-FX •Star Topology

y g

•Star Topology•Backbone or Horizontal Ports

•50 or 62.5 micron Fiber Cable•First MT-RJ ports•LC Connectors Permanent Solution

The History of Change

•10G Ethernet•Primary use today is in Data Center•Primary use today is in Data Center•Core/Distribution/Access Ports

•50 or 62.5 micron Fiber Cable•Direct Attach Cable (Twinax)•LC ConnectorsMPO Connectors (40/100G)•MPO Connectors (40/100G)

The History of Change•Fiber Channel over Ethernet•Primarily uses ToR Topology

•50 or 62.5 micron Fiber Cable•Direct Attach Cable (Twinax)•LC ConnectorsMPO C t (40/100G)•MPO Connectors (40/100G)

E l i f 802 11 Wi FiEvolution of 802.11 Wi-Fi

Evolution of 802.11 of Wi-Fi

IEEE 802.11ac – Wi-Fi for the Mobile and Video Generation Broadcom 2012

IEEE 802.11ac Wi-Fi

•IEEE 802.11ac

•Initial use in residential applications

•Speeds up to 3.6Gbps

•5 GHz Frequencyq y

•Multiple Antennas

•Beamforming•Beamforming

IEEE 802.11ac – Wi-Fi for the Mobile and Video Generation Broadcom 2012

How Can We Achieve Such High Speeds?Speeds?

802 11 64 b i 20 Mh B d id h 16 h QAM 54 Mb•802.11a – 64 subcarriers, 20 Mhz Bandwidth, 16 phase QAM– 54 Mbps

•802.11n – 64 subcarriers, 20/40 MHz Bandwidth, 64 phase QAM, MIMO – 600 Mbps

•802.11ac – 512 subcarriers, 80/160 MHz Bandwidth, 256 phase QAM, Multi-user MIMO – 3.6 Gbps

*What’s The Difference Between 802.11n And 802.11ac, Electronic Design, 2012

How Can We Achieve Such High Speeds?Speeds?

•Bandwidth – 20 MHz vs. 160 Mhz

Th hi h th b d idth th OFMD b i•The higher the bandwidth the more OFMD subcarriers•From 16 phase to 512 phase

•MIMO vs. MU-MIMO

•MIMO uses multiple receivers, transmitters and antennas•Spatial Division Multiplexing – create multiple streams within the bandwidth channelschannels•MU-MIMO – doubles the number of data streams

•Frequency – 5 GHz vs. 2.4 GHz

•5Ghz more robust and less interference from other devices•Higher frequency means less range•Incorporate Beam Forming to extend range

*What’s The Difference Between 802.11n And 802.11ac, Electronic Design, 2012

•Incorporate Beam Forming to extend range

Beamformingg•Beamforming was introduced as part of the 802.11n standard as an option

U f t hi h ll t itt t “l ” th t t t•Uses an array of antennas which allows transmitters to “learn” pathways to target devices

•Use its’ surroundings to form the transmit or receive streams “around” barriersg

•Gives the signals a chance to penetrate typical barriers such as concrete or metal

http://www.quantenna.com/beamforming.html

Infrastructure required to support 802 11ac802.11ac

•Until now Wi-Fi speeds have been less than 1Gbps•Supported by a single Category 5e or Category 6 cable•Category 6/6a cables for PoE or PoE+

•Manufacturers of some 802.11n solutions (Xirrus) use multiple gigabit ports for load balancingbalancing

•Early versions of 802.11ac deployments will achieve speeds of 800 MHz •Cat5e and 6 are still acceptable

•Higher end version capable of exceeding 1Gbps will likely have multiple gigabit ports

•Recommendations

•Migrations to 802.11ac networks will be via 11n networks based on frequency used

•Single or multiple Cat6/6a or 1GBase-T ports

Future of Ethernet –u u e o e e400Gbps and 1Tbps

Where are we Today with EthernetEthernet

•IEEE 802.3ba – HSE Standard

D fi 40 d 100Gb Eth t•Defines 40 and 100Gb Ethernet

•2007 IEEE 802.3 High Speed Study Group TutorialG oup u o a

•Significant findings•Application Data Rates DifferTwo Data Rates required•Two Data Rates required

•Most significant is the recognition of the need for even higher speed g pEthernet

•IEEE 802.3 Industry Connections Bandwidth Assessment Ad Hoc created

IEEE 802.3 Industry Connections Bandwidth Assessment

Bandwidth Assessment Ad Hoc created

Infrastructure Support for 40/100Gbps40/100Gbps

•TIA Defined Cabling Infrastructure required to support 40/100Gps

•SMF and MMF support•SMF and MMF support•SMF - CWDM•MMF – Parallel Optics

•Initially only very short lengths for copper supportInitially only very short lengths for copper support

Converged 40/100GbE Data Center Fabric – Frank Yang - CommScope

Predicted Growth by Verticaly•Financial and Science Sectors Leading the Growth

•Trading•Genome ProjectGenome Project

IEEE 802.3 Industry Connections Bandwidth Assessment

Drivers for Speeds over 100Gbpsp p•Sciences and Financial Markets driving Needs

•Data Center Requirements to support Growth•Data Center Requirements to support Growth•Storage •Compute

IEEE 802.3 Industry Connections Bandwidth Assessment

Infrastructure to Support 400Gbps – 1Tbps1Tbps

•First of all there is no TIA Standard for 400Gbps or 1Tbps

B ild th t Pl tf f M lti d Fib ?•Build on the current Platform for Multimode Fiber?

•10GBase-SR4 – (4) 10G lanes to support 40Gbps•100GBase-SR10 (10) 10G lanes to support 100Gbps( ) pp p

•If we extend that out to 400Gbps and 1Tbps

•(40) 10G lanes to support 400 bps

Parallel Transmission over 12 Fibres

12 x 10 Gb/s•(40) 10G lanes to support 400 bps•(100) 10G lanes to support 1Tbps

•Build on the current Platform for Singlemode?

12 x 10 Gb/sTransmit

12 x 10 Gb/s

•(2) Fiber 100Gbps x 4 circuits = 8 Fibers for 400Gbps•(2) Fiber 100Gbps x 10 circuits = 20 Fibers for 1Tbps

12 x 10 Gb/sReceive

Real World Example of 400Gbpsp p

•Alcatel Predicting 4 port 100Gbps Cards will l bi t i d t i i 400 Gbplay a big part in determining 400 Gbps

•Service Routing driven by IPTV

•Port Aggregation

•2, 4, 8 Port XMA Cards

Di ib d C i h DCDistributed Core in the DC

The Effect of Virtualization•Why Virtualize my Data Center

•Better Operational Efficiency

•Higher Availability of DataL H d•Less Hardware

•Less Impact on Network for Maintenance•Lower Power usage

What are we Looking for in a Virtual EnvironmentVirtual Environment

•From a Cloud perspective – large-scale elastic networks

•With Virtualization – traffic flows that are East and West

•VM Mobility

http://info.nsiserv.com/network-support-computer-services-CT/bid/25643/What-is-Virtualization-IT-Support-expert-gives-non-tech-explanation

Where Do We Stand Today In DC ArchitectureArchitecture

•Three Tiered Network Architecture

•Core •Distribution / Aggregation•Access

•Efficient for non-virtualized environments

•North and South Traffic Flows•North and South Traffic Flows

http://www.datacenterdynamics.com/focus/archive/2011/07/right-sizing-data-center-network-core

Leaf Spine Architecturep•Accommodates server to server or VM to VMC ( )•Connections (East and West)

•Low Latency•Non-blocking switchingNon blocking switching

•Full Mesh Architecture•Layer 3

http://www datacenterdynamics com/focus/archive/2011/07/righ

•Keeps traffic decisions among the Spine Switches

http://www.datacenterdynamics.com/focus/archive/2011/07/right-sizing-data-center-network-core•Fewer Hops

Physical Cabling Requiredy g q•Server to the Leaf Switch

•1g or 10G•Uplink from Leaf to Spine

•40 Gbps Uplinks

Leaf Switch to the Server

Category 6A Cables

Direct Attached Cables

Direct Attached Cables

Optical Fiber Cables

FibOM3 UTP or FTP

Fiber or Twinax

OM3or OM4

Multimode Fiber 10Gb Cabling OptionOption

PROs CONsPROs

Low Power1 watt

Hi h C tLong Distances550 meters

High Cost$699/port

Low Latency

Direct Attached 10Gb Cabling OptionOption

PROs CONsPROs

Low PowerShort Distances7 meters

1-2 watts

Low LatencyHigh cost for patch cords

Impact on Data Center Design•Short reach direct attached cables forces a ToR

hiarchitecture – 7 meter max

• Increased cost for more switches

Top of RackTop of Rack 3 3 -- TieredTieredswitches

• Increased management domains Data Center Architecture

Design Freedom•10GBase-T allows you to use current architectures – 100m

Design Freedom

•Better Port Utilization Leaf Leaf -- SpineSpine Direct ConnectDirect Connect

Let’s Talk Power

10 watt power consumption1st Gen PHYs90 nm

6 watt power consumption2nd Gen PHYs65 nm

<4 watt power consumption3rd Gen PHYs40 nm

<2.5 watt power consumption4th Gen PHYs28 nm

Further Reduction of PowerPower Consumption for 10GBase-T to under 1 watt

2 modes of operation. Less than 30 meters greatly reduces power consumption

Reduces power consumption 50 %Low-Power Idle

Further reduces power by putting ports in idle mode when not in use

Next Gen PHY will reduce power to 750 milliwatts

Short ReachEnergy

Wake on LAN 28 nm PHYShort Reach Efficient Ethernet

Wake on LAN 28 nm PHY

Myth: 10GBASE-T Cause Too Much LatencyLatency

• The latency of 10GBASE-T PHY usually is 50% lower than that of 1000BASET

10GBASE-T PHY Ping Response TCP File Transfer Web Server Response

Description 2 PHY devices 2 servers back to TCP file transfer From a browser back to back without cabling

back with a 10GbE fiber connection, round trip

across 10GbE network (3 switching hops), round trip

to a web server, round trip

Latency 2.5 microseconds 90 microseconds 0.3 to 1 millisecond (ms)

50 ms

Share (%) of – 5% 1 7 to 0 5% 0 01%Share (%) of latency from 10GBASE-T PHY

5% 1.7 to 0.5% 0.01%

Source: Intel, White Paper by CommScope, Intel and Cisco, 2012

Fact: Most Real-world Applications Are Not Sensitive to That Latency

Fiber Channel over 10GBASE-T EthernetEthernet

Before 2012

Fiber Fiber Fiber Fiber Breakthrough

Intel Converged Network Adapter X540 T2Intel Converged Network Adapter X540-T2Launched in March, 2012

Reference Material

h // i 802 /3/ d h /b /BWA R df

http://www.pcworld.com/article/231305/Alcatel_Leaps_Ahead_With_400_gigabit_Routing_Chip.html

http://www.ieee802.org/3/ad_hoc/bwa/BWA_Report.pdf

http://news.cnet.com/8301-1023_3-57495639-93/ethernets-future-how-fast-is-fast-enough/

http://www.datacenterknowledge.com/archives/2011/06/29/alcatel-lucent-unleashes-400-gbps-fp3-chip/

http://www.alcatel-lucent.com/wps/portal/products/detail?LMSG_CABINET=Solution_Product_Catalog&LMSG_CONTENT_FILE=Products/Product_Detail_001181.xml#tabAnchor4

http://www.datacenterdynamics.com/focus/archive/2011/07/right-sizing-data-center-network-core

http://h20000.www2.hp.com/bc/docs/support/SupportManual/c03042885/c03042885.pdf

http://www.f5.com/pdf/white-papers/dc-virtualization-wp.pdf

https://ripe64.ripe.net/presentations/21-Data_Center_Fabrics_-_What_Really_Matters_(RIPE).pdf