data center trends for fiber optic infrastructure - · pdf file© 2016 corning...
TRANSCRIPT
.
© 2016 Corning Incorporated . .
Data Center Trends for
Fiber Optic Infrastructure Max Prangnell
Corning Optical Communications June 2016
.
© 2016 Corning Incorporated . .
• Data Center Market Trends & New Solutions
– Bandwidth Growth – Spine & Leaf Architecture – Port Replication – Network Monitoring
• Path to 400G – Transceiver Technologies & Roadmaps – Parallel vs. Duplex – Structured Cabling to Support Migration to
40/100/400F • 12-fiber vs. 8-fiber Base Cabling
Agenda
.
© 2016 Corning Incorporated . .
Market Trend: Increasing Bandwidth Demands Speed Migration on Servers – Total Market
• 10G server connections reach majority of new shipments in 2015 • Growth begins with 25G(rack) and 40G(blade)
Source: Dell’Oro Group. Alan Weckel Ethernet Alliance presentation on Oct 16, 2014. “The Rate Debate”
.
© 2016 Corning Incorporated . .
Market Trend: Fiber Mix Enterprise Data Centers continue to deploy OM3/OM4
.
© 2016 Corning Incorporated . .
Market Trend: Fiber Mix Hyperscale Data Centers deploying SM for distance needs
• Enterprise DCs are nearly 80% OM3/OM4 – Lowest cost transceivers – Shorter reach (<100m) – 3-Tier switching
• Hyperscale/Mega DCs are nearly 85% SM cabling – MM reach does not meet needs
of environment – Fabric/CLOS/Spine and Leaf
architectures & campus fabrics
.
© 2016 Corning Incorporated . .
24 QSFP Ports 96x10Gig Breakouts
48 SFP+ Ports 48x10Gig Ports
48xSFP+ Line Card 24xQSFP Port Line Card
out Applications
Reduces Cost & Increases Port Density
.
© 2016 Corning Incorporated . .
Market Trend: Parallel Port Break-out Applications Reduces Cost & Increases Port Density
• Over half of 40GbE QSFP ports shipped are being used to break-out to 4x10G
• Why operate a 40GbE port in a “break-out” configuration?
– 2-3x the 10G density per blade – 50% less power per port – 30% cost savings per port – Switch migration path (do not
repurchase 40G optics or cards) Qty Qty Total List
48 Port 10GbE (SFP+) Line card 1 $44,000
10GBASE-SR SFP Module 48 $47,760
Cost/10G port (total of 48) $1912/port
24 Port 40GbE (QSFP) Line card 1 $55,000
QSFP 4x10GBASE-SR Transceiver, MPO, 300M 24 $71,880
Cost/10G port (total of 96) $1322/port
Note: This holds true for both Ethernet and Fibre Channel applications.
4x10G
4x25G
4x50G
4x100G
.
© 2016 Corning Incorporated . .
Market Trend: Flat Architecture Spine and Leaf (Mesh) – Logical vs. Physical Cabling
.
© 2016 Corning Incorporated . .
.
© 2016 Corning Incorporated . .
Market Trend: Flat Architecture Increases Fiber Count Requirements
Traditional Distributed (3-tier) Architecture
Spine and Leaf Mesh Architecture
.
© 2016 Corning Incorporated . .
High Density Fiber Solutions Indoor/Outdoor High Fiber Count Trunks Overview • Pre-terminated MTP-MTP Trunks and MTP Pigtail Trunks • Riser and LSZH, Armored & Non-Armored • 12-144F, 288F, 432F, 576F, 864F
Grip OD • 2.5” for 288Fand below • 4.5” for 432 – 864
.
© 2016 Corning Incorporated . .
High Density Fiber Solutions Indoor High Fiber Count Trunks Overview • MTP Trunk fiber count extended to 576F • 192, 216, 288, 384, 432, 576F Plenum & LSZH fiber counts
Plenum HFC Trunk (576F) Plenum HFC Trunk (192F)
.
© 2016 Corning Incorporated . .
High Density Mesh Fabric Solutions Mesh Module
4x4 SR4 to SR4 Mesh Module
Overview
• Implement 10G Spine and Leaf Fabric for expanded scale out of fabric • Implement redundancy across Parallel technologies (ex: SR4, PSM4)
.
© 2016 Corning Incorporated . .
High Density Mesh Fabric Solutions Mesh Module
.
© 2016 Corning Incorporated . .
Transceiver Diversification (Redundancy) Solutions Mesh Module
• Shuffle the (4) 10G channel of each QSFP input across (4) separate MTP ports
Trunk
All MTP outputs are comprised of a single channel from each of the four QSFPs on the input side
Each SFP is link to a single channel from each of the four input QSFPs. If all SFPs are used for switch uplinks, they are not tied to the same QSFP in the other switch.
.
© 2016 Corning Incorporated . .
Market Trend: Port Replication Port Replication Housing
• Flexible infrastructure for any port to any port connectivity
• Reduces risk at Directors • Improved Cable Management
Compute/Storage MDA / Cross-Connect (Patching Frame)
MDF
Traditional Patch Panels Today: Port
Replication Housing
.
© 2016 Corning Incorporated . .
Port Replication Housing - Brocade Configurations
• Modular chassis with “blade” panels for horizontal or vertical install • Blank “blade” panels and “module” panels for replicating multiple director
types
Brocade DCX 8510-4 Brocade DCX 8510
.
© 2016 Corning Incorporated . .
Market Trend: Network Monitoring Growing Rapidly
Drive Need for High Density Passive Optical Taps • What is monitoring looking for?
– Security threats – Performance issues – Optimization (I/O bottlenecks)
.
© 2016 Corning Incorporated . .
EDGE® TAP Module Configuration Options
Configuration B Integrated
MTP®/LC/MTP
Configuration C Integrated
MTP/MTP/MTP
Configuration A Non-Integrated
LC/LC/LC
.
© 2016 Corning Incorporated . .
PATH TO 400G
.
© 2016 Corning Incorporated . .
How to Increase Data Rate?
• Data Centers (especially cloud) continue to drive a need for increased speed (e.g. 10G server connections will outpace 1G connections in 2015)
• Traditionally we’ve been able to increase the Bitrate (turn the light off and on more quickly) within a single channel with serial transmission (e.g. 1G to 10G)
Tx Rx
Rx Tx
.
© 2016 Corning Incorporated . .
Path to 400G Wavelength Division Multiplexing (WDM) Transmission
Tx Rx
Rx Tx
• WDM : A technology which multiplexes a number of optical signals onto a single optical fiber by using different wavelengths (colors) of laser light.
• Analogy : If people in cars are data packets, to increase throughput we add more people/car.
.
© 2016 Corning Incorporated . .
Path to 400G Parallel Transmission
Rx Rx Rx Rx Tx Tx Tx Tx
Tx Tx Tx Tx Rx Rx Rx Rx
MTP Connector MTP Connector Fibre Position
1
12
12
1
• Parallel Transmission : Data is simultaneously transmitted and received over multiple fibers.
• Analogy : If people in cars are data packets, to increase throughput we add more lanes on the highway ( people/car and speed stays the same)
.
© 2016 Corning Incorporated . .
• Working relationships with major Technology Vendors
• Technology Vendor Roadmaps for Future Technologies
• Infrastructure Design Guidance
• Performance Qualification – Standard & Extended
• Joint Product Development
Data Center Technology Vendor Partners
.
© 2016 Corning Incorporated . .
Ethernet Optical Transceiver Roadmap
Solution Reach 40G 100G 400G
Duplex OM3/4 100-150m BiDi
WDM BiDi
WDM ??
Parallel OM3/4 100-150m SR4/eSR4 4x10G Gen1: SR10 10x10G
Gen2: SR4 4x25G
Gen1: SR16 16x25G Gen2: SR8 8x50G
Gen3: SR4 4x100G
Duplex SM 2-10km LR4 (10km)
LR4L (2km) LR4 (10km)
CWDM4 (2km) WDM(10km) WDM (2km)
Parallel SM 300-1000m PLR4 PSM4 PSM4 4x100G*
(100G via WDM, symbol rate, encoding)
• 40G solutions now have SM/MM with 2 & 8 fiber solutions • Similar solutions are currently in development phase for 100G • Roadmaps for 400G show a path to similar solutions (few speed bumps)
Takeaway: After much discussion with transceiver and switch vendors the foreseeable future (100/400G) is dominated with 2f and 8f solutions.
.
© 2016 Corning Incorporated . .
Typical Transceiver Cost Cycle
• Parallel uses existing cost reduced components for building next generation transceivers (flat price curve)
• Duplex requires new components (new lasers, advanced modulation, etc) in order to achieve new data rate (costly components until volume is reached and process optimized)
Takeaway: Early adopters plan for parallel solutions because they upgrade before the cost curve converges.
New Year 1
Parallel
Tx Cost
Year 2 Year 3 Year 4 Year 5
4-5x
2x
Duplex
.
© 2016 Corning Incorporated . .
Product Naming
Throughput (Mbytes/s)
Line Rate (Gbaud)
T11 Specification Technically Complete (Year)*
Market Availability (Year)*
8GFC 1,600 8.5 2006 2008
16GFC 3,200 14.025 2009 2011
32GFC 6,400 28.05 2013 2016
128GFC 25,600 4X28.05 2014 2016
64GFC 12,800 56.1 2017 2019
256GFC 51,200 4X56.1 2017 2019
128GFC 25,600 TBD 2020 Market Demand
Fibre Channel Optical Transceiver Roadmap
Takeaway: Fibre Channel on the SAN side of the Data Center is following a similar path at 128GFC by using a SR4 communication with breakouts.
Source: FCIA Speedmap v20 published 1_2_2014.
Example: Brocade recently released the “Windu” blade (FC16-64) which is a 16GFC linecard which uses 16 QSFP breakout ports to achieve 64 channels (4x16GFC engineered parallel)
.
© 2016 Corning Incorporated . .
Impact on Structured Cabling What do these Roadmaps mean?
• Solutions for the future include both duplex and parallel technologies – MTP based connectivity still needed to support all possibilities
• Technology deployment considerations impact structured cabling design – What technology deployment might be used in the future?
• True 40G link or 40G to 4x10G link • SR4 (Parallel Optics MM) • eSR4 (extended reach Parallel Optics MM) • WDM (Duplex)
• Is there existing cabling infrastructure going through a migration (brownfield) or is the installation a greenfield build?
.
© 2016 Corning Incorporated . .
“All Roads Lead to 2F and 8F Technologies”
SR4
BiDi
PSM4
CWDM4
PLR4 SR8
2 fiber 8 fiber
40 GbE 100 GbE 400 GbE
32G FC 64G FC
128G FC
.
© 2016 Corning Incorporated . .
Base 8 Advantage: Reduced Link Attenuation
Area Benefit Value
Reduced Link Attenuation
50% Reduction in Parallel Link
By eliminating the Conversion Modules, we cut the link attenuation in half resulting in longer SR4 link distances
30% Reduction in Duplex Link
Standard MTP-LC EDGE8™ module has a loss of 0.35dB as compared to 0.5dB for standard MTP-LC EDGE modules.
2.0 dB
1.0 dB
Connector Loss 40GBase-SR4
Distance
110m
178m (70% improvement)
Base 12
Base 8
.
© 2016 Corning Incorporated . .
Base 8 Advantage: Reduced Link Attenuation
Area Benefit Value
Reduced Link Attenuation
50% Reduction in Parallel Link
By eliminating the Conversion Modules, we cut the link attenuation in half resulting in longer SR4 link distances
30% Reduction in Duplex Link
Standard MTP-LC Base 8 module has a loss of 0.35dB as compared to 0.5dB for standard MTP-LC modules.
2.0 dB
1.4 dB
Connector Loss 16G Fibre Channel
Distance
110m
151m (35% improvement)
12 F MTP Trunk
Base 12
Base 8
8 F MTP Trunk
.
© 2016 Corning Incorporated . .
Base 8 Advantage: Cabling for Parallel Optics Port Break-out Applications
Area Value Comments
Port Mapping Optimized Port Breakout
All 4-channel parallel protocols (SR4, PSM4, etc.) are now mapped cleanly to a single element
24 port 40G QSFP Line Card 48 port 10G SFP+ Line Card
.
© 2016 Corning Incorporated . .
Base 8 Advantage:
Port Mapping
Area Value Comments
Port Mapping Optimized Harness Mapping
Allows for 24, 32, 36, 48-port blades on large chassis switches to be cabled with 8f harnesses without having to deal with un-utilized fiber/connectors.
Note: Base-8 cabling eliminates the unutilized connectivity for all line card port counts.
Harness (hydra) assemblies are often used for high-density line cards. This does not breakout cleanly when line cards are not divisible by six (for
example 32-port) hence you are left with un-utilized connectors.
32-port line cards
.
© 2016 Corning Incorporated . .
Base 8 Advantage:
Reduced Jumper Complexity Area Value Comments Jumper
Complexity 67% Reduction in
Inventory Pinning the trunks allows for a single pinless jumper deployment for all installations, reducing stocking and deployment complexity.
Note: Traditionally 12f MTP cabling utilized pinless MTP trunk cables, which results in pinning complexity when considering parallel optics. With Base 8 the pin management is simplified.
Direct Connect
Point-to-Point
Cross-Connect
Base-12 (pinless trunks)
Base-8 (pinned trunks)
Pinless-Pinless Pinless-Pinless
Pinned-Pinless Pinless-Pinless
Pinned-Pinless +
Pinned-Pinned
Pinless-Pinless +
Pinless-Pinless
= 3 jumper configurations
= 1 jumper configuration
.
© 2016 Corning Incorporated . .
Impact on Structured Cabling
Base-8 MTP Infrastructure
Area Benefit Value Link Cost Savings 15-25% Savings 100% fiber utilization without the need for conversion
modules, result in 30% less MTPs in the link
Migration 100% fiber utilization
Allows 100% fiber utilization for 4-channel (SR4, PSM4, etc.) and 8-channel (SR8, LR8)
Reduced Link Attenuation
50% Reduction in Parallel Link
By eliminating the Conversion Modules, we cut the link attenuation in half resulting in longer SR4 link distances
30% Reduction in Duplex Link
Standard MTP-LC Base 8 module has a loss of 0.35dB as compared to 0.5dB for standard MTP-LC modules.
Jumper Complexity
67% Reduction in Inventory
Pinning the trunks allows for a single pinless jumper deployment for all installations, reducing stocking and deployment complexity.
Port Mapping
Optimized Port Breakout
With 8f pigtailed modules all 4-channel parallel protocols (SR4, PSM4, etc) are now mapped cleanly to a single element
Optimized Harness Mapping
Allows for 24, 32, 36, 48-port blades on large chassis switches to be cabled with 8f harnesses without having to deal with unutilized fiber/connectors.