introduction 400 gigabit ethernet · 400 gigabit ethernet john d’ambrosia, huawei chairman,...

© 2018 Ethernet Alliancewww.ethernetalliance.org

INTRODUCTION400 GIGABIT ETHERNET

John D’Ambrosia, HuaweiChairman, Ethernet Alliance

1

March 14, 2018

© 2018 Ethernet Alliance

Regarding the Views ExpressedThe views I am expressing on IEEE standards and related products should NOT be considered the position, explanation, or interpretation of the Ethernet Alliance.

Per IEEE-SA Standards Board Bylaws, Dec 2016“At lectures, symposia, seminars, or educational courses, an individual presenting information on IEEE standards shall make it clear that his or her views should be considered the personal views of that individual rather than the formal position of IEEE. ”

2


This Chart Helped Launch 400GbE

Source: http://www.ieee802.org/3/ad_hoc/bwa/BWA_Report.pdf

• Diverse applications!

• Diverse bandwidth growth rates!

3

http://www.ieee802.org/3/ad_hoc/bwa/BWA_Report.pdf

http://www.ieee802.org/3/ad_hoc/bwa/BWA_Report.pdf


4


Families of Ethernet Lane Rates

5


How Many Lanes?• 400GbE has used 4, 8

and 16 lanes for various links

• 100GbE electrical lanes being developed now to enable 4 x100 Gb/s for 400GbE

6


The 400 GbE Optical Family

7

Port Type Reach Description

400GBASE-SR16 At least 100m16 x 25 Gb/s NRZ

Use of 16 parallel multi-mode fiber

400GBASE-DR4 At least 500m SMF4 x 100 Gb/s PAM4

Use of 4 parallel single mode fibers

400GBASE-FR8 At least 2km SMF8 x 50 Gb/s PAM4

Use of duplex single mode fiber

400GBASE-LR8 At least 10km SMF8 x 50 Gb/s PAM4

Use of duplex single mode fiber


400 Gigabit Ethernet Nomenclature

8


9

400 Gigabit Ethernet Form Factors

CFP2


The Importance of Multi-vendor Interoperability

• 400 GbE Standard ratified Dec 2017• Ethernet Alliance 400 GbE Demonstrations

– OFC 2017– SuperComputing 2017– OFC 2018 (Booth #2648)

• Ethernet Alliance 400GbE Plugfests in planning stages!

10

Mark NowellDistinguished Engineer, Data Center SwitchingCo-chair 100G Lambda MSAMarch 2018, OFC

Enabling low-cost 100 GbE and 400 GbE solutions100 Gb/s Lambda MSA

© 2018 Cisco and/or its affiliates. All rights reserved.

Technology Transitioning to 400 GbE40

0 G

bE10

0 G

bE10

GbE

Source: Dell’Oro

2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022

400 GbE Dominated50G -> 100G ASIC SERDES

100 GbE Dominated25G ASIC SERDES

10 GbE Dominated10G ASIC SERDES


Optics cost is becoming a barrier to transitionReduction of ASIC cost-per-bit is outpacing that of optics

Critical to upcoming 400 GbE transition that optics cost reductions are accelerated

Market Transition Barriers


Motivated by reducing the manufacturing complexity due to reduced component count.Initially specified in IEEE 802.3bs (400 Gb/s Ethernet) for:• 400GBASE-DR4: 500m over parallel SMF

MSA formed to broaden application of technology• concern over cost reduction opportunities for “existing” 400 GbE

solutions based on 8 optical lanes• Ongoing cost pressures for 100 GbE optics

Market interest in 100 Gb/s optical modulation


100 Gb/s Lambda MSA • Initiated in Sept 2017

• 22 initial member companies• Membership open and growing• Now 27 members

www.100GLambda.com


100 Gb/s Lambda MSA scope & progress

Phase 1

100G-FR 2 km D1.0 Published publicly

Internal updates in progress**

Target public D2.0 May/June

100G-LR 10 km

400G-FR4 2 km

Phase 2

400G-LR4 10 km Work about to initiate

** Strong member desire to maintain methodology alignment with IEEE 802.3cd


Implementation Cost Considerations400 GbE SMF PAM4 Module internals

Ser

Ser

FEC

FEC EQ

EQ 4 or 8 x DAC4 or 8

4 or 8

4 or 8

4 or 8

4 or 8Driver Mod Laser

Mux/demux(if nessecary)

TIA Det4 or 8 x ADC

400GAUI-8

400 GbE: Half the lane count

100 GbE: Quarter the lane count (vs. CWDM4/LR4)

cost, yield, power, scalability


• Products are hitting the labs right now!!

• Validation of specifications

• Possible interop testing

100 Gb/s Lambda MSA Next Steps

• Phase 2 work on 400G-LR4 specification

• Discussion around proposing IEEE project initiation with same PMD objectives


Questions?

Click to edit Master title styleClick to edit Master subtitle style

400Gbps Form Factors For Input/Output (I/O)

Connectivity

Nathan Tracy3/14/18

400G Form Factors Form Factor Electrical InterfaceCDFP 16x25GCFP8 16x25GCOBO 8x50GOSFP 8x50GQSFP-DD Type 1 8x50GQSFP-DD Type 2 8x50G

This discussion will focus on the 8x50G form factors

▪ Challenges

▪ Next Gen I/O

▪ Equipment Impact

o Density

o Electrical Performance

o PCB Issues

o Reach

o Thermal Management

o Air Flow

▪ Summary

Agenda

3

▪ I/O ports are valued for their flexibility

▪ Consist of connectors and cages that

accept pluggable modules

o Passive direct attach copper cable

o Short reach optical modules

o Medium reach optical modules

o Long reach optical modules

▪ Allows end users to flexibly choose the

appropriate reach and cost solution

▪ Provide good signal integrity

What’s a Port? Key Equipment Considerations

▪ Optimize thermal dissipation from the optics

▪ Different channel counts

▪ Port selection determines aggregate bandwidth and granular bandwidth

4

COBO Form Factor

▪ Embedded optics solution

▪ Eight channel and sixteen channel versions

operate with 50Gbps electrical interfaces to

provide 1x400 and 2x400G versions

▪ Three sizes of both versions on common

footprint

▪ Allows at least 32 400G modules to be

distributed around the host PCB instead of

crowded at the faceplate

▪ Opens the face plate airflow and allows full

height heat sinks providing best thermal

capability

▪ Electrical connector validated for 100Gbps

operation

At least 32 ports per 1RU

5

OSFP Form Factor

▪ OSFP is an eight channel port that

accommodates up to 36 modules in 1RU

▪ It achieves density by using a 0.6mm

connector contact pitch (vs. today’s

typical 0.8mm contact pitch)

▪ Like microQSFP, it implements a module

integrated heat sink to achieve higher

levels of power dissipation

▪ Can provide backward compatibility to

QSFP modules with the use of an adapter

▪ Electrical connector has been validated to

support 100Gbps operationUp to 36 ports per 1RU

Integrated heat sink

QSFP to OSFP adapter

6

QSFP-DD Form Factor

▪ QSFP-DD is a new form factor port that

enables backwards compatibility for

existing QSFP modules

▪ Because of the backwards compatibility, it

keeps the connector contacts on 0.8 mm

pitch and adds additional rows of

recessed contacts

▪ It uses the traditional riding heat sink

thermal management methodology

▪ QSFP-DD allows an extra 15mm of

module length outside the faceplate

▪ QSFP-DD can support 36 modules in 1RU,

same as QSFP

Up to 36 ports per 1RU

Riding heat sink

7

Equipment Impact

8

Density and Airflow

Signal Integrity

PCB layout

Thermal Capacity

Thermal Management

QSFP-DD, 35% Open

OSFP, 25% Open

COBO, 47% Open

COBO

OSFP

QSFP-DD

Connector Structure

SummarySignal

Integrity

Thermal

mgmt

Larger

Wire

AWG

Channel

Density

Backwards

Compatibility

COBO

Result #2 for RL and crosstalk

Up to 20W per module

26AWG fits

At least 32 modules

New form factor, no backwards compatibility

OSFP


At least 15W per module

26AWG fits

Up to 36 modules

QSFP with adapter

QSFP-DD


15W may be possible

26AWG is difficult

Up to 36 modules

Directly accepts legacy QSFP COBO OSFP QSFP-DD

9

1 OFC 2018 400G Standards Update: What Is on the Horizon? | OFC 2018 - 400G Standards Update: What Is on the Horizon?

400G Standards Update:

What Is on the Horizon?

Rob Stone

2 OFC 2018 400G Standards Update: What Is on the Horizon? |

Package Design Considerations for Switches

LGA

BGA

Larger Packages

Higher package loss

Additional Cost

Mature technology

Lowest cost packaging 25G / Lane Products

50G / Lane Products


Increasing Switch Bandwidth Forces Higher Lane Speeds

10G / Lane

25G / Lane

50G / Lane

100G IO

70mm package approx. limit @ 50G / Lane


• For Leaf / Spine Switch Applications, market demands highest number of ports (largest radix)

– minimize number of switch stages in the fabric, enables an efficient design

• Current technology offers 32 ports at 400GE, 64 ports at 200GE, or 128 ports at 100GE

• Will future switches require higher port speeds > 400GE? – Economics of higher rate optical interconnects needs to scale favorably (fiber plant + transceivers)

Port Speed vs ASIC Bandwidth

Total Number of Ports Possible

Total ASIC

IO (Tb/s) @ 100GE @ 200GE @ 400GE

3.2 32 16 8

4.8 48 24 12

6.4 64 32 16

12.8 128 64 32


• Switch IO is being driven to higher per lane speed as total bandwidths increase – Due to package size limitations

• Standardization activities to support these new electrical interface speeds

– 25 & 50G / lane electrical IO DONE

– 100G / lane electrical IO: Chip to Chip, Chip to Module, Backplanes, Copper Cables – IN PROCESS

• Challenges ahead: – Continue to scale $/Gb/s and pJ/bit of optical interconnects to enable cost effective, high bandwidth

large radix switch systems

Summary

6 OFC 2018 400G Standards Update: What Is on the Horizon? | OFC 2018 - 400G Standards Update: What Is on the Horizon?

Thank You

Recent Activities at TIA

Rakesh SAMBARAJUNexans Data Center SolutionsOFC 2018: 400G Standards, MSAs and Related Technologies: What is on the Horizon?

Introduction to Nexans

2 I

Worldwide leader in the cable industry-Started 120 years ago with electrical wiring-Became part of Alcatel in 1991-Became Nexans in 2000, listed on the European Stock Exchange since 2001-Today – have an industrial presence in 40 countries with commercial activities worldwide, close to 26,000 employees, and sales of 7.8 billion (USD) in 2017

OFC 2018, San Diego, CA. 03/13/2018

Path to 400G

3 I OFC 2018, San Diego, CA. 03/13/2018

Fiber Capacity

Para

llel T

rans

miss

ion

-New MMF – OM5-Study WDM over OM3/OM4-Study VCSEL performance for DMD measurements

-16F MPO-32F MPO

-Performance guidelines for cable/connectivity

New Fiber Type – MMF TIA-492AAAE standard for WDM capable MMF

OM5 is designed to supports 4 channel WDM (850 – 950 nm) over MMF Cable jacket, connector boot, adapters color – Lime Green

TIA considering studying wideband performance of OM3/OM4 Includes studying the VCSEL weighting functions at higher wavelengths Will provide for better system modeling to IEEE Q: Can WDM performance on existing OM3/OM4 be ‘guaranteed?’

4 I OFC 2018, San Diego, CA. 03/13/2018

MUX

WDM

DeMux

Parameter OM3 (TIA 492AAAC) OM4 (TIA 492AAAD) OM5 (TIA 492AAAE)

EMB@ 850 nm 2000 MHz.km 4700 MHz.km 4700 MHz.km

EMB@ 953 nm Not specified Not specified 2470 MHz.km

New Connector Types – MPO TIA 604-18/FOCIS-18: one/two row16F MPO Standard

MPO-16 Can support 8Tx/8Rx lanes Part of QSFP-DD and OSFP MSA Potential connector for 400G-SR8

MPO-32 2 rows of 16 fibers MDI for 400G-SR16; part of CDFP MSA

5 I OFC 2018, San Diego, CA. 03/13/2018

Cable/Connectivity Cable:

Reduce cable attenuation for MMF to 3.0 dB/km (previously 3.5 dB/km) Recommends armored/thick jacketed cables to avoid microbends in non-continuous cable

supports

Connectivity: Increase SM Splice return loss requirement to 35 dB (previously 26 dB) Specified break-out configurations to accommodate 2-row connectors Recommends pre-term cabling for quality consistence

Q: Address requirements for RL on SM MPO for PAM-4 systems?

6 I OFC 2018, San Diego, CA. 03/13/2018

Summary Standardized new MMF called OM5

Will enable consistent WDM over MMF

New 16 and 32 Fiber MPO Connectors for upcoming 400G PMDs Already part of 8x and 16x form factors

Tightened the specs for cabling/connectivity Will help with high baud-rate/multi-level signaling

Need to address SM connectivity reflectance for PAM-4?7 I OFC 2018, San Diego, CA. 03/13/2018

introduction 400 gigabit ethernet · 400 gigabit ethernet john d’ambrosia, huawei chairman,...

Documents