High Speed DWDM Provisioning – The Story of a World Record

Wolf Pueschner: Independent Consultant

Michael Enrico: DANTE

Geoff Bennett: Infinera

Internet Growth Rates

0

100

200

300

400

500

600

700

2009 2010 2011 2012 2013 2014 2015 2016 2017 2018

Total SP Bandwidth Usage (Tbps)

Source: Telegeography 2013

Cloud

Video

Mobility

8% Y/Y Population Growth

Source: ITU-T http://news.bbc.co.uk/2/hi/8552410.stm

30-50% Y/Y Traffic Growth

Sources: Telegeography, Akamai, Cisco

Business Services

Voice Services

An Example Service Provider Organization

Transport Organization

IP Router Network

Transport Network

IP Router Organization

• High Service Availability • Ease of Service delivery • Network Efficiency and TCO

The World Record Attempt

Amsterdam

Hamburg

Amsterdam to Hamburg

8Tb/s in 19min w/1 engineer

Production equipment

Production link

Tb/s per hour

The Guinness World Record

8Tb/s =

Average global internet traffic in 2005

5 Connect | Communicate | Collaborate

DANTE – who we are, what we do…

• DANTE (Delivery of Advanced Network Technology to Europe)

established in 1993 - plans, builds and operates advanced networks for

research and education

• Owned by Europe’s National Research and Education Networks

(NRENs) and works in partnership with them and the European

Commission

• DANTE's work is primarily organised in the form of projects, which

receive co-funding from EC e.g.

o GÉANT via GN3plus – pan-European comms infrastructure

o EUMEDCONNECT3 – Southern Mediterranean

o CAREN – Central Asia

o ORIENTPlus – China

o AfricaCONNECT - Africa

5

6 Connect | Communicate | Collaborate

GÉANT: Global Reach

7 Connect | Communicate | Collaborate

GÉANT Network

• GÉANT is co-funded by Europe’s NRENs and the European Commission (EC)

under the Seventh Framework Programme (FP7)

• Project Partners are 38 European NRENs, NORDUnet, TERENA and DANTE as

Co-ordinator

• 150 FTEs’ annual effort (> 350 individuals) working in GÉANT

across Europe

25 European

POPs

12,000km of dark

fibre on 18 routes

50,000km network

infrastructure on

44 routes

Diversified footprint • Serves 40 million users

• 8,000 institutions

• Across 40 European

countries

8 Connect | Communicate | Collaborate

Supporting the growth of R&E Communities - transforming how researchers collaborate

GÉANT delivers real value and benefit to society by enabling research

communities to transform the way they collaborate on ground breaking research

Together with

Europe’s NRENs,

GÉANT connects

50 million users in

10,000 institutions

across Europe

Health and Medicine | Energy | Environment | Particle Physics

Radio Astronomy | Arts & Education | Society

9 Connect | Communicate | Collaborate

CERN: The Large Hadron Collider

The World’s Largest Particle Accelerator

17 mile circular tunnel

9,300 super-cooled magnets

Data generated = 100,000 dual-layer DVDs

10 Connect | Communicate | Collaborate

SKA – Square Kilometre Array

Southern Africa

Western Australia

11 Connect | Communicate | Collaborate

ITER – Nuclear Fusion Demonstrator

12 Connect | Communicate | Collaborate

The Challenge to Infinera

Infinera claims to have an

architecture that is specifically

designed to offer a more “forecast

tolerant” transport architecture, but…

How far would they be

willing to go to prove it?

Why a Guinness World Record?

13

There are dozens of “hero experiments” carried out in optical communications every year • These are extremely useful for “pushing the boundaries”

In this trial we wanted to use: • A real network link

• Production grade equipment (no prototypes)

• Independent adjudication for the record

How do we structure the demonstration to meet the GWR criteria?

Four key criteria:

GWR Criteria

Measurable

Verifiable

Breakable

Based on a single variable

Stopwatch, test sets

On-site adjudicators

• Must provision more total capacity than the standing record

• The record is expressed as provisioning rate per hour

We were able to install the additional equipment using one engineer at each location for one day

A Core Benefit for the Infinera Experience: Ease of Installation

Boxes for the additional equipment needed

2 DTN-X racks like this one were

used at each end

Only 16 fibers needed into the line system

The Equipment Setup

Amsterdam PoP

Hamburg PoP

Line Module

531km 5 Optical Amplifiers

Line System Long Distance Fiber

Patch Fiber 100GbE 100GbE

Loopback Cable

100GbE Tester

OSA

Test Procedure and Timing

Equipment in place Boards are “parked”

Insert line card Start the clock

when 1st line card is inserted

Connect fiber to line card

X 16

Wait for super-channels to come up

Observe progress on OSA screen Provision 100GbE

service over the last line card inserted

Verify on 100GbE test set

Stop the clock when tester shows

“green”

Test Run Time (mm:ss)

1 19:10

2 19:55

3 19:01

Tb/s per hour

What happened: Step by Step

Clock Starts

When the first line card is plugged in Continue to insert another 15 line cards Insert the line-side fibers for each board

What happened: Step by Step

10min 45sec

We see the first super-channel activity on the OSA

Super-channels

What happened: Step by Step

15min 57sec

All 16 super-channels are “up” on the fiber They will now require a couple of minutes to stabilize

What happened: Step by Step

Just before 19mins

At this point the super-channel capacity is ready for services to use it We now provision a 100GbE service over the last super-channel line card to be inserted

What happened: Step by Step

19min 01sec

The 100GbE service is establish, and the test confirms it’s ready for use

We have the record!

Amsterdam to Hamburg

8Tb/s in 19min 01sec

1 engineer

Production equipment

Production link

Tb/s per hour

The Guinness World Record

Recap: How did this happen so quickly?

Amsterdam Hamburg

500G Scalability Terabit-ready

Automated amp chain management

Automated end to end service provisioning

16x500G vs 80x100G

The right Transport Network Architecture can be highly responsive and cost-effective

Must optimize this infrastructure to solve all of the needs of the service provider • Fixed, Mobile, International, R&E, MSO, Data Center, etc.

No capacity or scalability limitations !

Using Time As a Weapon

The World Record achievement shows this can be done in a real production environment today!

Q&A