PIONIER – fiber based NRENfrom an idea to the fact

Artur Binczewski, Michał Przybylski, Maciej Stroiński artur | michalp | stroins@man.poznan.pl

TERENA workshop on NREN-controlled fibers Copenhagen, 24th October 2003

PIONIER - idea

The idea of PIONIER emerged in 1999, based on newly announced eEurope programme

Goals:– to provide research infrastructures fulfilling the demands of

modern science, education, services and applications– to develop and test new generation of applications for information

society– to enable international collaboration, especially in the area of new

software and services for information society

PIONIER has been presented in 1999 and accepted in 2000 by KBN (State Committee for Scientific Research)

Phase I – network planning

Market survey: • national providers unable to fulfill the requirements of science (lack of bandwidth, low

reach, high prices)• inability to provide dark fibers

Target: to find suitable solution for science

• 2000 - first DWDM over dark fiber testbed in Poland (done as PIONIER experiment), demonstration of pilot, lambda based applications

• 2001 – second DWDM testbed and MPLS test,

Results: decision to build own fiber network, DWDM selected as the transport technology in PIONIER

Problem: no dark fiber offers from telecoms

Solution: PSNC will build fibers for academic community (ndependent investor or together with telcos)

Phase II – fibers deployment

Financial limitations:– science cannot build fibers alone, need to cooperate with

industrySolution:

– some fibers were to be built with telco participation - green field deployments

• 2001 – Telbank, Szeptel (1434km)• 2002 – Telbank, (<1214)

– main investor in other relations (2002, coop. with regional power grids) (reszta z 1214km)

Financial participation proportional to the fiber share in the whole cable (usually 16 fibers are owned by PIONIER, rest belongs to telcos)

Phase II – fibers deployment cont.

Investment protection:– SMF (Standard Mode Fiber, G.652, general purpose –

regional and national; used currently for 10GE transmission)– NZDSF (Non-zero Dispersion Shifted Fiber, G.655, future

long range multi-lambda 40Gbit/s transmission for direct HPC connection)

– average span length 60km for national backbone (allows for different class of equipment to be used)

– new interesting areas emerged – customer owned pipes (for future applications)

Problems– local loop construction is sometimes difficult (urban area -

average 6 months waiting time for permissions)

Phase II – fibers deployment, 3Q2003.

ŁÓ DŹ

TO RUŃPO ZNAŃBYDG O SZCZ O LSZTYNBIA ŁYSTOK

G D AŃSKKO SZALINSZCZECIN

ZIELO NAG Ó RA W RO CŁAWCZĘSTO CHO WAKRAK Ó W RZESZÓ W

LUBLINKIELCE PUŁAW YRADO MKATOW ICEG LIW ICE BIELSKO -BIAŁA

O PO LE

G U BIN WARSZAWA

CIESZYN

SIEDLCE

10 G E nodes10G E links

ŁÓDŹ

TORUŃ

POZNAŃ

BYDG OSZCZ

OLSZTYN

BIA ŁYSTOK

GD AŃSK

KO SZALIN

SZCZECIN

ZIELO NAGÓ RA

W RO CŁAW

CZĘSTO CHOWA

KRAK ÓW RZESZÓ W

LUBLIN

KIELCE

PUŁAW Y

RADO M

KATOW ICEGLIW ICE

BIELSKO-BIAŁA

OPO LE

GU BIN WARSZAWA

CIESZYN

SIEDLCE

PIO NIER nodesInstalled fiber

F ibers planned in 2004PIO NIER nodes planned in 2004

Phase II½ – 10GE transmission

Late 2002: – the need to reduce operational costs.– availability of some fiber links scheduled at mid 2003– needs from VLBI and CERN for high bandwidth links

Decision to buy 10GE transmission equipment for intermediate stage – tender announced.

This solution shall exist until target 40Gbit/s DWDM system is installed.

Then the equipment will be moved to regional networks

Phase II½ – 10GE transmission

Tender conditions:– complete 10GE transmission equipment had to be

delivered, installed and trial-tested. – router for VLAN routing and international

connectivity

Tender results:– no appropriate 10GE switch interface/line amplifier found– transport on simplified DWDM from ADVA / INRANGE– Black Diamond 10GE switches used as core equipment– A7770 for international connectivity and VLAN routing

Phase II½ – 10GE transmission

ŁÓDŹ

TORUŃ

POZNAŃ

BYDG OSZCZ

OLSZTYN

BIA ŁYSTOK

GD AŃSK

KO SZALIN

SZCZECIN

ZIELO NAGÓ RA

W RO CŁAW

CZĘSTO CHOWA

KRAK ÓW RZESZÓ W

LUBLIN

KIELCE

PUŁAW Y

RADO M

KATOW ICEGLIW ICE

BIELSKO-BIAŁA

OPO LE

GU BIN WARSZAWA

CIESZYN

SIEDLCE

10 G E nodes10G E links

Technical details – link specification

Line Poznan – Zielona Góra

From To Distance [km]

Attenuation [dB]

Fiber type

Poznan Poznan-TB ? 10 Corning G.652

Poznan-TB Grodzisk 56.67 13.2 Corning G.652

Grodzisk Wolsztyn 25.75 6.23 Corning G.652

Wolsztyn Sulechów 42.03 8.97 Corning G.652

Sulechów Zielona Gora TB 23.64 5.1 Corning G.652

Zielona Gora TB Zielona Gora ? (4) 10 (2.1) Corning G.652

Link specification 2

Tender specification

• fiber optics parameters specification (span, attenuation., att. estimation @ 0.25dB/km, real att. approx. 0.23dB/km)

• node localisation (where, what voltage, rack space)

• regeneration points (where, what voltage, access etc.)

• 10GE switch-based transport technology required (no WAN/LAN specification), one standard for whole network

• number & type of required interfaces in each node

• functionality of 10GE nodes

• extra functionality (ATM transport)

Transmission equipment

– ADVA Spectrum 3000 SL (SNMP)

– WDM modules

• 10GBaseLR LAN PHY, 10.312Gbit/s

• SDH WAN-PHY STM-64, 9.953Gbit/s

• FEC

• Automatic laser shutdown, LOS

• 48V

– custom tailored optical filters (reduced)

– DCM dispersion compensation module (20km, 40km, 2x40km)

– EDFA (in-line, pre-amp, booster, 4 channels, SNMP, ALS, 20(L)-23(C)dB gain)

Quantities

BD 6808 switch - 16

10GE switch card 1310nm - 37

1GE card (GBIC) - 16 (63)

Juniper M5 - 7

ADVA shelf - 50

10Gbit transponder - 42

EDFA - 44

DCM - 56

Regeneration cost – 50%

Installation

Gdansk optical lines: G.652

1 port Tczew Grudziądz Chełmno 1 port

1310nm 6,00dB 1310nm

45 km 27 km 41 km 40 km 33 km 50 km

11,25dB 6,75dB 10,25dB 10,00dB 8,25dB 12,50dB

(shared shelf)

MAN

/ Active Repeater /

DCM40>EDFA

>In/Out

SCNFM> WCM > DCM20 DCM40>EDFA

>In/Out

<EDFA<

In/Out DCM40 DCM20 <Tx

WCM

>RxSCNFM

<EDFA<

In/Out DCM40 < WCM <SCNFM

(ter

min

ated

)

MAN

Rx<

WCM

Tx>

SCNFM

Malbork Kwidzyn

Toruń

Line #1 Gdańsk-Toruń

10GE Switch

10GESwitch

...

13dB

5dB 3dB10d 10dB

5dB8dB8dB

Problems

• real line attenuation different (lower!) than planned (extra attenuators needed)

• need to keep proper signal/noise ratio (NSR, carefull amp/WDM) operating point

selection

• last minute project changes (last mile length variation)

• equipment relocation (changes during fiber works)

• optimisation (changes wrt original project)

• others not yet known (but will surely come up!)

MaintenanceMaintenance agreement with line operator, in case of major failure

24hrs to restore connectivity.

Failures may result from:

a) improper installation

b) material defects

c) Force Majeure

d) others (aging... ?)

They are repaired by the specialized company and are paid respectively by:

a) installing company

b) cable manufacturer

c) PSNC

d) PSNC....?

Why CEF? The economy behind

Telco provided channels between 21 MANs, per year:

• 622Mb/s (real cost) : 4.8 MEuro

• 2.5Gb/s (estimated cost, no offers available) : 9.6 MEuro

• 10Gb/s (estimated cost, no offers available) : 19.2 MEuro

Estimated PIONIER costs (based on actual costs for 2600 km)

• cost of 5200km of fibers + 10GE transmission : 55.0 MEuro

• annual PIONIER maintenance costs : 2.1 MEuro

Return of Investment in 3 years!(calculations made for only 1 channel used)

other advantages not included in calculation ;)

2003

1. To continue the development of remaining 2500km of fibers (new funding of 5MEuro received)

2. To start the deployment

of regional networks

Questions?

Thank you!

Michal Przybylskimichalp@man.poznan.pl