multipurpose rings explained-4

UC2B’s Multipurpose Fiber Rings Explained – 8/17/10 The multipurpose fiber rings proposed for UC2B provide four core functionalities. Because every ring has access to both telecommunications core nodes at the University and potentially a hut [or huts/pedestals to house Fiber-to-the-Home (FTTH) electronics] for that ring, there is tremendous flexibility to move fiber strands between these 4 functions as future needs dictate. It is also possible to easily change which of those facilities connects a FTTH customer to the network. The following discussion, looks beyond the grant-funded FTTH pilot project and anticipates the day when UC2B provides FTTH services to the entire community. The first two functions are both related to the delivery of WDM-PON based FTTH service. Assuming that there is a neighborhood hut that houses the FTTH core electronics for a given ring, those core electronics need to connect back to the network core electronics in University Nodes 8 and 9. For LG-Nortel’s WDM-PON system, an Optical Line Termination (OLT) shelf houses 8 OLT’s, each of which can drive a single 32-port filter in the field. In that OLT shelf is a network interface card that has two 10-Gbps ports for connecting to the network core electronics. So the first function of the fiber in a UC2B multipurpose ring is to connect each OLT shelf back to diverse core network locations. The least expensive way of doing that is to use two fiber strands on the “north path” on the ring to connect to a 10 Gbps switch port in Node 9 and to use the same two fiber strands on the “south path” of the ring to connect to a 10 Gbps switch port in Node 8. This would be a dual-homed diverse connection for that shelf that could survive a fiber cut on the ring, or a core electronics or environmental failure in either of the nodes. For the pilot project, the FTTH electronics are currently planned to be in Nodes 8 and 9, so there will be no need for huts or pedestals in the neighborhoods. However some strands of fiber will still be needed to connect each shelf to the core electronics in the “other” node that the OLT shelf is not located in. At 50% penetration in the community we would need to dedicate 40 strands per ring to this functionality. They would connect 20 OLT shelves on each of the seven rings that with 1:32 filters could provide connectivity to a maximum of 35,840 households or businesses. Most OLT’s would never be perfectly loaded at maximum capacity. Assuming an average load of 24 customers per OLT, the number of households served would be closer to 26,272 – as is illustrated on the attached spreadsheet.

The second WDM-PON related function for the fiber rings is to connect the OLT’s to the optical filters in the field. Each optical filter can connect 32 customers and requires a single fiber strand back to the OLT. Because the current optical filters do not support a redundant second fiber feed, we cannot have instant failover in the event of a fiber cut on the north path from the OLT to the filter. However taking advantage of the ring, we can pre-wire a south path from each OLT to its dedicated filter. In the event of a fiber cut on the north path, by sending one technician to the OLT and another to the filter, we can reconnect the filter to the OLT via the south path and restore service long before the north path fiber can be repaired. Depending on the location of the filter in relation to the OLT on the ring, in some instances we might need to swap standard OLT’s for longer-range OLT’s in this emergency configuration. Again, assuming even FTTH customer distribution between the rings, a 50% penetration and the 24 customer-per-OLT averages, we would need an average of 156 strands per ring for connecting OLT’s to their dedicated optical filters. The same fiber strand on the ring could be used for both the north and south paths. We would typically use the shortest path for the normal-connection and the longest path for the emergency connection. The third functionality of the ringed fiber is to support sites that want and are willing to pay for ringed connectivity directly to them. In this model, core electronics that could be located either at the ring’s hut or at Nodes 8 or 9 would be directly connected via both the north and south paths to electronics at the customer site. In the event of a fiber cut on one of the paths, the connection would instantly fail-over to the other path. Users connected via this “self-healing” connection would be unaware of the fiber cut. There are ways that you can daisy chain sites around the ring in this configuration, but to some degree that puts a dependency for customer A on every other customer in the daisy chain. The daisy chain approach also creates the possibility of needing physical access to customer B’s electronics to be able to restore customer A’s service. For the purposes of this discussion and projection, every “ringed customer” has fiber running around the ring directly back to both UIUC nodes. In its simplest form, a single fiber strand from the network core would be connected via the north path all the way to the customer owned electronics at the customer site. That same strand of fiber would be connected from the customer’s on-site electronics to the core via the south path. For maximum redundancy the north path would be fed from electronics in Node 9, while the south path would be fed by electronics in Node 8. As with the OLTs, in this configuration the customer’s service could survive either a fiber cut, or a core equipment or environmental failure in one of the nodes. It would be slightly less robust, but the core electronics for both the south and the north path could be located in the ring’s hut as well (if there are huts). In this scenario that same fiber cut and equipment failure protection exists, but an environmental issue in the hut could impact customer service.

Because of the dedicated fiber strand per customer site, this “ringed” service would more expensive than FTTH service and probably only those organizations or individuals with deep pockets or high bandwidth needs would choose this service. For the 50% FTTH penetration projections, 12.5% of the businesses have been projected as subscribing to this kind of service. That works out to 66 strands per ring that would be used by dedicated ringed customers. Unless the customer requested it, these strands would not enter the FTTH electronics hut (if there is one.) The final functionality of the fiber strands in the multifunction ring is for customers who have purchased their own fiber via an Indefeasible Right of Use (IRU) contract and will be operating their own electronics on it. In a few cases these customers will not need any access to the UIUC nodes or the FTTH hut(s). In most cases they will want to have small routers in each node to facilitate a resilient network architecture involving multiple rings. (A diagram of what an IRU customer network on multiple rings would look like is attached.) Cross connections between rings could be achieved via patch cables in the nodes or huts, permanent splices in splice cases at these facilities or anywhere on the rings where multiple rings share a manhole. Each IRU customer will initially decide where its strands will go, and if a customer’s needs change, fiber strands can be easily added or removed at any of those locations. We are reserving 60 strands on each ring for IRU customers. In the 50% penetration example detailed on the “Fiber Allocation” spreadsheet, there are some 96 spare strands that are available for growth that can be used for any of these four purposes. The fiber strand counts on the two attached spreadsheets do not exactly match at the 50% level, because the more detailed “Fiber Allocation” spreadsheet takes into account that ribbon fiber cable is spliced in layers of 12 strands each. Even if you only need one strand of fiber, typically you get 12 with a ribbon cable. Before we reach 75% penetration and potentially run out of fiber on the multipurpose rings, we expect 64-way WDM-PON filters to be available, which would reduce fiber needs. There are also those who argue that reaching 50% penetration will be difficult, although the national subscription average for municipally operated fiber networks is 53%. If people are betting against us getting to 50%, then worrying about having enough fiber strands to support 75% penetration would seem to be wasted effort at this time. As we get closer to 75% penetration our average customer count per OLT-filter combination will go up, perhaps to an average of 28 or 30 customers per OLT. That further reduces our need for fiber. If our future needs for fiber are well beyond these predictions, we will always have a spare duct that we can use to pull in a much larger 864-strand fiber cable, splice it into service and then remove the original 432-strand cable, giving us back our spare conduit and doubling our future capacity. For the purposes of the grant-funded fiber deployments, we have more than enough fiber on the rings to serve the customers we have initially committed to serve. Additionally, we have enough fiber to grow the system to more than a 50% FTTH subscription rate across the entire community.

Original Design - Multipurpose Ring Fiber Usage

49,778 Housholds in Champaign-Urbana & Savoy3,689 Businesses in Champaign-Urbana & Savoy

53,467 Total Households and Businesses in Champaign-Urbana & Savoy

Assumptions:7 Number of Multipurpose Fiber Rings

24 Average Active Ports on a WDM-PON filter and associated OLT60 Average Number of strands per ring dedicated to IRU's

25% Percent of Businesses with Ringed Connectivity as a % of FTTH customers

25% Projected FTTH Penetration6.25% Projected Business Penetration with Ringed Connectivity13,136 Total Number of FTTH Customers

231 Total Number of Ringed Business Customers547 Total number of WDM-PON filters, OLT Ports and ring fibers needed 20 # of strands needed per ring to feed OLT shelves from Core with ringed connectivity78 # of strands needed per ring for PON transport with perfect ring distribution33 # of strands needed for ringed business customers

191 Minimum # of strands needed per ring with perfect ring distribution


461 Total Number of Ringed Business Customers1095 Total number of WDM-PON filters, OLT Ports and ring fibers needed

40 # of strands needed per ring to feed OLT shelves from Core with ringed connectivity156 # of strands needed for PON transport per ring with perfect ring distribution66 # of strands needed for ringed business customers




60 # of strands needed per ring to feed OLT shelves from Core with ringed connectivity235 # of strands needed for PON transport per ring with perfect ring distribution99 # of strands needed for ringed business customers




80 # of strands needed per ring to feed OLT shelves from Core with ringed connectivity313 # of strands needed for PON transport per ring with perfect ring distribution132 # of strands needed for ringed business customers585 Minimum # of strands needed per ring with perfect ring distribution

Fiber Allocation for a Typical UC2B Multipurpose Ring - After PilotAssuming 50% community penetration and the other assumptions on the attached spreadsheet

Ribbon fiber cable is spliced 12 strands at a time 228 228 252 312

Strand #'s

# of Strands Purpose

Strands Enter

Node 9?

Strands Enter

Node 9?

Strands Enter Hut?

# of Strands

in Node 9

# of Strands

in Node 8

# of Strands in Hut

# of Strands between Nodes 8 & 9

1-48 48

Ringed Connectivity from Core Switches in Nodes 8 & 9 to each OLT shelf (which holds 8 OLTs) -

2 strands per shelf

Yes Yes Yes 48 48 48 0

49-204 156

Connections from OLT to WDM-PON Filter (with warm spare

capabilities) 1 Strand per Filter (rounded up to the nearest factor

of 12)

No No Yes 0 0 156 156

205-300 96 Spares that can be used for any of these purposes as needed. half half half 48 48 48 96

301-372 72

Single Strand Ringed Ethernet Customers - 1 Strand per

Customer (rounded up to the nearest factor of 12)

Yes Yes No 72 72 0 0

373-432 60 Strands for IRU's - as sold per ring Yes Yes No 60 60 0 60

Total: 432

Total Strand Counts

UIUCNode 9

UIUCNode 8

Urbana-Champaign Big BroadbandRelationship of the 7 UC2B

Fiber Rings to the UIUC Nodes and to each other

Ring # 1Far North

Champaign

Ring # 2Near North Champaign

Ring # 3Middle

Champaign

Ring # 4South Champaign

and Savoy

Ring # 5South Urbana

and Savoy

Ring # 6Middle Urbana

Ring # 7North Urbana

Every Ring connects to both Nodes, and any fiber strand on one Ring can be connected to any strand on any other Ring in either node.

Arbo

retum

Dodd

s Park

Meadowbro

ok Park

Urbana Country Club

Weav

er Pa

rk

UIUC Golf Course

Windsor Rd

Mattis

Av

Curtis Rd

Rising

Rd

Staley

Rd

Kirby AvNe

il St

First

St

Pros

pect

Av

Bradley Av

Linco

ln Av

High C

ross R

d

Springfield Av

Dunc

an R

d

Race

St

Philo

Rd

Green St

University Av

Vine S

tFlorida Av

Old Church Rd

Bloomington Rd

Main St

Marke

t St

Airport Rd

Dunla

p Av

Cunn

ingha

m Av

Cardinal Rd

Olympian Dr

Washington St

Olympian Rd

Oaks Rd

Wrigh

t St

Church St

Interstate Dr Willo

w Rd

Brownfie

ld Rd

Perkins Rd

Church Rd

700E

800E

900E

Perkins Rd

University Av

Green St

Willo

w Rd

Curtis RdRa

ce St

Linco

ln Av

Old Church Rd

Oaks Rd

Pros

pect

Av

Dunc

an R

d

Willo

w Rd

30

15

29109

184

187

110

107

102

106

185

2

20

34

40

4

2221

100

26

183

31

188

36

196

25

35

23

37

24

7

12

3

6

11

13

14

2

19

18 17

194

58

212

206

203

207

201

205

211

214

204

200

40

4645

44

90

43

49

52

63

10

47

61

48

71

64

58

195

60

72

54

5774

50

68

75

80

56

66

6967

53

73

5159

182

191

41

55

78

62

93

4582

89

87

88

81

216

98

108

103

189

99

193

29084

97

2

96

85

94

95

7-32-1

2-2

12.01-2

53-1

54-5

9.01-3 7-1

U-8

U-2

U-9

66

8677

0 0.5 10.25 Miles

.

Ring Map3/23/10

Legend

Anchor InstitutionsEducation & Library30Government12Medical45Park District & Youth112Public Computing Centers120Public Safety105Senior Living & Activity84

!. Backbone Junctions

Last Mile FTTP Funded ServiceArea2-1(labeled as Census Tract - Block Group)

Ring 7 - North UrbanaRing 6 - Middle UrbanaRing 5 - South Urbana & SavoyRing 4 - South Champaign & SavoyRing 3 - Middle ChampaignRing 2 - Near North ChampaignRing 1 - Far North Champaign

Backbone NodesU-9

33

Ringed Ethernet

FTTH

FTTH FTTH

FTTH

FTTH

FTTH

FTTH

FTTH

FTTH

FTTH

FTTH

FTTH

DiverseRinged

Ethernet

Typical FTTH Hut

IRU Customer

IRU Customer

UIUCNode 8

UIUCNode 9

Typical Multipurpose Fiber RingOLTs in Huts

Fiber strands that connect core electronics in Nodes to WDM-PON OLT's in HutsFiber strands that connect core electronics in Nodes to ringed Ethernet customer locations

Fiber strands that connect WDM-PON OLT's in Huts to WDM-PON filters in manholesFiber strands that connect IRU Customer sites to each other and to routers in Nodes

30ProvenaHospital

109PavillionHospital

110Frances NelsonCenter

204A Women's

Place

204Center forWomen in Transition

66 B.T

Washington School

66DouglassBranchLibrary

78Lincoln Trail

LibrariesSystem

58Stratton School

59Dr.

Howard School

60Garden

Hills School

50Judah

ChristianSchool

48Franklin Middle School

47Edison Middle School

43Central

HighSchool

51Holy

Cross School

80Champaign

Public Library

90U.S.ArmyCERL

26Fire

Station#5

22MainFire

Station

24Fire

Station#3

181Unit 4Early

Learning

40ParklandCollege

3Champaign

Public Works 17 ChampaignTownship

66Douglass

Center

92CPD

HayesCenter

93Saint

ThomasMoore194

Job Training Center

201Restoration

Urban Ministries

202Developmental

Services Center

Urbana-Champaign

Fiber Ring # 1 - Anchor Institutions2

ChampaignCity

Building

2AChampaign

Police Station

Big Broadband

205 Bethel Church

206

SalemChurch

100Arrow

Ambulance77

Boys & Girls Club

40ParklandCollegePolice

213HACCDorsey Homes

15 C-U

Public Health

106ChristieClinicMain

207TimesMen's Shelter

89Orpheum Science Museum

2InmanSeniorCenter

10UIUCPolice& Fire

10University

ofIllinois

Schools & LibrariesPublic Safety Public Computing Centers Medical Government Senior Centers Youth Centers

Sample Use of Middle Mile Fiber Ring to Serve Anchor Institutions

UIUCNode 9

UIUCNode 8

204A Women's

Place

204Center forWomen in Transition

66 B.T

Washington School

58Stratton School

59Dr.

Howard School

60Garden

Hills School

48Franklin Middle School

47Edison Middle School

43Central

HighSchool

26Fire

Station#5

22MainFire

Station

24Fire

Station#3

Urbana-Champaign

Fiber Ring # 1 - Multiple VLANs

2AChampaign

Police Station

Big Broadband

205 Bethel Church

206SalemChurch

Unit 4 Schools connected to each

other and the Internet on

dedicated fiber strands in a

redundant ring

Public Safety sites connected

to each other and the Internet on dedicated fiber

strands in a redundant ring

Public Computing Centers

connected to the Internet via WDM-PON

Youth Centersconnected to

the Internet via WDM-PON

Typical use of multiple VLANs and fiber strands on Middle Mile

Fiber Ring to serve various Anchor Institutions

66Douglass

Center

77Boys &

Girls Club

UIUCNode 9

UIUCNode 8

10Gbps

ISP # 1Router

AnywhereNode 8UC2B

Layer 2Switch

Node 9UC2B

Layer 2Switch

Home

ONT

Anchor Institution

ONT

Business

ONT

Typical WDM-PON

OLT in Hut or Node

Layer 2 Transport Network:VLAN Transport from Provider

to Customer.

Local ISP Peering Hub:Direct Layer 3 access between ISPs for high speed/low latency service to local businesses and institutions.

ONT

TVPC

Urbana-Champaign

WDM-PONFilter Stackin Manhole

WiFi

Cable/DSLRouter

IP Set-Top Box

100 Mbps

100 Mbps

1 Gbps

1 Gbps

All Links 10 GbpsAll Links

1 Gbps - 10 Gbps

Wave Division Multiplexing - Passive Optical Networking (WDM-PON)Fiber-To-The-Home Network Diagram

MultipleWavelengths

TypicalUC2B

ProtectedFiberRing

Big Broadband

Node 9UC2BHUB

PeeringRouter

Node 8UC2BHUB

PeeringRouter

Typical Home

UC2BISP

Router in 8 or 9

Ringed 1 Gbps

to Chicago

IPTV # 1Router

Anywhere

Commercial Internet

5/26/10

UC2BL2

UC2BL2

UIUC Node 8

UIUC Node 8

UIUC Node 9

WDM-PON

Splitter

WDM-PON

Splitter

WDM-PON

Splitter

ONT

ONT

ONT

BusinessMain FacilityRedundant 1Gbps Connections

BusinessSatellite Office 1100Mbps Layer2 Connection

BusinessSatellite Office 2100Mbps Layer2 Connection

100Mbps

1Gbps

Urbana-Champaign Big Broadband

UIUC Node 9

WDM-PON

Splitter

ONT

1Gbps

100Mbps

All Links 10Gbps

Middle Mile Private Network

Transport Diagram

multipurpose rings explained-4

Documents