telecommunications network overview · – red = oh crap! • requires manual acknowledgement...
TRANSCRIPT
TelecommunicationsONetwork Overview
Chad B. Jenkins, P.E.T l i ti P i i l E iTelecommunications Principal Engineer
Telecom Network Overview
• Private Transport• Private Transport
• Network Architectureet o c tectu e
• Telemetry Systems
• Voice Systems
• Network Management
2010.03.04 - UTC Region 3 Telecom Network Overview 2
Private Transport
• Core Network
• Backbone Network
• Equipment
Fiber Follies• Fiber Follies
2010.03.04 - UTC Region 3 Telecom Network Overview 3
Core Network
PTA / E t OPP / W t
GNT / BCC
3xDS3
3xDS3
2xEth
14xDS1
GNTBCC
PTA / East OPP / WestOC-3
OC-3
OC
-12
OC
-12DS3-A
DS3-B
DS3-C
BRKM13 M13DSX
ADM DS3-A
DS3-B
DS3-C
VICM13 M13DSX
ADM
OC-12
OC-12
OC-3 OC-3
OC-3 OC-3
OC-3 OC-3
3xDS3
3xDS3
2xEth14xDS1
PTA
2xEth
3xDS3
3xDS3
2xEth OPP
2xEth
OC-3
OC-3
OC
-12
OC
-12
OC-3
OC-3
OC
-12
OC
-12
3x3x 1x
14x
3x3x1xDS3-C
DS3-B
DS3-A
DIXM13 M13DSX
ADM
DS3-C
DS3-B
DS3-A
PAXM13 M13DSX
ADM
xDS3
xDS3
xEth
xDS1
xDS3
xDS3
xEth
HQT
2010.03.04 - UTC Region 3 Telecom Network Overview 4
HQT / PCCPCC
Typical Backbone Repeater
LMRSwitch
SCADASwitch
DIX
DS3-C
DS3-B
DS3-A
MTCDS3-C
DS3-B
DS3-A
PTA
M13 M13DSXADM
BAK
2010.03.04 - UTC Region 3 Telecom Network Overview 5
BAK
Microwave Equipment
Microwave NetworksCM6 : OC 3 3xDS3 1xDS3 8xDS1CM6 : OC-3, 3xDS3, 1xDS3, 8xDS1Space Diversity, Hot Standby
Proxim WirelessL 1 T1Lynx : 1xT1
Exalt CommunicationsEX-2 4i EX-5i : 4xT1 + EthernetEX-2.4i, EX-5i : 4xT1 + Ethernet
RADwin
2010.03.04 - UTC Region 3 Telecom Network Overview 6
Air Mux 400
Multiplex Equipment
Fujitsu SONETFlashwave 4100Eth t OC 12 OC 3 DS3 DS1Ethernet, OC-12, OC-3, DS3, DS1
Adtran M13Adtran M13MX2800 M13 Mux
Adtran Total Access604, 624, 750
RFL Electronics T1IMUX 2000
2010.03.04 - UTC Region 3 Telecom Network Overview 7
IMUX 2000System Protection Functions
ADSS After Dove Shoot
2010.03.04 - UTC Region 3 Telecom Network Overview 8
ADSS Fiber After Crop Duster
2010.03.04 - UTC Region 3 Telecom Network Overview 9
Network Architecture
• Dynamic Routing
• Equipment
• Security
Public Transport• Public Transport
2010.03.04 - UTC Region 3 Telecom Network Overview 10
Network Equipment
RuggedCom Firewall RoutersRX1000 : DS3, DS1, EthernetOSFP Dynamic Routing
RuggedCom IEEE 1613 SwitchesRS1600, RS2100, RS900, RMC40
B&B Electronics SwitchesESDS 100T
2010.03.04 - UTC Region 3 Telecom Network Overview 11
ESDS-100T
Layered Security
SubstationLAN
CoreNetwork
EdgeNetwork
AccesNetwork
UserLAN
Master Remote RelayingN t k
Core
MasterRadio
RemoteRadio
Core
EngineeringWorkstation
OfficeSwitch
NetworkDevices
CoreRing
FirewallRouter
MicrowaveTower
AccessNetworkSwitch
FirewallRouter
Tower
EdgeFirewallRouter
NovaTechOrion LX
EMSFirewallOSI
EMS
RelayingField
2010.03.04 - UTC Region 3 Telecom Network Overview 12
FirewallRouterEMS Switch
Public Transport Security
Satellite
Field Remote VSATiDirect iNFINTI 3000
SDN GlobalAtlanta Hub
PCC VSATiDirect iNFINTI 3000
Field TunnelDCB ET-3300
NetworkSwitch
Field RTU
NetworkSwitch
PCCDCB ET-6620
PCC
PCC CellularBlueTree Modem Alltel
Network
Field Remote CellularBlueTree Modem
Field TunnelDCB ET-3300
NetworkSwitch
Field RTU
2010.03.04 - UTC Region 3 Telecom Network Overview 13
Public Transport Modems
BlueTree / Sixnet Cellular ModemsBlueTree / Sixnet Cellular ModemsBT-6600, BT-4600
Service Provider AlltelService Provider Alltel
iDirect iNFINTI 3000 VSAT Modem256 kbps Up / 1500 kbps DownSDN Global – Atlanta
7 Single Site Remotes3 Master Nodes for Backhaul2 Backup Loops Alternate Routes
2010.03.04 - UTC Region 3 Telecom Network Overview 14
2 Backup Loops – Alternate Routes2 Control Center Masters
DCB Ethernet Tunnels
ET-6620 : Encrypted Ethernet BridgeThroughput > 200 Mbps
ET-3300 : Encrypted Ethernet BridgeThroughput 700 kbpsoug put 00 bps
Secure Local Area Network ExtensionOSPF Dynamic Routing Support
2010.03.04 - UTC Region 3 Telecom Network Overview 15
Telemetry Systems
• Master NodesMaster Nodes
• Telemetry Radios
• Data Concentrators
I t Ti T l t• Inter-Tie Telemetry
• Ethernet Modems
• Proof is in the Pudding
2010.03.04 - UTC Region 3 Telecom Network Overview 16
Telemetry Master Node
2010.03.04 - UTC Region 3 Telecom Network Overview 17
GE MDS Telemetry Radios
MDS 2710 : 3.2 kbps, -108 dBm @ 220 MHzMDS 4710 : 9.6 kbps, -110 dBm @ 450 MHzMDS 9810 : 22 5 kbps 110 dBm @ 915 MHzMDS 9810 : 22.5 kbps, -110 dBm @ 915 MHz
MDS entraNET 900106 kbps, -106 dBM @ 915 MHz
MDS iNET 900 : 256 / 512 kbps, -99 / -92 dBmMDS iNET-II : 512 / 1024 kbps, -97 / -92 dBm
2010.03.04 - UTC Region 3 Telecom Network Overview 18
Adapt4 : Cognitive IP Radio
Adapt4 XG1 @ 220 MHz-103 dBm @ 38 kbps-97 dBm @ 128 kbps97 dBm @ 128 kbps-95 dBm @ 192 kbps
Adapt4 XG2 @ 220 MHz-108 dBm @ 10 kbps-105 dBm @ 20 kbps@ p-101 dBm @ 40 kbps
Cognitive Software Defined RadioASAP : Automatic Spectrum Adaptation Protocol
SRT S R T h l
2010.03.04 - UTC Region 3 Telecom Network Overview 19
SRT : Spectrum Reuse Technology
DNPoIP Data Concentrator
2010.03.04 - UTC Region 3 Telecom Network Overview 20
Legacy RTU Transport
Prot
ocol
Orie
nted
Dat
a
Coni
tel 3
2-Bi
t P
4-
Wire
Aud
io
RS-2
32 B
yte
Or
2010.03.04 - UTC Region 3 Telecom Network Overview 21
Ethernet Modems
Digi PortServer TS 88 RJ-45 RS-232 Serial Port8 RJ 45 RS 232 Serial Port
DCB EtherPath : Single Port Serial ServerDCB EtherBridge : Convert Serial Radio to Ethernet
NovaTech Orion 5R / LX16 DB9/Fiber Serial Ports
2010.03.04 - UTC Region 3 Telecom Network Overview 22
Inter-Tie Telemetry
2010.03.04 - UTC Region 3 Telecom Network Overview 23
Voice Systems
• Private Mobile Radio
• Telephone System
• Voice Recorder
2010.03.04 - UTC Region 3 Telecom Network Overview 24
From Data over IP to VoIP
% SC• 100% IP SCADA Telemetry December 2008– Full Telemetry Support at both PCC and BCC
OSPF D i R ti– OSPF Dynamic Routing
• Voice over IP• Voice over IP– Private Mobile Radio Console System– Internal Phone SystemsInternal Phone Systems– Universal Voice Recorder
2010.03.04 - UTC Region 3 Telecom Network Overview 25
Avtec Console System
PCC-A
PCC B
Repeater A
OutPost
Repeater B
PCC-B
OCCBCC-A
4 WireE&M
4 WireE&M
T
WANBCCPCC
CRC
Metering
BCC-B
Tower
Telecom
Metering
CentralGeneration
Transportation
TransmissionPCC
VP-GateBCC
VP-Gate
2010.03.04 - UTC Region 3 Telecom Network Overview 26
Avtec Scout : PowerSouth Tab
2010.03.04 - UTC Region 3 Telecom Network Overview 27
Avtec Scout : Members Tab
2010.03.04 - UTC Region 3 Telecom Network Overview 28
Avtec Scout : Linc Tab
2010.03.04 - UTC Region 3 Telecom Network Overview 29
Phone System Upgrade
VPI-BCC
VPGate-BCC
VPI-PCC
VPGate-PCCG450-GNT G450-HQT
BCC Phones Phones Phones PhonesPSTNPSTN PCC
GNT HQT LOW MIP
Fiber @ 1G DS3 @ 45M DS3 @ 45M
HQTGNT LOW MIP
PBX-HQT-CMPBX-HQT-CMMPBX-HQT-AES
PBX-GNT-CMPBX-GNT-CMMPBX-GNT-AES
PBX-MIP-CMPBX-MIP-CMMPBX-MIP-AES
PBX-LOW-CMPBX-LOW-CMMPBX-LOW-AES
CM PBX ApplicationCMM Voice MailAES Voice Recording PBX HQT AES
PBX-HQT-SIPPBX-HQT-UTILPBX-HQT-DOM0PBX-HQT-CONS
UPS-HQT-A
VPI-HQT
PBX GNT AESPBX-GNT-SIPPBX-GNT-UTILPBX-GNT-DOM0PBX-GNT-CONS
UPS-GNT-A
VPI-GNT
PBX MIP AESPBX-MIP-SIPPBX-MIP-UTILPBX-MIP-DOM0PBX-MIP-CONS
UPS-MIP-A
PBX LOW AESPBX-LOW-SIPPBX-LOW-UTILPBX-LOW-DOM0PBX-LOW-CONS
UPS-LOW-A
AES Voice RecordingSIP External VoIP TrunksUTIL Utility ServerDOM0 Domain ZeroCONS Console Domain
2010.03.04 - UTC Region 3 Telecom Network Overview 30
UPS-HQT-BUPS-GNT-B
Network Management
S l t NMS• Survalent NMS– Alarm Management
– Performance Monitoring
• Other Monitoring– Kiwi Syslog Server
– PRTG Latency Measurements
• Reporting & Notification
2010.03.04 - UTC Region 3 Telecom Network Overview 31
Survalent NMS
2010.03.04 - UTC Region 3 Telecom Network Overview 32
Alarm Priorities
• Priority 0 – Normal– Green = Good– Also Used for Events
• Swap from Receiver A to B• Swap from Receiver A to B
• Priority 1 – Warning– Blue = Warning
• Pre-Acknowledged Abnormal ConditionExample : Errored Seconds– Example : Errored Seconds
• Priority 2 – Minor– Yellow = Caution
• Requires Manual AcknowledgementE l B k F il d– Example : Backup Failed
• Priority 3 – Major– Orange = Bad
• Requires Manual Acknowledgementff– Example : Traffic Down
• Priority 4 – Critical– Red = OH CRAP!
• Requires Manual Acknowledgement
2010.03.04 - UTC Region 3 Telecom Network Overview 33
– Example : Essential AC Failed
Alarm Menu
2010.03.04 - UTC Region 3 Telecom Network Overview 34
NMS Master Node
2010.03.04 - UTC Region 3 Telecom Network Overview 35
Microwave Networks CM6
2010.03.04 - UTC Region 3 Telecom Network Overview 36
RSL Historical Data
2010.03.04 - UTC Region 3 Telecom Network Overview 37
Exalt Microwave
2010.03.04 - UTC Region 3 Telecom Network Overview 38
Adtran MX2800
2010.03.04 - UTC Region 3 Telecom Network Overview 39
RuggedCom RX1000 Router
2010.03.04 - UTC Region 3 Telecom Network Overview 40
RuggedCom RS1600 Switch
2010.03.04 - UTC Region 3 Telecom Network Overview 41
NMS DNP RTU
2010.03.04 - UTC Region 3 Telecom Network Overview 42
Daily Reports
• Active Alarms• Bandwidth Delta• Blocked Alarms• CPU Utilization• Errored Seconds • FAA Tower Lighting
Detail Exceptions– Detail, Exceptions
• Generator– Fuel Estimate, Run Time
• Loss of Frame• Rebooted in Last 72 Hours
2010.03.04 - UTC Region 3 Telecom Network Overview 43
• Waveguide Pump
Logging & Notification
Power : AC, DC, GeneratorEquipment : Comm, RebootBackup, Failover, Bandwidthp, ,
Security Access
Equipment Alarms
Port StatusPort Status
Comm : RTU, Meter3 Phase : Volts, Watts, pf
2010.03.04 - UTC Region 3 Telecom Network Overview 44
Current Projects
• Core Router Upgrades
• NERC CIP Security
Mi E i i N th T it• Microwave Expansion in Northern Territory
• Phone System Upgrades
• Private Mobile Radio Narrowbanding
Smart Grid Communications• Smart Grid Communications
• Voice Recorder Installation
2010.03.04 - UTC Region 3 Telecom Network Overview 45