Network Engineering Workshop

The 47th Asia-Pacific Advanced Network Meeting

21 February 2019

Dr: Hyunsook Kim

Manager/KOREN NOC

KOREN SDI Roadmap

KOREN SDI Implementation Status

KOREN SDI User Portal

Future Plans

Software Defined InfraLegacy Infra

Provide VDI Services over KOREN Software Defined Infrastructure

Terminal

IP

Infra

M&C

L2/L3Services

Transport

ROADM ROADM

EMS Vendor EMS

NMS Monitoring Only

NW Only

Transport

POTNPOTN

VV

WBWB

vRoutervRouter

NFV

Infra

Controller

Services

VCloud

IP

L2/L3 NFV CloudLL

IP-SDN T-SDN OpenStack

M&O

Tenant Portal

• Distributed Control & Manual Operation

• Closed & Siloed Service

• Centralized Control & Automatic Operation

• Virtual Dedicated Infra(VDI) Services

ROADM ROADM

Infrastructure

(Physical + Virtual)

Domain Controllers

Management

& Orchestrator

Customer Facing

Service

T-SDN Controller

TL1

Path Computation

Prov.

ROADMProv.

Path Computation

Engine

Common

TopologyMgmt.

InventoryMgmt.

POTN Prov.

ServiceMgmt.

POTN Adaptor ROADM Adaptor

OpenFlow/TCP

SDN SW SDN SW

ROADMVendor specific Protocol

EMS V VServerStorage

Public CloudPOTN

OpenStack API

OpenStack

Nova Glance

Cinder Neutron

Heat Ceilometer

Cloud ControllerIP-SDN Controller

SDN SW API(OpenFlow)

RESTful Southbound APIs

Angular2PythonHTML 5Java 7.0

Cross-Domain Service Orchestrator Management

Service Reservation

ServiceProvisioning

Resource Management

TopologyManagement

Error Management

Performance Management

ServiceActivation

NetworkConfiguration

YAML / RESTful API

SDN SW

SDI User Portal

MariaDB

Reservation

NFV Controller

NAT DHCPFirewall

Management

Platform

User Management

IP Service : 28% (2 pops)(Seoul, Pangyo)

ROADM 100G

POTN 100G

WhiteBox 10G (4 nodes)

WhiteBox 100G (4 nodes)

WhiteBox 10G (6 nodes)

IP Service : 70% (6 pops)(Seoul, Pangyo, Daejeon,

Suwon, Daegu, Gwangju)

IaaS(Storage @ Seoul)

Phase 2017)- T- SDN , IP-SDN -

Phase II(2018)- Hardware infra & M&O -

Phase III(2019)- All SDI (NFV & SDN) -

Done!

Network

V

IP-SDN

Cloud

Network

V

IP-SDN

Here!

SDI Portal

Virtual Network Function(vDHCP,vNAT,vFirewall)

IP Service : 100%(All pops)

All SDI

(NFV)

NFV Design

V

IP-SDN

NFV

NFV

Orchestrator

Optical Link (L2) Service(Seoul, Pangyo, Daejeon, Suwon)

T-SDN

V

Done!

WB(100G)

WB(10G)

WB(10G)

WB(10G)

WB(100G) WB(100G)

WB(10G)

WB(100G)

WB(10G)

WB(10G)

WB(10G)

WB(10G)

WB(10G)

IP-SDN

IP-SDN

Controller

SDN SW SDN SW SDN SW

Subzone

Controller

V V V

L3

OpenFlow

(v1.3)

Routing- OF Protocol

- Routing

- NBI(RestAPI)

- Global Policy

Control

- L2/L3 Prov.

▪ PRISM: Virtual Router

- Quagga

▪ BEEM: OF Controller

- OpenMul

▪ ONL: Whiteboxswitch OS

▪ Whiteboxswitch: Edgecore (AS7712-

32X(100G), AS5812-54T(10G)) TCP

RestAPI

Telnet, FTP,

CLI, SNMP

IP/MPLS

Network

ONL

V

SDI User Portal

Service Portal

Admin

Controller HA(High Availability) Solution

PRISM Controller : Domain Controller- Control each domain IP-SDN Network- HA Solution- 2 controllers in each domain

BEEM Controller : Main Controller- Install Controller to each domain

Legend

display

10G Whitebox

100G Whitebox

ROADM

Seoul

Gwangju

ChunCheon

Orchestrator

Suwon

Jeju

JeonJu

Deagu

Busan

Controller#1 Controller#2 Controller#3 Controller#4 Controller#5

Daejeon

Pangyo

Vxlan Provide virtualized and multi-tenant communication environment

Physical layer

Physical layer

Overlay layer

VLAN VxLAN VLAN

VLAN

Virtual Router Backbone

EdgeCore(SDN)

EdgeCore(SDN)trunk

Port

PG_KUL DJ_KT

aggr aggr

VxLAN vni

trunk

Port

T-SDN

▪ ROADM: Coweaver(UTRANS-6000)

▪ POTN: Woorinet(UPN-3000)

Transport Network

T-SDNController

ROADM

POTN

SDN SW

Router

SDN SWPOTN

SDN SW

Router

SDN SW

POTN

SDN망

Legacy Network

CSO Management

Monitoring- Real-time Fault event detection- Traffic Collection

Control- L0~L2 Link status- Topology

RestAPI

POTNEMS

TL1

TL1

TL1

V

V V

V

Jeju

Gwangju

Jeonju

Suwon

Seoul

Chuncheon

Pangyo

Daegu

Busan

SDI User Portal

IP-SDNController

T-SDNController

Rest API

Admin

70%

POTN

ROADM

Legacy Router

Date : 2018, Nov, 7

Location : AI Network Lab

Participations : User Admins from 56 migrated KOREN organizations

※ Designated as a User Admin for managing and in charge of SDI user portal (Sep.~ Oct. 2018)

RESTful Southbound APIs

Angular2PythonHTML 5Java 7.0

Cross-Domain Service Orchestrator Management

Service Reservation

ServiceProvisioning

Resource Management

Topology Management

Fault management

Performance Management

SDI User Portal

MariaDB

Server Storage Switch

OpenDaylight OpenStack

IP Transport Cloud NFV

Transport

POTN/ROADM

L2/L3

WhiteBox SW Router

KubernetesMul.Virtual Infra

Physical Infra

User Management

SDI

Provide various KOREN SDI services including E2E and Cloud Service

Currently activated service

Announcement

Requested servicelist

Network Traffic Monitoring

VM servicemonitoring

Error Status

IP-SDN Service

T-SDN Service

Public Cloud Service

SDI E2E Service(IP-SDN, T-SDN) is based on virtual resource.

User Admin NOC Admin

SDI E2E Service

User Admin

NOC Adminor User Admin

ApprovalRequest

SDI E2E Service

CreateService

ServiceRequest

Virtual Resource Request

SDI User PortalLogin

ApprovalRequest

Deploy T-SDN Monitoring Function to SDI User Portal

Hospital A in Seoul use E-LAN service with Hospital B in Daegu

Hospital B(Daegu)

Location: SeoulOrganization : Organization ATenent: SE_USER1

Hospital A(Seoul)

Virtual NodeVirtual Node

KOREN

Virtual Network LinkLocation: DaeguOrganization : Organization BTenent: DG_USER2

Public Cloud Service (PaaS-TA)

PaaS-TA provide service

Public Cloud Service (OpenStack)

KOREN User

Public Cloud Server

Koren Storage

VM

Provide Storage

to each user

Provide VM

to each user

포털

Virtual Machine

Storage

User in Organization A

Creates VM and Storage Service

VM

Storage

IP-SDNFunctionUpgrade

ㆍMulticast, IPv6, MBGP

ㆍAPIs for SDI PortalT-SDNmonitoring

ㆍT-SDN Monitoring

ㆍDeploy to SDI Portal

NFVDevelopment

ㆍVNF-DHCP, NAT, FW

ㆍContainer based NFV SDI User Portal Upgrade

ㆍDesign

ㆍMonitoring

ㆍApply HA Solution

ㆍProtocol development (Multicast, MBGP, IPv6)

ㆍ APIs for SDI Portal Troubleshooting & Monitoring

SDI User Portal

L3, E2E ServiceVirtual

ResourceFailure Status & Troubleshooting

Topology Management

REST API

IP –SDN Controller

L2/L3

WhiteBox SW

Physical Network Intra

Path Computation L2 Switching

L3 Routing(IPv4, v6) Multicast

PRISM Controller

Mul Core(OpenFlow)

Monitoring

Service Mgmt.(L3, E2E)

Alarm / Notice Handler

Topology Handler

Traffic Static Handler

Virtual Resource Mgmt

Virtual Interface Mgmt.

Routing Table, ARP Information

BEEM Controller

Quagga(BGP, OSPF)

Topology Mgmt.

Network Monitoring

Routing Path Discovery

NBI Agent

REST API

MBGP

Deploy T-SDN Monitoring Function to SDI User Portal

Heat 연동 Module

Controller API YAML JSON Converter YAML

SDN Controller YAML for OpenStack

Controller

SDI User Portal

Service TemplateVirtual

Resource LogPerformance monitoring

ㅍㅍ

Elastic Stack

API Log message

T-SDN

Path Computation TopologyMgmt.

InventoryMgmt.

POTN Prov.ServiceMgmt.

Performance CPU/Memory/Storage Alarm

Agent

Beats

z

ELK StackVirtualization Layer & Virtual Resource

ComputingHardware

StorageHardware

NetworkHardware

Hardware Resources

Kubernetesor Docker Swarm

Flannel / Calico

Agent

Beats

FilebeatMetricBeatPacketBeat

Logstash

ElasticSearch

Kibana

vFirewall vNAT vDHCP

SDI User Portal

NFV Manager

Orchestrator

OSS/BSS NFV Orchestrator(NFVO)

VNF Manager (VNFM)

Virtualized Infrastructure Manager(VIM)

NFV Infrastructure (NFVI)

VNF

Deploy T-SDN Monitoring Function to SDI User Portal

ㅍ

Virtual Network

KOREN

SDI User Portal

Host

Docker Swarm

Ubuntu

Docker Node

Flannel / Calico

vDHCP vNAT vFW

Imageregistry

SeoulHost

Ubuntu

Docker Node

Flannel / Calico

vDHCP vNAT vFW

SeoulHost

Docker Swarm

Ubuntu

Docker Node

Flannel / Calico

vDHCP vNAT vFW

Imageregistry

PangyoHost

Ubuntu

Docker Node

Flannel / Calico

vDHCP vNAT vFW

Pangyo

Container based VNF vDHCP, vNAT, vFW Development