Data Plane Measurements

Deniz GurkanJune 26th, 2009

D. Gurkan 22

GENI Spiral 1: 5 Control Framework Clusters (29 Projects)

DETERTrial

Integration

Cluster A

Cluster B

PlanetLab

Enterprise GENI

GUSH Tools

Provisioning Service

Mid-Atlantic Crossroads

GpENI

SPP Overlay Hosting Nodes

Cluster C

ProtoGENI

Virtual Tunnels

CMU Testbeds

Instrumentation Tools

Measurement System

Studies

GENI Meta Operations

Security Architecture

Data Plane Measurements

Optical Access Networks

Cluster D

ORCA/BEN

Vehicular Mobile Network

Sensor/Actuator Network

Kansei Sensor Network

Cluster E

Orbit Framework

WiMAX

PICK ONE

Programmable Edge Node

GENI at 4yr Colleges

Million Node GENI

Regional Opt-In

Digital Object Registry

Embedded Real-time

Measurements

Outline

D. Gurkan 3

1. Review all Substrate Technologies*2. Embedded Measurements*3. Milestones4. Suggested External Measurements

a. Desired Attributes: networkingb. Desired Attributes: reconfiguration and

programmabilityc. An example case

* Based on the “Spiral-1 Substrate Catalog” GPO, J. Jacob.

Review all substrate technologies

D. Gurkan 4

Substrate Network Infrastructure

C – A TIED Routers and computers

Cluster B

Mid Atlantic Network

Regional optical network, 10 Gbps DWDM optical nodes, 10 Gbps Ethernet switches, computer servers

GpENI

Regional optical network, 10 Gbps optical switches, 10 Gbps Ethernet switches, Programmable Routers, Site-specific experimental nodes

Enterprise GENI Campus wide programmable Ethernet switches

Planet Lab

SPP Overlay High performance overlay hosting nodes, netFPGA cards

Review cont.

D. Gurkan 5

Cluster C

CMU TestbedsSmall scale Emulab testbed, Residential small form-factor machines, Wireless emulator

Proto-GENIProgrammable Ethernet Switch, PC’s with NetFPGA cards

Programmable Edge Node

Intel 2855 network processor based programmable edge node

Measurement SystemPC-based IP Packet monitors, Data Storage Systems

Substrate Network Infrastructure

Review cont.

D. Gurkan 6

Substrate Network Infrastructure

Cluster D

BEN

Regional optical network, optical fiber switch, 10 Gbps optical transport equipment, 10 Gbps Routers/Switches, Site-specific experimental nodes

DOMEMetro mobile network, variety of wireless interfaces, devices, wireless access points.

ViSEMulti Sensor (camera, radar, weather station) Network

Kansei Sensor Networks

Wireless sensor networks

C - EWiMAX IEEE 802.16e WiMAX base-station

Orbit Heterogeneous and Mobile Wireless Testbeds

Measurements

D. Gurkan 7

1. Embedded Measurements: Readily available at the multi-purpose nodes (network nodes, other boxes) where transparency is dependent on the manufacturer’s design. Access is sometimes restricted to only through the vendor’s API where there is no direct access to the sensors (refer to GIMS).

2. External Measurements: Depending on needs assessment in a GENI control framework, external measurement instruments are investigated.

Example Embedded Measurements

D. Gurkan 8

Ciena CN 4200: •Bit error rate, optical

power•Protocol specific

performance monitoring (Remote Monitoring (RMON) for Ethernet connections)

•Performance monitoring on network services2 x 10/100BaseT Ethernet ports for remote connectivity, and a RS-232 serial port for local craft access

Adva FSP 3000: •Optical performance

monitoring•SONET/SDH, physical layer ,

service availability•PM threshold setting•PM threshold crossing

alerts•FEC counters•SNMP traps for alarm

monitoring•Fault Management

Ethernet , RS-232 serial cable, SNMP, remote management via in-band channels

Infinera DTN: •Full digital access to

the optical layer and performance monitoring, fault management.Ethernet- based craft interface, remote connection via the in-band management channel carried by the Optical Supervisory Channel (OSC)

GpENIMid-Atlantic

Network

Proto-GENI & BEN

Example Embedded Measurements

D. Gurkan 9

Polatis 24 Port Fiber Switch in BEN•Monitor the optical power on a per

port basis•Ethernet, serial interface (RS232), or

GPIB.

NOTE: Measurement Applications Enabled by the Fiber Switch

•Receiver and transmitter testing•BER•Jitter and protocol testing

Source: http://www.polatis.com/solutions/test_measurement.asp

Embedded Measurements

D. Gurkan 10

Cluster B

• Mid Atlantic Network– Adva Optical Network ( FSP 3000):

Optical performance monitoring, FEC counters, SNMP traps for alarm monitoring

– Nagios: Monitors network Health , round trip time between nodes

– Ethernet Switches: Packet counters and error counters

– Cricket: Graphing of network performance and optical performance monitoring data.

• GpENI– Ciena CN 4200: Bit error rate ,

optical power and performance monitoring.

• Enterprise GENI– OpenFlow: Gather statistics at a

per flow entry on routers/switches.

• SPP Overlay– PlanetLab mechanisms for

auditing outgoing traffic.– Generates real time charts of

traffic associated with the slice.– NetFPGA: Programmable

hardware

Cluster DCluster C

Embedded Measurements

D. Gurkan 11

• CMU Testbedso Interface monitoring ,tcpdump/pcap and

Nagios-style monitoring of machine availability.

• Proto-GENI– Ethernet switches: Packet counters and

error counters– Net FPGA: Programmable hardware

• Programmable Edge Node– Network Processor: Flow Statistics

• Measurement System– Capture packets associated with the

experiment.– System utilization measurements via

SNMP– Activity logs

• BEN– Polatis 32 fiber optical switch: Optical

power measurement– Infinera DTN: Full digital access to the

optical layer , digital performance monitoring

• DOME– Umass Server: SSIDs and BSSIDs, signal

strength, noise level, and type of security

• Vise– NetCDF files: Raw reflectivity and

Voltage data

• Kansei Sensor Networks– Kansei Doctor: measures the number of

available nodes, their health, radio link quality and networking metrics relevant for sensor networks.

Embedded Measurements

D. Gurkan 12

Cluster E

• WiMax– NEC WiMax Base Station

o PHY : Access mode, Frequency, DL:UL ratio, Channel BW, FFT size, Frame duration, TX output Power and # of sectors.

o MAC: Head compression, ARQ, MBS support, Resource management

o Network: IP protocols, Bridging/Routing and Packet handling.– Orbit Measurement Library

o Record per flow or per packet measurementso Layer 2 and 3 measurements

MilestonesMilestones Delivered

• Review all substrate technologies in spiral-1

• Document embedded measurement capabilities

As more substrate input is delivered to the substrate workgroup, we

will revisit these deliverables.

Future Milestones

• Identify external measurement equipment due May 30th 2009

• Describe the network connections for external measurements due

August 31st , 2009

D. Gurkan 13

Some Notes on Embedded Measurements

• Control frameworks have been busy with preparing for the first prototype implementations.

• Embedded measurements (that are included in our report) are not all available in prototype implementations:

– Integration of measurement resources as components into the aggregate manager may not be present.

– Need-assessment for the embedded measurements has not been a priority.

• Most embedded measurements have been in the control plane serving layer 2/3 monitoring needs.

D. Gurkan 14

External MeasurementsWireless1. Anritsu MS269xA Signal

Analyzer with Mobile WiMAX Measurement Software: IEEE802.16e RF signal characteristics

2. JDSU G7104A Multimaster Base Station Tester: Test and measure CDMA, WCDMA/HSPDA systems

3. JDSU GC7105A Base Station Analyzer: Test and maintenance of wireless communication systems

4. JDSU GC7106A RF Analyzer: Test and measure RF communication systems

Optical1. Anritsu MP1800A: Signal Quality

Analyzer at 40 Gbps with Remote control Ethernet/GPIB

2. JDSU T-BERD/ MTS-8000: Full 40 G testing, 1550 nm optics (per ITU-T and GR-253 standards), G.826 and G.828 performance measurements with configuration capability on application modules.

3. Centellax TG1B1-A: 10G BERT with GPIB control Interface.

D. Gurkan 15

Desirable Attributes

Networking of Instruments

• Remote access mechanisms

• Flexible API to interface with the aggregate managers across GENI

• Storage

Re-configuration & Programmability

• Configure measurement parameters

• Re-program a measurement resource

• Slice a measurement instrument for multiple user access

D. Gurkan 16

Networking of External Measurement Instruments

• Remote access mechanisms: Ethernet, USB, other – include a computer (server) at each instrument site

• Interface to the instrument: (programmable) vendor API/drivers – couple with GENI control frameworks

– Planetlab interface, rspecs– ORCA interface, NDL– ProtoGENI interface, Emulab

• Storage (experiment execution – data collection and analysis*): on-instrument, on-network, local, at researcher’s access point, ???

* “Lifecycle of a GENI Experiment”, GPO, V. Thomas.

D. Gurkan 17

Re-configuration of External Measurements

• Configure measurements as you can register/plan (resource discovery, tool discovery, etc.)* an experiment – what parameters are measured at which measurement resource at what granularity.

• E.g.:– optical power per wavelength channel, – at input of Infinera DTN at UH for the link between UH and

Rice, – at a sampling frequency of 60 Hz.

• Reconfiguration availability: e.g. change sampling rate (need to know the range of configuration)

* “Lifecycle of a GENI Experiment”, GPO, V. Thomas.D. Gurkan 18

Programmability of External Measurements

• Re-program a measurement resource according to what your analysis requirements dictate:– Local analysis and then report instead of continuous raw

data reporting– Upload custom measurement software to instruments

• Slicing of a measurement instrument similar to a resource being sliced – multiple researchers can access the same or different measurement parameters at the same time

D. Gurkan 19

Example Capabilities: An optical measurement instrument

• Bit error rate• Polarization Mode

Dispersion testing – PMD delay, PMD coefficient and second order values.

• Chromatic Dispersion testing – OTDR based method and phase shift method

• DWDM: Optical SNR, power and wavelength in the S, C, L bands.

• Optical spectrum analyzer(OSA) module

• Network connection to the instrument

– Dedicated link– In-line

• Link-based measurements: the basis for end-to-end?

– Infinera– Ciena– ADVA– Fujitsu

• Update frequency of measurements

• Desired sampling rate• Event reporting• Other exotic analysis

D. Gurkan 20

Thank you

• Questions? • Suggestions?

D. Gurkan 21