sponsored by the national science foundation experimentation using geni mark berman geni project...

Sponsored by the National Science Foundation

Experimentation using GENI

Mark BermanGENI Project Office

February 18, 2011

www.geni.netgroups.geni.net

Sponsored by the National Science Foundation 2Feb 18, 2011

Thank You

To Deniz Gurkan for organizing this workshop

To all of you for coming

The GENI team hopes to engage you in• Using GENI for your experiments• GENI-enabling your infrastructure

GEC10 – San Juan, March 15-17: www.geni.net


Outline

• GENI Basics for Experimenters• Some Example Resources• Some Example Experiments• Please Get Involved


GENI’s Unique Advance

• Today– Lots of specific testbeds– Mostly homogeneous– Require separate accounts, tools– Interconnected via Internet

• GENI– End-to-end, controlled interconnection– Shared toolset– Common authentication, access control– Direct L2 access to end-users– Lots of stuff (quantity and diversity)


• Initial implementation with 3 aggregate types

• 20 aggregates advertise 5,000+ resources via the GENI AM API

• Shared credentials offer experimenters single point of access

October 19, 2010Network Resources: OpenFlow switches, PlanetLab/VINI links, ProtoGENI linksCompute Resources: PlanetLab nodes, ProtoGENI nodes

Spiral 2 Initial GENI AM API Implementation


PlanetLab, ProtoGENI, and OpenFlowOctober 20, 2010

Today’s Resources Accessible via GENI AM API

We want all GENI resources to appear on this map!


GENI Is a Virtual Laboratory

• To succeed as a virtual laboratory, GENI must support a wide variety of experiments.

• Early GENI goals include support for– Repeatable and/or “in the wild” behavior– Large-scale infrastructure– Novel network architecture– Deep programmability– Programmable switches and routers– Opt-in users

• These capabilities are rapidly taking shape– GENI will continue to increase in capability, scale, and

interoperability


GENI Experimenter Interests(June 2010)


What resources can I use?

Components

Aggregate AComputer Cluster

Components

Aggregate BBackbone Net

Components

Aggregate CMetro Wireless

These

GENIClearinghouse

Researcher

Resource discoveryAggregates publish resources, schedules, etc., via

clearinghouses


GENIClearinghouse

Components


Components


Components


Create my slice

Slice creationClearinghouse checks credentials & enforces policyAggregates allocate resources & create topologies


Components


Components


Components


Experiment – Install my software,debug, collect data, retry, etc.

GENIClearinghouse

ExperimentationResearcher loads software, debugs, collects measurements


Components


Components


Components


Make my slice bigger !

GENIClearinghouse

Slice growth & revisionAllows successful, long-running experiments to grow larger


Components


Components


Components


Make my slice even bigger !

GENIClearinghouse

Components

Aggregate DNon-NSF Resources

FederatedClearinghouse

Federation of ClearinghousesGrowth path to international, semi-private, and commercial GENIs


Components


Components


Components


GENIClearinghouse

FederatedClearinghouse

Components

Aggregate DNon-NSF Resources

Operations & ManagementAlways present in background for usual reasonsWill need an ‘emergency shutdown’ mechanism

Oops

Stop the experimentimmediately !


Outline



Spiral 2 infrastructureBuilding the GENI Meso-scale Prototype

WiMAX

ShadowNet

Salt Lake CityKansas City

Washington DCAtlanta

StanfordUCLAUC BoulderWisconsnRutgersPolytech Inst NYUUMassColumbia

OpenFlowbackbone

SeattleSunnyvaleLos AngelesDenverHoustonChicagoAtlantaWashington DCNew York City

OpenFlow

Arista 7124S Switch

HP ProCurve 5400 Switch

Juniper MX240 EthernetServices Router

NEC WiMAX Base StationNEC IP8800 Ethernet Switch

Pronto 3290 Ethernet Switch

StanfordU Washington

WisconsinIndianaRutgers

PrincetonClemson

Georgia TechKansas State


World-class GENI Partners

National LambdaRail and Internet2

Buildout for GENI prototyping within two national footprintsto provide end-to-end GENI slices (IP or non-IP)

National LambdaRailUp to 30 Gbps bandwidth

Internet2

ProtoGENI & SPP

Photo by Chris Tracy


Campus GENI build-outsResearchers teaming with campus IT staff

Nick FeamsterPI

Russ Clark, GT-RNOC

Ellen Zegura

Ron Hutchins, OIT

• OpenFlow in 2 GT-RNOC lab bldgs now

• OpenFlow/BGPMux coursework now

• Dormitory trial

• Access control, authentication focus

How are we “GENI-enabling” campuses?

Vitaliy Neret

WiMAX

GENIracks

http://commons.wikimedia.org/w/index.php?title=User:Vitaliy_Neret&action=edit&redlink=1


Example ProtoGENI Resources

U. Utah/Emulab:600+ PCs6 netFPGA

U. Utah/Emulab:600+ PCs6 netFPGA

U. Wisconsin:2 PCs

Wail: 100+ PCs50+ Routers

U. Wisconsin:2 PCs

Wail: 100+ PCs50+ Routers

Internet2 Kansas City PoP:2 PCs

4 NetFPGASPP node

Internet2 Kansas City PoP:2 PCs

4 NetFPGASPP node

Internet2 DC PoP2 PCs

4 NetFPGASPP node

Internet2 DC PoP2 PCs

4 NetFPGASPP node

U. Kentucky:90 PCs

U. Kentucky:90 PCs

Internet2 SLC PoP:4 NetFPGA

2 PCsSPP node

Internet2 SLC PoP:4 NetFPGA

2 PCsSPP node


Programmable WiMax Base Stations

• Site now:– WINLAB Rutgers– BBN Cambridge– NYU Poly

• Sites in progress:– Columbia– UMass Amherst – Univ Wisconsin– Univ Colorado Boulder– UCLA

GENI terminals(WiMAX phone/PDA running GENI/Linux)

Virtual GENI Router (at PoP)

GENI BackboneNetwork

GENI Access Network

(Ethernet SW &Routers)

GENI Compliant WIMAX Base

StationController

WiMAX Base Station (GBSN)


PlanetLab & SPP

• PlanetLab Central: 1000+ nodes worldwide

• SPP: programmable router in 5 Internet2 PoPs

• Other sites running local versions of PlanetLab:– GpENI high-speed network in

Kansas– GENI-enabled campuses

• Chassis Switch

• 10x1 GbE

• CP

• ExternalSwitch

• netFPGA

• GPE• GPE• NPE

• Line Card

• GP Processing Engines

• Network Processing Engine• Line Card

• Chassis Switch

• External Switch


Outline


Sponsored by the National Science Foundation 23Feb 18, 2011Sponsored by the National Science Foundation November 3, 2010

Pathlet ArchitectureGEC 9 experiment demonstration

• Lets users monitor and select their own network paths to optimize their services

• Protects critical traffic even without waiting for adaptation time

23

path 1failed link

path 2

Resilient Routing in thePathlet Architecture

Ashish Vulimiri and Brighten GodfreyUniversity of Illinois at Urbana-Champaign

Deploy innovative routing architecture deep into

network switches across the US

Deploy innovative routing architecture deep into

network switches across the US


ActiveCDNGEC 9 experiment demonstration

ActiveCDNActiveCDN

KansasKansas

UtahUtah

ClemsonClemson

Benefits of ActiveCDN:• Dynamic deployment based on load• Localized services such as weather, ads and news

Benefits of ActiveCDN:• Dynamic deployment based on load• Localized services such as weather, ads and news

GPOGPO

Jae Woo Lee, Jan Janak, Roberto Francescangeli, SumanSrinivasan, Eric Liu, Michael Kester, SalmanBaset,

Wonsang Song, and Henning SchulzrinneInternet Real-Time Lab, Columbia University

Program content distribution services deep into the network, adapt distribution in real

time as demand shifts

Program content distribution services deep into the network, adapt distribution in real

time as demand shifts


Multi-radar NetCDF DataMulti-radar NetCDF Data

Nowcast ProcessingNowcast Processing

1. Spin up system in Amazon commercial EC2 and S3 services on demand

1. Spin up system in Amazon commercial EC2 and S3 services on demand

“raw” live data

“raw” live data

Generate “raw” live dataViSE/CASA radar nodesGenerate “raw” live dataViSE/CASA radar nodes

http://stb.ece.uprm.edu/current.jsphttp://stb.ece.uprm.edu/current.jsp

ViSE views steerable radars as shared, virtualized resourceshttp://geni.cs.umass.edu/vise

ViSE views steerable radars as shared, virtualized resourceshttp://geni.cs.umass.edu/vise

Nowcast images for display

Nowcast images for display

Weather NowCastingGEC 9 experiment demonstration

David Irwin et al

Create and run realtime “weather service on demand”as storms turn life-threatening

Create and run realtime “weather service on demand”as storms turn life-threatening


GEC 9 experiment demonstration

Aster*x Load Balancing (via OpenFlow)Nikhil Handigol et al, Stanford Univ.

Program realtime load-balancing functionality deep into the

network itself

Program realtime load-balancing functionality deep into the

network itself


Outline



Experiments Guide GENI Development

• GENI needs your feedback– As experimenters, you are the GENI user community– What works? Doesn’t work? Hasn’t been built yet?

• GENI Solicitation 3 addresses some key needs– Place more GENI-enabled switches in backbone and

regional networks– Additional WiMax deployments– “GENI racks” for increased in-network storage and

computation– Instrumentation– Experiment Support


GENI’s next steps

• Substantially ramp up research experimentation– More experimenters, more experiments– Support experimenters via training, course materials, summer

camps, and help desk– Transition to reliable operations

• Enhance the growing meso-scale GENI– Increase number of GENI-enabled campuses– Enhance build-outs in campuses and backbones– GENI-enable 5-6 regional networks– Deploy 50-80 GENI-racks throughout US

• Begin to grow from meso-scale to “at scale” GENI

We hope you will be a part of GENI’s success.


Have an Experiment in Mind?

• GPO can help– Bring us in early– Advice on best match to your goals– Establishment of end-to-end VLANs– Some software support

If interested, contact Mark Berman ([email protected])


Want to affiliate your infrastructure?

• If so, you will become a new GENI “aggregate”– You own / operate your aggregate, and “affiliate” into GENI– You make (some of) your resources available for experiments– Examples: testbeds, campuses, regionals and backbone

networks, commercial providers, . . .

• Three actions needed on your part– Download GENI API software, modify to reflect your infrastructure

resources and local policies– Connect to GENI, ideally at Layer 2 but otherwise via GRE tunnel– Agree to GENI policies, sign MOUs, join GENI operations

• Reminder: GENI is still a really early prototype!

If interested, contact Heidi Dempsey ([email protected])


Conclusion

• GENI is entering an exciting phase!• Nobody has done this before• The GPO is here to help

GPO Points of Contact

Project Director: Chip Elliott, [email protected]

Architecture: Aaron Falk, [email protected]

Engineering: Heidi Dempsey, [email protected]

Experiments: Mark Berman, [email protected]

mailto:[email protected]




sponsored by the national science foundation experimentation using geni mark berman geni project...

Documents

geni resources

experiments geni

geni clearinghouse components

initial geni

internet geni

shape geni

geni team

outline geni basics