sponsored by the national science foundation getting started with your own experiment sarah edwards,...
TRANSCRIPT
Sponsored by the National Science Foundation
Getting Started With Your Own Experiment
Sarah Edwards,
GENI Project Office
Sponsored by the National Science Foundation
GENI Accounts and Projects
Advice and Intermediate Topics
Getting Help / Learning More
GENI Accounts and Projects
Sponsored by the National Science Foundation 3IC2E ‘14 – March 10, 2014
Access to GENI
For many experimenters:• no new passwords• familiar login screens
Leverage InCommon forsingle sign-on authentication
Experimenters from 342 educational and research institutions have InCommon accounts
GENI Project Office runs a federated IdP to provide accounts for non-federated organizations.
Sponsored by the National Science Foundation 4IC2E ‘14 – March 10, 2014
Projects
Projects organize research in GENI
Projects contain both people and their experiments
A project is led by a single responsible individual: the project lead
Project
Lead
Members
Slice
Sponsored by the National Science Foundation 5IC2E ‘14 – March 10, 2014
Project Membership example
Projects have 1 Lead and any number of Admins, Members, and Auditors
http://groups.geni.net/geni/wiki/GENIConcepts#Project
Typical Class
Expiration
Typical Research Project
Sponsored by the National Science Foundation 6IC2E ‘14 – March 10, 2014
Populating a Project
1. Member-initiated Each experimenter asks to join a project, approval needed
• Typical for Research projects
2. Admin-initiated Project Lead/Admin bulk-adds experimenters
• Typical for Classrooms or Tutorials
Sponsored by the National Science Foundation 7IC2E ‘14 – March 10, 2014
Slice Membership exampleSlices have:
• 1 Lead (person who created the slice)• any number of Admins, Members, and Auditors• Project Lead/Admins added as slice Admins
http://groups.geni.net/geni/wiki/GENIConcepts#Slice
Research AsstSlice Lead
Research AsstSlice Lead
Post-DocSlice Member
ProfessorSlice Admin
ProfessorSlice Admin
Sponsored by the National Science Foundation 9IC2E ‘14 – March 10, 2014
Slice Access
Being a member of a slice means you can act on a slice:– Add resources– Check status– Delete resources– Renew resources
With any tool!
Sponsored by the National Science Foundation
GENI Accounts and Projects
Intermediate Topics
Getting Help / Learning More
Advice and Intermediate Topics
Sponsored by the National Science Foundation 11IC2E ‘14 – March 10, 2014
Designing your experiment
• Decide on compute resources (raw PCs, VMs, memory, etc)
• Decide on networking needs
• Start small– Debug your experiment is small,
isolated topologies that you control all pieces
Sponsored by the National Science Foundation 12IC2E ‘14 – March 10, 2014
GENI Compute Resources
ExoGENI, InstaGENI, ProtoGENI are they different and how do I choose?
The important thing is your experiment, so you should always start by designing your experiment
and don’t worry about the aggregate.
ExoGENI, InstaGENI: GENI racks developed by different teams
ProtoGENI: Pre-existing testbeds that are GENI enabled, InstaGENI is based on ProtoGENI software
Sponsored by the National Science Foundation 13IC2E ‘14 – March 10, 2014
Inter-aggregate Links
• Stitching– Creates an inter-domain VLAN– Stitcher: Distributed with gcf/omni– Flukes: ExoGENI-only (not via GENI AM API)
• GRE tunnels over control interface– Use Flack to connect IG nodes via a GRE tunnel– Manually configure GRE tunnels between EG nodes
• Shared VLANs– Some pre-configured inter-domain shared VLANs are
available– Some are OpenFlow-enabled
Sponsored by the National Science Foundation 14IC2E ‘14 – March 10, 2014
Running your experiment
• Automate your experiment– Make it easy to bring up and run it
• Save the Rspec
• Backup your software– Resources can expire
– Nodes may fail
– Aggregates might go on maintanance
Sponsored by the National Science Foundation 15IC2E ‘14 – March 10, 2014
Reproducible Experiments
• Two approaches:– Use existing images with install scripts
http://groups.geni.net/geni/wiki/HowTo/WriteInstallScript
– Use custom images or snapshots• Image creation
– ExoGENI provides a sandbox for image creation• Snapshot images
– InstaGENI provides standard images which are easy to snapshot
Snapshot image: http://groups.geni.net/geni/wiki/HowTo/ManageCustomImagesIns
taGENI
• … or combine the two approaches
Sponsored by the National Science Foundation 16IC2E ‘14 – March 10, 2014
Disruptive experiments
Experiments:• with high resource constraints
– e.g. high bandwidth, many compute resources
• OpenFlow experiments with “risky” topologies– e.g with loops traversing national backbones
• requiring performance isolation
Notify resource owners and the community
Sponsored by the National Science Foundation 17IC2E ‘14 – March 10, 2014
GMOC
GMOC: GENI Meta-operation Center• Keeps track of outages• Notification system for resource reservation
http://groups.geni.net/geni/wiki/HowTo/PreReserveGENIResources
GMOC Google Calendar keeps track of reservations/outages
Sponsored by the National Science Foundation
GENI Accounts and Projects
Advice and Intermediate Topics
Getting Help / Learning More Getting Help / Learning More
Sponsored by the National Science Foundation 19IC2E ‘14 – March 10, 2014
Answer is
Have a question?
Sarah Edwards Niky Riga Vic Thomas
which is an email list which only goes to members of the GPO including…
(However, the archive of the list is public)
Sponsored by the National Science Foundation 20IC2E ‘14 – March 10, 2014
Ways to Get Help
• Sign Up for :
• Use #geni IRC chatroom
• Go over HowTo pages
http://groups.geni.net/geni/wiki/GENIExperimenter/GetHelp
Sponsored by the National Science Foundation 21IC2E ‘14 – March 10, 2014
General debug advice
1. Gather as much information as you can– Be specific about what is not working
• Step-by-step run through usually helps
– Include what you see (screenshots, omni output errors)– Always include:
• type of account you are using (eg portal)• the tool you are using (eg Flack, omni, portal)• your slice name or URN • aggregates you are using• a detailed description of what's wrong including any error messages
2. Contact [email protected] for help
3. Register for resource mailing lists
Sponsored by the National Science Foundation 22IC2E ‘14 – March 10, 2014
Finding other resources
• GENI wiki– Pages for Instructors and Experimenters
http://groups.geni.net/geni/wiki
Sponsored by the National Science Foundation 23IC2E ‘14 – March 10, 2014
Popular Samples
Tutorials:• Lab Zero
Basic GENI understanding, ensures students setup their environment
http://groups.geni.net/geni/wiki/GENIExperimenter/Tutorials/GettingStarted_PartI
• Intro To OpenFlowBasic OpenFlow introductory tutorial, students learn how to setup OVS and write simple controllers
http://groups.geni.net/geni/wiki/GENIExperimenter/Tutorials/OpenFlowOVS
Assignments: • IPv4 Routing
Students understand IPv4 forwarding and how to configure static routes
http://groups.geni.net/geni/wiki/GENIEducation/SampleAssignments/IPRouting/Procedure
• TCP Network AwarenessStudents explore different TCP flavors and TCP parameters
http://groups.geni.net/geni/wiki/GENIEducation/SampleAssignments/TcpAssignment
http://groups.geni.net/geni/wiki/GENIExperimenter/ExampleExperimentshttp://groups.geni.net/geni/wiki/GENIEducation/SampleAssignments
Sponsored by the National Science Foundation 24IC2E ‘14 – March 10, 2014
“How To” pages
• Listed under the “Experimenters” section
• Each “How To” is a short descriptions of how to do various tasks
• New entries being added all the time
Sponsored by the National Science Foundation 25IC2E ‘14 – March 10, 2014
Ways to Learn MoreSign up for [email protected] to be notified about:• GENI Engineering Conferences, 3x/year, open to all:
– Planning & discussion for experimenters, software, infrastructure– Tutorials and workshops – Travel grants to US academics for participant diversity– GEC19 March 17-19, 2014, Georgia Tech, Atlanta
• GENI Summer Camp • Train-the-TA at the start of each semester (online-only)
Sign up at: http://lists.geni.net/mailman/listinfo/geni-announce
Sponsored by the National Science Foundation 26IC2E ‘14 – March 10, 2014
http://tinyurl.com/GENI-IC2E14
Thank you for attending!
Please fill out the survey
Sponsored by the National Science Foundation 27IC2E ‘14 – March 10, 2014
Backup
Sponsored by the National Science Foundation
Solutions to Common Problems
Sponsored by the National Science Foundation 29IC2E ‘14 – March 10, 2014
Common Problems
Problem: Resources disappeared
Possible causes: – Slice expired– Resources (aka slivers) expired
Debug strategy:– Check slice/sliver status– Reserve resources again if expired – Don’t rely on nodes for storage
• Edit scripts locally and scp to your nodes• Copy data off machines
Sponsored by the National Science Foundation 30IC2E ‘14 – March 10, 2014
Expiration and renewal
slice expiration time ≤ project expiration time
each resource expiration time ≤ slice expiration time
each resource expiration time ≤ aggregate’s max expiration
project
slice
resource
(optional)project
expiration timeslice
expiration timeresource
expiration timenow
In general, to extend the lifetime of your resource reservation, you must renew the slice and all resources
resourceresource
Sponsored by the National Science Foundation 31IC2E ‘14 – March 10, 2014
Extend slice/resource expirations
Slice and Sliver Expiration
$ omni renewslice 01-31-14$ omni renewsliver –a gpo-ig myslice 01-31-14$ omni renewsliver –a renci-eg myslice 01-31-14$ omni renewsliver –a missouri-ig myslice 01-31-14
Sponsored by the National Science Foundation 32IC2E ‘14 – March 10, 2014
Common Problems
Problem: Can’t login to a node
Possible causes: – Wrong username– Public key isn’t loaded / Private key is wrong or non-existing– Private key has wrong permissions (it should have 0600)– Slice/sliver expired– Technical issue with node
Debug strategy:– Ask another member of the slice to login to the node
• If successful look for your account – cd ..; ls
• Look for loaded keys – sudo cat <user_path>/.ssh/authorized_keys
– Ask them to use ‘-v’ option• ssh –v [email protected]
Sponsored by the National Science Foundation 33IC2E ‘14 – March 10, 2014
Common Problems
Problem: Can’t access AMs
Possible causes: – Firewall issues– AM is down
Debug strategy:– Check the GMOC calendars for planned/unplanned outages
http://globalnoc.iu.edu/gmoc/index/support/gmoc-operations-calendars.html
– Try to telnet to the port:• e.g. telnet www.emulab.net 12369• Complete list of ports: http://groups.geni.net/geni/wiki/KnownGENIPorts
– Frequent issues on Campus Guest WiFi networks
Sponsored by the National Science Foundation 34IC2E ‘14 – March 10, 2014
Common Problems
Problem: Slice did not come up (“not green”)
Possible causes: – Did not wait long enough– Problem with RSpec
Debug strategy:– Check slice/sliver status– Use rspeclint on your rspecs
http://www.protogeni.net/wiki/RSpecDebugging