Eucalyptus: A Middleware for the NEP

Bruce Spencer, Sandy Liu, Yong LiangNational Research Council

June 26, 2007

2

The community I am talking to

• Scientists (natural, technical, social) who see an opportunity to accelerate their research by reaching out to a larger community– Researchers with similar interests, problems, approaches– To reach their subjects, data sources

• Sharing their computing environment and resources– Multiplatform, multisite, access reusable components

• Synchronous and Asynchronous– Access to people and resources for participatory sessions– Access to computing and storage devices

3

CyberInfrastructure

• While hardware performance has been growing exponentially – with gate density doubling every 18 months, storage capacity every 12 months, and network capability every 9 months – it has become clear that increasingly capable hardware is not the only requirement for computation-enabled [scientific] discovery.– Cyberinfrastructure Vision for 21st Century Discovery

• Networks of resources– High performance computers, communication systems

• Data sources– Data collection methods, sensor networks

• Data analysis methods– Data mining

• Service-based computing– Stateless/stateful, standards

• Virtual organizations– Having impact on society– Social networking

4

More from Cyberinfrastructure Vision for 21st Century Discovery

In facilitating the creation and support of effective virtual organizations, NSF will focus on three essential elements:

• the creation of a common technological framework that promotes seamless, secure integration across a wide range of shared, geographically-distributed resources;

• the establishment of an operational framework built on productive and accountable partnerships developed among system architects, developers, providers, operators, and

• end users who span multiple communities;…

5

More of NSF’s vision

Together, Web Services and service-oriented architectures are emerging as a standard framework for interoperability among various software applications on different platforms. They provide important characteristics such as standardized and well-defined interfaces and protocols, ease of development, and reuse of services and components, making them potential central facets of the cyberinfrastructure software ecosystem.

7

Service Oriented Architectures

• Model of distributed, shared computing– Evolution: Objects/Messages, Client/Server– Simplified model: Stateless services that complete some function– Platform and language independent, sharable components

• XML Standards– WSDL: Description, SOAP: Packaging– WS Triangle– Development environments: Eclipse WSToolKit– Repositories XMethods

• Workflows– BPEL: Ties services together– Relevant for business models

• Semantics of Services– OWL-S, WSMO: descriptions in logic of purpose and interface

Broker

Provider Client

1:Publish

4:Invoke5:Respond

2:Search 3:Bind

10

Eucalyptus in action

11

Eucalyptus Layers

Client

ClientPDSC

Resource

Resource

Resource

Resource

JNLPApplication

Eucalyptus Website

ClientJNLP

Application

SessionManager

UserManager

ResourceManager

FrameworkPDSF

ManagementServices

WS (Tomcat)

WS (Tomcat)

WS (Tomcat)

WS (Tomcat)Client

JNLPApplication

12

Management Web Services

ResourceResourceMgmtMgmtWebWeb

ServiceService

User MgmtUser MgmtWebWeb

ServiceService

Session Management Session Management

Web ServiceWeb Service

13

14

Eucalyptus Client• A Java Desktop Application• Integrated Web Services Clients• A dashboard that controls and configures sessions• Implemented as a floating dock • Use Java Web Start to simplify deployment and maintenance

15

Management Web Services

Manages the resources and users

Users interact with the system by engaging in sessions

Selecting people s/he wants to interact with and the resource that supports the interaction (e.g. High-Def VideoConference)

Status of sessions, resources, and users can be acquired through these management services

16

Resource Hosts

• Web Services platform (HTTP + Servlet Container + SOAP engine) installed

• All Resources (e.g. videoconference) are wrapped as Web Services

• Hides configuration complexity for each resource

17

APN - Articulated APN - Articulated Private NetworkPrivate Network

This Web Service allows a Eucalyptus admin user to configure an APN using UCLPv2.

Eucalyptus users can then use this configured APN as a resource for connectivity.

18

Eucalyptus Resources used by Architect / Industrial Design Community: CIMS

• Pleora videoconferencing– Pleora’s devices for converting digital media signal into IP– Standard Definition: 270 Mbps uncompressed– Signal can be easily accommodated by 1Gbps CANET4

• Ultragrid HD Videoconference– A Sweet Spot: $8K and a lightpath gives you point to point HD

• Isabel multi-site videoconferencing• Autodesk Maya

– Qube: rendering from Maya• OpenSceneGraph for visualization• DCV: graphics acceleration from IBM

– RVN for two-way graphics application sharing– SVN for display over multiple monitors

• UCLPv2 Lightpath configuration • CD++ Simulation system• Jabber Chat

19

How might you use Eucalyptus?

• Set up a session with a number of people accessing a number of resources for a certain period of time– Schedule a session with colleagues every Monday morning at 9:00

using Maya and lightpaths for an hour

• Files– File transfer over lightpaths (can be tricky)

• Desktop applications (standalone)– Use tool to share desktop with colleagues: VNC

• Both can move mouse, keyboard, etc.

– E.g Suppose an application licence costs $100,000 per desktop, you can share it across your network, saving you cost of more licences

• Networked applications (that already run in multiple locations)– Set up lightpath between locations– Bring them into the session

20

Adding your own resource

• You have a custom application – allows you to visualize a virtual phenomenon (weather maps in real

time, connected to many observation points)– You want to incorporate it to Eucalyptus to show your colleague

• You build a hosted Web Service that invokes your application• You provide the WSDL URL

– our software builds the stubs in Java– compiles them and deploys to our management service.

• We generate a generic client interface– Similar to xMethods– Probably want to customize for end-user client

• Now any Eucalyptus user can use your resource

21

Session Management Service

Resource Management Service

User Management Service

Workflow Management Service

WorkflowRepository

Resource Management Service

Resource Management Service

1

2

3

45

Eucalyptus Workflow

22

Workflow for High Definition Tool

Need lightpath?

Start

Stop

Set up lightpath

Start HD

yes

no

23

receive the initial quest from SMWS

invoke WS to start Isabel invoke WS to start Pleorainvoke WS for monitoring

wait wait

invoke WS to stop Isabel invoke WS to stop Pleora

wait

invoke WS to start Pleora

wait

invoke WS to stop Pleora

invoke WS for monitoring

Finished

Faulted

CompletedWithFault

Pick

OnAlarm

OnMessage

Pick

OnAlarm

OnMessage

Initial

2-step ConferenceFirst step

Two sub groups

Second stepOne big group

If a resources is not available (fault)We invoke backup

25

Working with the NRC team

• We are looking for NEP partners – Want to incorporate Eucalyptus– Interested in doing own development, customization with our

support– We provide software for basic management services

• We plan to licence the software as OpenSource across the set of our NEP partners– No sublicencing– After the technology is more mature, and then will open source

in the usual sense with sublicences, modifibility.– By then there will be a healthy Eucalyptus community

26

Eucalyptus Facts

• Eucalyptus provisions resources to users in sessions– Client code is in Java, delivered by Java WebStart– Resources deployed, configured through Web Services

• Sessions can be scheduled – To start immediately– to start/stop at specific times

• New resources are easy to add– New resource deployed by a Web Service easily integrated– Services can be hosted on any platform

• Two sets of clients– End-user for start/stop resources– Admin user for configure resources

• Eucalyptus is simple, lightweight, adaptable

27

28

29

30

31

Layer 1/2 and Layer3

• Lightpaths require a computer with access to layer 1– Direct connections through optical switches

• Access to Web Services usually requires access to layer 3– Routed network, the usual internet

• We have one computer that can access two networks

32

33

Driver for User

Controlled Networks• More and more organizations are acquiring their own fiber

networks

• Acquiring fiber in the long haul is very expensive to light and

obtain

– Alternative is to use “dim fiber” – point to point wavelengths

– But want flexibility to do configuration and change management as with dark

fiber

• e-Science needs dedicated networks for specific applications and

disciplines for high data volume grids

– Want to be able to manipulate the network in the same way they can

manipulate the application

• SOA and networks

− Can provide the same user control over networks as with applications

34

What is UCLP?

• Stands for User-Controlled Lightpath Provisioning

• A configuration and provisioning tool: http://www.uclp.ca/

• Treats network resources as software objects

• Uses Service Oriented Architecture (SOA) and so network can be integrated with other Web Service applications

• Extends the network into the application

• Creates discipline or application-specific IP network

• Supports for high-end e-science and grid applications

35

What is an APN – VPN enabled by UCLP

• Articulated Private Network is the Next generation VPN – normal VPNs but able to have any topology

• Network operators can make part of their resources available to end users

• The end users can then assemble these various Web Services into multiple network virtualizations, i.e. APNs, running their own protocols and services.

• Extending the Application into the Network: – users can make use of the network resources whenever they

are required, effectively bringing the network into the application itself.

– Not only can the end users control and manage their own private high speed networks, but so can their sensors, instruments and applications.

36

CANARIE provides

APN to NRC

New YorkChicagoSeattle

Vancouver

Edmonton

CalgaryRegina

Saskatoon

Winnipeg

Toronto

Ottawa

Montreal

Fredericton

HalifaxCA*net 4 router2G Lightpath WSGbE interface WS

Source: Bill St Arnaud

37

NRC partitions APN

New YorkChicagoSeattle

Edmonton

CalgaryRegina

Saskatoon

Winnipeg

Toronto

Ottawa

Montreal

Fredericton

Halifax

Source: Bill St Arnaud

38

NRC logical view of APN

New York

ChicagoSeattle

Victoria

Vancouver

Edmonton

Regina

Saskatoon

Winnipeg

Toronto

Ottawa

Montreal

Fredericton

HalifaxSource: Bill St Arnaud

39

Tomorrow’s peer to

peer IP network

World

UniversityRegional

Server

World World

National DWDM Network

NREN A NREN BNREN C NREN D

ChildLightpaths

Child Lightpaths

Source: Bill St Arnaud