cloud computing in d-grid

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR

D-Grid andCloudComputing

Cloud Computing in D-GridScience Days 2010

Stefan Freitag

Robotics Research InstituteDortmund University of Technology

03. November 2010

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Collaboration of Mad Rocket Scientists

Site B

Site A

Site C

Site D

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


(D-) Grid

Grid

. . . coordinated resource sharing and problem solving indynamic multi-institutional virtual organizations (Foster/Kesselmann/ Tuecke, 2001)

. . . enables resource virtualization, on-demand provisioning,and service (resource) sharing between organizations(Plaszczak/ Wellner, 2005)

Aim of the German Grid Initiative D-Grid

Establish a national e-infrastructure

Sustainable & longterm Grid infrastructure in GermanyTargeted towards public research and private-publicpartnerships involving SME

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Time line

D-Grid started late as other countries like UK or USA startedGrid initiatives in the late 1990s or early 2000s.

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Time line

CloudComputing

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Projects in D-Grid

In total: 35 projects in D-Grid

Infrastructure & Services

DGI, IVOM, D-MON, SuGI, SLA4D-Grid, . . .

Academic

HEP-CG, C3-Grid, AstroGrid-D, MediGrid, TextGrid, . . .

Academic & SME Cooperation

AeroGrid (T-Systems SfR), BIS-Grid, Biz2Grid, FinGrid(Deutsche Bank, Dresdener Bank), GDI-Grid, . . .

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Projects in D-Grid

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Compute and Storage Resources

30.000 CPUcores

5 PByte ofstorage

2009: 140 MioCPUh consumedby users

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Utilization 2008 2010

9000000AstroGrid-D adBWGrid bw

7000000

8000000

9000000AstroGrid-D adBWGrid bwMediGrid mdTotalLinear (Total)

6000000

7000000

8000000

9000000AstroGrid-D adBWGrid bwMediGrid mdTotalLinear (Total)

4000000

5000000

6000000

7000000

8000000

9000000CPUh

AstroGrid-D adBWGrid bwMediGrid mdTotalLinear (Total)

2000000

3000000

4000000

5000000

6000000

7000000

8000000

9000000CPUh


1000000

2000000

3000000

4000000

5000000

6000000

7000000

8000000

9000000CPUh


0

1000000

2000000

3000000

4000000

5000000

6000000

7000000

8000000

9000000

Jul08

Aug08

Sep08

Okt08

Nov0

8

Dez0

8

Jan09

Feb09

Mrz09

Apr09

Mai09

Jun09

Jul09

Aug09

Sep09

Okt09

Nov0

9

Dez0

9

Jan10

Feb10

Mrz10

Apr10

Mai10

Jun10

CPUh


0

1000000

2000000

3000000

4000000

5000000

6000000

7000000

8000000

9000000

Jul08

Aug08

Sep08

Okt08

Nov0

8

Dez0

8

Jan09

Feb09

Mrz09

Apr09

Mai09

Jun09

Jul09

Aug09

Sep09

Okt09

Nov0

9

Dez0

9

Jan10

Feb10

Mrz10

Apr10

Mai10

Jun10

CPUh


CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Current Software Stack

Compute middleware

gLite 3.2

UNICORE 6

Globus Toolkit 4

Storage middleware

dCache 1.9

OGSA-DAI

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Software Stack

OGSADAI

Databases

SEdCache

VSiteUNICORE

CEgLite

GRAMWS

Compute Frontends

dCache

Storage Frontends

PoolToolkitGlobus

Torque & MAUIFile

Systems

Online StorageWorker nodes

Functionality of this stack is ensured by running a test bedcontaining all services

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Software Stack Extension by CloudVSiteUNICORE CEgLite GRAMWSTorque & MAUIWorker NodesPlatform VirtualizationGlobus ToolkitCloudMiddlewareNew: Platform virtualization and Cloud middleware

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Hardware and Service Setup at DGRZR

Compute Middleware

gLite 3.1 and 3.2

UNICORE 5 and 6

Globus Toolkit 4.0.8

Storage Middleware

dCache 1.9.5

OGSA-DAI WSRF 2.2

Hardware

2048 CPU cores, 108 TByte storage

SLES10 SP3 with Xen, all services deployed in VMs

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


OpenNebula

Statement on homepage

Standard-based open-source toolkit to build private, public andhybrid clouds. [...] provides flexible architecture, interfaces andcomponents that fit into any existing data center.

Supports Xen, KVM and VMware (libvirt)

Interfaces also with Amazon EC2 and ElasticHosts

Other users

CERN (cloud infrastructure consisting of 3,200 cores)

NIKHEF

China Mobile (Big Cloud project)

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


OpenNebula at Dortmund

Slightly modified ONE 2.0 RC1 (October 2010)

Xen infrastructure and ssh image transfer

User interaction via CLI and management console

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Executions Hosts & Virtual Networks

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Worker Node Template

NAME = udown300VCPU = 8MEMORY = 13312

OS = [ boo t l o a d e r = / roo t / b in /domUloader . py ]

DISK = [ sou r c e = /wn s l 54 x86 64 . img ,t a r g e t = xvda , r e a don l y = no ]

DISK = [ type = swap , s i z e = 1024 ,t a r g e t = xvdb , r e a don l y = no

]DISK = [ type = b l o ck , c l o n e = yes ,

s ou r c e = / dev/ c c i s s / c0d0p4 ,t a r g e t = xvdc , r e a don l y = no

]NIC = [ NETWORK = DGRZRWorkernodes ,

IP = 129 . 217 . 242 . 166]

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Further plans at DGRZR

Present situation

Deployment of worker nodes (Private Cloud)

Access to Cloud interfaces for D-Grid/ external users

Split physical resources in Cloud & Grid partition

Dynamic change of partition sizes

Preemption or suspension of virtual machines priority?Job types: simple batch jobs, MPI jobs, services

Customer classes: bronze, silver, gold

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


(How) Should D-Grid deal with Clouds?

Situation in 2009

Utilization of compute resources 140 Mio CPUh consumed,but this was only around 50% of the available CPUh

1/2 of D-Grid compute resources are idle

Not really acceptable for a sustainable operation

Introduce compute cloud interface as new pillar

Not only my opinion. . .

Grid is too complex and hence not attractive to SMEs

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Grid complexity Resource Access

Grid

Application for X.509 certificate (1-2 days)

Contact Certification authorityContact Registration authority (f2f required)

Application for VO membership (hours - days)

Updating of the authorization information on the Gridresources (hours - days)

Cloud

Register once via e. g. web and specify name, credit cardinformation, . . .

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Grid complexity Service Interaction

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Cloud-Enabling D-Grid

Project start was on 01.06.2010, duration: 2 years

fluid Operations eCloudManager (eCM)

Self-service component for e. g. application deploymentand resource monitoring

D-Grid operators can use eCM for resource provisioningand data center operations

Accounting & billing modules integrated in eCM

Supports professional storage (NetApp, EMC, . . . )

Supports VMware, XenServer and Hyper-V

Supports EC2 (external)

SAP, LaaS

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Open issues

Technical level

User management

Authorization

Accounting & Billing

Monitoring

Information system

Legal issues (e. g. liability)

Legal status of a virtual organization?

Company constituted under Civil law (Gesellschaftburgerlichen Rechts)

Joint and several liability

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


User management

D-Grid

VO central user management

Resources query VOMRS servers and generate a mappingVO member local user IDAttribute-based authorization

Cloud (OpenNebula)

Local user management, no attributes

To Do

Enable Cloud middleware to query VOM(R)S servers

Can the concept of VOs be supported by cloudmiddleware?

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Accounting

D-Grid

Jobs pass along the compute middleware and reach theLRMS

LRMS job accounting information published via DGAS 1

Cloudjobs do not start at LRMS level

Cloud (OpenNebula)

Basic accounting features

To Do

Evaluation of collectable metrics

Translation of this metrics to a D-Grid compatible format

1Distributed Grid Accounting System

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Information System

Each Grid middleware uses a separate information system:BDII, CIS, MDS

D-MON2 gathers and aggregates the information

Development of a Cloud middleware adapter

To Do

Which information to publish? Available appliances,hardware limits (#CPU cores, RAM, . . . )

Cloud Resource Broker

2 http://www.d-grid.de/index.php?id=401

http://www.d-grid.de/index.php?id=401

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Conclusion and Future Challenges

Conclusion

Cloudification of D-Grid Resource Center Ruhr

Prototypic integration of a cloud middleware

Open issues for integration of compute clouds in D-Grid

Future Challenges

Virtual Organizations in Clouds

Cloudification of D-Grid

Why should Grid providers get cloudy?

Service Level Agreements

CloudComputing in

D-Grid

S. Freitag

D-Grid

DGRZR

Cloud atDGRZR


Questions?

Slides available:

http://www.slideshare.net/stefanfreitag

BlogGrid at Dortmund

http://gridatdortmund.blogspot.com/

D-GridD-Grid Resource Center RuhrCloud at DGRZRD-Grid and Cloud Computing

cloud computing in d-grid

Education