european organization for nuclear research software...

26
European Organization for Nuclear Research Software Testing and Deployment Using Virtualization and Cloud Presented by: Omer Khalid Contributors: Arsalaan Shaikh, Brice Copy 1

Upload: others

Post on 24-Sep-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Sof

twar

e Te

stin

g an

d D

eplo

ymen

tU

sing

Virt

ualiz

atio

n an

d C

loud

Pre

sent

ed b

y:O

mer

Kha

lid

Con

tribu

tors

: Ars

alaa

n S

haik

h, B

rice

Cop

y

1

Page 2: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Out

line

Pa

rt I

-Bac

kgro

und

U

se c

ases

, Inf

rast

ruct

ure

Pa

rt II

-C

once

pts

V

irtua

lizat

ion,

Clo

ud C

ompu

ting,

Too

ls a

nd D

eplo

ymen

t Mod

els

Pa

rt II

I -Im

plem

enta

tion

P

rivat

e cl

oud,

Con

text

ualiz

atio

n, Im

age

Man

agem

ent

Pa

rt IV

-R

esul

ts

Dep

loym

ent T

imes

, Wai

t Tim

es

2

Page 3: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Part

I

Intro

duct

ion

3

Page 4: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Use

Cas

es

•O

PC

Ser

ver

•D

iffer

ent v

endo

rs: C

AE

N, W

iene

r, IS

EG

•Lo

ad te

stin

g to

exa

min

e O

PC

ser

ver b

ehav

iour

–hi

gh tr

affic

, dur

atio

n of

exe

cutio

n et

c.

•P

LC S

ecur

ity•

Pro

cess

mon

itorin

g, C

omm

unic

atio

n an

alys

is

•S

ecur

ity a

ttack

dep

loym

ents

and

eva

luat

ions

•P

VS

S T

estin

g an

d P

atch

ing

•D

evel

opin

g ne

w p

atch

es, b

ug fi

xing

, pre

-pro

duct

ion

depl

oym

ent

•In

frast

ruct

ure

Dev

elop

men

t•

Mul

ti-P

latfo

rm D

eplo

ymen

t, H

ot-S

wap

of p

rodu

ctio

n se

rvic

es

4

Page 5: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Com

mon

Req

uire

men

t

Set

up a

nd C

onfig

ure

New

Mac

hine

s

with

pre

-con

figur

ed s

oftw

are

with

in 3

0 m

inut

es

5

Page 6: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Phys

ical

Arc

hite

ctur

e

16 H

P P

rolia

nt G

4 S

erve

rs: 4

TB

Sto

rage

, 10

GB

RA

M e

ach

6

Page 7: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Add

ition

al C

onst

rain

ts

M

ultip

le P

latfo

rms

W

indo

ws

XP

, Sci

entif

ic L

inux

5/6

(32

and

64 b

it)

So

ftwar

e D

epen

denc

ies

O

PC

Ser

ver (

mul

tiple

ver

sion

s, m

ultip

le v

endo

rs)

P

VS

S (m

ultip

le v

ersi

ons/

patc

h le

vel)

P

LC E

nviro

nmen

ts (S

tep7

and

Uni

ty –

mul

tiple

ver

sion

s)

Ti

me

Con

stra

ints

E

ach

user

nee

ds a

mac

hine

urg

ently

for t

estin

g

E

ach

mac

hine

mus

t be

re-in

stal

led

afte

r eve

ry te

st ~

= 2

hrs

7

Page 8: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Add

ition

al C

onst

rain

ts

Mul

tiple

-Dim

ensi

on K

naps

ack

Prob

lem

Lim

ited

Sup

ply

–M

ore

Dem

and

(res

ourc

es v

s us

ers

vs ti

me)

How

to s

olve

?

8

Page 9: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Part

II

Virt

ualiz

atio

nA

ndC

loud

Com

putin

g

9

Page 10: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Virt

ualiz

atio

n?

Sou

rce:

Wik

iped

ia

Virtu

aliz

atio

n, in

com

putin

g, is

the

crea

tion

of a

virt

ual v

ersi

on o

f som

ethi

ngsu

ch a

s ha

rdw

are

plat

form

, ope

ratin

g sy

stem

, sto

rage

dev

ice

or n

etw

ork

reso

urce

s

10

Page 11: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Clo

ud C

ompu

ting?

Del

iver

y of

com

putin

g (C

PU

, Sto

rage

, Mem

ory)

as

utili

ty-s

ervi

ce o

ver a

net

wor

k

Sou

rce:

Wik

iped

ia, G

oogl

e

11

Page 12: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Clo

ud C

ompu

ting?

Del

iver

y of

com

putin

g (C

PU

, Sto

rage

, Mem

ory)

as

utili

ty-s

ervi

ce o

ver a

net

wor

k

Sou

rce:

Wik

iped

ia, G

oogl

e

12

Page 13: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Part

III

Impl

emen

tatio

n

13

Page 14: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

•In

frast

ruct

ure

as a

Ser

vice

(Iaa

S):

•V

irtua

lizat

ion

and

Clo

ud P

latfo

rm•

Priv

ate/

Sha

red:

Use

rs te

sts

runn

ing

in v

irtua

l mac

hine

s +

Libr

ary

of im

ages

•M

ash-

up u

sing

: •

Com

mer

cial

, Ope

n S

ourc

e, a

nd c

usto

m d

evel

oped

tool

s

•E

valu

ated

tool

s:

•V

MW

are

vCen

ter/L

ab M

anag

er, C

itrix

Xen

Ser

ver/L

ab M

anag

er•

Ope

nSta

ck (C

ompu

te/G

lanc

e), E

ucal

yptu

s (w

ith X

en S

ourc

e), O

penN

ebul

a (o

pen-

sour

ce/c

omm

eric

al)

•>>

Dep

loye

d: V

MW

are

ES

Xi +

Ope

nNeb

ula

+ O

penS

tack

(Gla

nce)

•P

erfo

rman

ce T

estin

g:•

Diff

eren

t dep

loym

ent m

odel

s –

incr

emen

tal r

eque

sts

vs. b

urst

requ

ests

(10

VM

’s)

•D

iffer

ent s

tora

ge m

odel

s –

shar

ed s

tora

ge (N

FS) v

s. d

istri

bute

d st

orag

e (e

ach

serv

er)

Obj

ectiv

e: M

inim

ize

VM

Dep

loym

ent T

ime

Wha

t did

we

do?

14

Page 15: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Wha

t did

we

do?

10 S

erve

r, 3

TB o

f Sto

rage

, 100

GB

Ram

= 9

0 Vi

rtual

Mac

hine

s

15

Page 16: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Imag

e Se

rvic

e an

d C

onfig

urat

ion

•Im

age

Man

agem

ent

•P

ytho

n se

rvic

e –

runs

on

ever

y se

rver

, sta

ndal

one

com

pone

nt

•U

pdat

es a

nd d

ownl

oad

imag

es e

very

hou

r fro

m th

e O

penS

tack

imag

e se

rvic

e

•M

odifi

ed v

ersi

on o

f Ope

n N

ebul

a –

depl

oys

VM

’s u

sing

loca

lly c

ache

d im

age

16

Page 17: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Imag

e Se

rvic

e an

d C

onfig

urat

ion

•C

onte

xtua

lizat

ion

(Win

dow

s sp

ecifi

c)•

Reg

iste

ring

MA

C a

ddre

ss in

the

CE

RN

net

wor

k da

taba

se

•R

egen

erat

ing

syst

em s

ecur

ity ID

usi

ng S

yste

m P

repa

ratio

n (s

yspr

ep) T

ool

•U

ses

a sp

ecia

l con

figur

atio

n fo

r eac

h or

gani

zatio

n w

ide

setti

ngs

•A

ddin

g th

e m

achi

ne in

the

CE

RN

Dom

ain

-> R

eboo

t

17

Page 18: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Part

IV

Res

ults

18

Page 19: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Agg

rega

ted

Res

ults

Agg

rega

ted

depl

oym

ent t

imes

for a

ll co

nfig

urat

ions

arch

-1: s

hare

d st

orag

e w

ithou

t fro

nt e

ndar

ch-2

: sha

red

stor

age

with

fron

t end

arch

-3: d

istri

bute

d st

orag

e, re

mot

e co

pyar

ch-4

: dis

tribu

ted

stor

age

with

loca

l cac

he

19

netw

ork

dela

y to

cop

yea

ch V

M im

age

Opt

imiz

atio

n du

e to

loca

l cac

hing

of i

mag

es

Cen

tral s

tora

ge b

ased

depl

oym

ent

Page 20: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Wai

t Tim

es –

Bur

st m

ode

Sin

gle-

Bur

st: 1

0 V

M’s

on

one

serv

er

arch

-1: s

hare

d st

orag

e w

ithou

t fro

nt e

ndar

ch-2

: sha

red

stor

age

with

front

end

arch

-3: d

istri

bute

d st

orag

e, re

mot

e co

pyar

ch-4

: dis

tribu

ted

stor

age

with

loca

l cac

he

20

rem

ote

copy

, al

l VM

’s b

oote

dat

the

sam

e tim

e

Sha

red

cent

ral

stor

age

–di

ffere

nce

due

tom

emor

y ca

chin

g

Opt

imiz

atio

n: a

ll V

M’s

with

in 1

0 m

ins

Page 21: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Wai

t Tim

es –

Bur

st m

ode

Mul

ti-B

urst

: 10

VM

’s o

n al

l ser

vers

arch

-1: s

hare

d st

orag

e w

ithou

t fro

nt e

ndar

ch-2

: sha

red

stor

age

with

front

end

arch

-3: d

istri

bute

d st

orag

e, re

mot

e co

pyar

ch-4

: dis

tribu

ted

stor

age

with

loca

l cac

he

21

Mul

tiple

ser

vers

di

strib

utes

the

load

–co

nver

genc

e

Opt

imiz

atio

n: a

ll V

M’s

with

in 1

0 m

ins

Page 22: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Wai

t Tim

es –

Inte

rval

mod

eS

ingl

e-In

terv

al: 1

0 V

M’s

on

one

serv

er e

very

3 m

ins

arch

-1: s

hare

d st

orag

e w

ithou

t fro

nt e

ndar

ch-2

: sha

red

stor

age

with

fron

t end

arch

-3: d

istri

bute

d st

orag

e, re

mot

e co

pyar

ch-4

: dis

tribu

ted

stor

age

with

loca

l cac

he22

Opt

imiz

atio

n: a

ll V

M’s

in 3

0 m

ins

Mul

tiple

ser

vers

di

strib

utes

the

load

–co

nver

genc

e

rem

ote

copy

on

e-by

-one

: les

spa

ralle

lism

Page 23: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Wai

t Tim

es –

Inte

rval

mod

eM

ulti-

Inte

rval

: 10

VM

’s o

n al

l ser

vers

eve

ry 3

min

s

arch

-1: s

hare

d st

orag

e w

ithou

t fro

nt e

ndar

ch-2

: sha

red

stor

age

with

fron

t end

arch

-3: d

istri

bute

d st

orag

e, re

mot

e co

pyar

ch-4

: dis

tribu

ted

stor

age

with

loca

l cac

he23

Opt

imiz

atio

n: a

ll V

M’s

in 3

0 m

ins

Mul

tiple

ser

vers

di

strib

utes

the

load

–co

nver

genc

e

Page 24: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Con

clus

ion

•C

loud

/Virt

ualiz

atio

n•

Use

ful t

echn

olog

ies

for b

ette

r util

izat

ion

of p

hysi

cal i

nfra

stru

ctur

e•

Not

nec

essa

rily

appl

icab

le to

all

scen

ario

s, b

ut tr

ue fo

r som

e

•Lo

ts o

f too

ls a

vaila

ble:

Com

mer

cial

and

Ope

n S

ourc

e

•P

rivat

e “L

ocal

” Clo

uds

•P

ossi

ble

to d

eplo

y w

ith c

omm

odity

har

dwar

e –

reas

onab

le c

ost

•R

equi

res

som

e ex

perti

se to

dep

loy/

mai

ntai

n

•A

chie

vem

ent

•A

dded

flex

ibili

ty to

the

phys

ical

infra

stru

ctur

e : m

ulti-

tena

nt

•Li

brar

y of

imag

es fo

r our

use

rs –

diffe

rent

OS

with

sof

twar

e

•U

sers

can

get

thei

r VM

(Win

dow

s or

Lin

ux) w

ithin

30

min

s•

Run

the

test

, shu

tdow

n th

e V

M’s

afte

r tes

ting.

24

Page 25: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Use

ful P

oint

ers

25

B

enja

min

Far

nham

: WEP

MS0

06, M

OPM

S025

“A

utom

ated

test

ing

of O

PC

Ser

vers

“M

igra

tion

from

OP

C-D

A to

OP

C-U

A”

B

rice

Cop

y: W

EPK

S001

, WEA

AU

LT02

“A

gile

Dev

elop

men

t and

Dep

ende

ncy

Man

agem

ent f

or In

dust

rial C

ontro

l Sys

tem

s”

“M

odel

Orie

nted

App

licat

ion

Gen

erat

ion

for I

ndus

trial

Con

trol S

yste

ms”

Fi

lippo

Tila

ro: W

EPM

U02

9

“Indu

stria

l Dev

ices

Rob

ustn

ess

Ass

essm

ent a

nd T

estin

g ag

ains

t Cyb

er S

ecur

ity A

ttack

s”

Pa

ul C

. Bur

kim

sher

: TH

BH

MU

ST01

“Mul

ti-pl

atfo

rm S

CA

DA

GU

I Reg

ress

ion

Test

ing

at C

ER

N”

Page 26: European Organization for Nuclear Research Software ...epaper.kek.jp/icalepcs2011/talks/webhaust02_talk.pdf · PVSS Testing and Patching •Developing new patches, bug fi ... Infrastructure

Eur

opea

n O

rgan

izat

ion

for N

ucle

ar R

esea

rch

Que

stio

ns

Con

tact

: Om

er.K

halid

@ce

rn.c

h

26