european organization for nuclear research software...
TRANSCRIPT
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Sof
twar
e Te
stin
g an
d D
eplo
ymen
tU
sing
Virt
ualiz
atio
n an
d C
loud
Pre
sent
ed b
y:O
mer
Kha
lid
Con
tribu
tors
: Ars
alaa
n S
haik
h, B
rice
Cop
y
1
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Out
line
Pa
rt I
-Bac
kgro
und
U
se c
ases
, Inf
rast
ruct
ure
Pa
rt II
-C
once
pts
V
irtua
lizat
ion,
Clo
ud C
ompu
ting,
Too
ls a
nd D
eplo
ymen
t Mod
els
Pa
rt II
I -Im
plem
enta
tion
P
rivat
e cl
oud,
Con
text
ualiz
atio
n, Im
age
Man
agem
ent
Pa
rt IV
-R
esul
ts
Dep
loym
ent T
imes
, Wai
t Tim
es
2
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Part
I
Intro
duct
ion
3
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Use
Cas
es
•O
PC
Ser
ver
•D
iffer
ent v
endo
rs: C
AE
N, W
iene
r, IS
EG
•Lo
ad te
stin
g to
exa
min
e O
PC
ser
ver b
ehav
iour
–hi
gh tr
affic
, dur
atio
n of
exe
cutio
n et
c.
•P
LC S
ecur
ity•
Pro
cess
mon
itorin
g, C
omm
unic
atio
n an
alys
is
•S
ecur
ity a
ttack
dep
loym
ents
and
eva
luat
ions
•P
VS
S T
estin
g an
d P
atch
ing
•D
evel
opin
g ne
w p
atch
es, b
ug fi
, pre
-pro
duct
ion
depl
oym
ent
•In
frast
ruct
ure
Dev
elop
men
t•
Mul
ti-P
latfo
rm D
eplo
ymen
t, H
ot-S
wap
of p
rodu
ctio
n se
rvic
es
4
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Com
mon
Req
uire
men
t
Set
up a
nd C
onfig
ure
New
Mac
hine
s
with
pre
-con
figur
ed s
oftw
are
with
in 3
0 m
inut
es
5
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Phys
ical
Arc
hite
ctur
e
16 H
P P
rolia
nt G
4 S
erve
rs: 4
TB
Sto
rage
, 10
GB
RA
M e
ach
6
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Add
ition
al C
onst
rain
ts
M
ultip
le P
latfo
rms
W
indo
ws
XP
, Sci
entif
ic L
inux
5/6
(32
and
64 b
it)
So
ftwar
e D
epen
denc
ies
O
PC
Ser
ver (
mul
tiple
ver
sion
s, m
ultip
le v
endo
rs)
P
VS
S (m
ultip
le v
ersi
ons/
patc
h le
vel)
P
LC E
nviro
nmen
ts (S
tep7
and
Uni
ty –
mul
tiple
ver
sion
s)
Ti
me
Con
stra
ints
E
ach
user
nee
ds a
mac
hine
urg
ently
for t
estin
g
E
ach
mac
hine
mus
t be
re-in
stal
led
afte
r eve
ry te
st ~
= 2
hrs
7
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Add
ition
al C
onst
rain
ts
Mul
tiple
-Dim
ensi
on K
naps
ack
Prob
lem
Lim
ited
Sup
ply
–M
ore
Dem
and
(res
ourc
es v
s us
ers
vs ti
me)
How
to s
olve
?
8
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Part
II
Virt
ualiz
atio
nA
ndC
loud
Com
putin
g
9
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Virt
ualiz
atio
n?
Sou
rce:
Wik
iped
ia
Virtu
aliz
atio
n, in
com
putin
g, is
the
crea
tion
of a
virt
ual v
ersi
on o
f som
ethi
ngsu
ch a
s ha
rdw
are
plat
form
, ope
ratin
g sy
stem
, sto
rage
dev
ice
or n
etw
ork
reso
urce
s
10
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Clo
ud C
ompu
ting?
Del
iver
y of
com
putin
g (C
PU
, Sto
rage
, Mem
ory)
as
utili
ty-s
ervi
ce o
ver a
net
wor
k
Sou
rce:
Wik
iped
ia, G
oogl
e
11
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Clo
ud C
ompu
ting?
Del
iver
y of
com
putin
g (C
PU
, Sto
rage
, Mem
ory)
as
utili
ty-s
ervi
ce o
ver a
net
wor
k
Sou
rce:
Wik
iped
ia, G
oogl
e
12
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Part
III
Impl
emen
tatio
n
13
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
•In
frast
ruct
ure
as a
Ser
vice
(Iaa
S):
•V
irtua
lizat
ion
and
Clo
ud P
latfo
rm•
Priv
ate/
Sha
red:
Use
rs te
sts
runn
ing
in v
irtua
l mac
hine
s +
Libr
ary
of im
ages
•M
ash-
up u
sing
: •
Com
mer
cial
, Ope
n S
ourc
e, a
nd c
usto
m d
evel
oped
tool
s
•E
valu
ated
tool
s:
•V
MW
are
vCen
ter/L
ab M
anag
er, C
itrix
Xen
Ser
ver/L
ab M
anag
er•
Ope
nSta
ck (C
ompu
te/G
lanc
e), E
ucal
yptu
s (w
ith X
en S
ourc
e), O
penN
ebul
a (o
pen-
sour
ce/c
omm
eric
al)
•>>
Dep
loye
d: V
MW
are
ES
Xi +
Ope
nNeb
ula
+ O
penS
tack
(Gla
nce)
•P
erfo
rman
ce T
estin
g:•
Diff
eren
t dep
loym
ent m
odel
s –
incr
emen
tal r
eque
sts
vs. b
urst
requ
ests
(10
VM
’s)
•D
iffer
ent s
tora
ge m
odel
s –
shar
ed s
tora
ge (N
FS) v
s. d
istri
bute
d st
orag
e (e
ach
serv
er)
Obj
ectiv
e: M
inim
ize
VM
Dep
loym
ent T
ime
Wha
t did
we
do?
14
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Wha
t did
we
do?
10 S
erve
r, 3
TB o
f Sto
rage
, 100
GB
Ram
= 9
0 Vi
rtual
Mac
hine
s
15
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Imag
e Se
rvic
e an
d C
onfig
urat
ion
•Im
age
Man
agem
ent
•P
ytho
n se
rvic
e –
runs
on
ever
y se
rver
, sta
ndal
one
com
pone
nt
•U
pdat
es a
nd d
ownl
oad
imag
es e
very
hou
r fro
m th
e O
penS
tack
imag
e se
rvic
e
•M
odifi
ed v
ersi
on o
f Ope
n N
ebul
a –
depl
oys
VM
’s u
sing
loca
lly c
ache
d im
age
16
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Imag
e Se
rvic
e an
d C
onfig
urat
ion
•C
onte
xtua
lizat
ion
(Win
dow
s sp
ecifi
c)•
Reg
iste
ring
MA
C a
ddre
ss in
the
CE
RN
net
wor
k da
taba
se
•R
egen
erat
ing
syst
em s
ecur
ity ID
usi
ng S
yste
m P
repa
ratio
n (s
yspr
ep) T
ool
•U
ses
a sp
ecia
l con
figur
atio
n fo
r eac
h or
gani
zatio
n w
ide
setti
ngs
•A
ddin
g th
e m
achi
ne in
the
CE
RN
Dom
ain
-> R
eboo
t
17
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Part
IV
Res
ults
18
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Agg
rega
ted
Res
ults
Agg
rega
ted
depl
oym
ent t
imes
for a
ll co
nfig
urat
ions
arch
-1: s
hare
d st
orag
e w
ithou
t fro
nt e
ndar
ch-2
: sha
red
stor
age
with
fron
t end
arch
-3: d
istri
bute
d st
orag
e, re
mot
e co
pyar
ch-4
: dis
tribu
ted
stor
age
with
loca
l cac
he
19
netw
ork
dela
y to
cop
yea
ch V
M im
age
Opt
imiz
atio
n du
e to
loca
l cac
hing
of i
mag
es
Cen
tral s
tora
ge b
ased
depl
oym
ent
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Wai
t Tim
es –
Bur
st m
ode
Sin
gle-
Bur
st: 1
0 V
M’s
on
one
serv
er
arch
-1: s
hare
d st
orag
e w
ithou
t fro
nt e
ndar
ch-2
: sha
red
stor
age
with
front
end
arch
-3: d
istri
bute
d st
orag
e, re
mot
e co
pyar
ch-4
: dis
tribu
ted
stor
age
with
loca
l cac
he
20
rem
ote
copy
, al
l VM
’s b
oote
dat
the
sam
e tim
e
Sha
red
cent
ral
stor
age
–di
ffere
nce
due
tom
emor
y ca
chin
g
Opt
imiz
atio
n: a
ll V
M’s
with
in 1
0 m
ins
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Wai
t Tim
es –
Bur
st m
ode
Mul
ti-B
urst
: 10
VM
’s o
n al
l ser
vers
arch
-1: s
hare
d st
orag
e w
ithou
t fro
nt e
ndar
ch-2
: sha
red
stor
age
with
front
end
arch
-3: d
istri
bute
d st
orag
e, re
mot
e co
pyar
ch-4
: dis
tribu
ted
stor
age
with
loca
l cac
he
21
Mul
tiple
ser
vers
di
strib
utes
the
load
–co
nver
genc
e
Opt
imiz
atio
n: a
ll V
M’s
with
in 1
0 m
ins
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Wai
t Tim
es –
Inte
rval
mod
eS
ingl
e-In
terv
al: 1
0 V
M’s
on
one
serv
er e
very
3 m
ins
arch
-1: s
hare
d st
orag
e w
ithou
t fro
nt e
ndar
ch-2
: sha
red
stor
age
with
fron
t end
arch
-3: d
istri
bute
d st
orag
e, re
mot
e co
pyar
ch-4
: dis
tribu
ted
stor
age
with
loca
l cac
he22
Opt
imiz
atio
n: a
ll V
M’s
in 3
0 m
ins
Mul
tiple
ser
vers
di
strib
utes
the
load
–co
nver
genc
e
rem
ote
copy
on
e-by
-one
: les
spa
ralle
lism
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Wai
t Tim
es –
Inte
rval
mod
eM
ulti-
Inte
rval
: 10
VM
’s o
n al
l ser
vers
eve
ry 3
min
s
arch
-1: s
hare
d st
orag
e w
ithou
t fro
nt e
ndar
ch-2
: sha
red
stor
age
with
fron
t end
arch
-3: d
istri
bute
d st
orag
e, re
mot
e co
pyar
ch-4
: dis
tribu
ted
stor
age
with
loca
l cac
he23
Opt
imiz
atio
n: a
ll V
M’s
in 3
0 m
ins
Mul
tiple
ser
vers
di
strib
utes
the
load
–co
nver
genc
e
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Con
clus
ion
•C
loud
/Virt
ualiz
atio
n•
Use
ful t
echn
olog
ies
for b
ette
r util
izat
ion
of p
hysi
cal i
nfra
stru
ctur
e•
Not
nec
essa
rily
appl
icab
le to
all
scen
ario
s, b
ut tr
ue fo
r som
e
•Lo
ts o
f too
ls a
vaila
ble:
Com
mer
cial
and
Ope
n S
ourc
e
•P
rivat
e “L
ocal
” Clo
uds
•P
ossi
ble
to d
eplo
y w
ith c
omm
odity
har
dwar
e –
reas
onab
le c
ost
•R
equi
res
som
e ex
perti
se to
dep
loy/
mai
ntai
n
•A
chie
vem
ent
•A
dded
flex
ibili
ty to
the
phys
ical
infra
stru
ctur
e : m
ulti-
tena
nt
•Li
brar
y of
imag
es fo
r our
use
rs –
diffe
rent
OS
with
sof
twar
e
•U
sers
can
get
thei
r VM
(Win
dow
s or
Lin
ux) w
ithin
30
min
s•
Run
the
test
, shu
tdow
n th
e V
M’s
afte
r tes
ting.
24
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Use
ful P
oint
ers
25
B
enja
min
Far
nham
: WEP
MS0
06, M
OPM
S025
“A
utom
ated
test
ing
of O
PC
Ser
vers
”
“M
igra
tion
from
OP
C-D
A to
OP
C-U
A”
B
rice
Cop
y: W
EPK
S001
, WEA
AU
LT02
“A
gile
Dev
elop
men
t and
Dep
ende
ncy
Man
agem
ent f
or In
dust
rial C
ontro
l Sys
tem
s”
“M
odel
Orie
nted
App
licat
ion
Gen
erat
ion
for I
ndus
trial
Con
trol S
yste
ms”
Fi
lippo
Tila
ro: W
EPM
U02
9
“Indu
stria
l Dev
ices
Rob
ustn
ess
Ass
essm
ent a
nd T
estin
g ag
ains
t Cyb
er S
ecur
ity A
ttack
s”
Pa
ul C
. Bur
kim
sher
: TH
BH
MU
ST01
“Mul
ti-pl
atfo
rm S
CA
DA
GU
I Reg
ress
ion
Test
ing
at C
ER
N”
Eur
opea
n O
rgan
izat
ion
for N
ucle
ar R
esea
rch
Que
stio
ns
Con
tact
: Om
er.K
halid
@ce
rn.c
h
26