upgrading openstack? avoid these 3 common pitfalls

UPGRADING OPENSTACK? AVOID THESE

3 COMMON PITFALLS

KEN HUI DIRECTOR OF TECHNICAL MARKETING @hui_kenneth

HARRISON PAGE SOFTWARE ENGINEER @harrisonpage

P R O L O G U E "Upgrade from one OpenStack release to the next is a daunting task. Experienced OpenStack operators usually only do so reluctantly."

- Drew Fisher, Oracle

"It's a process that strikes fear into the hearts of Sysadmins everywhere." - Chris Cowley

“Backbreaking” OpenStack migrations hinder enterprise upgrades - Barb Darrow, Gagaom

"Over the course of a month, what became obvious was that a huge amount of the documentation I was consuming was either outdated or fully inaccurate."

- David Paube, Packet

W H Y A R E U P G R A D E S S O D I F F I C U LT ?

1 . U N I N T E N D E D C O N S E Q U E N C E S : N E W F E AT U R E S B R I N G N E W B U G S

2 . F E AT U R E S G E T D E P R E C AT E D O R A R E O T H E R W I S E N O T B A C K WA R D S C O M PAT I B L E

3 . N E W R E Q U I R E M E N T S : FA S T E R C P U , M O R E D I S K S PA C E

4 . D ATA B A S E S C H E M A C H A N G E S

5 . C U S T O M C O N F I G U R AT I O N S T O B E P R E S E R V E D : F I R E WA L L R U L E S , U S E R S E T T I N G S

S O W H Y U P G R A D E ? 1 . P L AT F O R M S TA B I L I T Y B U G S H A P P E N

2 . N E W F E AT U R E S O P E N S TA C K A D D S N E W P R O J E C T S A N D N E W F E AT U R E S T O E X I S T I N G P R O J E C T S

3 . O N G O I N G S U P P O RT V E N D O R S C A N ' T S U P P O R T E V E R Y T H I N G F O R E V E R

4 . S E C U R I T Y U P D AT E S A LWAY S W I T H T H E PAT C H E S

3 M O S T C O M M O N P I T FA L L S

1 . N O T I M P L E M E N T I N G A U T O M AT I O N

2 . N O T E N O U G H T E S T I N G

3 . N O R O L L B A C K C A PA B I L I T I E S

B U I L D I N G B L O C K P R I N C I P L E S

I T S TA R T S W I T H T H E R I G H T D E S I G N PAT T E R N S

• P I O N E E R S I N T H E C L O U D C O M P U T I N G S PA C E • A M A Z O N • N E T F L I X ( S I M I A N A R M Y )

• Y O U C A N B U I L D S Y S T E M S W I T H H I G H AVA I L A B I L I T Y A N D S E R V I C E U P T I M E , E V E N I F T H E U N D E R LY I N G I N F R A S T R U C T U R E I S F R A G I L E

MORE AUTOMATION

MORE TESTING

ROLLBACK CAPABILITIES

B U I L D I N G B L O C K P R I N C I P L E 1 :

T H E B I G G E S T R I S K F O R FA I L U R E O C C U R S W H E N A H U M A N I S R E Q U I R E D T O M A N U A L LY

C O M P L E T E R E P E T I T I V E TA S K S

MORE AUTOMATION

MORE TESTING



C L O U D M A N A G E M E N T TA K E S O N N E W M E A N I N G W H E N Y O U F O C U S O N O V E R A L L S E R V I C E U P T I M E I N S T E A D O F I N D I V I D U A L

C O M P O N E N T U P T I M E

MORE AUTOMATION

MORE TESTING



• M A K E U S E O F I M M U TA B L E I N F R A S T R U C T U R E • T R E AT Y O U R I N S TA N C E S A S D I S P O S A B L E

U N I T S • D O N ’ T U P G R A D E Y O U R I N F R A S T R U C T U R E ,

R E P L A C E I T

“ O T H E R W I S E T H E R E S U LT I S A U N I Q U E S N O W F L A K E - G O O D F O R A S K I R E S O R T, B A D

F O R A D ATA C E N T E R . " - - M A R T I N F O W L E R

MORE AUTOMATION

MORE TESTING


P L AT F O R M 9 M A N A G E D O P E N S TA C K

• C L O U D M A N A G E M E N T- A S - A -S E R V I C E

• Y O U R S E R V E R S H O S T Y O U R D ATA • P L AT F O R M 9 H O S T S O P E N S TA C K

C O N T R O L L E R S W I T H 2 4 / 7 M O N I T O R I N G , S U P P O RT , A N D S L A

• W O R K S W I T H Y O U R E X I S T I N G V M WA R E A N D K V M E N V I R O N M E N T S

• I N S TA L L S I N M I N U T E S , N O T M O N T H S

T H E P L AT F O R M 9 A R C H I T E C T U R E

A U T O M AT I O N W E ’ V E A U T O M AT E D C O N F I G U R AT I O N M A N A G E M E N T AT P L AT F O R M 9 U S I N G A N O P E N S O U R C E T O O L C A L L E D A N S I B L E W I T H “ S N A P E "

S N A P E : • C R E AT E S A M I - B A S E D I N S TA N C E S T H AT M A K E

U P A C U S T O M E R D U ( " D E P L O Y M E N T U N I T ” ) • A P P L I E S N E T W O R K C O N F I G U R AT I O N • C R E AT E S D ATA B A S E I N S TA N C E F O R E A C H D U • A P P LY C U S T O M E R C O N F I G U R AT I O N :

PA S S W O R D S , S S H K E Y S , S S L C E R T I F I C AT E S • D E P L O Y S M O N I T O R I N G , L O G G I N G A N D

A N A LY T I C S T O O L S

MORE AUTOMATION

MORE TESTING



MORE AUTOMATION

MORE TESTING

T E S T I N G W E H AV E A B O U T 1 0 0 L O N G - F O R M T E S T S , 1 0 0 0 S O F U N I T T E S T S T H AT W E C A N R U N O N E A C H B U I L D T O V E R I F Y A N U P G R A D E I S VA L I D

T H E B L U E / G R E E N D E P L O Y M E N T

M O D E L : • S TA N D U P T W O P R O D U C T I O N E N V I R O N M E N T S

• B L U E I S L I V E ( C U R R E N T R E L E A S E ) • G R E E N I S S TA N D B Y ( N E W R E L E A S E )

• I F A L L L O O K S G O O D , P R O M O T E T H E G R E E N I N S TA N C E T O P R O D U C T I O N A N D S E T B L U E A S I D E S O W E C A N R E V E R T T H E R E I F S O M E T H I N G G O E S W R O N G

MORE TESTING

MORE AUTOMATION


U P G R A D E P R O C E S S W E R E C E N T LY U P G R A D E D F R O M H AVA N A T O J U N O

P L AT F O R M 9 C U S T O M E R S A R E " O F T E N G E N U I N E LY A N D H A P P I LY S U R P R I S E D B Y O U R PA I N L E S S , Z E R O - T O U C H O P E N S TA C K U P G R A D E "

U P G R A D E S A R E S C H E D U L E D 1 - 2 W E E K S I N A D VA N C E :

• S O M E O R G A N I Z AT I O N S P R E F E R A L O N G E R W I N D O W

• O T H E R S W H O A R E H E L P I N G U S T E S T O R WA I T I N G O N N E W F E AT U R E S D O N ' T M I N D M O R E F R E Q U E N T U P D AT E S

B E F O R E U P G R A D I N G P L AT F O R M 9 :

• B A C K U P A L L L O G S A N D I N T E R E S T I N G F I L E S

• D U M P A L L D ATA B A S E TA B L E S

• G I V E E V E R Y B O D Y I N T H E C O M PA N Y V I S I B I L I T Y I N T O T H E P R O C E S S

MORE TESTING

MORE AUTOMATION


S E R V I C E O R I E N TAT I O N C U S T O M E R D U D O E S N O T S T O R E C O N F I G U R AT I O N D ATA L O C A L LY:

• E V E R Y T H I N G I S S T O R E D I N A R E M O T E D ATA B A S E • A L L C O N F I G U R AT I O N B I T S A R E E N C R Y P T E D A N D

C H E C K E D I N T O S O U R C E C O D E C O N T R O L

N E W I N S TA N C E S C A N B E D E P L O Y E D A S U S A G E I N C R E A S E S

MORE TESTING

MORE AUTOMATION


R O U T E R

W E B S E R V E R

A P P S E R V E R D B

MORE TESTING

MORE AUTOMATION


P L AT F O R M 9 P R A C T I C E S " C H AT O P S "

W E H AV E A S L A C K B O T T H AT C A N S C H E D U L E A N D K I C K O F F C U S T O M E R U P G R A D E S

• T H E S A M E B O T W I L L I N S TA L L O R R E C O V E R A C U S T O M E R I N S TA N C E

W E H AV E A # D E B U G C H A N N E L T H AT S H O W S W H AT ' S H A P P E N I N G U N D E R T H E H O O D

• C H AT- R O O M - A S - S H A R E D - S H E L L G I V E S I N S I G H T T O A L L PA R T I E S

MORE TESTING

MORE AUTOMATION


S U M M A RY 1 . U P G R A D E S A R E D I F F I C U LT B U T N E C E S S A RY

2 . WAT C H O U T F O R C O M M O N P I T FA L L S

3 . A D O P T C L O U D - N AT I V E P R I N C I P L E S

4 . C O N S I D E R L E T T I N G U P G R A D E S B E S O M E O N E E L S E ’ S P R O B L E M

upgrading openstack? avoid these 3 common pitfalls

Technology