virtualization: where it came from and where it's going

Post on 28-Nov-2014

1.503 Views

Category:

Technology

1 Downloads

Preview:

Click to see full reader

DESCRIPTION

Presentation to the IASA NE chapter on Sept 15, 2009. The topic was "Virtualization, where it came from and where it's going".

TRANSCRIPT

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Virtualization: where it came from and where it’s going

Kyle Smith

Sr. Member of Technical Staff

VMware, Inc.

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Who am I?

! " Working on cloud computing at VMware (vCloud)

! " Previously at IBM working with Linux on the mainframe

! " Introduced to virtualization by folks at Clarkson University in 2003

2

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Agenda

! " How it came about

! " The early days

! " The transition from mainframe to commodity

! " Competition in the commodity space

! " The state of virtualization today

! " The future

3

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Motivation for virtualization

! " On the mainframe, it originated in time-sharing

! " Computers too expensive for many to own

! " Turned out to be better to give people a whole virtual S/360 than to run multiple copies of the app

! " On commodity systems, consolidation was the driving force

4

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Early work from IBM

! " S/360 didn’t support time sharing

! " IBM wanted to win business from MIT

! " Proposal rejected, CSC began working on an OS that would allow S/360 to TS

! " Result was the control program (CP)

! " Up to 14 VMs, 256K of memory each

5

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

CP/CMS and S/370

! " CP/CMS ended in 1972

! " IBM introduced VM/370 for the new hardware family

! " Virtual storage introduced

6

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Fast forward to the 1990s

! " Client/server is the architecture du jour

! " 1 app per server

! " Virtualized hardware available, but $$$

! " Disco: commodity OSes on scalable multiprocessors

! " Namely, IRIX

7

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Disruptive change

! " As with most ideas from academia in the late 1990s...

! " N faculty members + M students + venture capital = $$$

! " And VMware was born

8

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Old model: traditional x86 architecture

>"Operating system and hardware tightly coupled

>"Applications often interfere with each other

>"Expensive resources are underutilized

9

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

“New” model: virtual machines

>"Separate OS and hardware – break hardware dependencies

>"Manage OS and application as single unit by encapsulating them in VMs

>"Strong fault and security isolation

>"Standard, hardware independent environments can be provisioned anywhere

>"Flexibility to choose the right OS for the right application

>"Different from emulation. Instructions mostly executed by physical hardware.

10

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Competition heats up

2003: Xen

2005: Parallels, Solaris containers

2005/2006: Intel and AMD add VT extensions

2007: KVM, Sun logical domains

2008: Microsoft Hyper-V

11

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Platform Focus Infrastructure Abstraction

High Availability Dynamic

Resource

Scheduling vShield Zones

vNetwork Distributed

Switch Storage vMotion

From solution to platform

Key Benefit = Consolidation

Early Generation Focus Multiple Apps per Machine

Key Benefit =

Dynamic, Flexible Infrastructure

vMotion

12

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Wild claim?

! " All the good ideas for virtualization up until 2003 came from the mainframe

! " The good ideas since then have come from VMware

! " (Xen had some too)

! " Without VMware driving the state of the art, the mainframe probably would be dead today

13

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

! " The problem: A rare timing dependent bug

! " Race conditions, deadlocks, etc.

! " Could occur only 1 in 1000 times

! " Exceedingly painful to debug

! " Test test test…crash – debug a little

! " Test test test…crash – debug a little

! " Solution: Replay execution with the exact same timings each time. But how?

Record and replay

14

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Storage I/O

! " Latency depends on caching, disk positioning

Network I/O

! " Timing dependent on other machines, traffic

! " Other machines may not be present during replay, won’t be in same state as before

User I/O

! " Keyboard, Mouse, etc depends on humans

Non-determinism

15

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Recording

VMware is the hardware

! " Hypervisor can record any external events

! " Complete control over when events are visible to the guest OS & applications

All events happen on instruction boundaries

! " Log events with instruction counter value

! " Well, not really, but close.

16

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Application - debugging

Debugging

! " Reproducible bugs

! " Mobile bugs

! " Zip up the statelog and snapshot state, mail your bug to the developers

! " Reverse execution debugging

! " Revert to snapshot, play forward to desired point

! " Gives illusion of (slow) reverse execution

17

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Applications – continuous availability

Goal: Seamless failover

Primary machine

! " Records a state log of its execution

! " Sends each entry to the secondary machine

Secondary machine

! " Replays primary’s state log in real time

! " If primary fails, simply “go live”

! " Secondary has become the primary

18

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Applications – continuous availability

Goal: Seamless failover

Primary machine

! " Records a state log of its execution

! " Sends each entry to the secondary machine

Secondary machine

! " Replays primary’s state log in real time

! " If primary fails, simply “go live”

! " Secondary has become the primary

19

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Where it’s going

! " Appliances/vApps

! " Mobile virtualization

! " Virtual desktops

! " Cloud computing

20

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Appliances/vApps

! " Based on Open Virtualization Format

! " A DMTF standard

! " Self-contained application

! " Disks + metadata

! " N-tier apps in a single package

21

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Attach policies

22

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Security

23

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Mobile virtualization

24

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Virtual desktop infrastructure

Common Thread: solutions targeted at enabling centralized management and control of data, image and applications

Multiple alternative computing options emerging:

25

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Why server-based desktop virtualization?

! " The need for “access anywhere” with increasing

numbers of remote workers and offshoring.

! " The promise of operating cost reductions

! " Longer hardware cycles

! " Fewer client-side visits

! " Increased uptime

! " Centralized management = control

! " Centralized data = security

26

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

VDI architecture

27

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

VDI architecture (2)

28

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

The shift

Mainframe

+ Centralized mgmt

+ Secure

- Limited access

- Inflexible

- Costly

+ Distributed CPU utilization

+ Added flexibility

- Complex / costly to deploy & manage

- Not secure

- Not efficient

Client/Server + Simple to deploy

and manage

+ Broader access

+ Scale

- Limited flexibility

- Limited efficiency

- Not secure

Web + Frictionless deployment

+ Simplified mgmt thru abstraction

+ On-demand scale

+ Unparalleled flexibility

+ Secure

+ Highly efficient

“Cloud”

29

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Acknowledgements

! " Julia Austin

! " Steve Herrod

! " Carl Waldspurger

! " Eric Newcomer

30

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

vCloud API coffee talk

Tomorrow, 9/16 at noon

http://vmware.com/go/vcloudapi

31

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Q&A

Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved. Copyright © 2009 Kyle Smith and VMware, Inc. All rights reserved.

Further questions?

Send email to kmsmith@vmware.com

top related