Train for trainers – open source in the cloud / Warsaw, 2013 /

Thomas ContéWindows Azure evangelist

@tomconte

tconte@microsoft.com

Linux on Windows Azure #ms_oss

Linux service offering

Distributions

We supportSUSE SLES 11 SP2, SP3Open SUSE 12.3CentOS 6.3 by OpenLogic* Ubuntu 12.04, 12.10, 13.04, 13.10Oracle Linux 6.4.0.0.0

Specific versions are endorsedIntegration ComponentsTesting and validation by partnersBring other variants at your own risk**

*Image provided by OpenLogic based on CentOS 6.3**Integration Work will be needed

Additional Partners

Our partners allow you to easily create images:Customize and mange Images or your own with :• Opscode: Chef• Canonical: Juju• ScaleXtreme• RightScale• Bitnami

Linux Offering Summary

Linux as a first class citizen in AzureWe will focus mainly on Enterprises and ISVs but will also reach out to the community

Open Sourcing critical componentsDocumenting API

We will offer both Community and Commercial Distributions You will be able to buy support for the commercial distributions (GA only)

IaaS and Linux

What Does Persistent Mean?

Persistent OS Disk…and highly durable

Virtual Machine

Windows Azure StorageWindows Azure Storage (Disaster

Recovery)

What Does Persistent Mean?

Persistent OS Disk…and highly durable

Virtual Machine

Windows Azure StorageWindows Azure Storage (Geo-Replication)

Virtual Machine

The Technology to Provision a Platform Image

Portal (API)HyperVisor

VM

OS

Data

Cache

ISO

Platform Storage Repository

Customer’s Storage Account

Stock Images

Provisioning Repository

Unattend

Add Server Hostname Password …

Storage API

OS Disk

Data Disk

Linux Built on Persistent VM Role

Windows Azure Virtual Machines

Linux Windows

WA Linux Agent Windows Setup

IC Drivers

CertsSSHKeys

The Technology to Provision a Linux Platform Image

Portal (API)HyperVisor

VM

OS

Data

Cache

ISO

Partner Repository

Customer’s Storage Account

Stock Images

Provisioning Repository

Unattend

Add Server Hostname Password …

Storage API

OS Disk

Data Disk

Linux Agent

ICs

Windows Azure Linux Agent

HV1 HV2

VM

Service Management APIWindows Azure provided DNS

Host1Host

2

Provisioning• Gallery Experience• Third Party Tool Provisioning• Bring Your Own Linux• Provision from Partner Repository

Provisioning

Demos

Gallery Experience

Lowest barrier of entry Partner created images Click through provisioning

Leverage portal to:Provide Images (VHDs that include ICs and agent)Associate SSH KeysCollect configuration information Drive provisioning

Third Party Tool Provisioning

Easily Customize a partner imageEase the creation of custom images, configuration and resources Select packages to include in ImageTool will include the appropriate ICs and AgentTool will drive provisioning for Customer if desiredCurrently Only SUSESuse Studio: Open SUSE or SLES

VM VM2

Service Management API

Azure Storage

Tool Based Provisioning

Customer Personal Image Repository

Customer Storage Account

VHD

VHD

PORTAL

VHD

Bring Your Own LinuxExpert Customers that want to tweak ,Customize, create images based on supported* distributionsCustomer will

Use Hyper-V to install DistributionAdd ICs and AgentGenerate the VHDCapture configurationGenerate resourcesUpload and start instance using:

Linux Native: Tools, libraries, scripts

Linux Integration Services:Run Linux on Hyper-V• Goals

• Linux guests can use same Hyper-V functionality as Windows guests• Competitive with functionality and performance of other hypervisors

• Recent development work in Linux kernel for Hyper-V• VMBus protocol updates to match WS 2012 Hyper-V• Dynamic memory• 2D synthetic video driver• File system consistent VM backups• Online VHDX resize• Synthetic fibre channel driver

• Development work is somewhat asynchronous with major Microsoft product releases

LIS Distribution & Support

Microsoftdevelopers

Customer servers w/Hyper-

V

MSdownloadcenter

LIS for Hyper-V

Customer installs LISSupport

issues flow in reverse direction

Linux kernel main

Linux community

LIS for Hyper-V

Distro vendors

Linux distro w/LIS . . . .

Linux Integration Services• Key Linux vendors now including LIS in standard distros

• Support strategy• Vanilla Linux questions: Contact the Linux vendor• Issues running Linux on Hyper-V: Contact the Linux vendor or

Microsoft

Distro Version LIS Availability

Red Hat Enterprise Linux5.7, 5.8, 6.0-6.3 Download LIS from Microsoft

5.9, 5.10, 6.4 LIS built-in and certified by Red Hat

SUSE Linux Enterprise Server

11 SP2, SP3 LIS built-in

CentOS5.7, 5.8, 6.0-6.3 Download LIS from Microsoft

5.9, 5.10, 6.4 LIS built-in

Ubuntu Server 12.04, 12.10, 13.04, 13.10

LIS built-in

Debian 7.0 LIS built-in

Oracle Linux 6.4 LIS built-in

VM

Service Management API

XStore

Customer Personal Image Repository

Customer Storage Account

VHD

VHD

Bring Your Own Linux

PORTAL

VHD

Provision From Partner RepositoryPartner Makes Image AvailablePartner Creates and tests an imagePartner makes image available in certain regionsPartner publishes image locationCustomer Consumes Partner ImageCustomer uses Linux Command line toolsCustomer creates a image in its local repository from Partner ImageCustomer creates VMs using the new private Image

Top Scenarios for Linux Partners• Creating a Partner Supported Image• Creating a Third Party Provisioning Tool• Creating and Managing Linux Images for Customers

Creating a Partner Supported ImageCreate ImageSame Bring your own Linux operations

Register as a partner Platform Image: Small, select number of partnersIndependent distribution: Publish image in your own repository

Publish ImageRegister the image with the platform ( ie. Distributions) Distribute that image from your repository

Support that image*

Creating a Partner Supported Image

Partner Personal Storage Account

Azure Platform

Customer VM

Customer Personal Storage Account

Partner Registration

VHD

VHD

Creating a Third Party Provisioning ToolUse a Supported DistributionProvide or leverage a distribution that is supportedInclude value add components (LIS, Agent , Stack)Optionally allow image customization Create an experience to allow customers to create VHDsInterface with the service management APICorrectly retrieve and store user credentialsUpload image, configuration and resourcesCreate and start instances

Creating and Managing Linux Images for CustomersSame Bring your own Linux OperationsUpload and publish image to Customer’s Personal RepositoryOr

Instantiate and customize a Platform Image Manage Images and Instances

Customer Personal Storage Account

Creating and Managing Linux Images for Customers

Azure Platform

Customer VM

VHD

VHD

Platform Image Repository VHD

Diagnosing and Troubleshooting• How to work with Linux VMs• Performance Considerations• Common Issues• Migrating an On Premise Image to the Cloud• Debugging a Malfunctioning VM in the Cloud • Debugging Linux from within Azure

Performance Considerations• Two Types of Persistent Disks:

• OS Disks• Data Disks

• Local Resources• Local HD partition ( Ephemeral )

• Right tool for the Job• Right VM Size= Right Amount of

Resources• Data Intensive Applications = Data

Disk• Fast Ephemeral Data = Local Disk

Common Issues• Deployment fails

• SSH key type• Resources Available• Known Issues*

• BYOL• Incorrect LIS drivers : Hyper-V boot problems• Agent not present: Provisioning never ends• Incorrect Agent dependencies

• Cannot login to VM: • End point issues , firewall issues

Migrating a Local Machine To the Cloud• Creating a Linux VM:

• LIS Drivers• Agent Code

• How to test locally• Hyper-V vs RDOS

• What you cannot test locally• Network• Storage• Provisioning

Debugging a Linux VM in the Cloud• Backup

• Copy Blob ( snapshot like)• Failed VM

• Delete VM and keep VHD• Mount VHD File • Inspect logs and correct issues• Loopback composition

• Request help• Forum Post ( preview)• Phone call (GA)• Escalation process

Debugging Linux from within AzureWhat can Azure support see and do• Platform Error logging:

• Hyper-V Errors: MDS logs just for errors• All VM related events logs

• Debugging Unreachable Linux VMs• Access VM• Collect

• Agent Logs• OS dumps

Homework• azure vm create --ssh --location "West Europe" mytestvm

b39f27a8b8c64d52b05eac6a62ebad85__Ubuntu-13_10-amd64-server-20131113-en-us-30GB tom 'Pass123!'

• (log in to vm)

• apt-get install nodejs• apt-get install npm• npm install something• waagent -deprovision

• azure vm shutdown mytestvm• azure vm capture --delete mytestvm mytestimage

36

© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.