datacenter optimization server virtualization
TRANSCRIPT
Datacenter Optimization Server Virtualization
Dirk Holzwarth
Alstom
Overview
The way to the Virtualisation
Present Situation
“Single Point” of Administration
The Challenge
The Workflows
ALSTOM Core Business
Rail Transport
Power
ALSTOM Power Turnkey Power Plants
Coal Handling
BoilerFeedwaterCondenserPreheater
Fly Ash Handling
ESP
Turbogroup(Turbine & Generator)
Transformer
E&C Switchyard
(T&D) Switchboards
(LV,MV)
ALSTOM Transport
IT at ALSTOM
Run as an internal business since 2001
ITIL processes adopted for service delivery
Delivering year on year cost reduction
Service in three regionsAmericaNorth EuropeSouth Europe
Key Figures
14 Countries
37,000 Desktops
2995 Servers
2494 Intel Servers1763 Physical / 731 Virtual
1,200 Staff
The way to the Virtualisation
Server Sprawl
Pressure to reduce operating costsMany physical locationsApplications requiring dedicated serversLow utilisation of existing server estate
12% CPU utilisation across 1,300 serversTime to provision new infrastructure
ProcurementCommissioning
Changing business requirements
Server Virtualisation Solution
Virtualisation with VMware provided demonstrable benefits following a 6 week evaluation in 2002Adopted as primary Intel platform for Windows/Linux workloads
Infrastructure Benefits
Fewer SAN connectionsFewer Network portsLess wasted disk spaceLower server costsFewer datacenter resources
Process Benefits
Server provisioning < 1hrStaff focus on value add activitiesSimplified recoveryLower costs overall
Server Virtualisation
ESXLotus Notes
Active Directory
Altiris
NetIQ App Mgr
alstom.com
intranet
Citrix
LiveLink
ESX
ESX
ESX
GSX
GSX
GSXLotus Notes
Active DirectoryDHCP/DNS
Altiris PS
Lotus NotesActive Directory
DHCP/DNSAltiris PSFile/Print
SAN
VirtualCenter
Datacenter Remote Sites
Remote Site Infrastructure
Objective to simplify the infrastructure and physical presenceSingle server/cluster running all site servicesTechnology
VMware GSX ServerHP Proliant DL380
Supporting sites of up to 300 usersFully manageable remotely
Admin & supportServer installs or rebuilds
Present Situation
Facts & Figures (Northern Europe)
625 Guest VM’s33 SMP
24 ESX Hosts5 x 2 CPU
17 x 4 CPU2 x 8 CPU
38 GSX Hosts13 x 1 CPU Single Server21 x 2 CPU Single Server2 x 1 CPU Package Cluster2 x 2 CPU Package Cluster
Facts & Figures (Northern Europe)
625 Guest VM’s33 SMP
24 ESX Hosts5 x 2 CPU
17 x 4 CPU2 x 8 CPU
38 GSX Hosts13 x 1 CPU Single Server21 x 2 CPU Single Server2 x 1 CPU Package Cluster2 x 2 CPU Package Cluster
41 % of all Intel Servers
in the Region North
are already Virtual
Facts & Figures (Northern Europe)625 Guest VM’s
33 SMP
23 ESX Hosts6 x 2 CPU
11 x 4 CPU6 x 8 CPU
36 GSX Hosts11 x 1 CPU Single Server21 x 2 CPU Single Server2 x 1 CPU Package Cluster2 x 2 CPU Package Cluster
1
10
100
1000
Jun 05
Jul 0
5Aug 05Sep
05
Okt 05
Nov 05Dez 0
5
Jan 0
6
Feb 06
Mrz 06
Apr 06
Mai 06
Jun 06
Jul 0
6Aug 06Sep
06
Okt 06
Guest VM`sSMPESX HostsGSX Hosts
Facts & Figures (Northern Europe)
Guest Systems (GSX & ESX HOSTS)Usage of the 625 Guest VM’s CPU Memory• Average over all 6% 20%• Average top 10% 63% 93%
Uptime of the 625 Guest VM’s• Average over all 92 days• Average top 10% 360 days (max. 361 days)
Facts & Figures (Northern Europe)
GSX Host SystemsUsage of … CPU Memory • Average over all 17% 65%• Average top 10 38% 91%
Uptime of the GSX Hosts• Average over all 14 days• Average top 10% 24 days (max. 34 days)
Facts & Figures (Northern Europe)
ESX Host SystemsUsage of … CPU Memory • Average over all 37% 12%• Average top 10 60% 17%
Uptime of the ESX Hosts• Average over all 81 days• Average top 10% 161 days (max. 361 days)
“Single Point” of Administration
Common VCC Region North
One centralized tool – VirtualCenter - for a decentralized administrationAdministrators of different countries working with one tool and can support each other
Virtual CenterManagement Console
Common VCC Region North
Not only the sites in Europe are managed, also the construction sites orbranch offices in e.g. Argentina, Egypt, Malaysia or Bulgaria Common look and feel over the whole structure
The Challenge
The Challenge
In Alstom, all IT development is done once in each Region and documented in a so called Ready-to-deploy-kit (R2DK)
All ESX- and GSX- Hosts are installed in the same way!
The Guest Servers are not installed in the same way everywhere!
The Processes for the installation of the Hosts are the same, but not for the service!
Targets for 2006 is, to standardise all work around the VirtualCenter
The Challenge
In 2005 we had some optionsDo all installation with a common, process based installation guide • Too complicated to do it manually• Too costly in the service• Administrators will not use the manual approach every time
Using unique templates• Even with templates different installations because of different environments
(e.g. not everywhere ADS)• Very cost intensive to keep all the templates up to date (Patch level;
Antivirus)
Automatic installation by scripts• Even with the knowledge of the software deployment tools ALTIRIS and
ENTEO, still very complicated• The software distribution comes after the deployment of a server and is
usually decentralise
The Challenge
At VMWorld 2005 we drew the attention of a Swiss company whichhas developed a workflow software around the VirtualCenter
After a one week evaluation, Alstom purchased the product VS-O fromdunes technologies SA
The first two challenges where tomake a internationally automated provisioning of ESX guest serversmake a process based backup (consistent, while the server is running) and restore of guest servers
The Workflows
The Workflows
Automated manipulation from VMs on ESX ServersWEB front-end for VM Server requestStandardizes Templates Country specific changes over WMIWorkflow dispatching over Lotus Notes
All based on VS-O from dunes technologies SA
The Workflows
What is VS-O? Virtual service orchestration software solution for VMware VirtualCenter
Integrated development platform based on open standards
Enables rapid design, validation and integration of businessprocesses into the virtualized datacenter
Integration of virtual infrastructure as well as physical systems
The Workflows
Customized Solutions for
ProvisioningMigrationBackupFailoverDisaster Recovery Monitoring
Enhanceable withUser-activated WorkflowsEvent-driven PoliciesScheduled Tasks
Process Automation for Virtual Infrastructure
Automation Engine
Dunes Library
VMware
Backup DisasterRecovery
Consultant Library
Enterprise Library
Provisioning
Effective Solutions forServer ConsolidationBusiness ContinuityBusiness AgilityDevelopment & Test
The Workflows
Overview
Development Process
For introduction of a workflow we use the Release Management based on ITIL
Each developer has own development environment built up with VMware Workstation. In the development environment, the workflows are developed and the first tests are made.
Before going to production, we test the new workflows in our test environment. This is a non-production copy of our standard service environment.
After successfully testing we apply the workflows to production environment.
Development Testing Service
Testing Environment
Testing environment is replica of production environment. This is necessary to do testing that is close to real-life .That means, we can do in production, what we can in testing environment.
Testing environment equipment:
VirtualCenter 1.4
2 x ESX Server 2.5.3
SAN with about 500GB
VirtualCenter 2.0
2 x ESX Server 3.0
SAN with about 460GB
Microsoft W2k3 Cluster for use with GSX / VMware-Server
To have a separate test environment is very important while using automated workflows:
You can do everything with workflows.
Build up, Change and Destroy !
Testing Environment
SAN Storage
GSX / VMware ServerW2k3 Cluster
VI3 / ESX3 Server
ESX2 Server
VSO-Client
Here you have a look at the VSO-Client start window
VSO-Client
Start a Workflow
Backup Workflow
Scheduled and manual hot-backups of virtual machinesManageable over VS-O Client or Webbrowser
Provisioning Workflow
Target:People of the IT-Department should have an easy way to request new
machines with only supplying a few parameters:
Operating system typeVirtual Machine configuration (RAM, disk space)IP Configuration, Server name, domainLocation
Provisioning Workflow
Solution:Create basic templates for each supported OS. The templates include the basic configuration and applications necessary for all countries at ALSTOM, e.g. Microsoft patches, virus scanner, support tools, ...Build a “Custom configuration package” for each countryThe “Custom configuration package” includes all country specificsettings and configurations, e.g. EPO Server, SNMP Settings, ...These settings are applied within the workflow over WMI to the new virtual machine, after the basic template is deployed. Develop a workflow in VS-OThe workflow in VS-O provides the GUI (VS-O Client, Webbrowser) for the users and manages the provisioning of the new machine.
Provisioning Workflow
ITInfrastructure
Request
FinanceApp Team
SalesApp Team
Server Request:NeedsTimeBudget
Approve
IT Security IT Manager
Server Approval:SecurityTimeBudget
PlanIT SpecialistIT Manager
Server Planning:CapacityTimeBudget
Supply
IT Operator
IT QA
Provision
Provisioning Workflow
Overview of deployment workflow:
Provisioning Workflow
Example of provisioning workflow: VM request
Provisioning Workflow
Email to approver:
Provisioning Workflow
Approval in Workflow:
Provisioning Workflow
Workflow in client view:
Q & A
Presentation Download
Please remember to complete yoursession evaluation form
and return it to the room monitorsas you exit the session
The presentation for this session can be downloaded at http://www.vmware.com/vmtn/vmworld/sessions/
Enter the following to download (case-sensitive):
Username: cbv_repPassword: cbvfor9v9r