ibm reference configuration for microsoft private cloud: … · 2016-08-11 · ibm reference...

62
ibm.com/redbooks Redpaper Front cover IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich Marco Rengan Scott Smith William Watson Michael Wilcox Understand the components of the IBM Reference Configuration Configure an approved Microsoft Private Cloud Fast Track solution Follow preferred practices to create the solution

Upload: others

Post on 16-Mar-2020

13 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

ibm.com/redbooks Redpaper

Front cover

IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Eric JohnsonPeter Kisich

Marco RenganScott Smith

William WatsonMichael Wilcox

Understand the components of the IBM Reference Configuration

Configure an approved Microsoft Private Cloud Fast Track solution

Follow preferred practices to create the solution

Page 2: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich
Page 3: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

International Technical Support Organization

IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

December 2011

REDP-4828-00

Page 4: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

© Copyright International Business Machines Corporation 2011. All rights reserved.Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP ScheduleContract with IBM Corp.

First Edition (December 2011)

This edition applies to the IBM Reference Configuration for Microsoft Private Cloud.

This document created or updated on December 22, 2011.

Preparation for use: Before using this information and the product it supports, read the information in “Notices” on page v.

Page 5: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Contents

Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .vTrademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vi

Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . viiThe team who wrote this paper . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . viiContacts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . viiiNow you can become a published author, too! . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . viiiComments welcome. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ixStay connected to IBM Redbooks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix

Chapter 1. Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1

Chapter 2. Architecture and component overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32.1 Architecture overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42.2 Component overview for the IBM Reference Configuration architecture . . . . . . . . . . . . 52.3 Rack and power for IBM Reference Configuration architecture . . . . . . . . . . . . . . . . . . . 6

Chapter 3. Host compute and production nodes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73.1 IBM System x3650 M3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83.2 Compute/production node cluster . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103.3 Management node for System Center Virtual Machine Manager . . . . . . . . . . . . . . . . . 103.4 IBM System x3550 M3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113.5 Active Directory server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12

Chapter 4. Storage for the IBM Reference Configuration architecture . . . . . . . . . . . . 13

Chapter 5. Networking, connectivity, and scaling out . . . . . . . . . . . . . . . . . . . . . . . . . . 195.1 Networking overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 205.2 Connectivity for the IBM Reference Configuration architecture . . . . . . . . . . . . . . . . . . 225.3 Scale-out methodology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23

Chapter 6. Operating system and management software . . . . . . . . . . . . . . . . . . . . . . . 256.1 Operating system software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26

6.1.1 Windows Server 2008. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 266.1.2 Virtual machine guests with Hyper-V . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 276.1.3 Private cloud operational software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27

6.2 Management software. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 276.2.1 IBM Hardware Management Pack for Microsoft System Center Operations Manager

2007 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 286.2.2 IBM System Storage (XIV) Management Pack for Microsoft System Center

Operations Manager 2007 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 286.2.3 System Director agent . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29

Appendix A. System x rack and power options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31

Appendix B. Parts lists . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33Compute/production node parts list . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34Management server parts list . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34Active Directory server parts list. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35

© Copyright IBM Corp. 2011. All rights reserved. iii

Page 6: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Appendix C. Ordering options for the IBM XIV Storage System . . . . . . . . . . . . . . . . . 37Capacity on demand (CoD) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38Sample XIV system parts lists . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39

Appendix D. Network ordering information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41

Appendix E. Host operating software ordering and parts. . . . . . . . . . . . . . . . . . . . . . . 43Windows Server 2008 R2 Datacenter Edition 2-CPU . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44Management server parts list for Windows Server 2008 R2 Enterprise 10 CAL . . . . . . . . . 44Active Directory server parts list for Windows Server 2008 R2 Standard . . . . . . . . . . . . . . 45Ordering information for additional Microsoft components. . . . . . . . . . . . . . . . . . . . . . . . . . 45Software ordering summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46

Related publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47IBM Redbooks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47Online resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47Help from IBM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48

iv IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 7: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Notices

This information was developed for products and services offered in the U.S.A.

IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM product, program, or service.

IBM may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not give you any license to these patents. You can send license inquiries, in writing, to: IBM Director of Licensing, IBM Corporation, North Castle Drive, Armonk, NY 10504-1785 U.S.A.

The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you.

This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice.

Any references in this information to non-IBM websites are provided for convenience only and do not in any manner serve as an endorsement of those websites. The materials at those websites are not part of the materials for this IBM product and use of those websites is at your own risk.

IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you.

Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.

This information contains examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental.

COPYRIGHT LICENSE:

This information contains sample application programs in source language, which illustrate programming techniques on various operating platforms. You may copy, modify, and distribute these sample programs in any form without payment to IBM, for the purposes of developing, using, marketing or distributing application programs conforming to the application programming interface for the operating platform for which the sample programs are written. These examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability, serviceability, or function of these programs.

© Copyright IBM Corp. 2011. All rights reserved. v

Page 8: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Trademarks

IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. These and other IBM trademarked terms are marked on their first occurrence in this information with the appropriate symbol (® or ™), indicating US registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at http://www.ibm.com/legal/copytrade.shtml

The following terms are trademarks of the International Business Machines Corporation in the United States, other countries, or both:

BladeCenter®BNT®IBM®

Redbooks®Redpapers™Redbooks (logo) ®

System x®XIV®

The following terms are trademarks of other companies:

Intel Xeon, Intel, Intel logo, Intel Inside logo, and Intel Centrino logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.

Microsoft, Windows, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.

Other company, product, or service names may be trademarks or service marks of others.

vi IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 9: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Preface

The IBM® Reference Configuration for Microsoft Private Cloud is a comprehensive, ready-to-use, easy-to-manage, high-performance, and ultra-reliable computing solution using Microsoft Hyper-V. The offering consists of IBM approved and tested servers, storage, and networking components which provide best-of-breed technology from entry level to the largest private cloud infrastructures.

This IBM Redpapers™ publication provides an overview of the Reference Configuration and a detailed parts list for IT teams responsible for integrating and deploying a private cloud infrastructure. It describes the process of setup, installation, and configuration to enable quick and easy deployments for a private cloud in a data center. This offering features an eight-node Microsoft Private Cloud Fast Track solution based on IBM System x3650 M3 servers with the IBM XIV® Storage System.

This paper is intended for clients who want to learn about the IBM reference architecture for the Microsoft Private Cloud Fast Track program and better understand how all of the components work together to form an end-to-end private cloud solution. Sample ordering configurations and ordering considerations are addressed.

This paper is a partner to IBM Reference Configuration for Microsoft Private Cloud: Implementation Guide, REDP-4829.

The team who wrote this paper

This paper was written by a team of specialists from around the world.

� Eric Johnson� Peter Kisich � Marco Rengan � Scott Smith � William Watson � Michael Wilcox

Thanks to the following people for their contributions to this project:

Karen LawrenceLinda RobinsonDavid WattsIBM Redbooks®

David HartmanJim MeyerIBM

Bryan HokeSteven TongBrocade

© Copyright IBM Corp. 2011. All rights reserved. vii

Page 10: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Special thanks to Avanade Inc. and especially Pat Cimprich for their contributions to the creation of this paper. Avanade spent many hours evaluating reference configuration components, running performance tests, assessing component sizings, and discovering opportunities for automation and integration within the Microsoft System Center Suite. Avanade is an IBM Business Partner and provides integration and customization services for cloud and virtualization projects.

Contacts

For more information or to place an order, contact your IBM sales or IBM Business Partner representative.

Avanade is an IBM Business Partner and provides integration and customization services for cloud and virtualization projects. Its website is here:

http://www.avanade.com

For additional information, send an email to Avanade directly at [email protected] to get started.

Now you can become a published author, too!

Here’s an opportunity to spotlight your skills, grow your career, and become a published author—all at the same time! Join an ITSO residency project and help write a book in your area of expertise, while honing your experience using leading-edge technologies. Your efforts will help to increase product acceptance and customer satisfaction, as you expand your network of technical contacts and relationships. Residencies run from two to six weeks in length, and you can participate either in person or as a remote resident working from your home base.

Find out more about the residency program, browse the residency index, and apply online at:

ibm.com/redbooks/residencies.html

viii IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 11: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Comments welcome

Your comments are important to us!

We want our papers to be as helpful as possible. Send us your comments about this paper or other IBM Redbooks publications in one of the following ways:

� Use the online Contact us review Redbooks form found at:

ibm.com/redbooks

� Send your comments in an email to:

[email protected]

� Mail your comments to:

IBM Corporation, International Technical Support OrganizationDept. HYTD Mail Station P0992455 South RoadPoughkeepsie, NY 12601-5400

Stay connected to IBM Redbooks

� Find us on Facebook:

http://www.facebook.com/IBMRedbooks

� Follow us on Twitter:

http://twitter.com/ibmredbooks

� Look for us on LinkedIn:

http://www.linkedin.com/groups?home=&gid=2130806

� Explore new Redbooks publications, residencies, and workshops with the IBM Redbooks weekly newsletter:

https://www.redbooks.ibm.com/Redbooks.nsf/subscribe?OpenForm

� Stay current on recent Redbooks publications with RSS Feeds:

http://www.redbooks.ibm.com/rss.html

Preface ix

Page 12: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

x IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 13: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Chapter 1. Introduction

IBM offers a powerful yet affordable cloud computing platform that can be rapidly deployed into multiple cloud environments for a variety of “on-demand” use cases and applications. The components incorporated into the IBM Reference Configuration for Microsoft Private Cloud architecture use leading-edge hardware technology, including advanced servers and storage from IBM along with Brocade and IBM networking products. This hardware, coupled with the latest Microsoft Self-Service Portal and Microsoft Hyper-V software versions, continues the tradition of delivering simple, easy-to-use solutions, incorporating the IBM System Director platform to provide a single pane of glass (SPOG) for setup, provisioning, management, and administration.

The IBM Reference Configuration architecture combines high-quality IBM System x® servers and best-of-breed networking hardware with robust tools and integrated software to create an innovative, comprehensive, and simplified cloud-computing offering. IBM reference architecture for Hyper-V Cloud Fast Track maximizes performance per square foot of data center space, while lowering total cost of ownership for proposed cloud solutions. This ensures that both mid-market businesses and enterprise data centers can reap cloud-computing benefits without a large IT staff or initial investment barriers.

The IBM Reference Configuration architecture is a pre-tested, end-to-end cloud solution that is ready to deploy. The following technologies are tested by IBM and approved as part of the Microsoft Private Cloud Fast Track program:

� IBM System x rack servers, combining high performance with reliability and including advanced predictive failure technology

� Microsoft Private Cloud Fast Track software, providing the latest Microsoft virtualization and cloud management software

� IBM Systems Director Upward Integration Modules (UIMs) and Performance and Resource Optimization Tips (PRO Tips), adding enhanced management when using Microsoft System Center

� Brocade top-of-rack switches and adapters, adding converged connectivity to storage and networking

� IBM XIV Storage System automated configuration, data protection, and upgradeability, providing greatly simplified management with tier one storage features and performance

1

© Copyright IBM Corp. 2011. All rights reserved. 1

Page 14: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

The IBM Reference Configuration architecture extends the inherent benefits of cloud infrastructures by further reducing cost of hardware, power, cooling, and space requirements while enhancing operational efficiencies. Important considerations such as capacity needs can be predefined within the integrated management tools, simplifying planning of the private cloud and VM infrastructure. Microsoft Self-Service Portal software is key to this rapid and automated VM deployment capability.

Microsoft Hyper-V virtualization technology and flexible licensing helps the IBM Reference Configuration architecture to take advantage of the cost savings of virtualization through Windows Server 2008 R2 SP1 with Hyper-V. Features including Live Migration and Cluster Shared Volumes provide the features dynamic virtual infrastructures require to maximize performance and efficiency in the data center.

2 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 15: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Chapter 2. Architecture and component overview

This chapter highlights the architecture of the IBM Reference Configuration for Microsoft Private Cloud solution. It includes the following sections:

� Architecture overview� Component overview for the IBM Reference Configuration architecture� Rack and power for IBM Reference Configuration architecture

2

© Copyright IBM Corp. 2011. All rights reserved. 3

Page 16: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

2.1 Architecture overview

The IBM Reference Configuration for Microsoft Private Cloud offers an architecture that can address the data and compute needs of data centers ranging from the small branch office to the highly scalable enterprise. Each selected configuration is a predefined, robust solution which provides necessary compute and application resources available quickly and efficiently.

Each IBM cloud reference configuration is a tested and Microsoft Private Cloud Fast Track certified architecture, an end-to-end solution combining all components configured in a modular, extensible, flexible, and scalable rack. This solution provides dynamically flexible compute resources and ease of deployment, including administration, support, expansion, and, most importantly, affordability.

To support changing business needs, cloud solutions must have the ability to dynamically add or reduce resources such as memory and disk storage capacity. The IBM Reference Configuration architecture supports dynamic scaling of compute resources. Combined with the Microsoft Self-Service Portal, requests can be created autonomously. The following key components enable this flexibility:

� IBM System x3650 M3 management and host servers and a x3550 M3 active directory server are optimized to meet the virtualization management and advanced workload demands of private cloud data centers. The x3650 M3 servers are 2U servers and can be substituted with the x3550 M3 1U server to provide more density per rack.

� Brocade 10 Gbps converged networking components form the backbone for data and network connectivity. The combination of high-performance adapters and low-latency cut-through switches enables the high-speed infrastructure that is critical for resource utilization and load balancing within the cloud.

� The IBM XIV Storage System offers linear scalability, simplified configuration and management, high performance, and automation.

The structural elements of the offering consist of a set of functional groups, as discussed in this paper.

The IBM reference architecture for Microsoft Private Cloud Fast Track structural components has been selected primarily to contribute a combination of performance, reliability, and value. As consolidation of compute resources increases, reliability and high availability are paramount when offering cloud services. These components provide the up time and fault tolerance essential to any successful cloud deployment. Along with reliability, these components have been selected for businesses of all sizes, from mid-market to large enterprises. IBM is uniquely positioned to provide leading-edge technologies at a mainstream price point for the wide range of IBM Reference Configuration architecture deployments.

4 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 17: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

2.2 Component overview for the IBM Reference Configuration architecture

The IBM Reference Configuration uses Microsoft software, IBM servers and storage, and Brocade networking hardware, including the IBM System x3650 M3 for server production and management nodes, IBM System x3550 M3 for Active Directory server, and the XIV system.

As shown in Figure 2-1, the following hardware building blocks make up the IBM Cloud Reference:

� Networking components � Management nodes� Compute/production nodes� Storage system

The software stack includes the following components:

� Microsoft Windows Server 2008 R2 SP1� Microsoft System Center Virtual Machine Manager (SCVMM) 2008 R2 SP1� Microsoft System Center Operations Manager (SCOM) 2007 R2 SP1� SQL Server 2008 x64 SP1 Standard Edition� Microsoft Self Service Portal 2.0 (SSP) 2.0� Forefront Security Client� IBM System Director Platform Agent� IBM System Director System Center UIM

Figure 2-1 Major components of the IBM Reference Configuration for Microsoft Private Cloud Fast Track

IBM B32 10 Gb Converged Switch

IBM B24Y 1 Gb Switch

IBM x3550 M3 – Active Dir

IBM x3650 M3 - Management

IBM x3650 M3 - Production IBM XIV Storage Platform

Chapter 2. Architecture and component overview 5

Page 18: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Table 2-1 outlines the configuration required for IBM Reference for Microsoft Private Cloud.

Table 2-1 IBM cloud reference configuration summary

2.3 Rack and power for IBM Reference Configuration architecture

IBM rack and power infrastructure offerings are custom designed for IBM System x servers and provide the following benefits:

� Improved data center efficiency� Increased power efficiency� Increased space efficiency (avoiding over-design)� Lower cost through better data center utilization� Improved IT availability� Improved uptime� Opportunity to act before downtime impacts business� Matching utilization, power resources, and capacity planning

To provide availability demanded in consolidated virtual infrastructures, data centers require rack and power components that securely manage and control power resources, servers, and appliances, maintain the highest levels of IT availability, and drive operational efficiencies.

IBM offers many such rack and power options:

� Three new 1200 mm deep equipment racks, including 47U tall racks and 42U dynamic (ship-loadable) racks.

� An IBM lineup of optional uninterruptible power supply (UPS) units, including rack-mounted and tower units supporting voltages and configurations not previously available, with new 1500, 2200, 3000, and 6000 volt-ampere (VA) units.

� A new line of 0U strip power distribution units (PDUs) designed for tool-less installation in the new racks. These PDUs have 24 outlets for today’s server-dense rack installations.

� New Local and Global Console Managers that support unique cabling options (“conversion options”) to enable chaining up to 1024 managed devices from a single console.

For cabling, power, and rack ordering information, see Appendix A, “System x rack and power options” on page 31.

Feature IBM Reference Configuration Components

Host server family x3650 M3

Active Directory server x3550 M3 (Optional)

Host CPU sockets/server 2

Number of Management hosts 2

Number of Production hosts 8

Number of production cluster cores 96

SAN family XIV

Range of VMs (estimated) 100-240

6 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 19: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Chapter 3. Host compute and production nodes

The IBM System x3650 M3 rack servers address current cloud business requirements while delivering the scalability to manage future growth. Key capabilities of these servers include performance, reliability, and simplified management.

The compute/production nodes are the processing elements for the IBM Reference Configuration for Microsoft Private Cloud. Virtualization technology in the Hyper-V hypervisor compute node resources emulate dedicated infrastructure even though it is shared among other processes, applications and business functions.

3

© Copyright IBM Corp. 2011. All rights reserved. 7

Page 20: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

3.1 IBM System x3650 M3

Built on the latest six-core Intel Xeon processor 5600 series, the IBM System x3650 M3 two-socket server offers a highly available, high-performance 2U platform for Windows Server 2008 R2 with Hyper-V. With integrated 6 Gbps RAID adapters and double the I/O performance, the x3650 M3 provides a resilient architecture that is well-suited for virtualization environments.

The Intel Xeon processor 5600 series expands the benefits of virtualization with innovations that boost performance, increase consolidation ratios, and enable servers of separate generations to be combined in the same virtualized server pool. The result offers more flexibility and a robust infrastructure with improved load-balancing, virtual machine failover, and disaster recovery capabilities.

IBM System x3650 M3 servers help provide a strong foundation platform for virtualized environments with large memory and I/O capacity to satisfy the high-speed processing and reliability requirements of running software in a virtualized cloud environment.

The following list provides a quick summary of the x3650 M3 features:

� Innovative, energy-smart 2U design that helps to lower operational costs.

� Up to two Intel Xeon 5600 series processors.

� Maximum of 18 DIMMs of DDR3 memory for up to 288 GB of memory.

� One 6 Gbps SAS RAID adapter.

� Support for four PCIe x8 2.0 adapter slots. An optional embedded hypervisor for managing virtual workloads is also supported.

� Up to 16 hot-swap HDDs with an internal storage capacity of 8.0 TB (using 2.5 inch hot-swap SAS or SATA drives. Alternatively, up to 16 solid-state drives (SSDs) are also available, offering up to 800 GB of storage.

� Enhanced systems management with an integrated management module and Unified Extensible Firmware Interface (UEFI), and software tools including ToolsCenter, IBM Systems Director, and Active Energy Manager.

� Best-in-Class RAS (highly redundant design, predictive failure analysis (PFA), light path diagnostics).

� Open architecture and common tools for quick and simple installation.

� Better serviceability with a highly scalable, flexible design that is easy to deploy, integrate, service, and manage.

8 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 21: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Figure 3-1 shows the front view of the IBM system x3650 M3 server.

Figure 3-1 The IBM System x3650 M3

Figure 3-2 shows the rear view of the x3650 M3 server.

Figure 3-2 System x3650 M3 rear view

For additional details about the x3650 M3, refer to the IBM System x3650 M3 Product Guide, available at the following address:

http://ibm.com/systems/x/hardware/rack/x3650m3/

Hot-swap2.5” HDDs

Statuslights

Pop-out lightpath diagnosticspanel

Opticaldrive

Videoport

PowerButton with sliding cover

USB 2.0ports

Light pathdiagnosticspanel release

Gb Ethernetports

USBports

Videoport

Serialport

Ethernetport for IMM

Status LEDs

Hot-swappower supplies

PCI Express adapter slots

Optional 3rd and 4th Gb Ethernet ports

Chapter 3. Host compute and production nodes 9

Page 22: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

3.2 Compute/production node cluster

The compute/production node cluster uses System x3650 M3 servers. The configuration uses eight nodes.

Each node in the cluster uses the following components:

� IBM System x3650 M3� Two Intel Xeon Processor X5670 6C 2.93 GHz 12 MB Cache 1333 MHz 95w� 96 GB RAM (made up of twelve 8 GB DIMMs)� One ServeRAID M1015 SAS/SATA Controller (battery not included)� Two IBM 73 GB 15K 6 Gbps SAS hot-swap disk drives� Two Brocade 10 Gb Dual Port Converged Network Adapters

The compute/production node cluster components can be ordered using the parts list in Appendix B, “Parts lists” on page 33.

3.3 Management node for System Center Virtual Machine Manager

The management node for this configuration consists of a pair of IBM System x3650 M3 rack servers. The management node architecture provides redundancy and fault tolerance and is an essential component in managing the cloud and virtualization. It manages the complete IBM private cloud environment.

This management cluster runs the following Microsoft applications:

� Windows Server 2008 R2 SP1 Enterprise Center� System Center Operations Manager (SCOM) 2007 R2� SQL Server 2008 x64 Standard Edition� System Center Self-Service Portal 2.0 SP1� System Center Forefront Security Client

Of particular note is Microsoft System Center Virtual Machine Manager (SCVMM), which manages the overall virtualized infrastructure. It enables increased physical server utilization, centralized management, and rapid provisioning of new VMs. In addition, there is no need to replace current VMware investments. Microsoft SCVMM helps manage the Hyper-V, virtual server, and VMware environments, all from a centralized platform. This is the essence of single pane of glass (SPOG) management: A key ingredient to the IBM ease-of-use feature that simplifies management of the data center.

Microsoft System Center Virtual Machine Manager supports:

� Live migration � Clustered shared volumes� Hot addition and removal of storage� Host Maintenance mode� Storage migration� Support for third-party cluster file systems

For Management Node Ordering Information, see Appendix B, “Parts lists” on page 33.

10 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 23: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

3.4 IBM System x3550 M3

Built on the latest six-core Intel Xeon processor 5600 series, the IBM System x3550 M3 rack-mounted two-socket server offers a highly available, high-performance 1U platform for Windows Server 2008 R2. With integrated 6 Gbps RAID adapters and double the I/O performance, the x3550 M3 provides a resilient architecture.

The x3550 M3 uses significantly less power than previous generations, with unified systems management tools, leadership reliability, availability, and serviceability features, and broad systems flexibility, housed in a compact 1U mechanical package.

The following list provides a quick summary of the x3550 M3 features:

� Innovative, energy-smart 1U design helps to lower operational costs.

� Up to two Intel Xeon 5600 series processors.

� A maximum of 18 DIMMs of DDR3 memory for up to 288 GB of memory. Chipkill, ECC, and memory mirroring are also supported.

� One 6 Gbps SAS RAID adapter.

� Support for PCIe 2.0 x16 adapter slots. An optional embedded hypervisor for managing virtual workloads is also supported.

� Up to eight hot-swap HDDs with an internal storage capacity of up to 8.0 TB (using 2.5 inch hot-swap SAS or SATA drives. Alternatively, up to eight solid-state drives (SSDs) are also available, offering up to 400 GB of storage.

� Enhanced systems management with an integrated management module and Unified Extensible Firmware Interface (UEFI), and software tools including ToolsCenter, IBM Systems Director, and Active Energy Manager.

� Best-in-Class RAS (highly redundant design, predictive failure analysis (PFA), light path diagnostics).

� Open architecture and common tools for quick and simple installation.

� Better serviceability with a highly scalable, flexible design that is easy to deploy, integrate, service, and manage.

Figure 3-3 shows the front view of the IBM system x3550 M3 server.

Figure 3-3 The IBM System x3550 M3

Four hot-swap2.5" bays

Pop-out light path diagnostics panel with

power button and status LEDs

Videoport

Light pathdiagnosticspanel eject

buttonTwo USB2.0 ports

Four hot-swap2.5" bays

or one DVD bay

Chapter 3. Host compute and production nodes 11

Page 24: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Figure 3-4 shows the rear view of the x3550 M3 server.

Figure 3-4 System x3550 M3 rear view

For additional details about the x3550 M3, refer to the IBM System x3550 M3 Product Guide, available at the following address:

http://ibm.com/systems/x/hardware/rack/x3550m3/

3.5 Active Directory server

This optional server provides an Active Directory and DNS environment for the IBM Reference Configuration servers, allowing the servers to participate in a Microsoft cluster and to work with several pieces of the management solution. If an Active Directory server is already available in the environment, this server is not required.

The Active Directory servers can be virtualized or stand-alone servers, depending on requirements.

If required, each Active Directory server in the IBM Reference Configuration architecture is configured with the following specifications:

� IBM System x3550 M3, as shown in Figure 3-3 on page 11� Intel Xeon X5640 processors, 4C 2.66 GHz 12 MB Cache 1066 MHz CPUs� 6 GB RAM (configured as one 4 GB DIMM)� ServeRAID M1015 SAS/SATA controller � Two IBM 146 GB 10k 6 Gbps SAS 2.5 inch SFF Slim-HS disk drives

For Active Directory server parts list provides parts ordering information see Appendix B, “Parts lists” on page 33.

Hot-swap powersupply bays

Videoport

Serialport

USBports

Ethernet port for IMM

Power supplysocket

PCIe slot

Standard Gb Ethernet ports

PCIe slot

Two optional Gb Ethernet ports

12 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 25: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Chapter 4. Storage for the IBM Reference Configuration architecture

The IBM XIV Storage System used in the IBM Reference Configuration for Microsoft Private Cloud offers performance, automation, reliability, and flexibility.

The XIV system includes the following key features:

� Continuous, predictable high performance without traditional complex tuning requirements

� No single point of failure

� Industry-leading rebuild times in the event of disk or module failures (less than 60 minutes for 2 TB drives)

� All-inclusive enterprise software including:

– Innovative space efficient snapshots – Asynchronous and synchronous replication – Thin provisioning– Reporting and management– Data migration– Quality of Service (QoS)

� Non-disruptive maintenance and upgrades

� Scalability from the IBM XIV Storage System Gen2 model to the IBM XIV Storage System Gen3 model, which can provide up to four times the throughput (10 GBps) and up to three times better response time matching the demands of high transactional workloads

� Completely automated configuration, ensuring every disk is balanced for optimal performance

� Unparalleled ease-of-use through the innovative XIV system GUI

� Option for future upgradeability of the XIV system Gen3 model 114 to solid-state drive (SSD) caching for breakthrough SSD performance levels at a fraction of typical SSD storage costs (planned availability for Gen3 in the first half of 2012)

4

© Copyright IBM Corp. 2011. All rights reserved. 13

Page 26: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

The XIV system is shown in Figure 4-1.

Figure 4-1 IBM XIV Storage System

FC

iSCSI

XIV Module

XIV Module

XIV Module

XIV Module

InfiniBandConnectivity

Host

Host

Host

14 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 27: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

The XIV system offers a dramatic reduction in operational storage expense while also providing low capital expense for cloud infrastructures. Through innovative automation and a simple GUI (shown in Figure 4-2), XIV system storage is so easy to manage that only a minimal storage skill level is needed.

Figure 4-2 XIV system GUI overview and status

Chapter 4. Storage for the IBM Reference Configuration architecture 15

Page 28: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

The XIV system GUI can create multiple LUNs in one step as shown in Figure 4-3. All LUNs are automatically added to the storage configuration.

Figure 4-3 Creating LUNs using the XIV system GUI

The XIV system Gen3 model currently ships either with 7200 RPM 2 TB or 3 TB Serial Attached SCSI (SAS) disks in a highly scalable configuration which accommodates usable capacities of up to 243 TB. At a minimum, the storage system ships with six modules, each of which contains 12 spindles, for a total of 72 disks.

For ordering information about the XIV system, see Appendix C, “Ordering options for the IBM XIV Storage System” on page 37.

The storage subsystem used by the IBM Reference Configuration architecture needs to support the two-node management cluster and the Hyper-V compute/production cluster (eight-node cluster). Storage I/O can vary widely depending on the applications being run. It is a good practice to profile storage needs to ensure that adequate space and I/O capacity are available while meeting any bandwidth or latency requirements.

Clustered Hyper-V servers can use storage in several ways:

� The primary use of storage is to present LUNs (disks) to the host servers through a Fibre Channel SAN. All VM configuration and virtual hard disk (VHD) files use storage on these shared LUNs.

� Clustered Shared Volumes (CSV) is the technology available to clustered Hyper-V servers to allow simultaneous access to LUNs from all servers in the cluster for the purpose of hosting VM files. CSV can greatly simplify the storage configuration by providing a common namespace for all Hyper-V servers in a cluster.

� VHD files are the virtual hard disks used by VMs to contain the operating system and data files under typical circumstances. Use of virtual hard disks allows maximum flexibility in terms of VM migration and backup options. These VHD files reside on an XIV system LUN that has been made available to the host server.

� Certain circumstances might require a VM to have direct access to a storage LUN. Examples of this are the use of guest clustering in the VM directly and disk I/O-intensive

16 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 29: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

applications. Two approaches to this are the use of iSCSI initiator software in Windows to connect to iSCSI targets presented by the XIV system or the use of a pass-through disk that is passed from the host to the VM. Future versions of Hyper-V will allow the use of Fibre Channel versus ISCSI. Currently, clustered highly available (HA) virtual machines (VMs) can only be implemented on iSCSI if using direct access I/O.

Chapter 4. Storage for the IBM Reference Configuration architecture 17

Page 30: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

18 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 31: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Chapter 5. Networking, connectivity, and scaling out

This chapter highlights networking and connectivity of the IBM Reference Configuration architecture. It also addresses a scale-out methodology for the architecture. This chapter includes the following sections:

� Networking overview� Connectivity for the IBM Reference Configuration architecture� Scale-out methodology

5

© Copyright IBM Corp. 2011. All rights reserved. 19

Page 32: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

5.1 Networking overview

Using a solution built around high-bandwidth 10 Gbps converged networking leverages the latest advances in networking and storage architectures. The core of the high bandwidth converged backbone is a pair of IBM B32 Converged Network top-of-rack switches.

These B32 switches connect to the servers through Brocade Converged Network Adapters (CNAs), which provide four 10 Gb ports per adapter to build teamed fault-tolerant, high-performance storage and communication networks. As an option, a pair of IBM B24Y switches can be connected to the B32 switches and used for ISCSI connectivity to the IBM XIV Storage System.

The IBM Converged Switch B32 enables access to LAN and SAN environments over a common server connection by utilizing Data Center Bridging (DCB) and Fibre Channel over Ethernet (FCoE) protocols. The B32 uses full Fibre Channel Forwarding (FCF) capabilities and connects to servers through Brocade Converged Network Adapters (CNAs). The switch offers 24 10 Gbps DCB Ethernet ports which can transport both FCoE and regular Ethernet traffic. FCoE can be forwarded into a FC SAN network through the eight 8 Gbps FC ports on the B32.

The consolidation of server SAN and LAN ports and corresponding cables simplifies configuration and cabling in server cabinets and reduces acquisition costs. With fewer components using power and cooling, organizations can save significant operating costs as well. For the IBM Reference Configuration for Cloud, the 10 Gbps DCB Ethernet ports provide connectivity to the storage and hosts and can also provide uplinks for LAN aggregation. The B32 Fibre Channel ports are used to connect to the IBM XIV system.

Figure 5-1 shows the IBM B32 Converged Switch

Figure 5-1 IBM B32 Converged Network Switch

The IBM B32 switch provides outstanding performance with eight Fibre Channel ports concurrently active at 8 Gbps and 24 Converged Enhanced Ethernet (CEE) ports concurrently active at 10 Gbps link speeds. The switch offers the following features:

� Twenty-four 1 Gbps SFP+ ports plus eight 8 Gbps Fibre Channel uplink ports

� Converged Enhanced Ethernet ports capable of transporting both FCoE and traditional Ethernet protocols.

� High-performance, 304 Gbps line speed, full-duplex throughput with low latencies

� Dual redundant, hot-swappable power supplies and highly available fan unit

� Mature and consistent IronWare OS found across all IBM b-type system networking devices, providing a common, industry-standard command line interface (CLI)

� Upwards integration into Systems Director Network Control with inventory and monitoring capabilities

20 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 33: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Figure 5-2 shows the IBM Ethernet switch B24Y.

Figure 5-2 IBM Ethernet switch B24Y

The optional IBM B24Y Ethernet switch is a compact, high-performance, highly available switch providing both 1 Gb and 10 Gb connectivity. Features of the switch include:

� Twenty-four 1 GbE RJ-45 ports plus four 10 GbE SFP+ uplink ports

� Full Layer 2 and Layer 3 capabilities with jumbo frame support

� High-performance, 128 Gbps line speed, full-duplex throughput with low latencies

� Dual redundant, hot-swappable power supplies and highly available fan unit

� Mature and consistent IronWare OS found across all IBM b-type system networking devices, providing a common, industry-standard command line interface (CLI)

� Upwards integration into Systems Director Network Control with inventory and monitoring capabilities

Two dual-port 10 GbE CNAs, which act as NICs, are used to provide a highly available, redundant communications pathway and to physically separate iSCSI storage traffic from other traffic.

Figure 5-3 shows the Brocade dual-port GbE CNA.

Figure 5-3 Brocade dual-port 10 GbE CNA for IBM System x

Chapter 5. Networking, connectivity, and scaling out 21

Page 34: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

The Brocade CNA includes the following features:

� Eight PCIe Gen 2 host interface ports

� Industry-leading 500k IOPS performance per port

� NIC teaming and multi-VLAN capabilities integrated in Windows NDIS stack

� Full Data Center Bridging (DCB) and Fibre Channel over Ethernet (FCoE) capabilities

� Jumbo frame support

� TCP Segmentation Offload (TSO), Large Send Offload (LSO) v1/v2, Header Data Split (HDS), and Receive Side Scaling (RSS) offload capabilities

5.2 Connectivity for the IBM Reference Configuration architecture

This section focuses on the connectivity of the key components for the IBM Reference Configuration architecture. These components include:

� Compute/production node� Management node� Storage subsystem� Networking

The building block architecture of the IBM Reference Configuration for Microsoft Private Cloud Fast Track is facilitated by the use of a converged network that provides 10 Gb server connectivity and FCoE for SAN connectivity. A pair of redundant, high-speed IBM B32 10 Gb Converged Networking Switches create the backbone of this network.

Each server contains two, two-port converged network adapters per server, providing a total of four 10 Gb ports. SAN traffic uses a FCoE multipath configuration to access storage, while fault tolerant network teams support the data network needs on isolated VLANs.

22 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 35: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Figure 5-4 shows a high-level illustration of the network topology.

Figure 5-4 High-level IBM Reference Configuration network topology

For network ordering information, see Appendix D, “Network ordering information” on page 41

5.3 Scale-out methodology

The IBM Reference Configuration architecture accommodates growth. This growth most typically takes one or more of these forms:

� Using a pooled resource model for CPU, memory, and storage, VMs can be added quickly as new business needs arise. Examples are new business applications or departments.

� Additional servers or storage can be brought online to increase pool reserves as needed.

In addition, isolating specific hardware elements from a group of users helps maximize and prioritize hardware utilization and minimize costs.

Depending on the starting point, the scale-out approach uses one of the following approaches:

� Adding additional x3560 M3 servers to the production cluster (up to 16). Additional networking switches might also be needed to accommodate additional servers and prevent networking bottlenecks.

� Adding additional storage using additional drives or expansion trays in the XIV system.

Zones 1&2

Zones 3&4

VLAN 20

VLAN 30

VLAN 40

VLAN 50

VLAN 60

VLAN 70

VLAN 80

VLAN 90

VLAN 100

FC Storage

FC Storage

iSCSI Storage

Production Cluster Private / CSV

Production Cluster Private / Live Migration

Production Cluster Public / VM Communication

Management

Management Cluster Private

Management Cluster Private – Live Migration

SQL Cluster Private

Out of Band Management - IMM

IBM

B32 Sw

itch

IBM

B32 Sw

itch

Th

e XIV

storag

e is

con

ne

cted

to th

e F

C p

orts o

nth

e B

32

. Th

e h

os

ts co

nn

ect to

the

10

GB

FC

oEp

orts. Th

e h

osts

use

MP

IO on

the

stora

ge s

ide

,an

d a F

T te

am

s of 1

0 G

be

de

vice

s carve

d in

to

the

req

uired

VL

AN

s for d

ata

com

mu

nic

atio

n.

Two stacked B24Y2C with 10 Gb uplinkmodules for 1 GB connections (iSCSI, inband and out of ban d management) 10 GbEuplink are connected to B32 switches.

IBM XIV

IBM System x3550 M3• 2 – 1 GbE – Management• IMM Port to VLAN 100

2 – IBM System x3650 M3Windows Server 2008 R2 SP1Enterprise running Hyper-V

• SQL Server 2008• System Center Ops Mgr 2007 R2• System Center VMM 2008 R2• Self Service Portal 2.01 – FT Pair 10 Gb C NA

• FC Zone 1&2• vSwitch team

1 – FT Pair 10 Gb C NA• FC Zones 3&4• VLAN 60 (Mgmt Cluster Public)• VLAN 70 (Mgmt Cluster Private)• VLAN 80 (Mgmt Cluster Live Migration)

IMM Port to VLAN 100

8 – IBM System x3650 M3Windows Server 2008 R2 SP1Datacenter running Hyper-V

1 – FT Pair 10 Gb CNA• FC Zones 1&2• vSwitch team

1 – FT Pair 10 Gb CNA• FC Zone 3&4• VLAN 30 (Prod Cluster Priv)• VLAN 40 (Prod Cluster LM)• VLAN 60 (Mgmt Network)

IMM Port to VLAN 100

Chapter 5. Networking, connectivity, and scaling out 23

Page 36: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

In either case, the architecture allows for the same management servers to administer the additional host clusters that are added while providing the required security or performance driven by customer or business needs.

Scaling out of production clusters adds additional considerations. In general, when starting with Intel-based servers, continue with the Intel processor-based server family. Regarding the physical attributes of the rack and the number of ports in the top-of-rack switch, scaling out requires additional cables, switches, racks, and rack components when their initial capacity is exceeded.

24 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 37: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Chapter 6. Operating system and management software

This chapter examines the software involved in the IBM Reference Configuration for Microsoft Private Cloud. It includes the following sections:

� Operating system software� Management software

6

© Copyright IBM Corp. 2011. All rights reserved. 25

Page 38: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

6.1 Operating system software

The host servers are one of the critical components of a dynamic, virtual infrastructure. The host servers, running Windows Server 2008 R2 SP1 with Hyper-V technology, provide the foundation for running VM guests and also provide the management interface between the guests and Microsoft System Center Virtual Machine Manager (SCVMM).

This section describes a detailed host server design and sizing methodology and presents a set of reference server architectures. The reference server architectures are intended to be a starting point for the design process and provide a foundation for documenting the final design.

In the IBM Reference Configuration for Microsoft Private Cloud, the server infrastructure is distributed among three groups:

� Compute/production (host) node� Management node� Directory node (Active Directory)

The underlying operating system for each of these nodes is Microsoft Windows Server 2008 R2 SP1. The preferred edition (Standard Edition, Enterprise Edition, or Datacenter Edition) depends on which type of node is under consideration. Because the compute/production node hosts the virtual guests that reflect the users, a multiple guest license is often preferred. Because the Management node is the control point for the compute/production node, the best license depends on how many compute/production node servers (and CPUs) are in the environment. Finally, because the Directory node works fairly independently, Windows Standard Edition is suitable.

The software components used in the IBM Reference Configuration architecture are as follows:

� Windows Server 2008 R2 SP1 with Hyper-V (x64)� Microsoft System Center Virtual Machine Manager (SCVMM) 2008 R2 SP1 � System Center Operations Manager (SCOM) 2007 R2 � SQL Server 2008 x64 Standard Edition� System Center Self-Service Portal 2.0 SP1� System Center Forefront Security Client� IBM Systems Director Platform Agent 6.2.1� IBM System Director Upward Integration Module and PROTip� IBM XIV Storage System SCOM Management Pack

6.1.1 Windows Server 2008

As mentioned, the various Editions (licenses) of Windows Server 2008 allow support for a varying number of users and provide optimum scalability of the infrastructure. There are three groupings of the OS, each of which allows for a specific number of Windows-based VMs:

� Standard edition: Includes one running VM � Enterprise Edition: Includes up to four VMs � Datacenter Edition: Includes unlimited virtualization rights

Each of these groupings provides a tiered level of virtualization user rights.

Windows clustering requires either Enterprise or Datacenter editions. The Enterprise Edition with four included licenses allows up to four Windows guest VMs and is a good choice for the management servers.

26 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 39: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

The license option suitable for the Production Server in the IBM Reference Configuration architecture is Windows Server 2008 R2 SP1 Datacenter Edition because it includes unlimited virtualization use rights and allows as many guests as are needed on the physical server.

6.1.2 Virtual machine guests with Hyper-V

Hyper-V allows a wide range of resources to be assigned to guest virtual machines to greatly increases the scalability and maximize the number of workloads that can be run on a given host:

� Up to 64 GB or RAM and 4 vCPU per VM

� Up to eight vCPU for each logical processor

� Fixed and dynamic disks available for each VM

Dynamic memory allows a range of memory to be assigned to each VM and allows Hyper-V to balance the allocation per VM based on VM priority and server workload

In general, each guest should be configured with no more than the resources needed. This nominal guidance applies to most resource allocation scenarios to ensure equitable distribution for other guests and future growth.

6.1.3 Private cloud operational software

Microsoft System Center is the central operational and control element that completes the cloud and virtualization management. Microsoft Systems Center has two key components:

� Microsoft System Center Virtual Machine Manager (SCVMM)� System Center Operations Manager (SCOM)

For detailed guidance on how to install and configure System Center Virtual Machine Manager 2008 R2, refer to this source:

http://technet.microsoft.com/en-us/systemcenter/vmm/default.aspx

For host server software ordering and parts lists, see Appendix E, “Host operating software ordering and parts” on page 43.

6.2 Management software

The core management environment formed by Microsoft System Center Operations Manager (SCOM) and IBM integration packs is tightly linked with Microsoft System Center Virtual Machine Manager (SCVMM) to monitor and manage the health and performance of the physical and the virtual environment. Microsoft Self Service Portal 2.0 (SSP) extends Microsoft SCVMM to provide self-service provisioning for end customers for their allocated virtual resources. In addition, Microsoft System Center Opalis Server can be used to automate key IT tasks, and System Center Data Protection Manager can provide backup services to the platform.

Chapter 6. Operating system and management software 27

Page 40: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

6.2.1 IBM Hardware Management Pack for Microsoft System Center Operations Manager 2007

The IBM Hardware Management Pack for Microsoft System Center Operations Manager (MSCOM) 2007 is an upward integration module that plugs into Microsoft SCOM Server 2007 R2. The IBM Hardware Performance and Resource Optimization Kit is an integration module that plugs into Microsoft Virtual Machine Manager 2008 R2. Using these management packs enables enhanced features for Microsoft System Center Operations Manager and System Center Virtual Machine Manager to manage the health of the IBM hardware offering.

The IBM Hardware Management Pack includes these key features:

� Extensive monitoring of the health of hardware components for IBM System x servers and BladeCenter® x86/x64 blade servers running Microsoft Windows

� Comprehensive monitoring of the health of software stacks for managing IBM hardware

� Easy determination of system health problems by aggregating monitors for hardware health

� Detection of hardware errors and evacuation of virtual machines from affected nodes.

To download the latest version of this software, visit the following URL (IBM ID required; follow the link on the page to register) and select the UIM as shown in Figure 6-1:

https://www14.software.ibm.com/webapp/iwm/web/reg/download.do?source=dmp&S_PKG=director_uim&S_TACT=sms&=en_US&cp=UTF-8

Figure 6-1 Downloading the IBM Hardware Management Pack

6.2.2 IBM System Storage (XIV) Management Pack for Microsoft System Center Operations Manager 2007

The IBM Storage Management Pack for Microsoft System Center Operations Manager (SCOM) is a set of software plug-ins that can be individually imported into SCOM to provide storage-specific extensive monitoring and diagnostic capabilities. It includes management packs for a handful of IBM enterprise-class storage solutions, including the IBM XIV Storage System Gen3 model. Thus, IT administrators can customize Microsoft System Center environments by importing management packs that apply only to active data center storage systems. SCOM then uses various authentication protocols to communicate with the corresponding devices.

28 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 41: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

The IBM Storage Management Pack links to the XIV system using a secure SSL communication channel handled by the XIV system command line interface (XCLI) client. The latest IBM Storage Management Pack for SCOM 1.1.1 supports XIV system Gen3 and previous generation models using microcode versions 10.2.2, 10.2.4.x, and 11.0.0. After SCOM establishes a successful link to the storage system, multiple monitoring modules can report alerts, events, and global and granular physical and logical component system health states. Visual representations in the form of diagrams depicting hierarchical storage component relationships also provide valuable enhancements to SCOM centralized monitoring and reporting features.

For further information, review the IBM Storage Management Pack for Microsoft System Center Operations Manager (SCOM) v1.1.1 User Guide:

http://publib.boulder.ibm.com/infocenter/ibmxiv/r2/topic/com.ibm.help.xiv.doc/docs/IBM_Storage_MP_for_SCOM_1.1.x_UG.pdf

6.2.3 System Director agent

The IBM Director platform system agents serve as the control point for surfacing hardware events and information. These agents, in conjunction with the IBM Hardware Management Pack for SCOM 2007 R2, can be discovered and managed by Microsoft System Center Operations Manager Server.

Visit the following site for information about downloading Upward Integration Module agents:

http://ibm.com/systems/software/director/downloads/agents.html

Chapter 6. Operating system and management software 29

Page 42: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

30 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 43: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Appendix A. System x rack and power options

Figure A-1 shows the rack and power options that are available for IBM System x servers.

Figure A-1 System x rack and power choices

A

Racks UPSs PDUs KVM/consoles

42U and 47U deep racks Optional NetworkManagement Card

Optional EnvironmentalMonitoring Probe

1000VA LCD Tower UPS1500VA LCD Tower UPS

1500VA LCD 2U Rack UPS2200VA LCD 2U Rack UPS3000VA LCD 3U Rack UPS6000VA LCD 4U Rack UPS

0U 24 C13PDUs

0U 12C13/12 C19PDUs

1754D1X IBM Global2x2x16 Console

Manager (GCM16)

46M5382 IBM SerialConversion Option (SCO)

46M5383 IBM Virtual MediaConversion Option Gen2

(VCO2)

1754D2X IBM Global4x2x32 Console

Manager (GCM32)

1754-A2XIBM Local 2x16 Console

Manager (LCM16)

1754-A1XIBM Local 1x8

Console Manager (LCM8)

© Copyright IBM Corp. 2011. All rights reserved. 31

Page 44: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Table A-1 show the common rack and power items used in the IBM Reference Configuration for Microsoft Private Cloud offerings.

Table A-1 IBM Reference Configuration rack and power parts list

Part number Description Quantity

1754D1X IBM Global 2x2x16 Console Manager 1

46M5383 IBM Virtual Media Conversion Option VCO2 11

172319X 1U 19 inch Flat Panel Monitor Console Kit with DVD 1

40K5372 IBM Keyboard with Integrated Pointing Device 1

46M4004 IBM 1U 12 C13 Switched and Monitored DPI PDU 4

40K9614 IBM DPI 30A Cord (NEMA L6-30P) 4

93604PX IBM 42U 1200 mm Deep Dynamic Rack 1

32 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 45: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Appendix B. Parts lists

This appendix lists the parts for the various components of the IBM Reference Configuration for or Microsoft Private Cloud solution. It includes the following sections:

� Compute/production node parts list� Management server parts list� Active Directory server parts list

B

© Copyright IBM Corp. 2011. All rights reserved. 33

Page 46: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Compute/production node parts list

Use the parts in Table B-1 to help you order the compute/production node cluster components.

Table B-1 IBM Reference Configuration compute/production node configuration parts list

Management server parts list

The pair of servers described in 3.3, “Management node for System Center Virtual Machine Manager” on page 10 constitutes a management cluster configuration that provides reliability and fault tolerance.

Each of the two management servers uses the following components:

� IBM System x3650 M3� Two Intel Xeon X5670 processors: 6C 2.93 GHz 12 MB Cache 1333 MHz 95w� 48 GB RAM (composed of six 8 GB DIMMs)� One ServeRAID M1015 SAS/SATA Controller (optional battery not included)� Two IBM 73 GB 15K 6 Gbps SAS 2.5 inch SFF Slim-HS disk drives� Two Brocade 10 Gb Dual Port CNAs

Part number Description Quantity

7945-AC1 IBM System x3650 M3 w/ 2.93 GHz 6C Processor 8

46M1087 2nd 2.93 GHz 6C Processor 8

44X0138 PCI-Express (2 x8 slots; 1 FH/FL, 1 LP) Riser Card 1 8

46M1131 PCI-Express (2 x8 slots; 1 FH/FL, 1 FH/HL) Riser Card 2 8

49Y1397 8 GB (1x 8 GB, 2Rx4, 1.35 V) PC3-10600 CL9 ECC DDR3 1333 MHz LP RDIMM 96

46M0831 ServeRAID M1015 SAS/SATA Controller 8

46M1075 IBM 675 W Redundant Power Supply 8

42C1820 Brocade 10 Gb CNA for IBM System x 16

42D0632 IBM 146 GB 10K 6 Gbps SAS 2.5" SFF Slim-HS HDD 16

46C7526 Virtual Media Key 8

4849MGN MS Windows Srv 2008 R2 Datacenter (2 CPU,5 UserCAL) ROK-ML (BR,EN,FR,SP) 8

39Y5533 2.8 m, 10 A/100-250 V, C13 to IEC 320-C14 Rack Power Cable 16

34 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 47: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Table B-2 provides parts ordering information for the management nodes for the IBM reference configuration.

Table B-2 Management node parts list for the IBM Reference Configuration for Cloud

Active Directory server parts list

Table B-3 provides parts ordering information for the Active Directory.

Table B-3 Active Directory server parts list

Part number Description Quantity

7945-AC1 IBM System x3650 M3 w/ 2.66 GHz 4C Processor 2

44E5181 2nd 2.66 GHz 6C Processor 2

44X0138 PCI-Express (2 x8 slots; 1 FH/FL, 1 LP) Riser Card 1 2

46M1131 PCI-Express (2 x8 slots; 1 FH/FL, 1 FH/HL) Riser Card 2 2

49Y1397 8 GB (1x 4 GB, 2Rx4, 1.35 V) PC3-10600 CL9 ECC DDR3 1333 MHz LP RDIMM 12

46M0831 ServeRAID M1015 SAS/SATA Controller 2

46M1075 IBM 675 W Redundant Power Supply 2

42C1820 Brocade 10 Gb CNA for IBM System x 4

42D0634 IBM 146 GB 10K 6 Gbps SAS 2.5" SFF Slim-HS HDD 4

46C7526 Virtual Media Key 2

4849MTN MS Windows Srv 2008 R2 Enterprise (1-8 CPU,10 CAL) ROK-ML (BR,EN,FR,SP) 2

39Y5533 2.8 m, 10 A/100-250 V, C13 to IEC 320-C14 Rack Power Cable 4

Part number Description Quantity

7944-AC1 IBM System x3550 M3 w/ 2.66 GHz 4C Processor 1

46C0594 2 GB (1x 2 GB, 2Rx8, 1.5 V) PC3-10600 CL9 ECC DDR3 1333 MHz LP RDIMM 3

46M0831 ServeRAID M1015 SAS/SATA Controller 1

42D0632 IBM 146 GB 10K 6 Gbps SAS 2.5" SFF Slim-HS HDD 2

46C7526 Virtual Media Key 1

46M1075 IBM 675 W Redundant Power Supply 1

4849MSN MS Windows Srv 2008 R2 Standard (1-4 CPU,5 CAL) ROK-ML (BR,EN,FR,SP) 1

39Y5533 2.8 m, 10 A/100-250 V, C13 to IEC 320-C14 Rack Power Cable 2

Appendix B. Parts lists 35

Page 48: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

36 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 49: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Appendix C. Ordering options for the IBM XIV Storage System

The IBM XIV Storage System Gen3 model shown in Figure C-1 is ordered according to the capacity required. The minimum physical installation is six data modules yielding 55 TB of usable storage (there is also a Capacity on Demand (CoD) plan allowing a three-module 28 TB minimum entry point). Although 28 TB is the minimum configuration for the XIV system using CoD, it is appropriate only for storage requirements that grow to at least 55 TB in a one to three-year period.

Figure C-1 XIV Storage System Gen3 model internal components

C

FC

iSCSI

Inter-moduleConnectivity

Host

Host

Host

15 data modules, each containing:• 12 high-density SAS disk drives• 24 GB memory• Quad-core Intel CPU• 2 x 20 Gbps InfiniBand HCA ports

Host connectivity:• 24 x 8 Gbps FC ports• 22 x 1 Gbps iSCSI ports

2 InfiniBand switches:• Redundant inter-module connectivity• 600 Gbps total internal bandwidth

3 UPS modules:• Stable power to all system

components• Safe shutdown upon power outage

Cache CPU

Interface Disks

UPS

Data Module

Data Module

UPS UPS

Data Module

Data Module

© Copyright IBM Corp. 2011. All rights reserved. 37

Page 50: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Each XIV system includes all of the following software at no additional cost:

� Thin provisioning � Snapshots� Sync and async replication� “Host connection” software � Fibre Channel connectivity � ISCSI connectivity � Performance monitoring� Migration software

Basically, all XIV systems include all XIV features, and there are no “options” or additional software features that must be ordered.

Initial configuration options for the IBM Storage System XIV Gen2 and Gen3 models are shown in Table C-1.

Table C-1 Configuration options for XIV Storage System Gen3 models

If ordered initially with less than 15 data modules, the XIV system Gen3 model can be upgraded using the increments in Table C-1. Additional capacity, processing, connectivity, and cache can all be created as needed without disruption or performance impact.

Capacity on demand (CoD)

With the CoD ordering option for the XIV system Gen3 model, customers benefit from the full processing, caching, and drive spindle performance of the physically deployed system, yet only the minimum necessary capacity must be ordered initially.

The minimum usable capacity purchased in a CoD configuration is 28 TB (other initial increments are available). This minimum entry point consists of three CoD data modules and three CoD I/O data modules. As shown in Figure C-2 on page 39, this configuration provides 28 TB of purchased capacity and 27 TB of in-place expansion.

Number of XIV data modules 6 9 10 11 12 13 14 15

Number of disks 72 108 120 132 144 156 168 180

Usable capacity TBs (2 TB drives) 55 88 102 111 125 134 149 161

Usable capacity TBs (3 TB drives) 84 132 154 168 190 203 225 243

Fibre Channel (FC) ports (8 GB) 8 16 16 20 20 24 24 24

Processors (Quad core) 6 9 10 11 12 13 14 15

Gen2 Memory (GB) 96 144 160 176 192 208 224 240

Gen3 Memory (GB) 144 216 240 264 288 312 336 360

38 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 51: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Although there is a slight premium per usable TB for CoD options, the performance of CoD purchased capacity benefits from the additional processor, memory, FC ports, and spindles in a base 55 TB configuration.

Figure C-2 Available in-place upgrade with CoD

For more information about the CoD program, terms, and conditions, contact your IBM representative or authorized partner.

Sample XIV system parts lists

The sample configurations shown in Table C-2 and Table C-3 on page 40 were produced by using the IBM e-config tool.

Table C-2 XIV Gen3 model (6 module, 1 year warranty) configuration/parts list

0

10

20

30

40

50

60

TBu

Un-act.

Active

Product Part Description Quantity

2810-114 IBM XIV Storage System Gen3 model 1

0018 AAS SW order indicator 1

0030 Base unit indicator 1

0035 Retail unit indicator 1

0102 Windows Host Attachment 1

0806 6 module initial capacity 1

1125 2 TB Interface Module 3

1126 2 TB Data Module 3

9101 Modem 1

9811 US/CA/LA/AP 60 A pin cord 1

9890 Single phase power 1

5639-YYB IBM XIV Software V11.0.1 1

0001 IBM XIV SW Drawer 2 TB drives 6

5005 Preinstall 1

5809 Supply feature 1

6942-25B Warranty Service Upgrade 1

Appendix C. Ordering options for the IBM XIV Storage System 39

Page 52: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Table C-3 XIV system Gen2 model (15 module, 1 year warranty) configuration/parts list

The IBM Reference Configuration certification testing for Microsoft Private Cloud Fast Track used an XIV model Gen2 machine running firmware level 10.2.4a and Gen3 machine running firmware level 11.0.0-internal-p20110816.

0050 Request Proposal for Prices 1

4524 WSU Same Day 24x7x4 Response 1

Product Part Description Quantity

2810-A14 IBM XIV Storage System 1

0018 AAS SW order indicator 1

0030 Base unit indicator 1

0035 Retail unit indicator 1

0102 Windows Host Attachment 1

0815 15 module initial capacity 1

1101 Dual-CPU interface module 6

1106 LV data module 9

9000 Maintenance module 1

9101 Modem 1

9820 3ph non-EMEA 60 A pin cord 1

9891 Three phase 60 A power 1

5639-XX1 IBM XIV Storage System Software Reg/Ren: 1 Yr 1

0001 Per Storage Device 1TB SW MAINT NO Charge 1 Yr Reg 15

5639-XXA IBM XIV Storage System Software V10.2 1

0001 IBM XIV SW Drawer 1 TB drives Basic License Charge Per Storage Device w/1Yr SW Maint

15

5005 Preinstall 1

5809 Supply feature 1

6942-25B Warranty Service Upgrade 1

0050 Request Proposal for Prices 1

4524 WSU Same Day 24x7x4 Response 1

Product Part Description Quantity

40 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 53: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Appendix D. Network ordering information

B32 and optional B24Y networking components shown in Table D-1 and Table D-2 on page 42 provide parts ordering information for Brocade networking components.

Table D-1 B32 networking components

D

Inclusion of CNAs: The CNAs are ordered as part of the servers.

Part Number Description Quantity

3758-L32 IBM Converged Switch B32 2

2738 Twinax Active 3 m 8-Pack 3

2758 Twinax Active 5 m 8-Pack 3

2718 Twinax Active 1 m 8-Pack 1

2808 8 Gbps SW SFP Transceiver 8- Pack 2

5605 Fibre Cable LC/LC 5m multinode 16

5910 Mid-mount Rack Kit 2

7408 FC and Converged Activation 2

7715 3758-B32 Firmware Upgrade 2 years 2

6942-25B Warranty Service Upgrade 1

0050 Requested Proposal for Prices 1

0202 3758-L32 24x7x4 WSU 2

4524 WSU Same Day 24x7x4 Response 1

© Copyright IBM Corp. 2011. All rights reserved. 41

Page 54: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Table D-2 B24Y networking components

With the B24Y withdrawn from marketing, IBM is evaluating a replacement for PCO. One possible option is the IBM BNT® RackSwitch G8052 listed in Table D-3. However this switch had not been tested for the Microsoft Private Cloud Fast Track program at the time of writing.

Table D-3 IBM BNT RackSwitch G8052 networking components

Part Number Description Quantity

4002CY2 IBM Ethernet Switch B24Y 2

45W7346 4-port 10 Gbe Uplink/Stacking Module (SFP+) 2

68Y5748 3 Year Onsite Repair 9x5 Next Business Day 2

45W7207 Redundant 210 watt AC power supply 2

39Y7931 Line cord – 4.3 M, 10 A/125 V, C13 to Nema 5-15P (US) 4

45W4262 IBM 10 Gb SFP+ Transceiver 4 pack 1

Withdrawn from marketing: The optional B24Y switch was withdrawn from marketing on December 17, 2011. See this page for more information:

http://www-01.ibm.com/common/ssi/rep_sm/5/897/ENUS4002-_h05/

Part Number Description Quantity

1455-48E IBM BNT RackSwitch 8052R 48 port 1 GbE switch 2

4650 Rack Indicator – Not Factory Integrated 2

6469 Power Cord (14 foot – C13 to C14) 4

EB28 SFP+ Transceiver 4

42 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 55: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Appendix E. Host operating software ordering and parts

This section lists the parts that make up the host operating software. It includes the following sections:

� Windows Server 2008 R2 Datacenter Edition 2-CPU� Management server parts list for Windows Server 2008 R2 Enterprise 10 CAL� Active Directory server parts list for Windows Server 2008 R2 Standard� Ordering information for additional Microsoft components� Software ordering summary

E

© Copyright IBM Corp. 2011. All rights reserved. 43

Page 56: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Windows Server 2008 R2 Datacenter Edition 2-CPU

Table E-1 provides parts ordering information for the Windows Server 2008 R2 Datacenter Edition, licensed for two CPUs.

Table E-1 Windows Server 2008 R2 parts list

Management server parts list for Windows Server 2008 R2 Enterprise 10 CAL

Table E-2 provides parts ordering information for the Windows Server 2008 R2 Enterprise 10 CAL. With two x3650 M3 servers, each with 2 CPUs, order the following quantities:

Table E-2 Windows Management Server 2008 R2 parts list

IBM part number Geography Description Qty of Licenses(order for appropriatelanguage group)

4849-MGN World-wide Windows Server 2008 R2 Data Center (2 CPU, 5 CAL) ROK - Multilang (BR,EN,FR,SP) US, Canada and LA

8

4849-MGM EMEA/APK/APJ Windows Server 2008 R2 Data Center (2 CPU, 5 CAL) ROK - Multilang (CS,EN,FR,DE,IT,JA,KO,PL,RU,SP,TR)

8

4849-MGX APGCG/ASEAN Windows Server 2008 R2 Data Center (2 CPU, 5 CAL) ROK - Chinese Simplified

8

4849-MGT APGCG/ASEAN Windows Server 2008 R2 Data Center (2 CPU, 5 CAL) ROK - Chinese Traditional

8

IBM part number Geography Windows Server 2008 R2 Enterprise 10 CAL Quantity of Licenses(order for appropriatelanguage group)

4849-MTN World-wide Windows Server 2008 R2 Enterprise (1-8 CPU, 10 CAL) ROK - Multilang (BR,EN,FR,SP) US, Canada, and LA

2

4849-MTM EMEA/APK/APJ Windows Server 2008 R2 Enterprise (1-8 CPU, 10 CAL) ROK - Multilang (CS,EN,FR,DE,IT,JA,KO,PL,RU,SP,TR)

2

4849-MTX APGCG/ASEAN Windows Server 2008 R2 Enterprise (1-8 CPU, 10 CAL) ROK - Chinese Simplified

2

4849-MTT APGCG/ASEAN Windows Server 2008 R2 Enterprise (1-8 CPU, 10 CAL) ROK - Chinese Traditional

2

44 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 57: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Active Directory server parts list for Windows Server 2008 R2 Standard

Table E-3 provides parts ordering information for the Windows Server 2008 R2 Standard. Order the following quantities:

Table E-3 Windows Active Directory Server 2008 R2 parts list

Ordering information for additional Microsoft components

The following Microsoft licenses are provided with IBM Reference Configuration for Microsoft Private Cloud. They are also specified in Table E-1 on page 44, Table E-2 on page 44, and Table E-3.

� Windows Server 2008 R2 Enterprise Edition for Management Server� Windows Server 2008 R2 Data Center for Host Servers

These additional Microsoft licenses must be procured outside of those provided by IBM:

� Microsoft SQL Server 2008 R2� System Center Operations Manager 2007 R2� System Center Virtual Machine Manger 2008 R2� System Center Data Protection Manager 2010� Forefront Endpoint Protection 2010� Microsoft Deployment Toolkit 2010 Update 1

IBM part number Geography Windows Server 2008 R2 Standard Quantity of Licenses(order for appropriatelanguage group)

4849-MSN World-wide Windows Server 2008 R2 Standard (1-4 CPU, 5 CAL) ROK - Multilang (BR,EN,FR,SP) US, Canada, and LA

1

4849-MSM EMEA/APK/APJ Windows Server 2008 R2 Standard (1-4 CPU, 5 CAL) ROK - Multilang (CS,EN,FR,DE,IT,JA,KO,PL,RU,SP,TR)

1

4849-MSX APGCG/ASEAN Windows Server 2008 R2 Standard (1-4 CPU, 5 CAL) ROK - Chinese Simplified

1

4849-MST APGCG/ASEAN Windows Server 2008 R2 Standard (1-4 CPU, 5 CAL) ROK - Chinese Traditional

1

Appendix E. Host operating software ordering and parts 45

Page 58: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Software ordering summary

See Table E-4 (for US and Canada) and Table E-5 (for EMEA and the rest of the world) for the software components being used in the IBM Reference Configuration and the required licenses.

Table E-4 Software part number list for the US and Canada

Table E-5 Software Part number list for EMEA and the rest of the world

Software IBM part Where used Server type Quantity of licenses

Windows Server 2008 R2 Data Center 2-CPU

4849-MGN All compute/ production servers - unlimited users

x3650 M3 8

Windows Server 2008 R2 Enterprise 1-8 CPU 10CALs

4849-MTN All management servers x3650 M3 2

Windows Server 2008 R2 Standard 1-8 CPU 10CALs

4849-MSN Active Directory server x3550 M3 Optional

System Center Virtual Machine Manager 2008 R2

None Management servers VM on x3650 M3 1

Windows System Center Operations Manager 2007 R2

None Management servers VM on x3650 M3 1

Windows SQL Server Standard Edition 2008 R2

None Management servers VMs on x3650 M3 1

Software IBM part Where used Server type Quantityof licenses

Windows Server 2008 R2 Data Center 2-CPU

4849-MGM All compute/ production servers – unlimited users

x3650 M3 8

Windows Server 2008 R2 Enterprise 1-8 CPU, 10 CALs

4849-MTM All management servers x3650 M3 2

Windows Server 2008 R2 Standard, 1-8 CPU, 10 CALs

4849-MSM Active Directory Server x3550 M3 1

MS System Center Virtual Machine Manager 2008 R2 Workgroup Ed.

4849-MVW(EMEA only)

One Management Server (**License shared betweentwo managment servers)

x3650 M3 1

Windows System Center Operations Manager 2007 R2

None One Management Server x3650M3 1

Windows SQL Server Standard Edition 2008 R2

None One Management Server x3650M3 1

46 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 59: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Related publications

The publications listed in this section are considered particularly suitable for a more detailed discussion of the topics covered in this paper.

IBM Redbooks

The following IBM Redbooks publications provide additional information about the topic in this document. Note that several publications referenced in this list might be available in softcopy only.

� XIV Storage System: Host Attachment and Interoperability, SG24-7904-00

http://www.redbooks.ibm.com/abstracts/sg247904.html?Open

� XIV Storage System: Copy Services and Migration, SG24-7759-01

http://www.redbooks.ibm.com/abstracts/sg247759.html?Open

You can search for, view, download or order other Redbooks, Redpapers, Web Docs, draft and additional materials, at the following website:

ibm.com/redbooks

Online resources

These websites are also relevant as further information sources:

� IBM XIV Storage System overviews:

– IBM XIV Storage System series: Storage reinvented: Powerful, virtualized, easy-to-manage enterprise storage for a dynamic world

http://ibm.com/systems/storage/disk/xiv/specifications.html

– IBM XIV Storage System: Storage reinvented

http://ibm.com/systems/storage/disk/xiv/

� IBM XIV Storage System Information Center (Online Manuals)

http://publib.boulder.ibm.com/infocenter/ibmxiv/r2/index.jsp

� XIV Storage System Downloads (MS SCOM, XIV GUI, CLi, XIV MIB, etc.)

http://www-947.ibm.com/support/entry/portal/Downloads/Hardware/System_Storage/Disk_systems/Enterprise_Storage_Servers/XIV_Storage_System_%282810,_2812%29

� IBM Certified Specialist Training - XIV Storage System Technical Solutions Version 2

http://ibm.com/certify/certs/23003002.shtml

© Copyright IBM Corp. 2011. All rights reserved. 47

Page 60: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

Help from IBM

IBM Support and downloads

ibm.com/support

IBM Global Services

ibm.com/services

48 IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Page 61: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich
Page 62: IBM Reference Configuration for Microsoft Private Cloud: … · 2016-08-11 · IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide Eric Johnson Peter Kisich

®

REDP-4828-00

INTERNATIONAL TECHNICALSUPPORTORGANIZATION

BUILDING TECHNICAL INFORMATION BASED ON PRACTICAL EXPERIENCE

IBM Redbooks are developed by the IBM International Technical Support Organization. Experts from IBM, Customers and Partners from around the world create timely technical information based on realistic scenarios. Specific recommendations are provided to help you implement IT solutions more effectively in your environment.

For more information:ibm.com/redbooks

Redpaper™

IBM Reference Configuration for Microsoft Private Cloud: Deployment Guide

Understand the components of the IBM Reference Configuration

Configure an approved Microsoft Private Cloud Fast Track solution

Follow preferred practices to create the solution

The IBM Reference Configuration for Microsoft Private Cloud is a comprehensive, ready-to-use, easy-to-manage, high performance, and ultra-reliable computing solution using Microsoft Hyper-V. The offering consists of IBM approved and tested servers, storage, and networking components which provide best-of-breed technology from entry level to the largest private cloud infrastructures.

This IBM Redpapers publication provides an overview of the Reference Configuration and a detailed parts list for IT teams responsible for integrating and deploying a private cloud infrastructure. It describes the process of setup, installation, and configuration to enable quick and easy deployments for a private cloud in a data center. This offering features an eight-node Microsoft Private Cloud Fast Track solution based on IBM System x3650 M3 servers with the IBM XIV Storage System.

This paper is intended for clients who want to learn about the IBM reference architecture for the Microsoft Private Cloud Fast Track program and better understand how all of the components work together to form an end-to-end private cloud solution. Sample ordering configurations as well as ordering considerations are addressed.

This paper is a partner to IBM Reference Configuration for Microsoft Private Cloud: Implementation Guide, REDP-4829.

Back cover