Chapter 7, Cloud Architecture and Datacenter Design (57 pages) in Distributed Computing: Clusters, Grids and Clouds, All rights reserved by Kai Hwang, Geoffrey Fox, and Jack Dongarra, May 2, 2010

7 - 1

Chapter 7

Cloud Architecture and Datacenter Design

Summary : This chapter covers the design principles and enabling technologies for cloud platform architectural design. We start with datacenter design and management. Then we present the design choices of cloud platforms. The topics covered include layered platform design, virtualization support, resource provisioning, and infrastructure management. Chapter 8 will cover cloud computing platforms built by Google, Amazon, IBM, Microsoft, and Salesforce.com. Case studies of some current and future clouds will be given in Chapter 9.

7.1 Cloud Computing and Service Models 2 7.1.1 Public, Private, and Hybrid Clouds

7.1.2 Cloud Ecosystem and Enabling Technologies 7.1.3 Popular Cloud Service Models

7.2 Datacenter Design and Interconnection Networks 10 7.2.1 Warehouse-Scale Datacenter Design

7.2.2 Datacenter Interconnections Networks 7.2.3 Modular Datacenter in Truck Container 7.2.4 Interconnection of Modular datacenters 7.2.5 Datacenter Management Issues

7.3 Architectural Design of Computing Clouds 19 7.3.1 Cloud Architecture Design Technologies 7.3.2 Layered Cloud Architectural development 7.3.3 Virtualization Support and Disaster Recovery

7.3.4 Data and Software Protection Techniques

7.4 Cloud Platforms and Service Models 28 7.4.1 Cloud Platforms and Providers

7.4.2 Cloud Service Models and Extensions 7.4.3 Trends in Cloud Service Applications

7.5 Resource Management and Desi gn Challenges 33 7.5.1 Resource Provisioning and Platform Deployment 7.5.2 Cloud Resource Management Issues 7.5.3 Cloud Architecture Design Challenges

7.6 Cloud Security and Trust Management 42 7.6.1 Cloud Security Defense Strategies 7.6.2 Distributed Intrusion/.Anomaly Detection

7.6.3 Reputation-Guided Protection of Datacenters

7.7 References and Homework Problems 50

Chapter 7, Cloud Architecture and Datacenter Design (57 pages) in Distributed Computing: Clusters, Grids and Clouds, All rights reserved by Kai Hwang, Geoffrey Fox, and Jack Dongarra, May 2, 2010

7 - 2

7.1 Cloud Computing and Service Models

Over the past two decades, the world economy is rapidly moving from manufacturing to services. In 2010, 80% of the US economy is driven by service industry, leaving only 15% by manufacturing and 5% from the agriculture. Cloud computing benefits primarily the service industry and advance the business computing to a new paradigm. It has been forecasted that global revenue in cloud computing may reach $ 150 billion by 2013 from the $ 59 billion reported in 2009. We have introduced the basic concept of cloud computing in Chapter 1. In this and next 2 chapters, we will study cloud computing from all angles. T

In this chapter, we study cloud architecture and infrastructure design. The next chapter focuses on real cloud platforms built in recent years, their service offerings, programming and application development. Virtualized cloud platforms are often built on top of datacenters, we will study the design and roles of datacenters first in support of the cloud development. In this sense, clouds aim to power the next generation datacenters by architecting them as a network of virtual computing services including hardware, database, user-interface, application logic, etc.

The users are able to access and deploy applications from anywhere in the world on demand at competitive costs depending on users QoS (Quality of Service) requirements. Developers with innovative ideas for new Internet services no longer require large capital outlays in hardware to deploy their service or human expense to operate it. The cloud offers significant benefit to IT companies by freeing them from the low level task of setting up hardware (servers) and software infrastructures. This will free up users to focus on innovation and creating business value for the computing services they need.

7.1.1 Public, Private, and Hybrid Clouds

Cloud computing applies a virtual platform with elastic resources putting together by on-demand provisioning of hardware, software, and datasets, dynamically. The idea is to move desktop computing to a service-oriented platform using server clusters and huge databases at datacenters. Cloud computing leverages its low cost and simplicity to both providers and users. Cloud computing intends to leverage multitasking by serving many heterogeneous applications simultaneously. The computations (programs) are sent to where the data is located, rather than copying the data to millions of desktops. Cloud computing avoids large data movement resulting in better network bandwidth utilization. Furthermore, machine virtualization has enabled the cost-effectiveness in using the cloud platforms.

The concept of cloud computing has evolved from the concepts of cluster, grid, and utility computing and providing software as a service. Cluster and grid computing leverage the use of many computers in parallel to solve a few large problems. Utility and SaaS provides the computing resources as a service with a notion of pay per use. Cloud computing leverage multiple resources to deliver a service to the end user. It is a HTC paradigm where the infrastructure provide the services through a large datacenter or server farms. Cloud computing model enables the users to share access of resources from anywhere at any time through their connected devices.

Some people argued that cloud computing is centralized computing at datacenters. We argue that cloud computing is indeed practicing distributed parallel computing over datacenter resources. All computations associated with a single cloud application are still distributed to many servers in multiple datacenters. These centers may have to communicate with each other around the globe. In this sense, cloud platforms are indeed distributed systems. Figure 7.1 shows three cloud classes: private, public and hybrid clouds and their analogy with offering various types of training services. They are deployed in the Intranets and over the open Internet as illustrated in Figure 7.2. Note that these clous are created over all Internet domains By no means, they are centralized in one place, just like many branch bank offices scattered around in a large banking systemAs clouds evolve, they will be interconnected to support the delivery of application services in a scalable and efficient manner to consumers around the world.

Chapter 7, Cloud Architecture and Datacenter Design (57 pages) in Distributed Computing: Clusters, Grids and Clouds, All rights reserved by Kai Hwang, Geoffrey Fox, and Jack Dongarra, May 2, 2010

7 - 3

Public Clouds: A public cloud is built over the Internet, which can be accessed by any user who has paid for the service. Public clouds are owned by service providers. They are accessed by subscription. Many companies have built public clouds, namely Google App Engine, Amazon AWS, Microsoft Azure, IBM Blue Cloud, and Salesforce Force.com. These are commercial providers that offer a publicly accessible remote interface for creating and managing VM instances within their proprietary infrastructure. A public cloud delivers selected set of business processes. The application and infrastructure services are offered qith quite flexible price per use basis.

Private Clouds: The private cloud is built within the domain of an intranet owned by a single organization. Therefore, they are client owned and managed. Their access is limited to the owning clients and their partners. Their deployment was not meant to sell capacity over the Internet through publicly accessible interfaces. Private clouds give local users a flexible and agile private infrastructure to run service workloads within their administrative domains. A private cloud is supposed to deliver more efficient and convenient cloud services. They may impact the cloud standardization, while retai8ning greater customization and organizational control.

Private/Enterprise

Clouds

Cloud computingmodel run

within a companys own Data Center / infrastructure forinternal and/or

partners use.

Public/Internet

Clouds

3rd party, multi-tenant Cloud

infrastructure & services:

* available on subscription basis

(pay as you go)

Hybrid/Mixed Clouds

Mixed usage of private and public

Clouds:Leasing publiccloud services

when private cloud capacity is insufficient

Figure 7.1: Classes of clouds and their analogy to training services

Hybrid Clouds: A hybrid cloud is built with both public and private clouds, as shown at the lower left corner of Fig.6.2. Private clouds can also support a hybrid cloud model by supplementing local infrastructure w