cloud computing infrastructure

Dr. Anita Goel

Cloud Computing Infrastructure

WBDCC 2016Workshop on Big Data and Cloud Computing, India

Dyal Singh CollegeDepartment of Computer Science

University of Delhi, India

Presentation Outline

• Introduction to Cloud Computing

• Concept of Virtualization

• Software Defined Networking

• Software Defined Storage

• Research Directions

2

Need of Cloud Computing

• Processor Resource

• Multicore Processors - 20% hardware used 80% time

• Users and Energy

• Global access to files from different devices

• Machines underutilized; energy consumption full

• Business Needs

• On demand resource

• Scalability on demand

• Changing Nature of Applications 3

Computing Service

4

Computing as a Resource

Computing as a Service

Cloud Computing Definition (NIST)

•Cloud computing is a model for

• enabling ubiquitous, convenient, on-demand

network access to a shared pool of

• configurable computing resources (e.g., networks,

servers, storage, applications and services)

• that can be rapidly provisioned and released with

minimal management effort or service provider

interaction.

5National Institute of Standards and Technology's (NIST)

NIST Cloud Reference Architecture

6

Robert B. Bohn, John Messina, Fang Liu, Jin Tong, Jian Mao, “NIST Cloud Computing Reference Architecture”, 2011 IEEE World Congress on Services

Infrastructure as a Service (IaaS)

8

Storage

Provides web based, scalable storage

Allow hiring of storage space on cloud storage servers

Manages data availability and security

Network

Provides resource sharing - geographically separate locations

Allows connection to desired resources

Manages network -VPN firewalls etc.

Compute

Provides processing power as a resource

Allows provisioning of machines

Manages multi-tenancy issues

Concept of Virtualization

•Decoupling of hardware and software

•Abstract and create a layer of resources

• Uses Hypervisor for abstraction

•Abstracted resources can be

• Can be used, demanded

• Cannot be owned or configured

• Can be sliced, resized, combined, and distributed

9

Traditional Picture

10

Virtualization

Hardware

Virtual Machine Monitor (VMM) / Hypervisor

Guest OS(Linux)

Guest OS(NetBSD)

Guest OS(Windows)

VM VM VM

App AppApp AppApp

11

Traditional OS

12

Pre VT-x and Post VT-x

14

VMM ring de-privileging of guest OS VMM executes in VMX root-mode

Guest OS aware its not at Ring 0 Guest OS de-privileging eliminated

Intel Virtualization Technology Processor Virtualization Extensions and Intel Trusted execution Technology

Pre VT-x Post VT-x

Binary

Translation

Paravirtualization

Page-table

Shadowing

IO-Device

Emulation

Interrupt

Virtualization

DMA Remap

VT-x & VT-d Working Together

Physical Memory I/O DevicesLogical

Processors

Virtual Machine Monitor (VMM)

Virtual

Machines

Hardware Virtualization

Mechanisms under VMM Control

VT-x

VT-d

Intel® Virtualization Transforms IT http://www.intel.com/content/www/us/en/virtualization/intel-virtualization-transforms-it.html

Openstack

Provide IaaS services for public and private clouds

Openstack (contd.)

• Relationship between components

SDN: Software Defined Network

18

Computer Industry

19Software Defined Networks and the maturing of the Internet, Nick Mckeown

Network Industry

20Software Defined Networks and the maturing of the Internet, Nick Mckeown

Towards OS for Networks

Specialized Packet Forwarding Hardware

App App App


App App App


App App App


App App App


OperatingSystem

OperatingSystem

OperatingSystem

OperatingSystem

OperatingSystem

App App App

Closed

OpenFlow/SDN tutorial, Srini Seetharaman, Deutsche Telekom, Silicon Valley Innovation Center

21

Software Defined Networking

• Control plane physically separate from Forwarding

plane

• Single Control plane controls several Forwarding

devices

22

Towards OS for Networks..


App App App


App App App


App App App


App App App


OperatingSystem

OperatingSystem

OperatingSystem

OperatingSystem

OperatingSystem

App App App

Network Operating System

Control Programs


23

Towards OS for Networks..

Simple Packet Forwarding Hardware



Simple Packet Forwarding Hardware Simple Packet

Forwarding Hardware

Network Operating System

Control Programs


24

OpenFlow

25

Data Path (Hardware)

Control Path OpenFlow

OpenFlow Controller

OpenFlow Protocol (SSL/TCP)


OpenFlow is a communication protocol that gives access to the

forwarding plane of a network switch or router over the network.Nick McKeown; et al. (April 2008). “OpenFlow: Enabling innovation in campus networks. ACM Communications Review

OpenFlow Protocol

NETWORK OPERATING SYSTEM

Bandwidth -on - Demand

DynamicOptical Bypass

Unified Recovery

UnifiedControl Plane

Switch

Abstraction

Networking

Applications

VIRTUALIZATION (SLICING) PLANE

Underlying

Data

Plane

Switching

Traffic Engineering

Application-Aware QoS

Packet

Switch

Packet

Switch

Wavelength

Switch

Time-slot

Switch

Multi-layer

Switch

Packet & Circuit

Switch

Packet & Circuit

Switch

Software-Defined Network, Jason, Tsung-Cheng, HOU, Wanjiun Liao

SDN

NOX Beacon ONIX POX ONOS

SDN..

27

SDS: Software Defined Storage

28

Storage Devices

• Direct Attached Storage - DAS

• Network Attached Storage - NAS

• Expensive, Scaling Issues, NAS Islands

• Storage Area Network - SAN

• Expensive, Scaling Issues, Raid Recovery time

29

SDS

• Inspired by Software Defined Network

• Control Plane separate from Data Plane

• Uses Commodity Storage for Data Plane

• Uses Server for Control Plane

• Enabling Technology – Hadoop Distributed File

System (HDFS)

30

HDFS

31

What is Ceph?

• Open-Source Software

• Software Defined Storage System

• Unified Storage Solution• Block storage, File storage, Object storage

• Cost effective – Runs on Commodity Hardware • Provides enterprise - grade highly reliable storage

• Easy to consume - in Linux Kernel

• Integrated with OpenStack, Cinder, Ubuntu

32

Ceph: Architectural Philosophy

• Distributed Storage System

• High Performance System

• Reliable System - No single point of failure

• Massively Scalable - Exabyte levels

• 1EB ~ 1000 PB ~ 1 million TB ~ 1billion GB

• Fault tolerant - Data Replication

• Self-manageable, wherever possible

33

34

Key Features

• Decoupled data and metadata – Uses CRUSH• Files striped onto predictably named objects

• CRUSH maps objects to storage devices

• Dynamic Distributed Metadata Management

• Dynamic subtree partitioning - Distributes metadata among MDSs

• Object-based storage

• OSDs handle migration, replication, failure detection and recovery

Source: Weil OSDI

Ceph Architecture Overview

35

Ceph Storage Cluster

Underlying Commodity Hardware

Linux OS

Ceph Client Storage Services

File Block Object

Some Examples

36

Ceph with ARM Servers

38

Ceph Unique?

39http://www.mellanox.com/blog/2015/06/ceph-is-a-hot-storage-solution-but-why/#

http://www.mellanox.com/blog/wp-content/uploads/John-Kim-062215-venn-diagram.png

http://www.mellanox.com/blog/wp-content/uploads/John-Kim-062215-venn-diagram.png

Why Ceph is Hot

http://www.mellanox.com/blog/2015/06/ceph-is-a-hot-storage-solution-but-why/#

40

Feature Means Final Benefit

Open Source No license fees Lower cost

Software-defined

Different hardware for different workloads

Broader use cases, higher efficiency

Use commodity hardware Lower cost, easier to evaluate

Scale-out

Manage many nodes as one system

Easier to manage = lower operational cost

Distributed capacity Multi-PB capacity for object & cloud

Distributed performanceGood performance from low cost servers

Block + Object Store more types of data Broader use cases

Enterprise features

Data protection Don’t lose valuable data

Self-healingHigher availability, easier management

Data efficiency Lower cost

Caching/tiering Higher performance at lower cost

An architecture for SD Cloud Computing environments

41

Software-Defined Cloud Computing: Architectural

Elements and Open Challenges

Rajkumar Buyya, Rodrigo N. Calheiros, Jungmin Son, Amir

Vahid Dastjerdi, and Young Yoony

Research Directions

• Design of Control layer – Compute, Storage

• Standardization of control layer

• Design of a new modular, easily modifiable – Compute

and Storage

• Creation of APIs for storage and compute architecture

• Development of Monitoring Tools providing maximum

coverage

Publications

• An Overview of Data Storage on the Cloud, P. Jain, A. Goel, S. Gupta• In Proceedings of IEEE International Conference on Advanced Research in Engineering

and Technology, India, pp. 318-322, 2013.

• Object Storage as a Service, P. Jain, A. Goel, S. Gupta• In Proceedings of International Journal of Innovations & Advancement in Computer

Science, Vol. 4, pp. 605-614, 2015.

• Monitoring Checklist for Ceph Object Storage Infrastructure, P. Jain, A. Goel, S. Gupta

• In Proceedings of 5th IFIP International Conference on Computer Science and Its Application, Saida, Algeria, pp. 611-623, 2015.

• Monitoring the Infrastructure of Riak CS, P. Jain, A. Goel, S. Gupta• In Proceedings of 11th International Multi Conference on Information Processing,

Bangalore, India, pp.137-146, 2015.

• Requirement Checklist for Infrastructure Monitoring of Swift , P. Jain, A. Goel, S. Gupta

• The 2015 International Conference On High Performance Computing & Simulation, HPCS, Amsterdam, Netherlands

Publications..

• IaaS as a Service, A. Datt, A. Goel, SC Gupta• In Proceedings of SARC-IRAJ International Conference, New Delhi, India, June 2013,

ISBN: 978-81-927147-6-9, pp. 18-23

• Comparing Infrastructure Monitoring with CloudStack Compute Services for Cloud Computing Systems, A. Datt, A. Goel, SC Gupta

• In Proceedings of 10th International Workshop - Databases in Networked

International Systems, DNIS (2015) , Japan, LNCS 8999, Springer, 2015, pp. 195-212. • Analysis of Infrastructure Monitoring Requirements for OpenStack Nova, A. Datt,

A. Goel, SC Gupta• In Proceedings of Eleventh International Multi Conference on Communication

Networks, ICCN 2015, August 21-23, 2015, Bangalore, India, Volume 54, ISBN: 1877-0509, pp. 127-136

• Monitoring list for Compute Infrastructure in Eucalyptus Cloud, A. Datt, A. Goel, SC Gupta

• In Proceedings of The 24th IEEE International Conference on Enabling Technologies:Infrastructure for Collaborative Enterprise, Cyprus, 2015, Pages: 69 - 71, WETICE

Publications..• Infrastructure Monitoring of Compute Cloud, A. Datt, A. Goel, SC Gupta

• Published in Journal of Advances in Economics and Business Management (AEBM), ISSN: 2394-1545, vol. 2, issue 5, pp. 439- 444

• Cloud Service Orchestration Based Architecture of OpenStack Nova and Swift, P. Jain, A. Datt, A. Goel, S. Gupta

• 5th International Conference on Advances in Computing, Communications and

Informatics, Jaipur, India September 21-24, 2016

• Object storage in OpenStack and Installation Steps of Swift, P. Jain, A. Goel

• 3 hour Session in “Recent Trends in Big Data and Cloud Computing”, Indira Gandhi Delhi

Technical University for Women (IGDTUW), India, 19th December 2013.

Thank You

Contact: [email protected]