vng/ird - cloud computing & openstack discussion 3/5/2014

Cloud Computing

OpenStack

VNG – Infrastructure platform

Tran Anh Nhan – IRD department head

Pham Tran Kim Chi – Lead System Engineer

May 2014

Cloud Computing - OpenStack - VNG - IRD

Agenda

• VNG - IRD

• What is Cloud Computing?

• OpenStack Architecture

• OpenStack Networking

• Deployment Model

• Ceilometer


New Section VNG Corp introduction


VNG Corporation

• Game publisher/developer (VLTK, VLCM,

Gunny, Boom, Khu vuon tren may,

ZingPlay …)

• Online music/media (ZingMP3, ZingTV)

• Social network (Zing Me, Zalo)

• E-commerce (123mua.vn, 123pay.vn)


IRD Department Research and build the infrastructure platform for VNG to enhance business, optimize quality and cost, meet the new technology.

• Content Delivery Network (CDN) system is used by all VNG products that want to optimize static bandwidth.

• Live-streaming system is a streaming platform for Zing events, Talk TV.

• OpenStack provides servers and networks for some products with a small scale (in pilot phase. Project Team is receiving feedback for further enhancement).

• Object storage (in POC phase).


New Section What is Cloud Computing?


References

• Gartner

• Synergy research

• The National Institute of Standards and

Technology (NIST)

• Cloud computing today

• 451 Research


Number & trend


What is Cloud computing?


Cloud Services


Cloud Services

• AWS #1 of cloud services provider - What services AWS provide? – Amazon Web Services (AWS) continues to dominate

the IaaS and PaaS space in terms of revenue. AWS: 3.8$B revenue (2013)

– Compute & Networking (Amazon EC2, Auto Scaling, Elastic Load Balancing, Route 53 ,..)

– Storage & CDN (Amazon S3, Amazon Glacier a low cost storage for backup, Amazon EBS, Cloud Front/CDN)

– DB – Cache: RDS (MySQL, Oracle, SQL Server, and PostgreSQL), DynamoDB (NoSQL data store), ElastiCache (In-Memory Caching Service), Redshift (Data Warehouse Service)

– Application services: Elastic Transcoder,..


Cloud Orchestration Framework


New Section OpenStack Architecture


History

• OpenStack is an open source IaaS

initiative for managing and creating huge

groups of virtual private servers in a cloud

computing environment. It was initially

developed by Rackspace and NASA.


Nowadays


Servers Storage

Network switch Network switch Network switch

Virtualization Solution (VMWare VCenter,

Citrix XEN Server, Ovirt, Proxmox….)

Hypervisor (VMWARE, XEN, QEMU, KVM, Hyper-V)


Cloud Infrastructure

• Modular architecture

• Designed to easily scale out

• Based on set of core services


OpenStack Platform

Servers Storage

Network switch Network switch Network switch

Hypervisor (VMWARE, XEN, QEMU, KVM, Hyper-V)


Infrastructure As A Service Overview


Infrastructure As A Service roles

• Cloud Ops: monitor/add/remove physical compute nodes, storage nodes, controller nodes, network nodes.

• App Owner: add/remove/upgrade cloud services, check billing status.

• Dev Ops: launch/ terminate/ scale instances, storage. Register/ unregister new image. Backup/ restore instances/ storage. These tasks can be done via dashboard or API.

• App Devs: call the dev ops tasks inside application logical flow.


OpenStack Architecture



On-Demand Self-Services

Resource

pooling

Broad

Network

Access

Mesearued

services



Hypervisor

Server

Storage Network

Nova compute Cinder Neutron


New Section OpenStack Networking


OpenStack Networking


Network Node Compute Node

phy-br-

em2

phy-br-

em2

em1: 172.16.0.2 em1: 172.16.0.3

em2: no ip address

em2: no ip address

Nova API …

ovs/ br-int

dnsmasq

dchp agentIP name space

Nova Compute …

tap-xx

qvo-xx

int-br-em2

tap-xx qvb-xx

Linux bridge

qbr-xxxxx

Instance

eth0

ovs/ br-int

qvo-xx

int-br-em2

veth

Neutron API0.0.0.0:9696

management network

dedicated physical VLAN for neutron traffic between nodes

neutron ovs plugin

veth


New Section Deployment Model


Cinder

API

COROSYNC + HAProxy

Controller 01 Controller 02

Rabbit

MQ

Keyston

e

Glance

API

Nova

API

PACEMAKER

Compute node 1

Compute node n

Ceph node 1

Ceph node n

QE

MU

Driver

Ceph node 2Compute node 2

RBD Driver


OpenStack Networking

Neutron Server

Switch Interface

Driver

Physical switch

Controller Node

OVS Plugin

OVS Plugin

Openvswitch

Instances

Compute Node

Neutron OVS agent

DHCP

InstancesInstances

OVS Plugin

Openvswitch

Instances

Compute Node

Neutron OVS agent

InstancesInstances

L3 Agent DHCP L3 Agent


Feature

• Launch instance

• Snapshot/ restore instance

• Attach device to instance

• Snapshot/ restore attach device

• Scale up instance

• Internal network for instances

• Provide instances with VLAN as product

requires.

• Instances are stored totally in Ceph Storage.


DEMO


New Section Ceilometer



On-Demand Self-Services

Resource

pooling

Broad

Network

Access

Mesearued

services


Monitoring

• Monitor physical host by cacti, graphite,

zabbix.

• Monitor instances status by ceilometer.

• Monitor OpenStack statistics by

ceilometer.


Ceilometer

• Objectives

• Ceilometer component

• Ceilometer collect data

• Access collected data

Objectives

• Provide a infrastructure to collect

any information in OPS.

• Publish information for other

monitoring.

• Integrate with Heat for trigger auto

scale.

Celiometer - OpenStack - VNG - IRD

Ceilometer collect data

• Bus listener

• Polling agent

• Push agents



Ceilometer


Process meter

Access collected data

• Via API

• Via Ceilometer command



DEMO


Q & A

vng/ird - cloud computing & openstack discussion 3/5/2014

Technology

cloud computing openstack

vng ird openstack networking

cloud computing environment

vng ird history openstack

vng ird agenda vng ird

vng ird cloud services

vng ird infrastructure

vng products