introducing the synnefo open source iaas platform · 2013. 2. 3. · 1. fosdem 2013 motivation:...

FOSDEM 2013

vkoukis@grnet.grg g

INTRODUCING THE SYNNEFO OPEN SOURCE IAAS PLATFORM VANGELIS KOUKISIAAS PLATFORM. VANGELIS KOUKIS TECHNICAL LEAD, ~OKEANOS

1

FOSDEM 2013

vkoukis@grnet.grMotivation: ~okeanos g g

Goals

- Everything open source

- Production-quality IaaS

- Persistent VMs

- Commodity hardware – No SAN

- Large-scale InstallationsLarge scale Installations

- Super-simple UI

How?

2

FOSDEM 2013

vkoukis@grnet.grCluster vs Cloud g g

UI

API

SYNNEFOOPENSTACK

OPENSTACKOPENSTACK API

CLOUD

OPENSTACKOPENSTACK

SYNNEFO

CLUSTER

OPENSTACK

NODE

GANETI

LIBVIRT

HYPERVISORKVMKVM

3

FOSDEM 2013

vkoukis@grnet.grGoogle Ganeti g gg

Mature, production-ready VM cluster management

- used in Google’s corporate infrastructure

Multiple storage backends out of the box

- DRBD, LVM, Files on local or shared directory, RBD (Ceph/RADOS)

External Storage Interface for SAN/NAS support

Ganeti cluster = masterd on master, noded on nodes

Easy to integrate into existing infrastructure

- Remote API over HTTP, pre/post hooks for every action!

4

FOSDEM 2013

vkoukis@grnet.grCompute – Network: Cyclades g gp y

Thin Compute layer over Ganeti

- Python/Django

- Supports multiple Ganeti clusters, for scaling

- OpenStack Compute API

Networking

- No restrictions on deployment – it’s the Ganeti side

- IPv4/IPv6 public networks, complete isolation among VMs

- Thousands of private networks, private L2 segments over single VLAN

5

FOSDEM 2013

vkoukis@grnet.grCyclades g gy

6

FOSDEM 2013

vkoukis@grnet.grStorage: Pithos g gg

Every file is a collection of blocks

Content-based addressing for blocks

Partial file transfers, deduplication, efficient syncing

Independent of storage backend (NFS, RADOS, …)

OpenStack Object Storage API plus extensions

An integral part of Synnefo

- Single store for Files, VM Images

- Uses common backend with Archipelago

7

FOSDEM 2013

vkoukis@grnet.grPithos g g

8

FOSDEM 2013

vkoukis@grnet.grg g

Spawn

my own Ubuntu

Freezemy own Ubuntu

9

FOSDEM 2013

vkoukis@grnet.grg g

Clone

Ubuntu + user data

SnapshotUbuntu + user data

10

FOSDEM 2013

vkoukis@grnet.grg g

11

FOSDEM 2013

vkoukis@grnet.grg g

12

FOSDEM 2013

vkoukis@grnet.grg g

RADOS

Monitor nodes

block I/O

S

Volume Composer

Storage

Mapperppand Blocker

object I/O

Archipelago Object Storage nodes

13

FOSDEM 2013

vkoukis@grnet.grVolumes: Archipelago g gp g

Unified storage for Files, Images Volumes

Thin layer over the actual storage cluster

Storage backend agnostic

- NFS, RADOS, …

Efficient syncing / sharing of Images as files on Pithos

Zero-copy cloning of volumes from ImagesZero copy cloning of volumes from Images

14

FOSDEM 2013

vkoukis@grnet.grArchipelago g gp g

15

FOSDEM 2013

vkoukis@grnet.grCurrent production ~okeanos g gp

Rolling hardware and software upgrades

- Node evacuations with live VM migrations

- Cross-datacenter move, Intel AMD, no VM downtime

- IP renumbering of all VMsg

> 2600 VMs, > 1800 users 2600 VMs, 1800 users

Ready to scale in beta

7 Ganeti clusters currently move to > 10 000 VMs- 7 Ganeti clusters currently, move to > 10.000 VMs

16

FOSDEM 2013

vkoukis@grnet.grTry it out! g gy

http://www.synnefo.orghttp://www.okeanos.iohttp://www.okeanos.io

17