synnefo open source software for iaas clouds

1

FOSDEM 2013

vkoukis@grnet.gr

INTRODUCING THE SYNNEFO OPEN SOURCE IAAS PLATFORM. VANGELIS KOUKIS TECHNICAL LEAD, ~OKEANOS

2

FOSDEM 2013

vkoukis@grnet.gr

Motivation: ~okeanos

Goals

- Everything open source

- Production-quality IaaS

- Persistent VMs

- Commodity hardware – No SAN

- Large-scale Installations

- Super-simple UI

How?

3

FOSDEM 2013

vkoukis@grnet.gr

Cluster vs Cloud

UI

API

CLOUD

CLUSTER

NODE

HYPERVISOR

SYNNEFOOPENSTACK

OPENSTACK

OPENSTACK

SYNNEFO

OPENSTACK

GANETI

LIBVIRT

KVMKVM

4

FOSDEM 2013

vkoukis@grnet.gr

Google Ganeti

Mature, production-ready VM cluster management

- used in Google’s corporate infrastructure

Multiple storage backends out of the box

- DRBD, LVM, Files on local or shared directory, RBD (Ceph/RADOS)

External Storage Interface for SAN/NAS support

Ganeti cluster = masterd on master, noded on nodes

Easy to integrate into existing infrastructure

- Remote API over HTTP, pre/post hooks for every action!

5

FOSDEM 2013

vkoukis@grnet.gr

Compute – Network: Cyclades

Thin Compute layer over Ganeti

- Python/Django

- Supports multiple Ganeti clusters, for scaling

- OpenStack Compute API

Networking

- No restrictions on deployment – it’s the Ganeti side

- IPv4/IPv6 public networks, complete isolation among VMs

- Thousands of private networks, private L2 segments over single VLAN

6

FOSDEM 2013

vkoukis@grnet.gr

Cyclades

7

FOSDEM 2013

vkoukis@grnet.gr

Storage: Pithos

Every file is a collection of blocks

Content-based addressing for blocks

Partial file transfers, deduplication, efficient syncing

Independent of storage backend (NFS, RADOS, …)

OpenStack Object Storage API plus extensions

An integral part of Synnefo

- Single store for Files, VM Images

- Uses common backend with Archipelago

8

FOSDEM 2013

vkoukis@grnet.gr

Pithos

9

FOSDEM 2013

vkoukis@grnet.gr

Spawn

FreezeUbuntumy own Ubuntu

10

FOSDEM 2013

vkoukis@grnet.gr

Clone

Snapshot

Ubuntu rootUbuntu + user data

11

FOSDEM 2013

vkoukis@grnet.gr

golden Debian

12

FOSDEM 2013

vkoukis@grnet.gr

13

FOSDEM 2013

vkoukis@grnet.gr

Storage

Archipelago

RADOS

Object Storage nodes

Mapperand Blocker

Volume Composer

object I/O

Monitor nodes

block I/O

14

FOSDEM 2013

vkoukis@grnet.gr

Volumes: Archipelago

Unified storage for Files, Images Volumes

Thin layer over the actual storage cluster

Storage backend agnostic

- NFS, RADOS, …

Efficient syncing / sharing of Images as files on Pithos

Zero-copy cloning of volumes from Images

15

FOSDEM 2013

vkoukis@grnet.gr

Archipelago

16

FOSDEM 2013

vkoukis@grnet.gr

Current production ~okeanos

Rolling hardware and software upgrades

- Node evacuations with live VM migrations

- Cross-datacenter move, Intel AMD, no VM downtime

- IP renumbering of all VMs

> 2600 VMs, > 1800 users

Ready to scale in beta

- 7 Ganeti clusters currently, move to > 10.000 VMs

17

FOSDEM 2013

vkoukis@grnet.gr

Try it out!

http://www.synnefo.orghttp://www.okeanos.io