synnefo open source software for iaas clouds

17
1 FOSDEM 2013 vkoukis@grnet .gr INTRODUCING THE SYNNEFO OPEN SOURCE IAAS PLATFORM. VANGELIS KOUKIS TECHNICAL LEAD, ~OKEANOS

Upload: nectarioskoziris

Post on 12-Nov-2014

36 views

Category:

Documents


2 download

DESCRIPTION

Synnefo is open source cloud software used to create massively scalable IaaS clouds. It uses Google Ganeti for the low level VM management. It also talks to the outside world through the OpenStack APIs with extensions for advanced operations. Go to www.synnefo.org for more, and try it out! Sign up to get free VMs.

TRANSCRIPT

Page 1: Synnefo open source software for IaaS Clouds

1

FOSDEM 2013

[email protected]

INTRODUCING THE SYNNEFO OPEN SOURCE IAAS PLATFORM. VANGELIS KOUKIS TECHNICAL LEAD, ~OKEANOS

Page 2: Synnefo open source software for IaaS Clouds

2

FOSDEM 2013

[email protected]

Motivation: ~okeanos

Goals

- Everything open source

- Production-quality IaaS

- Persistent VMs

- Commodity hardware – No SAN

- Large-scale Installations

- Super-simple UI

How?

Page 3: Synnefo open source software for IaaS Clouds

3

FOSDEM 2013

[email protected]

Cluster vs Cloud

UI

API

CLOUD

CLUSTER

NODE

HYPERVISOR

SYNNEFOOPENSTACK

OPENSTACK

OPENSTACK

SYNNEFO

OPENSTACK

GANETI

LIBVIRT

KVMKVM

Page 4: Synnefo open source software for IaaS Clouds

4

FOSDEM 2013

[email protected]

Google Ganeti

Mature, production-ready VM cluster management

- used in Google’s corporate infrastructure

Multiple storage backends out of the box

- DRBD, LVM, Files on local or shared directory, RBD (Ceph/RADOS)

External Storage Interface for SAN/NAS support

Ganeti cluster = masterd on master, noded on nodes

Easy to integrate into existing infrastructure

- Remote API over HTTP, pre/post hooks for every action!

Page 5: Synnefo open source software for IaaS Clouds

5

FOSDEM 2013

[email protected]

Compute – Network: Cyclades

Thin Compute layer over Ganeti

- Python/Django

- Supports multiple Ganeti clusters, for scaling

- OpenStack Compute API

Networking

- No restrictions on deployment – it’s the Ganeti side

- IPv4/IPv6 public networks, complete isolation among VMs

- Thousands of private networks, private L2 segments over single VLAN

Page 6: Synnefo open source software for IaaS Clouds

6

FOSDEM 2013

[email protected]

Cyclades

Page 7: Synnefo open source software for IaaS Clouds

7

FOSDEM 2013

[email protected]

Storage: Pithos

Every file is a collection of blocks

Content-based addressing for blocks

Partial file transfers, deduplication, efficient syncing

Independent of storage backend (NFS, RADOS, …)

OpenStack Object Storage API plus extensions

An integral part of Synnefo

- Single store for Files, VM Images

- Uses common backend with Archipelago

Page 8: Synnefo open source software for IaaS Clouds

8

FOSDEM 2013

[email protected]

Pithos

Page 9: Synnefo open source software for IaaS Clouds

9

FOSDEM 2013

[email protected]

Spawn

FreezeUbuntumy own Ubuntu

Page 10: Synnefo open source software for IaaS Clouds

10

FOSDEM 2013

[email protected]

Clone

Snapshot

Ubuntu rootUbuntu + user data

Page 11: Synnefo open source software for IaaS Clouds

11

FOSDEM 2013

[email protected]

golden Debian

Page 12: Synnefo open source software for IaaS Clouds

12

FOSDEM 2013

[email protected]

Page 13: Synnefo open source software for IaaS Clouds

13

FOSDEM 2013

[email protected]

Storage

Archipelago

RADOS

Object Storage nodes

Mapperand Blocker

Volume Composer

object I/O

Monitor nodes

block I/O

Page 14: Synnefo open source software for IaaS Clouds

14

FOSDEM 2013

[email protected]

Volumes: Archipelago

Unified storage for Files, Images Volumes

Thin layer over the actual storage cluster

Storage backend agnostic

- NFS, RADOS, …

Efficient syncing / sharing of Images as files on Pithos

Zero-copy cloning of volumes from Images

Page 15: Synnefo open source software for IaaS Clouds

15

FOSDEM 2013

[email protected]

Archipelago

Page 16: Synnefo open source software for IaaS Clouds

16

FOSDEM 2013

[email protected]

Current production ~okeanos

Rolling hardware and software upgrades

- Node evacuations with live VM migrations

- Cross-datacenter move, Intel AMD, no VM downtime

- IP renumbering of all VMs

> 2600 VMs, > 1800 users

Ready to scale in beta

- 7 Ganeti clusters currently, move to > 10.000 VMs

Page 17: Synnefo open source software for IaaS Clouds

17

FOSDEM 2013

[email protected]

Try it out!

http://www.synnefo.orghttp://www.okeanos.io