community cloud antonioseverien
DESCRIPTION
Community networks are a reality and provide and interesting heterogeneous environment for testing projects for the future internet. The CONFINE project aims to create a testbed on such environment, thus this study aims to evaluate the viability of providing cloud services on community networks by experimenting with different cloud middleware.TRANSCRIPT
Community Network Cloud Middleware
Supervisor Leandro Navarro [email protected]
“A Storage Approach”
Students Antonio Severien
Ioanna Tsalochidou [email protected]
Outline
• IntroducCon • Cloud Middleware • ObjecCves • OpenStack • Experimental Setup • Results • Future Work • Findings • Summary 06/12/12 2
IntroducCon
• Community Networks Testbed for the Future Internet – Commodity wireless and opCcal links; heterogeneous nodes; different
rouCng protocols; different applicaCons
• Cloud middleware running on “wild-‐area” resources – OpenStack, OpenNebula – Evaluate scalability and “suitability” to provide either; compu.ng or
storage services
06/12/12 3
Cloud Middleware
• Cloud OperaCng System – Controls large pools of compute, networking and storage resources throughout a datacenter
Your ApplicaCons
Cl
Standard Hardware
Cloud OperaCng System
Storage Networking Compute Management
GUI
06/12/12 4
ObjecCves • Observe how the different cloud middlewares behave – On unstable network environment – On scarce hardware resources
• Create a methodology to be used on CONFINE
• Preliminary benchmarking • TesCng – Inject delays on network (Netem) – Measure performance (FileBench)
06/12/12 5
OpenStack Conceptual Architecture
Figure taken from h`p://docs.openstack.org/folsom/openstack-‐compute/admin/content/figures/openstack-‐conceptual-‐arch-‐folsom.jpg 06/12/12 6
OpenStack Logical Architecture
Figure taken from h`p://docs.openstack.org/folsom/openstack-‐compute/admin/content/figures/openstack-‐logical-‐arch-‐folsom.jpg 06/12/12 7
OpenStack Logical Architecture
Figure taken from h`p://docs.openstack.org/folsom/openstack-‐compute/admin/content/figures/openstack-‐logical-‐arch-‐folsom.jpg 06/12/12 8
OpenStack Storage
Storage Services – Block Storage (Cinder) à nova-‐volume (iSCSI/LVM)
• Uses LVM to create and manage volumes, and exports them via iSCSI
– Object Storage (Swif) • Low level of abstracCon • Good for staCc content (e.g., CDN) • HTTP interface with REST API
– File Storage • “none na.ve support” (There is a connector for GlusterFS)
06/12/12 9
Cinder (Nova-‐volume)
Instance
Volume
Instance A volume can be a`ached/detached from running instances
Block Storage Store
06/12/12 10
Cinder (Block Storage)
Block Storage Block Storage Block Storage
Compute
Volume Store
Instance
06/12/12 11
Cinder (Block Storage)
Block Storage Block Storage Block Storage
Compute
Volume Store
Instance
06/12/12 12
Running Compute Node
Figures taken from h`p://docs.openstack.org/folsom/openstack-‐compute/admin/content/images-‐and-‐instances.html
06/12/12 13
Experimental Setup
• FileBench Workload Generator – File system and storage benchmark – Variety of workloads and pre-‐defined workloads for webserver, file server, etc.
– Reports throughput and latency – Uses Workload Model Language (WML)
Cinder Volume Store
Nova Compute & Controller
06/12/12 14
Experimental Setup
1. Off-‐line creaCon of volumes 2. At-‐runCme a`achment of volumes to instances hosted within
the same availability zones 3. Formakng mounted volumes with ext3 file system 4. MounCng the forma`ed volume as a file system within a Linux
instance 5. Subsequent benchmarking…
Steps for experiments:
06/12/12 15
Experiment Results Read Experiments
File Size: 3GB IO Size: 1MB Threads: 1 Caching: disabled
06/12/12 16
Experiment Results Write Experiments
File Size: 3GB IO Size: 1MB Threads: 1 Caching: disabled
06/12/12 17
Future Work
• Use OpenNebula and perform the same experiments • Expand this work to run on a larger scale • Use CONFINE testbed for experiments
06/12/12 18
Future Work (Real Deal)
06/12/12 19
Summary
• Cloud Middleware: nothing but a resource manager • Deployed OpenStack in a micro test-‐environment
• Benchmarking: diverse workloads
• Community Cloud… it is possible, but with restricCons bounded by available resources
06/12/12 20
Findings
• OpenStack – Is evolving – Needs to be more user-‐friendly – Dynamic configuraCon
• Community Cloud – Provide services that require less resources – “Guarantee” stability and availability of resources
06/12/12 21
Acknowledgments
• Thanks to Leandro Navarro • Thanks to Ying for clearing the clouds from the cloud • Thanks to Manos and Mudit for networking assistance
• Thanks to Ioanna for accepCng the challenge • Thanks to the OpenStack community • Thanks to the Linux community
06/12/12 22
References • OpenStack: h`p://www.openstack.org • Ubuntu Cloud: h`p://www.ubuntu.com/cloud • OpenNebula: h`p://opennebula.org/ • DevStack: h`p://devstack.org/ • CONFINE: h`p://confine-‐project.eu/ • FileBench: h`p://sourceforge.net/apps/mediawiki/filebench/ • Netem:
h`p://www.linuxfoundaCon.org/collaborate/workgroups/networking/netem
06/12/12 23
