if you knew what i know or cloudwave - improving services in the cloud through collaborative...

27
If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant [email protected] IBM Haifa Research CloudWave Project Coordinator

Upload: melody-uselton

Post on 14-Dec-2015

219 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

If you knew what I knowor

CloudWave - Improving services in the Cloud through collaborative adaptation

Eliot Salant

[email protected]

IBM Haifa Research

CloudWave Project Coordinator

Page 2: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

Where things are today

Grid computing – resources allocated to nodes

Cloud ComputingElasticity

Scale upScale out

Page 3: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

So, what’s the problem? Hint…

Page 4: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

Evolution of software delivery

Runs cost money!

Fail early, fail cheaply

Extensive alpha and beta testing

Page 5: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

Release times (wks) –Windows vs. app

Page 6: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

The DevOps paradigm

Development

Operations

“A large segment of DevOps tools delivers automation and configuration to relax stress on developers and operators during continuous delivery… but to support smooth operation data analytics will need to step up to the plate.” http://siliconangle.com/blog/2014/12/23/predictions-for-devops-in-2015-the-year-of-smart-devops/

Page 7: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

How can the Cloud better support DevOps-style development AND adopt DevOps concepts itself?

Page 8: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

The CloudWave idea

Infrastructure behavior

Application behavior

Page 9: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

CloudWave overviewwww.cloudwave-fp7.eu

3 year project sponsored by the EU’s FP7Just finished the first year

10 partner organizations

6.3 Meuro budget

Page 10: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

Main project concepts

Holistic Cloudevents db

Application monitoringInfrastructuremonitoring

Adaptation engine

FDD

Page 11: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

Some CloudWave Challenges

Page 12: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

Strategy

Page 13: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

Functional Decomposition

CW DevOp engineer

Development Env

Administration Env.

Runtime Environment

Feedback

App changes

FeedbackDeployment

FeedbackConfiguration CloudWave Admin

Status visual.

Administration

Level 1 decomposition

Page 14: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

Terminology

OpenStack – Open Source cloud computing platform

Heat – Orchestration tool for deployment on OpenStack cloud

HOT – Heat Orchestration Template

Ceilometer – OpenStack resource monitoring tool

Enactment point – Sets the state of the application for adaptation

Page 15: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

Concept

Application and monitoring environment

Monitoring collection and

Analysis Coordinated Adaptation

Monitoring data

Enactment point definition

Enactment trigger

Living State Manager

User input

OpenStack action

Application adaptation request

Heat Engine

FDD

Physical machine

Application and monitoring environment

Cloud Stack Mgr

Page 16: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

CW Monitoring

Physical machine: Nova Compute Node

CW.so library

CW Pollister

PollsterN

Pollster1…

Application code

Application logging

tools

Celiometer Agent

CW probe

VM

OpenStack Controller Node

CWE dispatcher

Mongo db

Celiometer Collector

Page 17: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

Adding analytics

OpenStack Controller Node

CWE dispatcher

Mongo db

Celiometer Collector

CelioEsper

EsperOther CEP

Engines

To Living StateManager

From monitoring

Page 18: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

Living State Manager

HOT++

Heat Engine

Adaptation Engine

CW Grunt

From Ceiloesper

Page 19: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

All together now

Page 20: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

Coordinated Adaptation

Page 21: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

Directions for Coordinated Adaptation

• Machine learning to react to enactment point triggers

• Adaptation of both infrastructure and application

• Determination of new enactment points

Page 22: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

Some challenges• Multiple layers for adaptation

Page 23: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

Coordinated adaptation challenges

• Ultimate effect of adaptation actions at different levels not always clear

• Sample set for machine learning

• Standardizing application adaptations

• …

Page 24: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

Example of potential coordinated adaptation

• Computations on a mobile phone vs. in Cloud

• IoT devices – autonomy vs. centralized control

Page 25: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

Feedback Drive Design

• Better monitoring information and analysis to help developers

• Analysis of Adaptation Engine efficiency

• Feedback driven testing– Evolution of testing

• Problem recreation

Page 26: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

FDD Challenges

• Effective feedback visualization

• Intelligent hints to developers (analysis)

• What-if analysis

Page 27: If you knew what I know or CloudWave - Improving services in the Cloud through collaborative adaptation Eliot Salant salant@il.ibm.com IBM Haifa Research

In summary…