ibm initiatives in autonomic computing

1

© 2002 IBM Corporation© 2003 IBM Corporation

Autonomic Computing

IBM Initiatives in Autonomic Computing

Alan Ganek

Vice President, Autonomic Computing

© 2003 IBM Corporation 2

The on demand Era

Simplify infrastructure

Sense and respond to business changes

Protect privacyDeliver unique value to

customers

Ensure continuity

Improve cost structure

Accelerating advances in technology

Deeper integration of IT with business systems

Emergence of industry ecosystems


The good news…Processor Storage

Communications Systems


The bad news…

WorkloadsWorkloads

PricePriceComplexity

Services and Software Costs

Skills Shortage

New Workloads


Business Challenges

Complex, heterogeneous environments

Outages of mission-critical systems cost quite a bit

Poorly documented legacy applications make it painful to diagnose and resolve complex cross-product problems

25-50% of IT resources are spent on problem

determination and resolution

Up to 40% of today’s outages are unscheduled stoppages

The skills needed to do manual cross-product problem determination are scarce and expensive

Missing or Loss of critical data is immeasurable

Outages & unscheduled work leads to saturation on backup systems & power systems


Autonomic Vision

Focus on Mission, not infrastructure!

“Autonomic computing allows companies to operate more efficiently and achieve more from their existing IT environments, enabling increased responsiveness, business continuance and availability.”

—Rick Sturm

“Intelligent” open systems that: Manage complexity Know themselves Continuously tune themselves Adapt to unpredictable conditions Prevent and recover from failures Provide a safe environment


Autonomic Computing Attributes

Increased Responsiveness

Adapt to dynamically changing environments

Business Resiliency

Discover, diagnose,and act to prevent

disruptions

OperationalEfficiency

Tune resources and balance workloads to maximize use of IT resources

Secure Information

and Resources

Anticipate, detect, identify, and

protect against attacks

Self-managing systems that deliver:


How does autonomic computing help organizations?

Improved resiliency and quality of service Always there when you

need it

Safe and secure

Time to Value Improves responsiveness

Reduction in Risks

Reduction in Infrastructure Costs Better asset utilization More productive people Reinvestment of IT productivity and cost savings

“Autonomic computing is a vision that will take several years to realize, but with the model that IBM has outlined, there are benefits attainable at every step, which pay you back...fairly quickly for the investments you make.” —Mike Gilpin


Open Standards

The Big Picture of Autonomic Computing Technology

Autonomic core capabilities

Products delivering autonomic features

Business policy

Au

ton

om

ic C

om

pu

tin

g A

rch

itec

ture

Solution Install

Problem Determination Admin Console

PolicyResource

Provisioning

• Define a base reference architecture model which creates a common vernacular for autonomic computing

• Deliver core infrastructure technologies that provide for an open framework for the industry

• Deliver products with built-in autonomic capabilities

• Create open standards for autonomic computing


A Holistic Approach

• End-to-end automation enabled by consistent technology across all system elements

• Based on open standards

• Distributed globally into a single virtual operating environment

Pro

fessio

nal S

erv

ices

NetworkStorageServers

Web Services

Open Grid Services Architecture - OGSA

ApplicationServers

ISVSolutions

DatabaseSystemMgmt

Applications

Au

ton

om

ic C

ap

ab

ilit

ies

Architecture Framework

Customer-centric solutions, not just products Industry standards are key


Autonomic Computing Architecture Overview

Managed Element

Sensors

Resource Manager

Effectors

Sensors Effectors

Knowledge

Plan

ExecuteMonitor

Analyze

Data Action

Autonomic Manager

Manageability Interface


Autonomic Control Loops: next step evolution

Autonomic featuresLocal view

Global environment view and knowledge

USER RESPONS

E TIMEAVAIL.

RESOURCE

BUSINESS SLA

POLICY


Multiple Contexts for Autonomic Behavior

System Elements(Intra-element

self-management)

Groups of Elements

(Inter-elementself-management)

ServerFarm

EnterpriseNetwork

StoragePool

Business Solutions(Business Policies,

Processes, Contracts)

Customer Relationship Management

EnterpriseResourcePlanning

Servers StorageNetworkDevices Middleware Database Applications


ThinkPad Active Protection System…

A patented hardware and software solution that can reduce hard drive failures by avoiding fall-induced damage

Hardware: Motion Detector (or “accelerometer”) on the system board senses movement that could cause system damage

Same chip used in automobile airbags

Software: Interprets signals from the accelerometer and signals the hard drive to temporarily park the drive head when rapid system motion or vibration is detected

Can differentiate between potentially harmful movements and repetitive motion (such as in a car or airplane)

The system senses computer’s orientation and displays it on the screen real-time

Standard on all T41 and R50

ThinkPads


Storage attributes

can be auto-

discovered

Storage can be aggregated into storage pools with

similar service class

Storage can be changed without

disruption to the application

server

Virtualization hides the physical

topology from the application

servers

Individual application servers do

not manage their own

file system

TotalStorage:SAN File Systems and SAN Volume Controller

The IBM TotalStorage Virtualization software is designed to automate configuration and provisioning across multiple servers.

Tasks that historically have been done manually, are automated, thus reducing complexity and increasing productivity

SAN File System and SAN Volume Controller

UNIXLinux

SUN W2K

AIX

HP

Files are automatically provisioned based upon policy based

rules


WebSphere Application Server v5

Policy-driven Self-Optimizing Solution:IBM Server Allocation for WebSphere

IBM Server Allocation for WebSphere

ForecasterAdvice Application

Internet

Load Balancer WebSphere Transactional Grid

Mid priority

Low priority

High priority

DatabaseServer

Account Manager

Stock Trading

ParallelServices

ApplicationProvisioning

•Multiple WebSphere transactional applications

•Multiple Service Level objectives

•Dynamic and automated application provisioning


IT Infrastructure Orchestration Business challenge Extend Events to millions of sports fans Real-time “point-by-point” scores and statistics Latest news delivered online

On demand business benefits Secure and scalable infrastructure (up to 50 times the previous

infrastructure capacity) Real-time access to all play-by-play tournament information on “as-

needed” basis Global reach with around-the-clock availability

When resources not in use,allocation is given to biotechnology research

Hour of Day

Tourcast SU Utilization Annika at the Colonial

0

50

100

150

200

0:5

91

:59

2:5

9

3:5

9

4:5

9

5:5

9

6:5

9

7:5

9

8:5

9

9:5

9

10

:59

11

:59

12

:59

13

:59

14

:59

15

:59

16

:59

17

:59

18

:59

19

:59

20

:59

21

:59

22

:59

23

:59

Allocated Thursday Friday Saturday Sunday

Tivoli Intelligent Orchestrator


Intelligent Orchestration Saves Time and Costs:IBM Tivoli Intelligent Orchestrator

100 Servers at 20% Capacity

100 Software Licenses

3 Administrators

Maintenance Costs $$$$$

Add/Remove Resources in Days

50 Servers at 40% Capacityutilizing current infrastructure

50 Software Licenses

1 Administrator

Maintenance Costs $

Add/Remove Resources in Minutes

Intelligencebefore after


Open Standards

Core Capabilities Enable Autonomic Behavior

Autonomic core capabilities

Products delivering autonomic features

Business policy

Au

ton

om

ic C

om

pu

tin

g A

rch

itec

ture

Solution Install

Problem Determination Admin Console

PolicyResource

Provisioning

Service Support

Solution install & maintenance

Problem determination

Common System Administration

Service Delivery

Policy-based security and management

Autonomic monitoring

Complex analysis

Provisioning

Heterogeneous workload management


Building an Open Framework for the Industry… Solution Install & Maintenance

IU

IUIU

IU

IU

IU

Tooling

Installer: Dependency Checkers,Install, Configuration &Verification Actions,Updates

Solution Installed in

Hosting Environment

Managing changes through the lifecycle of the solution

One consistent software installation technology across all products Consistent and up-to-date configuration and dependency data Reduced deployment time with less errors Reduced software maintenance time, improved analysis of failed system components Component-based product install

Standards-based: OGSA, Web Services,CIM

Creation of Installable Units: descriptors and artifacts


Building an Open Framework for the Industry… Integrated Solutions Console

One Stop Shopping for all Administrative Tasks

One consistent user interface across product portfolio

Common runtime infrastructure and development tools based on industry standards, component reuse

Provides a presentation framework for other autonomic core technologies

Through a unified portal

Standards-based: J2EE, JSR168

...n

Unified end-to-end customer tasks from hardware management thru middleware


Building a Self-Healing System

Level 1

Data capture

Analysis

Self Healing

Common log format

StandardizationAdapters

Symptom databases

CorrelationSimple analysis

Consult PolicyTake corrective

actionClosed Loop

Remediation

Complex analysisSuggested

Corrective Action

Increasing level of automation


Disparate pieces and parts

Tools focused on individual products

No common interfaces among tools

No synergies in building tools OR in creating log entries

Log Format TodayLog Format Tomorrow

Database

Networks

ApplicationServer

Servers

Storage devices

Applications Common Base Eventsubmitted to OASIS

Generic Log Adapters Common formats for

log files Common set of tools Common interfaces

among tools

Ad

ap

ters

Ad

ap

ters

common base event


Log and Trace Analyzer for Autonomic Computing

Viewing, analysis, and correlation of log files

Consolidated environment that deals with logs and traces produced by various components

Easier and faster for developers and support personnel to debug and resolve problems

Link to WebSphere symptom database available today


data analysis

information analysis

knowledge reasoning

Data

e.g.: Memory,

CPU

Information

e.g.:App stopped, Mem leak

Knowledge

e.g.: Restart,

command

Analyze Plan

Monitor ExecuteAction

Resource Model:Process Analysis

Resource Model:Memory Management

Resource Model:Event Log Processing

Data

Tivoli Autonomic Monitoring Engine

Knowledge

Policies

validate

action

In development

In development

Symptomservice

Knowledge

situation

actionable cause

In development

In development


Autonomic Computing Self-Healing Systems

Feedback

Dat

a

Policies

Knowledge

common base event

Policyengine

Symptomservice

ApplicationServer

Servers

Storage devices

Database

Networks

Applications Ad

ap

ters

Ad

ap

ters

Tivoli Autonomic Monitoring Engine


Life cycle of autonomic elements

Multi-agent learning & negotiation/conflict resolution

Software tools Testing, verification,

robustness Policies and SLA’s Availability, fault

tolerance & recovery Continuous operations Problem determination

Research ChallengesInnovationNeeded!!

Optimization & prediction End to end security Distributed resource

management & scaling Peer system interaction Context awareness Human computer interface Metering, monitoring &

control Cultural change & trust . . . .


Autonomic Computing alphaWorks Zone Get started developing autonomic solutions

now

– Available on alphaWorks:• Log and Trace Tool

• Business Workload Management Developer Kit

• Tivoli Resource Model Builder

• Agent Building and Learning Environment (ABLE)

• IBM Grid Toolbox

• Web Services Tools

– Coming soon – components from:• Autonomic Computing Toolkit

• Solution Install

• Policy-based Management

• and more!

www.alphaworks.ibm.com/autonomic


the journey has started……

Products, services available today

Architecture and core technologies emerging

IBM is working with business partners and standards organizations to develop

open standards for self-managing systems

Broad IT industry participation is needed – this is an industry-wide initiative

Innovation & Collaboration are a must!! Aggressive research is essential!!

Freeing people to focus on their business instead of

their infrastructure


Questions?

Web sites:

www.ibm.com/autonomic

www.research.ibm.com/autonomic

www.alphaworks.ibm.com

A Vision of Autonomic Computing– IEEE Computer, January 2003

IBM Systems Journal special issue on Autonomic Computing– http://www.research.ibm.com/journal/sj42-1.html

ibm initiatives in autonomic computing

Documents