the challenge of managing “websphere farm” … challenge of managing “websphere farm”...

®

IBM Software Group

© 2007 IBM Corporation

The Challenge of Managing “WebSphere Farm”Configuration

Rational Automation Framework for WebSphereTerence ChowTechnical SpecialistIBM Rational Hong Kong

IBM Software Group | Rational software

2

Example: Set Up A Simple WAS Cluster


3

Perform pre-installation tasks (05 steps)

Create, configure, and verify deployment manager profile (20 steps)

Create, configure, and verify application server profile (12 steps)

Create, configure, and verify custom profile (10 steps)

Federate nodes (both app server and custom profiles) (14 steps)

Install, configure, and verify IBM HTTP server (14 steps)

Install the distributed remote plug-in (20 steps)

Create and configure the horizontal cluster (High Availability) (17 steps)

Enable and configure HA persistent service (09 steps)

Configure HTTP session persistence (41 steps)� Memory-to-memory (20 steps)

� Database (21 steps)

Create and configure SIBus and messaging engine (5 steps)

Total Steps = 150+What’s Happening Behind the Scenes


4

Now consider something more complex….


5

Common Pains in WebSphere EnvironmentsLack of consistency and/or repeatability

�Staff taxed by environment synchronization efforts; Configuration changes hard to manage

�Challenge to connect disparate groups under single, enforceable process

No ability to manage WebSphere environments beyond the cell level�Most WebSphere admin performed today using home-grown solutions.

� Cost-center and a burden to the business.

No change history or audit trail for WebSphere configuration

Costly automation of configuration changes and deployments �Requires custom coding

�Time consuming to deploy without a framework

Lack of a disaster recovery


6

Expand Value with Software Production Orchestration

Operations

Creative B

ehavior

Procedural R

igor

Requirements

Design

Coding

Build

Stage

Deploy

Test

Package

Package

Handoff

Production/GA

Development

“DevOps”Software Delivery Automation

“Front-Office”Workflow Automation

“Back-Office”Production Automation

“Consumers”UsersBuild

Rational

Automation Framework

TestDeploy


7

worker

Agent

Automation Targets

Clients

DatabaseApplication Server

Automation Server

Rational Asset

Analyzer

Agent

worker

ClearCase / Synergyworker

Agent

Rational Asset

Manager (RAM)

worker

Agent

Rational AppScan

worker

Agent

serverServer

Serverserver

Background: The Build Forge Automation System� Centralized automation server oriented to software development activities

� Distributed automation system supporting huge variety of platforms

� Windows, Linux, Unix, Mac, z/OS, i5/OS, zLinux, Tandem, etc.

� Enterprise Proven automation platform

worker

Agent

worker

Agent

Rational Software Analyzer

Mainframe


RAFW Topology

Rational Build Forge Management Console

Rational Build Forge Agent

Rational Automation Framework for

WebSphere

Framework Server

Engine, Services Layer, UI

WebSphere Base/ND Cell

WebSphere Portal Cell

Target Systems

SSH

SSH

Windows SMB/CFIS/DCE/RPC

Windows SMB/CFIS/DCE/RPC


9

Example Build Forge Automated ProcessBuild Forge

GO

SCM RationalClear Quest

RAM

1.

ExtractSourceCode

6.

Update Defect

Tracking

AggregatedReports

across entireProcess

2.

ExtractAsset

Metadata

3.

Static Analysis of

Source

4.

BuildSourceCode

5.

PackageBuild

Results

7.

DeployBuild

Results

8.

ExecuteTests

Effect of Class Sharing on Memory Footprint in WAS V6.1

126

245

363

481

600

719

140

233

328

422

516

609

0

100

200

300

400

500

600

700

800

1 2 3 4 5 6

Number of Running App Servers

Me

gaby

tes

WAS 6.02 WAS 6.1

System configuration Linux: IBM X-Series 335, 2x 3.2 GHz Intel Xeon, 8.00 GB RAM, Suse Enterprise Linux 9 SP3

RationalClearCase,

Team Concert,Telelogic Synergy

Rational Asset

Manager

Rational Software Analyzer, AppScan,

Asset Analyzer

Rational ClearQuest,

Team Concert,Telelogic Change

Rational Quality Manager

Rational WebSphere Framework


10

What Is the Rational Automation Framework for WebSphere?

Customizable Framework for the WebSphere Family of products that delivers

�WebSphere product installation & patching automation

�Configuration change management

�Application deployment automation

�Accuracy“Data Driven” - RAFW maintains normalized configuration data

Apply the right data to the right WebSphere environment�Reliability

Apply data in repeatable manner to WebSphere environments

�Consistency

The framework’s strengths are…


11

Does It Work?.... Customer stories:

Financial Service Company:�At present, there are some automated processes in place, but with limited consistency.

Knowledge and processes are not standardized across the teams and applications. Much of engineers’ time is spent executing the steps require d to update and deploy these applications . With repeatable automated build and deploys using Build Forge, this could be eliminated. In discussions with the team, 50-75% of the total t ime of engineering is spent on managing and maintaining Websphere alone . Build Forge can be used to improve the overall efficiency and productivity of the engineers as well as the team leads and management.

�Source: Rational Build Forge Software Value Assessment for a Financial Company (2007)


12

� Visa – End to end automation from software build, release, test and deploy – significantly improved productivity with same staff

� ING - Reduced Portal environment deployment from 4-5 weeks to 1 week

� Circuit City – Reduced WebSphere Application Server environment deployment from 2-3 weeks to 3-4 days

� Fifth 3rd Bank – Automated WebSphere administration from 12 headcount by 30%

RAFW Successes


13

Why you need RAFW

Reduce Costs

Free staff up for strategic initiatives

Reduce labor costs

If Time = Money, Less time = More Money

Repeatability & Consistency

Rebuild environments consistently

Reliable and Repeatable Disaster Recovery

Introduce consistency across SDLC

Reduce Maintenance Time

Minimize deployment/environment build time

Build Environments in hours not days

Deploy code in minutes not hours

Gaining Control of your Environment

Eliminate Spaghetti Infrastructure problem

Enforce Standards Across the Enterprise

Reduce Human Errors


14

RAFW: Automation of WebSphere & Portal Admin

Why Does it Get me?�Enterprise-level solution with

Multiple O/S support

�Multi-cell WebSphere Auotmation

�Over *300* pre-built, field tested actions for WAS and Portal

� Plus 100+ Portal specific actions

Common use scenarios�Multi-cell WebSphere tool

�Environment build out

�Configuration capture

�Application deployment

�Change management for WebSphere configuration

�Configuration comparison

Development

Q&A

Staging

Production

Source Control

Build Forge Framework for Websphere Server

Architectural Overview


15

Centralizing the Management of WebSphereMulti-cell WebSphere management

Secure communication (using ssh)

Enterprise solution

Multiple OS support

Framework Server


16

Configuration Scope


17

How RAFW functionsAbility to chain actions together

Context switching between cells

Data Driven

Binding of scoped configuration data, environment, and action execution

Common collection of reusable actions

Reflects scope in WebSphere


18

� Every night Build Forge executes a scheduled comparison of the live cell configuration against the Master.

� Any difference causes an email notification to be generated and sent to WebSphere administrator for that cell.

Cell

ND Cell

Example Use Case: Monitor Live WebSphere Configuration

Source Control System

Rational Build Forge

WebSphere Application Server (and derivatives)

Master (approved) configuration stored under change control

Email or RSS feed notification of results of configuration comparison


19

Example Use Case: Automating Cloud DevelopmentIBM Rational Build Forge with Rational Automation Framework for WebSphere

Cut the Cost of Software Development�Rational brings industrial production techniques to

your cloud development lifecycle that reduce time-to-market and deliver higher quality, consistent results

Improve Control in WebSphere Environments�Over 400 field-proven automated tasks for configuration

and application deployment to Application Server and Portal Server targets

Automate for Agility�Automate your existing tools and processes, gain

rapid ROI, and then fine-tune your cloud development for increased efficiency and savings

Head for the Clouds for Greater Resource Utilization�Rational Automation Framework for WebSphere integration with WebSphere Cloudburst

delivers on-demand, easily customized middleware appliances for all purposes


20

WebSphere Application Server (and derivatives)

WebSphere CloudBurst1. Dispense WebSphere

Pattern

3. RAFW package anddeploy application

RAFW

Rational Automation Framework for WebSphere CloudBurst

2. CloudBurst script callback to RAFW

Cloud

CustomNode

IBM HTTPServer

DeploymentManager

CustomNode

Note: This scenario can be extended to include addi tional Rational components including

Rational Asset Manager, Rational AppScan, and Ratio nal Software Architect

Start:RAFWInvokesCloudBurst


21

Example Use Case for Portal in the Developer Cloud� The Developer Cloud includes an image

for Portal Server that is to be used on-demand for testing the Portal application

� RAFW bridges the gap between development IDE and Portal Server running in the Developer Cloud

Rational Build Forge & Rational Automation Framework for

WebSphere

SCMApplication Developer

Development Tools

WebSpherePortal Server

IMAGE

WebSpherePortal Server

Theme Portlet

Portlet WSRP Portlet

Rational AppScanRQM

1. Portlet developer makes modifications to a portion of the Portal Application and checks changes in to the project SCM

5. Testing and validation is performed against Portal application to detect quiality problems and potential security vulnerabilities

2. An RAFW automated process is launched that ensures that the target Portal Server image is started within the Developer Cloud.

3. The RAFW automated process builds the portal application changes into a solution release package

4. The RAFW automated process deploys the solution release package on to the Portal Server running in the Developer Cloud


What that looks like in RAFWBuild Out New WebSphere Clustered

Environment

1. Generate new Environment using Framework Wizard

2. Click on New Project to launch build of new Environment

3. Automatically Notify interested parties upon completion

4. Add steps in project for Configuration elements (JDBC, JMS, JAAS etc)

5. Schedule unattended jobs

6. Rebuild environment as Needed!

Complete WebSphere Cell Build out!


Screen capture of RAFW Environment Wizard


Screen capture of Framework LibrariesCommon configuration and deployment patterns defined as RAFW “building block” reusable Libraries


Middleware Supported

AIX HP-UX Linux Solaris Windows zLinux z/OS

IBM HTTP ServerVersion 6.0, 6.1, 7.0

InstallConfigureDeploy






Configure*Deploy*

WebSphere Application ServerVersion 6.0, 6.1, 7.0







Configure*Deploy*

WebSphere Application Server NDVersion 6.0, 6.1, 7.0







Configure*Deploy

WebSphere PortalVersion 6.0, 6.1







Configure*Deploy

* z/OS Support Planned for 4Q09

RAFW Release 7.1.1 (May 15, 2009)

Supported Middleware Versions, Platforms, and Action Types


�Detailed domain models

�Calculates required deployment tasks

�Maps deployment tasks to automated jobs in Build Forge

�Stores models and deployment plan in RAM

�Publishes deployment plan directly to Build Forge

Rational Software Architect

Deployment Modeling


27

© Copyright IBM Corporation 2007. All rights reserv ed. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, the on-demand business logo, Rational, the Rational logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others.

Learn more at:

IBM Rational software

IBM Rational Software Delivery Platform

Process and portfolio management

Change and release management

Quality management

Architecture management

Rational trial downloads

developerWorks Rational

IBM Rational TV

IBM Rational Business Partners


28

Rational Automation Framework for WebSphere Platform Support

Middleware Versions Supported

�WebSphere Application Server 6.0, 6.1, 7.0

�WebSphere Network Deployment Server 6.0, 6.1, 7.0

�WebSphere Portal Server version 6.0, 6.1

Middleware Supported on Following Operating Systems�Linux

�AIX

�Solaris

�Windows

�HP-UX

the challenge of managing “websphere farm” … challenge of managing “websphere farm”...

Documents