dynacache in websphere portal server

©2012 IBM Corporation

IBM Exceptional Web Experience Conference 2012 - Americas

May 21 – 24, 2012 Austin, Texas

TECH-P30Build and Deliver Increased Web Experience Platform Performance with IBM WebSphere Extreme Scale

Benjamin Parees, Software Engineer, XC10 Caching Appliance Development, IBM

© 2012 IBM Corporation2

Exceptional Web Experience Conference 2012 - Americas

Session Overview

TECH-P30

Build and Deliver Increased Web Experience Platform Performance with IBM WebSphere Extreme ScaleBenjamin Parees, Software Engineer, XC10 Caching Appliance Development, IBM

WebSphere Portal can make extensive use of the WebSphere dynamic cache feature for performance optimization. IBM WebSphere eXtreme Scale & WebSphere DataPower XC10 Appliance augment these services by providing a more powerful elastic cache solution that can extend both scale and performance improvement to meet increasing business web platform presentation demands. Attend this session to learn how WebSphere Portal and Web Content Manager (Version 7 and higher releases) can leverage WebSphere eXtreme Scale & WebSphere DataPower XC10 Appliance to greatly increase total cache capacity and eliminate redundant content rendering. This combination can achieve a potential reduction in response time, greater application server throughput, and facilitates faster startup time for new WebSphere Portal servers added to a cluster. Perhaps just as impressive is the fact this can be accomplished with relatively simple configuration changes. This session will deliver the technical capabilities and business benefits of extending yourWebSphere Portal solution to leverage WebSphere eXtreme Scale capabilities for dynamic cache management needed by many organizations today.




Agenda

● Motivation● Overview of DynaCache and the Portal Advanced Cache● Review Performance Results● Configuration Overview● eXtreme Scale and XC10 Background




Market Drivers• The competition is only a click away in today's

web-facing world.

• Response times are critical to giving customers a good experience and generating revenue.

• Customer sessions are becoming more critical.

• The cost of attracting new customers to your web site for enrollment is significant.

• Losing the data that they have entered will likely create a negative impression and result much higher abandonment rates



Market Drivers



Elastic Caching minimizes the impact of Transaction Overload

Web Server Tier Back-end SystemsDatabase Tier

App Server Tier Elastic Cache

IBM HTTP ServerIBM HTTP Server WebSphere Application Server

WebSphere Application Server DB2 UDBDB2 UDB

Improve Performance, Scalability & Availability

Highly Scalable Web Applications

Data-intensive Applications

Extreme Performance

http://www.google.com/imgres?imgurl=http://www.bakerstreetresources.com/images/Used-IBM-AS400.gif&imgrefurl=http://www.bakerstreetresources.com/buy-sell-used-ibm-servers.htm&usg=__y-HfmeaS5Wmu-HV9m8ZOPJpzSFg=&h=180&w=205&sz=21&hl=en&start=2&sig2=r38fmffuvXThcc4zRSVI3Q&itbs=1&tbnid=HtzGx_OBhn6s5M:&tbnh=92&tbnw=105&prev=/images%3Fq%3Dibm%2Bservers%26hl%3Den%26gbv%3D2%26tbs%3Disch:1&ei=zbfXS6OHGMX_lgeK6MDrAw

http://www.google.com/imgres?imgurl=http://www.bakerstreetresources.com/images/Used-IBM-AS400.gif&imgrefurl=http://www.bakerstreetresources.com/buy-sell-used-ibm-servers.htm&usg=__y-HfmeaS5Wmu-HV9m8ZOPJpzSFg=&h=180&w=205&sz=21&hl=en&start=2&sig2=r38fmffuvXThcc4zRSVI3Q&itbs=1&tbnid=HtzGx_OBhn6s5M:&tbnh=92&tbnw=105&prev=/images%3Fq%3Dibm%2Bservers%26hl%3Den%26gbv%3D2%26tbs%3Disch:1&ei=zbfXS6OHGMX_lgeK6MDrAw



Applications using DynaCache

Each JVM has a private disk based cache to support caches much larger than possible with a memory only conventional cache

2 tier cache: JVM has a small local cache, then the disk file.

Cached content is redundant across JVMs



Portal Advanced Cache

● DynaCache instance used to store rendered content● Specifically content pulled from a Web Content Manager database● Configuration used

Site level caching (rendered content)

30 day expiration

Do not clear cache on startup



During a recent ‘News’ application promotion, the customer response to the new portlet overwhelmed the web-site. The web-site became painfully slow under the significant load. The result, not a happy customer…

W e l c o m e , U s e r !

!#*!

… too slow!

DynaCache disk-offload




WPS

News Portlet Deployment - Failure

WPS

WPS

WPS


Exceptional Web Experience Conference 2012 - Americas10

Scalability: Off-loading Dynamic cache to WXS/XC10Much larger cache capacity

WebSphere Portal JVMs run more efficiently

– Lower local memory requirements

– Faster start-up time

Improved consistency of performance

– Improved cache and environment stability

– High availability of cached data




W X S

Elastic cache

WPS

WPS

WPS

WPS

During a recent ‘News’ application promotion, the customer response to the new portlet was very high. However, with addition of an elastic cache the web-site was able to handle the significant increase in load. The customers did not perceive any slow down of the web-site. The result, happy customers and a successful content promotion…

News Portlet Deployment - Success

With WXS DynaCache Grid configured, disk-offload is no longer required




W X S

Elastic cache

WPS

WPS

WPS

WPS

Fast start-up when adding more capacity – on the fly

WPS

New Server

New WebSphere Portal servers can be brought on-line quickly to meet increased capacity needs. When start-up is complete, the new server has immediate access to a warm cache provided by eXtreme Scale.




W X S

Elastic cache

WPS

WPS

WPS

WPS

Maintain consistent user experience during site maintenance

WPS Down for maintenance

If a WebSphere Portal server needs to be restarted after applying an iFix, eXtreme Scale can provide up to 54% improvement in time to reach steady-state



Scenario Details

● Two Portal Servers with Web Content Manager

● Single WCM DB Server

● Two XC10 Caching Appliances

● Advanced Cache maximum entries

Using App Server heap: 5000 per server

Offloading to XC10: 1,000,000 shared available (Observed ~9 gigs)

● 300 concurrent users simulating Wiki/Blog accesses

● Web Content Manager DB content: 50 gigs

WPS+WCM

WPS+WCM

WCM DB

2 XC10 Collective

Proxy



Portal Customer Experience – Steady State Comparison

● Enabling WebSphere Content Manager Advanced Cache using an offloaded eXtreme Scale/XC10 grid cache

● With WXS/XC10 average throughput in our steady state/concurrent user scenario was consistently faster than with Default Advanced Cache

42% improvement over no Advanced Cache in our scenario

24% throughput improvement over default cache implementation using Application Server JVM heap in our scenario

● Using the Default Advanced Cache implementation requires available Application Server heap, offloading the cache to WXS/XC10 does not require heap

● Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. Actual performance in a user's environment may vary.

Throughput(requests/second)50

60

70

80

90

100

Default WCM Advanced CacheWCM Advanced Cache Offloaded to XC10


60

70

80

90

100

No WCM Advanced CacheWCM Advanced Cache Offloaded to XC10

Cache Offload Performance



Portal Customer Experience – Steady State Comparison

Cache Offload Performance● With WXS/XC10 average steady state response-times are consistently faster than with Default WebSphere Content Manager Advanced Cache

5.5 second improvement over no Advanced Cache in our scenario

3.4 second improvement over default cache implementation using Application Server JVM heap in our scenario


Response Time(seconds)4

6

8

10

12

14

16No WCM Advanced CacheWCM Advanced Cache Offloaded to XC10


6

8

10

12

14

16

Default WCM Advanced CacheWCM Advanced Cache Offloaded to XC10



Reducing Portal warm-up time – Cold Start Results● With WXS/XC10 average throughput of a

newly started server is consistently faster than with Default WebSphere Content Manager Advanced Cache

54% throughput improvement in our scenario

● With WXS/XC10 average response-times are consistently faster than with Default Advanced Cache

4 second improvement observed in our scenario

● With WXS/XC10 response times improve faster due to quicker cache hydration


Cache Offload Performance


40

50

60

70

80

90

Default Advanced CacheAdvanced Cache Offloaded to XC10


6

8

10

12

14

16

Default Advanced CacheAdvanced Cache Offloaded to XC10



Summary of Primary Benefits

● WCM Advanced Cache implemented through the DynaCache, stores fully rendered pages that do not have to be pulled out of WCM DB. Today customers can enable Advanced Cache in the app server’s heap space. Technical goal is to avoid trips back to the WCM database to avoid building these pages. WXS plugin allows you to store the DynaCache content in a remote grid, so that the data being inserted into DynaCache does not consume app server heap space. 1. Caching is of highest importance with WCM. Complex WCM components can be very CPU

intensive2. WXS grid can store more data, have a larger hit percentage than DynaCache and reduce trips to

WCM DB which is more expensive. (More consistent Response times)3. Benefits customers who are heaped constrained (no DynaCache) can leverage the Advanced

Cache by not committing memory on their Portal server. The WXS scenario does not consume memory on the Portal server.

4. Shared cache, each portal JVM does not have to warm its cache on server restarts5. Eliminates invalidation chatter.. critical in the farm topology



Client Usage: eCommerce Retailer

Catalog page cache

1k page views/sec

Faster startup

JVM restarts are nondisruptive

Cache consistency

One of the largest ecommerce sites–Befor e: Existing WebSphere Commerce Server customer.

–Per JVM catalog cache lead to lots of memory wastage and cache warming problems on cluster start as well as JVM restarts

–After : –Moving to a shared cache using WXS, speeds cluster start time by 60%

–customer response times see no impact from JVM restarts.

–Memory is dramatically reduced. –Catalog consistency is better (time based promotions)–Less CPU used

http://images.google.com/imgres?imgurl=http://www.salemcoop.com/images/OnlineBankingAA046836_002.jpg&imgrefurl=http://www.salemcoop.com/onlinebanking.php&usg=__7xbn0HsSEysFZaWUsElbGMmWxfE=&h=700&w=523&sz=27&hl=en&start=11&tbnid=9Qum6493E3rO7M:&tbnh=140&tbnw=105&prev=/images?q=banking&gbv=2&hl=en



Configuration Steps

● Install eXtreme Scale client on WebSphere Portal● Point WebSphere to grid endpoints (XC10)● Create a new grid● Update the DynaCache instance settings● Restart the server instance



Product Versions

Plus APAR PM63259 (targeted for Portal CF14 and Web Content Manager CF31)



Catalog Service Configuration



Creating a new grid

Click + to create a new cache

Type the name

Click OK

1

2

3

4

Select the cache type



Cache Instance Configuration



DynaCache Instance Configuration



So, what are eXtreme Scale and XC10 anyway?



Scales from simple in-process topologies to powerful distributed

topologies.

It can be used as a platform for building powerful Extreme

Transaction Processing (XTP) / Data Grid

applications.

Can be used as a form of in memory database to manage

application state.

A distributed caching platform.It takes the free memory across a number of Java™

Virtual Machines (JVM™) and marshals them into one logical cache.

New York San Francisco

London Shanghai



Modern Application Infrastructure Topology

Web Ser ver Tier Database TierApp Ser ver Tier Elast ic Data Gr id

WebSpher e Applicat ion Ser ver

DB2 UDB

DataPower XC10 for simple data oriented scenarios:• HTTP Session Replication• Elastic Dynacache• Web Side Cache• REST Cache

eXtreme Scale for maximum flexibility covering data and application oriented scenarios

1

2

XC10



IBM WebSphere eXtreme Scale• Proven mature product:

– Fourth major release of product with V7.1– Public References– Private References– Used at some of the largest web sites/companies in

the world

• Lightweight runtime footprint (20MB jar)

• Integrates with all versions of WebSphere and almost any Java-based application container or Java Virtual Machine

• Proven multi-data center capabilities

• Proven low-latency access to data



IBM WebSphere DataPower XC10 V2

New Form Factor (2U) Larger Cache (240 GB) Better Performance (Faster SSD, Use of RAM) Improved monitoring (SNMP Support) Support for non-Java Applications (REST Gateway) Grid Capping



Scale out with Ease

• 240 GB (new in 2.0) elastic cache for your business-critical applications

• Scales elastically without application downtime

• Linear, predictable scaling at predictable cost

• Quickly and easily increase cache capacity as needs grow

• Unbinds cache from application server memory constraints



Innovative Elastic Caching Solutions“Data Oriented”

“Application Oriented”

Session management

Elastic DynaCache

Web side cache

Event Processing

In-memory OLTP

Worldwide cache

Petabyte analytics

Data buffer

In-memory SOA

eXtreme Scale

DataPower XC10 Appliance

• Ultimate flexibility across a broad range of caching scenarios

• In-memory capabilities for application oriented scenarios

• Drop-in cache solution optimized and hardened for data oriented scenarios

• High density, low footprint improves datacenter efficiency

Elastic caching for linear scalabilityHigh availability data replication

Simplified management, monitoring and administration



Utilizing WebSphere DataPower XC10 for DynaCache

Clients can attach to the ‘cache’ using the network

No dependency on a large file system cache.

No disk dependency, no SAN required.

Cache is as large as the memory in the ‘grid’.

Each record is stored once in the grid and shared by all clients.

Network

XC10 Collective


Exceptional Web Experience Conference 2012 - Americas34 DataPower XC10 Overview

Elastic Dynamic Cache service support

• No new code required• WebSphere DataPower XC10 and WebSphere eXtreme Scale

provide client code and a plug-in for WebSphere Application Server applications to support Dynamic Cache API

• Allows applications deployed to WebSphere servers to use WebSphere DataPower XC10 or WebSphere eXtreme Scale as a “drop-in” cache, instead of storing cache data in local memory or multiple instances of a disk cache



Traditional Cache Operation

App

App

App

App

EIS

A

A

A

A

App

Invalidatio n chatterInvalidatio n chatter

■ Cache capacity determined by individual JVM Size.■ Size of each cache = M■ # JVMs = N■ To ta l c a c he = M■ Invalidation load per server increases as cluster grows.■ Cold start servers hit the database.



Extreme Scale based Cache Operation


App

App

App

App

EIS

A

B

D

C

C’

D’

App

B’

A’ Cache is4x larger!

Cache is5x larger!

■ Cache capacity determined by total cluster size■ Size of each cache = M■ # JVMs = N■ Total Cache = M x N■ No invalidation chatter■ Linearly scalable■ Less load on database and no cold start spikes



One more use case...HTTP Session Persistence


Exceptional Web Experience Conference 2012 - Americas38 DataPower XC10 Overview

HTTP Session data cache● No new code required ● Extension of legacy session management caching

mechanism in WebSphere Application Server● Extensions to WebSphere Application Server

administrative console to support WebSphere DataPower XC10 session management caching and WebSphere eXtreme Scale session management caching

● WebSphere Application Server connects seamlessly to the WebSphere DataPower XC10 appliance or WebSphere eXtreme Scale

– Client code must be installed on WebSphere Application Server systems

● Easily configure WebSphere applications to store HTTP session data to a data cache on the WebSphere DataPower XC10 appliance through the WebSphere Application Sever administrative console

● Replaces other session replication mechanisms (memory-to-memory replication)

● Removes the need for Database traditionally used for persistence

● Enables HTTP session failover between WebSphere Application Server cells



Session Caching for WebSphere Portal



•Ability to share the profile & persist session

Manage the life cycles of HTTP sessions that are associated with the application

Improve QoS and Lower Memory footprint

Better guarantees of session availability during server failover

Topology spans multiple data centers across different physical locations

Farming: Shared installations & Session caching

Elastic Cache DataPower XC10



For More Information

WebSphere eXtreme Scale and XC10 User Wiki

http://www.ibm.com/developerworks/wikis/display/extremescale/Home

IBM Customer Experience Suite, WebSphere Portal and Web Content Manager Software and Solutions

http://www-01.ibm.com/software/info/customerexperience/

http://www-3.ibm.com/software/genservers/portal/

WebSphere Portal and IBM Web Content Manager Information Center

http://www.ibm.com/developerworks/websphere/zones/portal/proddoc.html

IBM Web Experience Fast Track Offerings

http://www-01.ibm.com/software/genservers/portal/fasttrack/

WebSphere Portal Business Solutions Catalog

https://greenhouse.lotus.com/catalog/home_full.xsp?fProduct=WebSphere%20Portal




Your Feedback is Important!

Please visit www.ibmconf.com to enter your feedback from your wireless device, any laptop or one of our evaluation kiosks

Ask a Room Monitor for a paper form if preferred and leave it with a Room Monitor or at Registration

Thank you!



© IBM Corporation 2012. All Rights Reserved.

The information contained in this publication is provided for informational purposes only. While efforts were made to verify the completeness and accuracy of the information contained in this publication, it is provided AS IS without warranty of any kind, express or implied. In addition, this information is based on IBM’s current product plans and strategy, which are subject to change by IBM without notice. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this publication or any other materials. Nothing contained in this publication is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.

References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in this presentation may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results.

IBM, the IBM logo, Lotus, Lotus Notes, Notes, Domino, Quickr, Sametime, WebSphere, UC2, PartnerWorld and Lotusphere are trademarks of International Business Machines Corporation in the United States, other countries, or both. Unyte is a trademark of WebDialogs, Inc., in the United States, other countries, or both.

Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.

Microsoft and Windows are trademarks of Microsoft Corporation in the United States, other countries, or both. Intel, Intel Centrino, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.

UNIX is a registered trademark of The Open Group in the United States and other countries.Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others.

.




IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion.

Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.

The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.

.


dynacache in websphere portal server

Documents

clear cache

ibm2012 ibm corporation

web contentmanager version

total cache capacity

customersa good experience

ibmwebsphere portal

elastic caching

dynacachew e lc o