how national australia bank (nab) used ca apm during performance testing to improve transaction...
Post on 14-Sep-2014
2.509 views
DESCRIPTION
Users are becoming increasingly impatient with new apps that don’t work. Often, you get one shot to get it right. But, new applications are being rolled out all the time, and being accessed from all sorts of devices. Operations need to provide developers with real-world production data to help them identify performance issues before applications go into production. This Application Lifecycle Optimization (or DevOps) is key for businesses to reduce the risk of faulty application rollouts. Recently at DevOps Summit in New York, Peter Tsatsaronis of National Australia Bank (NAB) discussed how they used Application Performance Management (APM) from CA Technologies to create an exact replica of load and performance data from production to help developers improve new and enhanced application quality. As a result of that, NAB has lowered their transaction response time by 85%, improved developer code efficiency, and even found issues they didn’t know they had , which were all discovered in performance testing, by implementing CA APM. Aruna Ravichandran, VP, Product Marketing, Application Performance Management and DevOps, CA Technology joined Peter from NAB at this session and shared how CA Technologies is uniquely positioned to help customers in their journey to DevOps transformation . Peter and Aruna used this slide deck to present at the DevOps Summit, New York. Leatn more about CA APM at http://www.ca.com/apmTRANSCRIPT
Peter TsatsaronisDelivery ManagerNAB
Aruna RavichandranVP Product Marketing , APM & DevOpsCA Technologies
National Australia Bank (NAB) : How we used CA APM during performance testing to improve
transaction performance by 85%
NAB Transformation
Technology Centric Tools
Application Performance Management
DevOps
Agenda
Imminent Future is Customer Centric
1
2
3
4
5
Our Financial Services Business
17thLargest Bank Globally
12+ Million Customers
42,000 Employees
1,800+ Stores/Branches
10 Countries of Operations
Laser Focus on the Customer
JOURNEYTECHNOLOGY TRANSFORMATION
Stage 2APM in Dev
Stage 3DevOps
Bank Evolution Technology Transformation Journey
Stage 1Technology Centric
Tools
RESULTS
User Experience Suffers
2009
RESULTS
Great User Experience
2011
RESULTS
User Experience as Differentiator
2014
Stage 1: App Focused – Web Interface Into Bank
Technology
IT Operations • Home grown or multiple
vendors• Feature specific , no integration
App Development• Dev centric• Function specific (dev, QA, etc.)
Challenges• Limited visibility in customer
experience• Reactive “User-Based” alerting• Hard to identify problematic app• hotspots
Organization
IT Operations
APP PERFORMANCE & PROBLEM RESOLUTION
Service Delivery
Infrastructure
Network
Change Management
Other Teams…
Sep
arat
ed
To
ols
an
d G
rou
ps
Application Development
APPLICATION ROLLOUT
& LIFECYCLE
Development
Testing
Technical Service Management
Solution Design
Other Teams…
Dif
ficu
lt C
om
mu
nic
atio
n
• Siloed tools and teams
• No cross-team visibility
FASTERWE CAN DELIVER APPLCIATIONS
Stage 2: App Issues – Identify Early, Resolve Fast
Technology
IT Operations • Home grown or multiple
vendors• Feature specific , no
integration
App Development• CA APM implemented in
pre-production (Introscope, End User Experience)
Benefits• Fast App Delivery!• Faster troubleshooting,
deep app visibility• Simple transaction
performance optimization
Organization
IT Operations
APP PERFORMANCE & PROBLEM
RESOLUTION
Service Delivery
Infrastructure
Network
Change Management
Other Teams…
Imp
rove
d C
om
mu
nic
atio
n
App Development
APPLICATION ROLLOUT
& LIFECYCLE
Un
ifie
d D
eve
lop
men
t
• Improved communication between Dev
and ops
• Predictable Dev SLAs
• Still…siloed tools and De/Ops teams
App Development
Testing
Service Management
Solution Design
Other Teams…
• CA APM agents deployed on 80+ servers in 5 days
• 2 hrs. to build service-centric CA APM Dashboard
Solution -> Deploy CA APM in Pre-Production
Pre-Production Success - UBankLogin and Origination Transaction Performance
Situation
• Dev team spent 4 weeks troubleshooting UBank R2A performance issue
• 80+ servers - collecting log files across
• Network packet capture
• Manually correlating performance data
Challenges
• Heavy resource involvement
• Little improvement or direction to resolution
• No progress on Dev side
• Delays with App rollout
Pre-Production Success UBank - CA APM In Action
OSB Dashboard
• Dev team spent 3 weeks troubleshooting UBank R2A performance issue
• 80+ servers - collecting log files across
• Network packet capture
• Manually correlating performance data
• Drill-down from UBank Dashboard
• Out of the box, no config required
Transaction Tracing
• Within an hour of tracing “Login”, several problematic components identified
• From 30, narrowed to 2 Oracle transaction components
• Eliminated the need to investing 10+ backend systems
Time to Value
• Fast and scalable install (80 servers, 5 days)
• Simple configuration, running in under two hours
• Immediate actionable information, transaction tracing configured out-of-the box
Pin Point Focus
• Reduce number of of components we need to investigate from 30 to 2
• Eliminate the need for investigating 10+ back end systems
Pre-Production Success UBank - Service Measurable ResultsFaster app delivery, improved app performance
Project Improvements
Project back on track (from Risk)
2 weeksElapsed time is 4 weeks
Actual APM effort only
App Performance
82%faster
Login transaction performance
2.3seccompared to before APM
Login time reduced by
HARMONYDEVOPS BRING IS IT ALL TOGETHER IN
Stage 3: DevOps – Share the Goodness Across the Boundaries
Technology
IT Operations • CA APM, Cloud Monitor
deployed in production
App Development• Addition of CA Service
Virtualization, CA Application Test to CA APM in pre-production
Benefits• Fast App delivery, great
quality, seamless user experience
• Preemptive problem resolution
• Cost is minimized and team efficiency improved
Organization
IT Operations App Development
• Single Tools, Single Team!
• Org structure is optimal for agile development and operations
APP PERFORMANCE & PROBLEM RESOLUTION
Service Delivery
Infrastructure
Network
Change
Management
Other Teams…
APPLICATION ROLLOUT & LIFECYCLE
Infr
astr
uct
ure
Man
agem
ent
Un
ifie
d D
ev a
nd
Op
s To
ols
No
Co
mm
un
icat
ion
Bar
rie
rs
Development
Testing
Tech Service
Management
Solution Design
Other Teams…
CA
AP
M, C
A C
lou
d M
on
ito
r
CA
AP
M, C
A L
ISA
Dev Fu
nctio
nal To
ols
Dev and Ops “talk the same language” to accelerate app delivery
CA APM at NAB - From Development to Operations
• CA APM enables Dev and ops to “talk the same
language”, accelerating app delivery and Org
transformation
• Transaction response reduced from 20sec to 3sec
Enable DevOps Transformation
85% Decrease in Transaction Time
• Ability to trace transactions across our current
mainframe & new core baking platforms
Transaction Tracing & Mainframe
• Using same tools in Dev and Production help us
significantly reduce resolution time
Reduce Resolution Time
CUSTOMER FOCUSIMMINENT FUTURE FOR NAB IS…
• Modernization dictates new org adjustments
• DevOps model is deeply embedded in the culture
• User centric model will drive business owner participation
• Mobile is cornerstone of
our business, not only
customer (2+ M AMO
today) facing but also
internal
• Creating new & modern
App and Mobile
infrastructure (Oracle)
• Expanding to Mobile APM
and DevOps (native, hybrid,
web)
• Focus on pre-emptive
management
• App behavioral analytics
Imminent Future UBANK – 100% User Centric, 100% DevOps
Technology Organization
End Users are at the center of DevOps cycle
Time for new banking experience!
DEVdesign
develop
test
deliver
measure
report monitorOPS
Pre-DevOps
design
test
monitor
report
assess
develop deliver
measure
DEVOPS
Post-DevOps
DevOps TransformationChanging People, Processes, and Culture
Gartner Market Trends: ARA, DevOPs and Mobile Device Management Ignite Configuration Management, Laurie F. Wurster, Ronni Colville,
November 27, 2014.
CA DevOps Marketecture
Application Delivery
Infrastructure Management
Application Performance Management
DevOps
=> [developers]:/collaborate/APM operations =>
<= /accelerate /(new applications).delivery <=
“DevOps represents a change in IT culture as a trade-off for rapid IT service
delivery through the adoption of agile and lean practices in the context of a
systems-oriented approach.” – Gartner* (2014)
*Source : Gartner Market Trends: ARA, DevOPs and Mobile Device Management Ignite Configuration Management, Laurie F. Wurster, Ronni Colville, November 27, 2014.
CA DevOps: Application DeliveryAchieving Speed and Quality
Developer
Developer
Developer
DEV
DEV
DEV
TESTING
TESTING
Integration UAT/Staging Performance Production Operations
Continuous ValidationCA Application Test/CA Cloud Test/
CA Test Data Management
Continuous DeliveryCA Release Automation/CA Cloud Manager
Agile DevelopmentCA Service Virtualization
CA APM
On
-Pre
mis
e
APPLICATION ROOT CAUSE ANALYSISDiagnostics/Root-Cause Analysis/Transaction Tracing/Triage
APPLICATION BEHAVIOR ANALYTICSIT Operation Analytics Multi-Metric Correlation
END-USER EXPERIENCEApp Performance Over the Network and Servers
SaaS
CLOUD MONITORSynthetic Transactions
CA DevOps :Application Performance ManagementInspire Users With Every App Interaction
Partners
3rd Party and
Extensions
Business
Viewpoint
Infrastructure
Aware APMMainframe
Aware APM
CA DevOps tools: Infrastructure Management
Improve service quality, predictability and efficiency with Unified IM
Foundation for Successful DevOps
Unified Infrastructure Management
Unified Management Portal(Available via mobile)
Operational Intelligence Solutions(e.g., Capacity Management, Service Operations Management, etc.)
Systems Storage Network Database Apps Cloud SaaS DCIM Other
Industry-leading and easiest-to-use domain solutions
Adaptable and extendable (over 140 probes in CA Nimsoft Monitor today)
CA ApplicationPerformance Management
CA CloudService Management
Other CA andThird-Party Tools
1Strong IT Performance is competitive
advantage
2 DevOps practices improve IT performance
3 Organizational culture matters
4Job satisfaction is #1 predictor of Org
performance
RelationshipsOrganizational Performance->IT Performance -> DevOps*
* 2014 State of DevOps Report, presented by Puppet Labs
Questions?