world quality report: trends in technology, organization ... · pdf file"world quality...
TRANSCRIPT
W5 Track 10/7/2009 11:30 AM
"World Quality Report: Trends in Technology, Organization and
Outsourcing"
Presented by:
Charlie Li & Murat Aksu Capgemini
Brought to you by:
330 Corporate Way, Suite 300, Orange Park, FL 32073 888‐268‐8770 ∙ 904‐278‐0524 ∙ [email protected] ∙ www.sqe.com
Charlie Li
The vice president of Global Quality and Testing Services for Capgemini’s Financial Services Sector, Charlie Li helps customers mitigate the risks of IT deployments and reduce the overall cost of IT. He is the author of Optimize Quality for Business Outcomes: A Practical Approach to Software Testing, now in its third edition in both English and Japanese. Charlie has published several white papers in the automated quality software industry and has spoken at leading industry events throughout the country including both the STAREAST and STARWEST conferences.
Murat Aksu Murat Aksu heads Capital Markets Testing for North America in Capgemini. He has played several leadership roles in sales, service delivery, account management, competitive intelligence, product marketing and marketing in his career span of more than 13 years. During the 7 successful years working with HP Mercury Interactive, he was the Manager of Competitive Intelligence and Director of Product Marketing responsible for the Performance Testing and SOA solution tool sets. Prior to joining Capgemini, Murat was the VP of Products and Marketing at Zenoss.
8/10/2009
1
World Quality Report: Trends in Technology, Organization and OutsourcingOutsourcing Charlie Li, VP, Quality Management and TestingMurat Aksu, Practice Head, Quality and Testing
Agenda
Demographics of participants
Tools and Technologygy
State of Quality
Test Organization
Testing Outsourcing
Economic Conditions
2World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
Trends
8/10/2009
2
Quality Report Profile - Geography
15%15%
20%
15%
50%Asia
Europe
ROW
USA
3World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
Quality Report Profile - Industry
24%24%
6%
7%
5%4%5%
47%
Financial Services
Government
Health Care
Manufacturing and Logistics
Others
Research & Education
Telecomm and Media
E
4World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
2%0%Energy
Information Technology
8/10/2009
3
Quality Report Profile – Size Of The Company
45%
10%
15%
20%
25%
30%
35%
40%
Enterprise
Large
Mid Size
Small
5World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
0%
5%
10%
Total
TOOLS AND TECHNOLOGYAPPLICATION LIFECYCLE MANAGEMENT (ALM) IS THE MARRIAGE OF BUSINESS MANAGEMENT TO SOFTWARE ENGINEERING MADE POSSIBLE BY TOOLS THAT FACILITATE AND INTEGRATE REQUIREMENTS MANAGEMENT, ARCHITECTURE, CODING, TESTING, TRACKING, AND RELEASE MANAGEMENT.*
6World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
*WIKIPEDIA
8/10/2009
4
Is Application Complexity Increasing?
88%
80%
90%
100%
30%
40%
50%
60%
70%
Yes
No
7World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
12%
0%
10%
20%
Total
Leverage Of Automation Technology Across ALM
25%
22%25%
30%
7%
13%
18%
15%
5%
10%
15%
20%
8World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
0%
Business IP‐Domain Management Business Flow Modeling
Requirements Use Case
Test Cases Defect Management
8/10/2009
5
Need For Automation Investment
19%
22%
18% 19%20%
25%
12%
2%5%
10%
15%
9World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
0%
Business Flow Modeling Requirements
Test Management and Execution Defect Management
Environments and Data Management None, we have all that we need
Receiving ROI and Fully Leveraging Your Technology Investments?
20%21%
Less than 25%
Up to 50%
Up to 80%
NORTH AMERICA
EUROPEROW
16%
7%
16%54%
18%
13%50%
20%
20%
46%
18%
44%
None
Can't quantify/do not know
EUROPEASIA
10World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
7%7%
12%
20%
9%5%
18%
10%7%
8/10/2009
6
STATE OF QUALITY
11World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
STATE OF QUALITY
Overall Quality Getting Better? (Last Two Years)
Energy
Information Technology
Health Care
Manufacturing and Logistics
Others
Research & Education
Telecomm and Media
Yes
No
12World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
0% 20% 40% 60% 80% 100%
Financial Services
Government
8/10/2009
7
Which ALM Area Poses The Greatest Challenge?
16% 24%
Business consensus on the right investments
Change management
NORTH AMERICA
EUROPE
ROW
28%
14%
34%
23%
10%
3%
44%
3%
9%
6%
50%
14%
35%
Change management
Getting development right
Other (eg. Source Code Control, Build Management)
Testing and validation
ASIA
13World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
7%7%10%
3%
10%10% 16% 4%
10%13%
Understanding and capturing business requirements
Organization’s ALM Process Consistently Followed For All Projects?
90%
100%
30%
40%
50%
60%
70%
80%
More than 50% of the time
About 50% of the time
Up to 25% of the time
Less than 10% of the time
Never
14World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
0%
10%
20%
Enterprise Large Mid Size Small
8/10/2009
8
% Reuse Of The Quality And Testing Artifacts ALM
90%
100%
30%
40%
50%
60%
70%
80%
50% and above
About 50%
Up to 25%
Less than 10%
None
15World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
0%
10%
20%
Enterprise Large Mid Size Small
Benefits From Reusability
Telecomm and MediaEnergy
Information Technology
0% 20% 40% 60% 80% 100%
Financial ServicesGovernmentHealth Care
Manufacturing and LogisticsOthers
Research & Education
16World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
Cost reduction
Faster time to market for applications
More testing coverage leading to higher overall quality of the application
Shorter and more agile testing cycles
We are not re‐using any testing artifacts
8/10/2009
9
TEST ORGANIZATION
17World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
TEST ORGANIZATION
Testers’ Domain And Business Experience
42%
NORTH AMERICA
EUROPEROW
ASIA
62%
29%
9%
58%
16%
60%27%
23% Some Domain/Business Experience
No Domain/Business Experience
Domain and Business SMEs as Testers
18World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
26%
13%
35%
8/10/2009
10
Do Testers Have Business Analyst Experience?
17%43%
NORTH AMERICA
EUROPEROW
ASIA
58%
30%
13%
52%
17%
52%
17%21%
Somewhat
No
Yes
19World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
31%31%
36%
45%61%
QA Required To Have Development Experience?
NORTH AMERICA
EUROPEROW
ASIA
35%
23%48%22%
14%
7%
Sometimes
No
Yes
20World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
43%30%
40%32%
8/10/2009
11
QA With Dev Background Better QA?
21%
33%
NORTH AMERICA
EUROPEROW
ASIA
39%40%
31%
39%43%
36%33%
Sometimes
No
Yes
21World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
23%30%36%
31%
Business Think QA Is Only About Executing Test Scripts?
NORTH AMERICA
EUROPEROW
ASIA
23%
77%30%
70%29%71%
43%
57%
Yes
No
22World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
43%
8/10/2009
12
TEST OUTSOURCING
23World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
TEST OUTSOURCING
Do You Outsource QA?
NORTH AMERICA
EUROPEROW
ASIA 16%
62%
38%44%
56%52%
48%Yes
No
ASIA
24World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
84%
8/10/2009
13
QA Outsourcing Trend
18%17%
17%16%
NORTH AMERICA
EUROPEROW
ASIA18%
58%
8%
16%
32%
6%
47%
7%
38%
17%
Staying the same level
We do not use any outsourced resources for testing
Increasing
Reducing
25World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
8%
45%29%
29%
28%
Outsourced Resources With Relevant Industry-Domain And Technology Experience?
NORTH AMERICA
EUROPE
ROW
ASIA
21%
5%50%
24%
34%
29%
41%
38%Somewhat
No
Yes
We do not use any outsourced f i
ASIA
26World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
24% 21%
21%15%
15%23%
11%
resources for testing
8/10/2009
14
ALM Automation Reduce Outsourced Resources#?
19% 30%
NORTH AMERICA
EUROPEROW
ASIA
30%
40%
19%
25%
56%
40%36%
30%
54%
Somewhat
No
Yes
ASIA
27World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
30%
24%
16%
Increase Leverage Of Testing Outsource For Value Added IP And Solutions?
Telecomm and Media
Energy
Information Technology
Financial Services
Government
Health Care
Manufacturing and Logistics
Others
Research & Education
Telecomm and Media
28World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
0% 20% 40% 60% 80% 100%
No, we only need staff augmentation for cost reasons
No, we want their solutions and IP but don’t need their resources
Yes, we need more value‐add from our vendors
8/10/2009
15
ECONOMIC CONDITIONS
29World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
ECONOMIC CONDITIONS
Economic Effects Of IT Spending By Industry
Energy
Information Technology
Government
Health Care
Manufacturing and Logistics
Others
Research & Education
Telecomm and Media
30World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
0% 20% 40% 60% 80% 100%
Financial Services
Government
I don't know Reduced IT investments Increased IT investments Stayed the same
8/10/2009
16
Economic Effects Of IT Spending
90%
100%
20%
30%
40%
50%
60%
70%
80%
90%
31World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
0%
10%
Engineer Senior Engineer Mid Manager Executive
I don't know Reduced IT investments Increased IT investments Stayed the same
Effect Of Economic Crisis On Your Work Load?
90%
100%
Stayed the same
30%
40%
50%
60%
70%
80%Stayed the same
Increased or stayed the same due to cuts in resources
Increased due to new application development projects
32World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
0%
10%
20%
Enterprise Large Mid Size Small
Decreased due to project cancellation
8/10/2009
17
More Investment In New App Dev Projects?
NORTH AMERICA
EUROPE
ROW
ASIA
16%
51%
14%71%
9%
10%81%
16%
65%No
Only those that generate ROI in less than 6 months
Yes
ASIA
33World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
33%
15%
19%
Expectation Of Apps Project Workload For 2010?
20%
14%NORTH AMERICA
EUROPE
ROW
ASIA 11%0%22%
25%
8%
27%34%
4%32%
Stay the same
Decrease
Increase
Unclear at this point in time
ASIA
34World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
67%
40%
5%
41%
50%
8/10/2009
18
TrendsCompanies will increase investment in areas of requirements, test environment and data management
Increased leverage of Agile type of methodologies for shorter application lifecycles
App complexity increases requirements challenges needs to improve ROI willApp complexity increases, requirements challenges, needs to improve ROI will require future QA to be more business focused and have a stronger technology background
QA team to become more skilled, more nimble and smaller teams
Europe is leading in the leverage of outsourcing for testing and expected to outpace other regions in the growth of test outsourcing
Expect IT spending to shift more from Ops to new apps (increased competitive l d l d i ti t )
35World Quality Report 2009© Copyright Capgemini 2009 All Rights Reservedin collaboration with
landscape, legacy modernization, etc.)
Americans lead the world in agreeing with Obama with their inherent optimism that things will get better in 2010 followed by Asians (Note: Kim Jong -Il declined to participate in the report and declared martial law on all North Korean Testers)