webcast presentation: vruc mobile webcast: the importance of knowing when your mobile app is really...

Join the Community

www.rational-ug.org

Tweet with Us @RationalUC #rationaluc

www.twitter.com/rationaluc

Join Our Group on LinkedIn: Global Rational User Community

https://www.linkedin.com/groups/Global-Rational-User-Community-GRUC-120486/about

Connect with Us on Google+

https://plus.google.com/+RationalugOrgGlobal/posts

http://www.rational-ug.org/



http://www.twitter.com/rationaluc













© 2013 IBM Corporation

IBM Mobile Quality Assurance Continuously deliver high quality mobile apps

Yan (Tina) Zhuo, Product Manager – Mobile

Leigh Williamson, IBM Distinguished Engineer

The importance of knowing when your mobile app is really missing the mark!

http://www.linkedin.com/in/RogerSnook

http://www.slideshare.net/RogerSnook

https://w3-connections.ibm.com/profiles/html/profileView.do?key=8af37631-bdae-4b1b-977a-9e808c1b684b&lang=en

© 2013 IBM Corporation 2 #IBMMobile

Please note – This discussion is about an Open Beta

IBM’s statements regarding its plans, directions, and intent are subject to change or

withdrawal without notice at IBM’s sole discretion.

Information regarding potential future products is intended to outline our general product

direction and it should not be relied on in making a purchasing decision.

The information mentioned regarding potential future products is not a commitment, promise,

or legal obligation to deliver any material, code or functionality. Information about potential

future products may not be incorporated into any contract. The development, release, and

timing of any future features or functionality described for our products remains at our sole

discretion.

Performance is based on measurements and projections using standard IBM benchmarks

in a controlled environment. The actual throughput or performance that any user will

experience will vary depending upon many factors, including considerations such as the

amount of multiprogramming in the user’s job stream, the I/O configuration, the storage

configuration, and the workload processed. Therefore, no assurance can be given that an

individual user will achieve results similar to those stated here.


Industry Solutions

IBM & Partner Applications

Banking Insurance Transport Telecom Government Retail Healthcare Automotive

Application & Data Platform

Str

ate

gy &

Des

ign

Serv

ice

s

Cloud & Managed Services

Devices Network Servers

De

ve

lop

me

nt &

Inte

gra

tion

Se

rvic

es

Management Analytics Security

IBM MobileFirst offering portfolio


Scan & Certify

Instrument

Test

Integrate Obtain Insight

Manage

Deploy

Design & Develop

Thinking through the mobile enterprise lifecycle


Mobile application quality is more complex


Mobile quality presents unique needs

Consumerization of Technology is Changing the Definition of Quality

Usability and fit-to-purpose are important aspects of perceived quality

Quality of Experience is defined as “the overall acceptability of an application or service,

as perceived subjectively by the end user.”

Time to Feedback

Mobile engagement requires a lifecycle focus on “time to feedback”

Shorter iterations, and more frequent delivery

Majority of the testing performed by developers

Focus is on reducing time to feedback vs. bug count


Helping the software team get smarter about their mobile apps

Tester End Users Developer LOB/Digital Marketer

“When someone leaves a negative review in the app store, it scars your

app for life, you can’t respond to it, and you can’t learn more about the

problem in order to fix it quickly.”

- Mobile Orchard

• How effective our mobile

app is at engaging

customers?

• How can I stay on top of

current quality metrics, and

turn them into an

actionable strategy?

• How could I get visibility to

issues that customers

experience in production

so that I can address them

quickly?

• How can I get more

people to test the apps so

that we can cover different

devices, network carriers,

and OS versions?

• How can I get the latest

and greatest build without

wasting my time to track

that down?

• How can I quickly submit

bug reports with

screenshots and device

details right from the

application?

• How can I provide

direct and

constructive

feedback?


Tester End Users Developer

Over the air build distribution 1 In app bug reporting 2

Crash log reporting

4

In app user feedback 3

LOB/Digital Marketer

Sentiment Analysis 5

Builds

User Feedback Crash logs

Bugs Bugs vs. Crashes

Quality Dashboard

with Sentiment Analysis

Mobile Quality Assurance features that support the use cases ibm.biz/mobilequalitycloud

Coming soon

ibm.biz/mobilequalitycloud


Continuous delivery for mobile apps backed by a set of cloud services for each stage of the app lifecycle

Developer

Checks in code

Mobile build service

Manual mobile

testing services

Post-release

mobile services

Daily

Hourly

Release

Weekly

Automated mobile

testing services

Mobile device farm


Continuously deliver high quality mobile applications

What’s New

• End user feedback and quality metrics available at every

stage of development

• App quality assurance in a fragmented and complex

environment

Features/Business Value

• Evidence-based prioritization – enable business and IT to

collaborate on mobile strategy and user experience

• Over the air app distribution – get the latest in the hands of

testers as soon as it is available

• Frictionless bug reporting – spend every minute on testing

latest and greatest builds, not the hassles

• In-app crash reporting – rapid understanding of why an app

fails

• Sentiment analysis – mine app ratings and reviews to extract

actionable feedback before they go viral(coming soon)

Client Benefits

• Improve mobile app quality with holistic visibility into user

experience, including bugs, crashes, feedback, and user

sentiment

• Proactively manage quality risks through rapid assessment

of issues and reduced cycle time

Updated xx-xx-12

Introducing IBM Mobile Quality Assurance (beta)

”What you are talking about

doing is fantastic. You have a

very powerful approach here and

it will drive a lot of what people

will want to do in the market”

IBM Mobile Quality Assurance (beta)


Over the air app distribution

Developer manages builds

Developer distributes a new build to

in-housed or outsourced testers

Testers update to the new build

when they start up the app or via

notification

Developer can choose to ignore

bug reports or crashes from

obsolete builds

Developer can disable a version on

tester devices

Enables developers to distribute new builds to testers


In app bug reporting

When bugs are identified, tester

simply shakes mobile device to

• Activate bug reporting UI

• Capture screen shots and add

annotation

• Submit bug reports

Bug reports also include environment

meta

• Device maker & model

• OS & version

• Carrier & connection speed

• Battery life & resolution

Enables testers to submit bug reports directly from their phone


Automated crash reporting

IBM MQA captures and aggregates

crashes from pre-production or

production

It captures crash details

• Device maker & model

• OS version

• Carrier & connectivity

• Battery life

• Stack trace

• Log files

It includes a list of sessions that

experienced the same crash and session

details

Enables developers to know when and why crashes occur


Direct user feedback

IBM MQA gathers valuable feedback and

input from your users while they're using

your app

Developers can customize the feedback

workflow

End users can send free-form text

feedback directly to your app managed in

IBM MQA

Enables developers to connect with users


Mobile Quality Assurance

Agile Mobile Development – Integration Scenario with RTC

Rational Team Concert

1. Build mobile app using RTC build engine

2. RTC mobile app build output is uploaded to

MQA

3. OTA new app build distribution to testers

4. Testing under real world conditions

5. In-app crash and bug reporting

6. RTC work items are created from MQA, and

linked to MQA detailed bug reports/crash data

7. Fix most important defects and start new build

Mobile app developer

6

3

5

Mobile app tester

4

7

2

1

Bug reports and

Crash analytics

SDK

SDK


IBM Mobile Quality Assurance




Sentiment Analysis

Mine app ratings and reviews to extract

actionable feedback

IBM MQA allows users to see

• Review stats on their mobile apps

• Detailed attribute scores

• Cumulative sentiment score and

trends

Enables line of business to mine user sentiment

Coming soon – Not yet in Open Beta


Action Items for Today:

IBM Mobile Quality Assurance Open Beta

https://www.ibm.com/developerworks/community/blogs/mobilequalitybeta/entry/what_is_mobile_quality_assurance?lang=en_us


Click Feedback button to get Help or provide feedback


1 Tools and Technologies for MobileFirst Developers:

http://www.ibm.com/developerworks/mobile/

2 3

Ways to get started with IBM MobileFirst

Take part in the IBM Mobile Quality Assurance

open beta: ibm.biz/mobilequalitycloud

Read the CTO Mobile Frontier Blog:

http://bit.ly/ibmmobile-frontier-blog

http://www.ibm.com/developerworks/mobile/








Legal Disclaimer

© IBM Corporation 2013. All Rights Reserved.

The information contained in this publication is provided for informational purposes only. While efforts were made to verify the completeness and accuracy of the information contained in

this publication, it is provided AS IS without warranty of any kind, express or implied. In addition, this information is based on IBM’s current product plans and strategy, which are subject

to change by IBM without notice. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this publication or any other materials. Nothing contained

in this publication is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the

applicable license agreement governing the use of IBM software.

References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or

capabilities referenced in this presentation may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to

future product or feature availability in any way. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you

will result in any specific sales, revenue growth or other results.

If the text contains performance statistics or references to benchmarks, insert the following language; otherwise delete:

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will

experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage

configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.

If the text includes any customer examples, please confirm we have prior written approval from such customer and insert the following language; otherwise delete:

All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs

and performance characteristics may vary by customer.

Please review text for proper trademark attribution of IBM products. At first use, each product name must be the full name and include appropriate trademark symbols (e.g., IBM Lotus®

Sametime® Unyte™). Subsequent references can drop “IBM” but should include the proper branding (e.g., Lotus Sametime Gateway, or WebSphere Application Server). Please refer

to http://www.ibm.com/legal/copytrade.shtml for guidance on which trademarks require the ® or ™ symbol. Do not use abbreviations for IBM product names in your presentation. All

product names must be used as adjectives rather than nouns. Please list all of the trademarks that you use in your presentation as follows; delete any not included in your presentation.

IBM, the IBM logo, Lotus, Lotus Notes, Notes, Domino, Quickr, Sametime, WebSphere, UC2, PartnerWorld and Lotusphere are trademarks of International Business Machines

Corporation in the United States, other countries, or both. Unyte is a trademark of WebDialogs, Inc., in the United States, other countries, or both.

If you reference Adobe® in the text, please mark the first use and include the following; otherwise delete:

Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.

If you reference Java™ in the text, please mark the first use and include the following; otherwise delete:

Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.

If you reference Microsoft® and/or Windows® in the text, please mark the first use and include the following, as applicable; otherwise delete:

Microsoft and Windows are trademarks of Microsoft Corporation in the United States, other countries, or both.

If you reference Intel® and/or any of the following Intel products in the text, please mark the first use and include those that you use as follows; otherwise delete:

Intel, Intel Centrino, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and

other countries.

If you reference UNIX® in the text, please mark the first use and include the following; otherwise delete:

UNIX is a registered trademark of The Open Group in the United States and other countries.

If you reference Linux® in your presentation, please mark the first use and include the following; otherwise delete:

Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others.

If the text/graphics include screenshots, no actual IBM employee names may be used (even your own), if your screenshots include fictitious company names (e.g., Renovations, Zeta

Bank, Acme) please update and insert the following; otherwise delete: All references to [insert fictitious company name] refer to a fictitious company and are used for illustration purposes

only.

http://www.ibm.com/legal/copytrade.shtml

Join the Community

www.rational-ug.org

Tweet with Us @RationalUC #rationaluc

www.twitter.com/rationaluc

Join Our Group on LinkedIn: Global Rational User Community


Connect with Us on Google+





http://www.twitter.com/rationaluc











