crmug uk november 2015 - testing testing! panel discussion with scott durow, sarah critchley and...

explore

engage

elevate

Testing, Testing!Chair: Scott Durow, MVP

Panel: Sarah Critchley and Priscilla Tse

13:45 – 14:35

explore engage elevate

Scott Durow – Dynamics CRM MVP

Solution Architect

CRMUG Committee Member

Dynamics CRM MVP

Email: [email protected]

Twitter: @scottdurow

Blog: http://scottdurow.develop1.net

mailto:[email protected]

http://scottdurow.develop1.net/


Sarah Critchley

Developer & Consultant

Experience with CRM 2011, 2013 & 2015 in both Online and On-Premise environments

Passionate about CRM


Twitter: @DynamicCRMCat

Blog: crm.fueledbysleep.com


Priscilla Tse

Technical Team Lead, Senior CRM Technical Consultant, Technical Writer

Experienced in end-to-end implementation of Dynamics CRM4 to CRM2015/online for government agencies, health sectors and multinational cooperation.


Blog: DynamicsCRMGirl.wordpress.com

LinkedIn: https://uk.linkedin.com/pub/priscilla-tse/14/9b3/a41



https://uk.linkedin.com/pub/priscilla-tse/14/9b3/a41


Bridging the gap

You are here!

Happy UsersUSER ACCEPTANCE

TESTING

………………………

Software is tested in the

"real world" by the intended

audience or business

representatives

INTEGRATION, SYSTEM &

REGRESSION TESTING

………………………

Combine software together

and ensure it meets

requirements with no

unwanted side-effects

UNIT TESTING

………………………

Isolate small pieces of

testable software and

ensure it behaves as you

expect


Let’s collaborate together and answer…


Case Study – Upgrade of CRM4 to CRM Online


Infinite Time & Budget?

100% Unambiguous Requirements?

Massive Dedicated Test Team?

Let’s be pragmaticand not

theoretical!


Unit Testing Challenges (from discussions)

Moqs and fakes working for the tests (automated testing)

Javascript is a challenge to unit test (all client side) –multiple browsers and things are difficult to control

Scalability testing (Possible performance issues)

Standardisation between developers – is everyone writing the same way? Practicing standards

Testing data migration is difficult at this stage

Commenting code/tracing and knowledge transfer (can cover all of them)


Integration, System & Regression Test Challenges (from discussions)

Developers understanding specification and not working straight away

Testing security roles

Configuration entities – testing right setup

Firewalls/infrastructure challenges (environmental readiness) – Dev -> QA -> UAT

Mobile and different applications


User Acceptance Test Challenges (from discussions)

Time Commitments and the cascade in this (time management) – scheduling in this time

Control of changes and coherent release tracking – bug tracking which things have been fixed and which things haven’t

The above point if is particular for retesting also

Positive test evidence

Data and how this is relevant to the user

Differences between test and live and mismatches

Good representation of tests

The difference between training and testing (chicken and egg) and avoiding bias

Representative users to do representative things/roles – replicating a normal and a non-typical day

Feedback being sent back e.g. what did it do to not work, what are the replication steps.

explore

engage

elevate

5 minutes of…

Unit TestingScott Durow


♥


AAA

ASSEMBLE

ACT

ASSERT


Reasons why Unit Testing fails to deliver value…


Top Reason Unit Testing fails to deliver value…

explore

engage

elevate

5 minutes of…

QA & Formal TestingSarah Critchley


Sarah’s Top tips - QA & Formal Testing

Know what your testing

Business Processes vs Documented Functionality

WHAT are you doing?! WHY are you doing it?!



What are you testing? Why are you testing it?

• Business Process

• Documented Functionality



Formal testing techniques

Shooting for and around the goal

Positive & Negative Testing



Exploratory testing

Testing without an Ego

Benefits and Challenges

explore

engage

elevate

5 minutes of…

User Acceptance TestingPriscilla Tse


User Acceptance Testing (UAT) … Involves …

UAT

Testers

Test System

Test Scripts


Test Scripts: Start Early and Iterate

Test Scripts


Test System: Is Built By …

Test System

Dev Team

Data Migration Team

Deployment Team

Collaboration


Testers: Support UAT Testers

Testers / End Users

Quality Feedback

Product Champion

explore

engage

elevate

Call to action: Accept and expect bugs and work

together to find them as early as possible.

explore

engage

elevate

Final thoughts?

explore

engage

elevate

Please fill in your feedback forms for this session!