microsoft test manager
Post on 17-Oct-2014
29.183 views
DESCRIPTION
A presentation to the Canberra VSTS User Group on the topic of Microsoft Test Manager (MTM).TRANSCRIPT
![Page 1: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/1.jpg)
![Page 3: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/3.jpg)
• Managing Testing Efforts
• Automating Test Cases
• Deploying Lab Environments
![Page 4: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/4.jpg)
![Page 5: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/5.jpg)
• Terminology
• Demos – Creating Test Plans
– Understanding Test Settings
– Creating Test Cases
– Using Shared Steps
– Launching Test Cases
– Creating Bugs
– Reviewing Results
• Best Practices
![Page 6: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/6.jpg)
• Test Plan; a container for test cases with a
set time span.
• Test Case; a sequence of steps which must
be tested.
• Test Run; a group of tests that are being
run locally or in the lab.
• Test Result; a result from a test case in a
test run.
![Page 7: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/7.jpg)
Demonstration
![Page 8: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/8.jpg)
Demonstration
![Page 9: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/9.jpg)
Demonstration
![Page 10: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/10.jpg)
Demonstration
![Page 11: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/11.jpg)
Demonstration
![Page 12: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/12.jpg)
Demonstration
![Page 13: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/13.jpg)
Demonstration
![Page 14: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/14.jpg)
• Test Plans – By Feature Area/By Iteration?
• Shared Steps – When to Use?
• Configurations – Common Attributes?
• Data Recorders – Considerations?
![Page 15: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/15.jpg)
![Page 16: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/16.jpg)
• Coded UI Test; some code that uses the UI test automation framework that is hosted inside MSTest.
• Coded UI Test Builder; a utility that allows you to graphically construct UI tests.
• Action Log Recording; an XML file previously recorded via the Test Runner with the Action Log Recording data collector.
![Page 17: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/17.jpg)
• Terminology
• Demos
– Create from Action Log Recording
– Create with Coded UI Test Builder
– Create from Scratch
– Using Test Case Data Sources
• Best Practices
![Page 18: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/18.jpg)
Demonstration
![Page 19: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/19.jpg)
Demonstration
![Page 20: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/20.jpg)
Demonstration
![Page 21: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/21.jpg)
Demonstration
![Page 22: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/22.jpg)
• Action Log Recordings - Good or Bad?
• Hand Code? The curse of the UIMap!
• Automation - When to automate?
![Page 23: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/23.jpg)
Iteration 1 Iteration 2 Iteration 3 Iteration 4
Story #1
Story #2
Legend
New
![Page 24: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/24.jpg)
Iteration 1 Iteration 2 Iteration 3 Iteration 4
Story #1
Story #2
Story #1
Story #2
Story #3
Story #4
Story #5
Legend
New Changed
![Page 25: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/25.jpg)
Iteration 1 Iteration 2 Iteration 3 Iteration 4
Story #1
Story #2
Story #1
Story #2
Story #3
Story #4
Story #5
Story #1
Story #2
Story #3
Story #4
Story #5
Story #6
Story #7
Legend
New Changed Stable
![Page 26: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/26.jpg)
Iteration 1 Iteration 2 Iteration 3 Iteration 4
Story #1
Story #2
Story #1
Story #2
Story #3
Story #4
Story #5
Story #1
Story #2
Story #3
Story #4
Story #5
Story #6
Story #7
Story #1
Story #2
Story #3
Story #4
Story #5
Story #6
Story #7
Story #8
Story #9
Legend
New Changed Stable
![Page 27: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/27.jpg)
Iteration 1 Iteration 2 Iteration 3 Iteration 4
Story #1
Story #2
Story #1
Story #2
Story #3
Story #4
Story #5
Story #1
Story #2
Story #3
Story #4
Story #5
Story #6
Story #7
Story #1
Story #2
Story #3
Story #4
Story #5
Story #6
Story #7
Story #8
Story #9
Legend
New Changed Stable
Action Log Assisted Testing
![Page 28: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/28.jpg)
Iteration 1 Iteration 2 Iteration 3 Iteration 4
Story #1
Story #2
Story #1
Story #2
Story #3
Story #4
Story #5
Story #1
Story #2
Story #3
Story #4
Story #5
Story #6
Story #7
Story #1
Story #2
Story #3
Story #4
Story #5
Story #6
Story #7
Story #8
Story #9
Legend
New Changed Stable
Action Log Assisted Testing
Coded UI Testing
![Page 29: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/29.jpg)
Iteration 1 Iteration 2 Iteration 3 Iteration 4
Story #1
Story #2
Story #1
Story #2
Story #3
Story #4
Story #5
Story #1
Story #2
Story #3
Story #4
Story #5
Story #6
Story #7
Story #1
Story #2
Story #3
Story #4
Story #5
Story #6
Story #7
Story #8
Story #9
Legend
New Changed Stable
Action Log Assisted Testing
Coded UI Testing
Unit Testing
![Page 30: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/30.jpg)
![Page 31: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/31.jpg)
• Terminology
• Demos
– Running Automated Tests from MTLM
– Creating Environments
– Automating Deployments
– Nightly Regression Tests
• Best Practices
![Page 32: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/32.jpg)
• Team Build; a component of TFS that
provides distributed build capability.
• Build Workflow; a XAML file containing
the instructions to produce a build via
Team Build.
• Lab Build; a special case build workflow
designed to automate lab management.
![Page 33: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/33.jpg)
• Lab; the infrastructure you use to test out the products you are developing.
• Environment; a specific subset of the lab dedicated to a particular team project.
• Hyper-V; the virtualisation technology created by Microsoft.
• SCVMM; a product from the System Centre suite designed to manage multiple Hyper-V hosts.
![Page 34: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/34.jpg)
• Library; a storage location for saved VMs,
ISO images etc.
• Snapshot/Checkpoint; a point in time
version of a lab machine (memory + disk).
![Page 35: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/35.jpg)
Demonstration
![Page 36: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/36.jpg)
Demonstration
![Page 37: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/37.jpg)
Demonstration
![Page 38: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/38.jpg)
Demonstration
![Page 39: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/39.jpg)
• Snapshotting – Pre/Post?
• Reporting - Track Quality, Track Activity
• Network Isolation – What is it? Why?
• Environment Configuration – How?
![Page 40: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/40.jpg)
Internet
Fire
wal
l
Remote Access
Gateway
VPN (Encrypted) RDP (Encrypted)
HTTP (Encrypted)
Active Directory
Multi-Tenant TFS
Hyper-V Farm
(VMM) Customer
Build Server(s)
Customer Build
Server(s)
Dedicated Lab
Machines
Dedicated Lab
Machines
Dedicated Lab
Machines
Dedicated Lab
Machines optional external
exposure
Other Services
Other Services
![Page 41: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/41.jpg)
• Managing Testing Efforts
• Automating Test Cases
• Deploying Lab Environments
![Page 42: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/42.jpg)
• http://blogs.msdn.com/lab_management/
• http://vslabmgmt.codeplex.com
• http://channel9.msdn.com/tags/ALM/
![Page 43: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/43.jpg)
• Visual Studio 2010 Workshop (1 day)
• Implementation Consulting
• Virtual Build Master (Managed Service)
![Page 44: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/44.jpg)
![Page 45: Microsoft Test Manager](https://reader033.vdocuments.net/reader033/viewer/2022051322/544144b7b1af9ff44d8b465b/html5/thumbnails/45.jpg)