04 test controlling and tracking
DESCRIPTION
Testing with Visual Studio 2012 Agile TMapTRANSCRIPT
![Page 1: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/1.jpg)
Module 03Test Controlling
and Tracking
![Page 2: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/2.jpg)
Topics
![Page 3: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/3.jpg)
Providing the client with sufficient insight into, and the opportunity to influence, the following:
• The progress of the test process
• The quality and risks of the test object
• The quality of the test process
Manage the test process, the infrastructure and the test products. Using the data thus obtained as a basis, and the analyses of possible trends.
http://www.tmap.net/en/tmap/4-essentials/structured-test-process/acceptance-and-system/control-phase
The Control Phase
![Page 4: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/4.jpg)
Software Testing with Visual Studio
![Page 5: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/5.jpg)
Reporting on Software Quality
![Page 6: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/6.jpg)
Monitoring Quality Metrics
![Page 7: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/7.jpg)
Available Test Reports
![Page 8: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/8.jpg)
Rich Information
Rich Visualization
Harder to Customize
SQL Server Reports
![Page 9: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/9.jpg)
Out of the Box
Easy to create your own
Easy to Customize
Excel Reports
![Page 10: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/10.jpg)
All information inone place – the browser
Based on Excel Services
Customizable
Ideal for “Self-Service BI”
SharePoint/Web Access Dashboards
![Page 11: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/11.jpg)
Manual/FunctionalTest Results
Microsoft Test Manager Results
![Page 12: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/12.jpg)
Filters allow you to control
which builds you see
View the test and code coverage
results for each build to
determine quality
![Page 13: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/13.jpg)
![Page 14: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/14.jpg)
![Page 15: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/15.jpg)
Line-by-line highlighting illustrates
which code is covered, uncovered,
or partially covered by test
Results show which methods are
covered by test and total coverage is
indicated by a percentage
![Page 16: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/16.jpg)
Track total percentage hours
completed by user story
View real-time status of
each user story
Test results quickly display
quality status of each user story
Track active and resolved
bugs by user story
![Page 17: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/17.jpg)
Demo
Quality Reports
![Page 18: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/18.jpg)
Bugs and Defects
![Page 19: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/19.jpg)
Manual Testing
![Page 20: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/20.jpg)
Catching and Tracking Bugs
Rich Information
Customizable
Collect rich Information with Data Diagnostic Adapters
Customizable bug flow, states and reporting
![Page 21: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/21.jpg)
Organize testing in multiple
configurations
Playback a prior recording to save
time with frequently-repeated
setup steps and prerequisites
Bind data to controls, to
support multiple iterations
and future automation
Pause, save, close, return, and
pick up where you left off
![Page 22: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/22.jpg)
Filing Bugs
Rich Information
Customizable
Microsoft Test Runner
Microsoft Test Manager
TFS Web Access
Visual Studio
Feedback Manager*
3rd party tools*
![Page 23: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/23.jpg)
IntelliTrace Logs
System logs & configurationDetailed status and history
visible to all team members
Audio & Video recordings
![Page 24: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/24.jpg)
Action Recording
Video
Intellitrace
Test Impact
“Create your own”
Data Diagnostic Adapters
![Page 25: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/25.jpg)
Get an overview of the test run
with summary pie charts, or drill
into the details for each test.
Analyze code coverage for manual
tests to determine which specific
parts of your code were tested .
Associate manual test runs
with builds and environments.
![Page 26: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/26.jpg)
Demo
Creating and Resolving a Bug
![Page 27: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/27.jpg)
The Bug Backlog
Put Bugs on theBacklog
Create your ownBug Workflow
![Page 28: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/28.jpg)
Custom Reports
![Page 29: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/29.jpg)
Relational Databases(TFS)
Data Warehouse(Reporting Services)
Creating Customized Reports
![Page 30: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/30.jpg)
Creating Excel Reports for Test
![Page 31: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/31.jpg)
Quality Status Reports“What is the status of testing of specific user stories or product areas?”
“What is the quality of builds based on the number of failed and passed tests?”
“How many test cases have never been run?”
“Which test cases have never been run?”
Quality Trend Reports“How many tests are blocked, passing, or failing over time?”
“How many tests are regressing?”
“How consistent is the manual test activity over time?”
Test Results - Data Points
![Page 32: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/32.jpg)
Demo
Creating an Excel Pivot Table
![Page 33: 04 test controlling and tracking](https://reader034.vdocuments.net/reader034/viewer/2022051322/546273b9b4af9f4e1c8b478d/html5/thumbnails/33.jpg)