testing tools using visual studio - windows - microsoft studio... · visual studio are now created...
TRANSCRIPT
![Page 1: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/1.jpg)
Testing Tools usingVisual Studio
Randy PagelsSr. Developer Technology SpecialistMicrosoft Corporation
![Page 2: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/2.jpg)
ProductionDevelopment
Collaboration
BACKLOG
REQUIREMENTS Monitor + LearnPlan
Develop + Test Release
![Page 3: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/3.jpg)
Agenda
• Web Performance Testing
• Load Testing
• Unit Testing
• Manual Testing
• Exploratory Testing
• Coded UI Testing
• Lab Management
![Page 4: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/4.jpg)
• Coded UI Tests
• Web Performance Tests
• Load Tests
• Generic Tests
• Ordered Tests
• Developer Unit Tests
• Database Unit Tests
• Test Plan Management
• Test Case Management
• Shared Steps Management
• Exploratory Testing
• Test Configuration Management
• Test Fast Forwarding
• Test Data Collection
• Test Lab Management
Test Manager
Manual Testing Tools
Visual Studio
Automated Testing Tools
![Page 5: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/5.jpg)
New Test Runner
![Page 6: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/6.jpg)
Unit Testing with Code Coverage
![Page 7: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/7.jpg)
![Page 8: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/8.jpg)
Exploratory Testing
• Exploratory testing is the testing of an application without a set of tests defined in advance. During an exploratory test session, you are not restricted to a script or a set of predetermined steps. Some improvements have been made to the exploratory testing in Microsoft Test Manager.
![Page 9: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/9.jpg)
Coded UI Testing
• Coded UI tests provide a way to create fully automated tests to validate the functionality and behavior of your application’s user interface. You can create coded UI tests directly from existing action recordings. Action recordings contain the steps taken during manual testing of an application.
![Page 10: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/10.jpg)
Web Performance Testing
• Any new Web performance and load testing efforts you create in Visual Studio are now created in a Web performance and load test project type instead of a test project. A Web performance test consists of a series of HTTP requests. Web performance tests work at the protocol layer by issuing HTTP requests.
![Page 11: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/11.jpg)
Load Testing
• Load tests consist of a series of Web performance tests or unit tests which operate under multiple simulated users over a period of time. Load tests can also include automated coded UI tests. Coded UI tests should be included only under specific circumstances. All the scenarios that use coded UI tests in load tests involve using the coded UI tests as performance tests.
![Page 12: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/12.jpg)
![Page 13: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/13.jpg)
View the performancedata from Application Insights
Application counters are correlated with the user load
Understand what issuesmay be causing any performance problems
Easily go to Application Insights if you need to do a more detailed analysis
![Page 14: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/14.jpg)
Load Test Manager
![Page 15: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/15.jpg)
Testing Tools using Visual Studio
Demo
![Page 16: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/16.jpg)
![Page 17: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/17.jpg)
REST APIs for tags
Query on Tag
Tags in Visual Studio
Tag Permissions
Exclude non-working days
Cumulative Flow Start Dates
Pinning of Work Item Charts
![Page 18: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/18.jpg)
![Page 19: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/19.jpg)
Export your test plan to HTML
Choose the level of detail you want
![Page 20: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/20.jpg)
Create sets of test data
Reference by various test cases
Easily bind to automated tests
![Page 21: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/21.jpg)
Permissions Reference
![Page 22: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/22.jpg)
![Page 23: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/23.jpg)
![Page 24: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/24.jpg)
Set alerts, get notified when changes occur
![Page 25: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/25.jpg)
Lab Management
• Testing a complex multi-tiered application and creating different configurations in a user-flow can be challenging. Lab Management provides teams a powerful and flexible development and test lab environment to enable scalable build-deploy-test workflow and continuous integration through environment templates.
![Page 26: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/26.jpg)
Testing Architecture
VM Template Library SCVMM Environment Standard Environment
VM Template 2VM Template 1
Test Agent Test Agent Test AgentTest AgentVMMAgent
Web Server
VMDatabase Server
VMVM Host Web Server Database Server
Test AgentTest Agent
Team Foundation Server
System Center Virtual Machine Manager (SCVMM)
Team Build
Test Controller
![Page 27: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/27.jpg)
Build-Deploy-Test
SCVMM Environment
Test AgentTest AgentVMMAgent
Web Server
VMDatabase Server
VMVM Host
Team Foundation Server
Test Controller
Team Build
(1) Get Source Code (2) Compile projects
(7) Send test
results
(6) Execute
automated tests
(3) Copy build to running
environment
(4) Run deployment scripts for
each machine
(5) Create environment snapshot
(8) Publish results to
Team Foundation Server
![Page 28: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/28.jpg)
Related Content
http://msdn.microsoft.com/en-us/library/tfs/bb385901%28v=vs.110%29
http://blogs.msdn.com/b/visualstudioalm/archive/2012/06/04/getting-started-with-load-testing-in-visual-studio-2012.aspx
http://msdn.microsoft.com/en-us/library/tfs/dd293547%28v=vs.110%29
http://blogs.msdn.com/b/visualstudioalm/archive/2012/07/09/javascript-unit-tests-on-team-foundation-service-with-chutzpah.aspx
http://blogs.msdn.com/b/visualstudioalm/archive/2012/07/31/writing-a-visual-studio-2012-unit-test-adapter.aspx
http://msdn.microsoft.com/en-us/library/tfs/ms182539%28v=vs.110%29.aspx
![Page 29: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/29.jpg)
Visit Team System Café Today!The door is open 24/7 at the café! Stop by for a cup of joe and delicious tidbits on AppDev topics!
http://www.teamsystemcafe.net
![Page 30: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/30.jpg)
What's New for Application Lifecycle Management in Visual Studio 2012
http://bit.ly/baSMz5
What's new for Microsoft Test Manager 2012
http://bit.ly/wN2JrH
Quick Start Guide for Manual Testing using Microsoft Test Manager 2012
http://bit.ly/d4l9qN
Test Scribe for Visual Studio 2012
http://bit.ly/Nim0gH
What is new in Coded UI Tests 2012
http://bit.ly/zWIbVf
Platforms for Coded UI Tests and Action Recordings
http://bit.ly/b5m32u
Resources
![Page 31: Testing Tools using Visual Studio - Windows - Microsoft Studio... · Visual Studio are now created in a Web performance and load test ... a more detailed analysis . Load Test Manager](https://reader031.vdocuments.net/reader031/viewer/2022030509/5ab8a54d7f8b9a28468d161c/html5/thumbnails/31.jpg)