managing test labs without the headaches
TRANSCRIPT
![Page 1: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/1.jpg)
Managing Test Labs Without the Headaches Visual Studio 2012
Imaginet and ALM…Efficiently Build Better Software
![Page 2: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/2.jpg)
Agenda
• Lab Management Overview– Demo: Creating a Standard Environment
• Version Comparison– Agents– Standard Environments
• Workflow Impact– Demo: Implementing a BDT workflow in
a Standard Environment
![Page 3: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/3.jpg)
Test Environments
• Group of machines configured to support testing of a system
• Generally…– Shared resources– IT and/or Dev Controlled
• Configuration• Reconfiguration• Backup/Restore• Deployment
Web Server
Database Server
App Server
![Page 4: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/4.jpg)
Lab Management
• Create and manage virtual or standard test environments
• Take snapshots or revert to existing snapshots for virtual environments
• Interact with test environment through the Environment Viewer
• Support for shared or isolated virtual environments
• Define and use test settings for environments
• Facilitate automated build/deploy/test
![Page 5: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/5.jpg)
Virtual and Standard Test Environments
Environment #2aEnvironment #1 Environment #2bVirtual Machine Server(s)
Environment #2a
VM1
VM2
VM3
Environment #2b
VM4
VM5
VM6
![Page 6: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/6.jpg)
Logical Lab Architecture
Team Foundation Server
Lab Management
Test Management
Build Management
Work Item Tracking
Version Control
Reporting
Test Controller(s)
Build Controller(s)
Standard Environment(s)
Hyper-
V H
ost
(s)
System Center Virtual Machine Manager
(SCVMM)
Vir
tual
Envir
onm
ent(
s)
Lib
rary
Serv
er(
s)
Microsoft Test Manager (Lab Center and Environment Viewer)
![Page 7: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/7.jpg)
DEMONSTRATION
• Using MTM’s Lab Center to Create a Standard Environment
![Page 8: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/8.jpg)
Agenda
• Lab Management Overview– Demo: Creating a Standard Environment
• Version Comparison– Agents– Standard Environments
• Workflow Impact– Demo: Implementing a BDT workflow in
a Standard Environment
![Page 9: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/9.jpg)
Lab Management 2010
• First Generation product
• Core Functionality– Physical & Virtual Test Environments– Build-Deploy-Test (BDT) Workflow*– Test Environment Snapshots*– Environment Viewer– Identical network-isolated environments*
* Out-of-the-box for Hyper-V only
![Page 10: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/10.jpg)
Changes in Lab Management 2012
• Simplified Agent Configuration
• SCVMM 2012 and Clustered Host Support
• Standard Environments
![Page 11: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/11.jpg)
Simplified Agent Configuration
• Visual Studio 2010 – Three agent types installed on client machine:
• Test• Build• Lab Agent
• Visual Studio 2012– Single agent (Test) automatically installed during
environment creation
![Page 12: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/12.jpg)
Agents
• Installed on “client” machines
• Three agent types:– Test Agent – Enables automated
testing on the client machine– Build Agent – Enables automated
deployment to the client machine– Lab Agent – Enables Network
Isolation (2010 Only)
• Available on the Lab Management media (Test and Lab) or the TFS media (Build)
• Can be installed/maintained using the VMPrepTool
![Page 13: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/13.jpg)
Test Controllers and Agents
Figure from MSDN documentation
![Page 14: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/14.jpg)
Standard Environment (2012) with Build Agents
System #1
Build Controllers and Agents
Build(Compile)
Build(Deploy)
Automated build and deployment is through Build Controllers and Agents.
Team Foundation
Server
Build Controller(s)
Build Server(s)
(with Build Agents)
Virtual Environment with
Build Agents
System #2
Etc.
VM #1
VM #2
Etc.
![Page 15: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/15.jpg)
Virtual Machine Server(s)
Lab Agents (2010 Only)
Environment A
VM1+Agent
VM2+Agent
VM3+Agent
Environment B
VM1+Agent
VM2+Agent
VM3+Agent
Environment C
VM1+Agent
VM2+Agent
VM3+Agent
![Page 16: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/16.jpg)
Standard Environments
• Environments composed of non-Hyper-V machines:– Physical machines– VMWare– Other non-Microsoft virtualization technologies
• Lab management features available without SCVMM and Hyper-V:– Automated Deploy– Automated Testing
• Easy to get started testing using Lab Management
![Page 17: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/17.jpg)
Environment Comparison
Capability Virtual Environments
Standard Environments
TestingRun manual tests Supported Supported
Run coded UI and other automated tests Supported Supported
File rich bugs using diagnostic adapters Supported Supported
Build deployment
Automatic build-deploy-test workflow Supported Supported
Environments creation and management
Automatically install test agent into machines of the environment Supported Supported
Create environment from VM template Supported Not supported
Start/stop/snapshot environment Supported Not supported
Connect using Environment Viewer Supported Supported
Run multiple copies of an environment at the same time using network isolation Supported Not supported
![Page 18: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/18.jpg)
Comparison of Installation Process
Virtual Environments
• Prerequisites:– TFS 2010 or TFS 2012
• SCVMM Admin Console on the TFS
– Virtual machine host server(s):• Windows Server 2008 or later (R2
or 2012 recommended)• Hyper-V• SCVMM Server• Library server
• Process:– Configure Lab Management using
the TFS Admin Console– Import virtual machines– Install agents as needed– Create environments, templates,
etc. in library
Standard Environments
• Prerequisites: – TFS 2010 or TFS 2012
• Process:– Install agents on existing physical
(or non-Hyper-V virtual) machines• ‘Automatic’ with TFS 2012
– Create environments based those machines
![Page 19: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/19.jpg)
Agenda
• Lab Management Overview– Demo: Creating a Standard Environment
• Version Comparison– Agents– Standard Environments
• Workflow Impact– Demo: Implementing a BDT workflow in
a Standard Environment
![Page 20: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/20.jpg)
TFS Build Process
Build Workflow
DEVDEV
DEV
TFS Version Control
C#
EXE
![Page 21: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/21.jpg)
Manual Test Workflow
QA QA
Rich Bug
Run Tests in Standard
Environment
![Page 22: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/22.jpg)
Developer Workflow
Review Rich Bug
DEV
Bug fix checked into
TFS
![Page 23: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/23.jpg)
Implementing a BDT Workflow
• Configure Team Foundation Build Service for your team project collection
• Set up a test controller and register it with your team project collection
• Set up a lab environment– SCVMM, or – Standard (physical, VMWare, other virtualization platform)
• To run automated tests after deployment– Create a test plan with test case(s)– Create automated test(s) and link to test case(s)– Create test settings for the automated test(s)
• Create deployment scripts for your application(s)• Configure BDT workflow
![Page 24: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/24.jpg)
DEMONSTRATION
• Implementing a Build-Deploy-Test Workflow using a Standard Environment
![Page 25: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/25.jpg)
Want to know more...?
![Page 26: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/26.jpg)
Imaginet’s New Visual Studio 2012 Website!
http://visualstudio.imaginet.com
Visit Imaginet’s new Visual Studio 2012 website, your one-stop hub for all your Visual Studio 2012 needs!
![Page 27: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/27.jpg)
For attendees of today’s session that fill out the survey
FREE Imaginet On DemandWeb Training Subscription Offer
Complete our Post-Webcast survey, and receive 1 free Imaginet On Demand web training subscription, good for 1 person for 1 month!! The survey will be emailed to you immediately after this webcast is over.
What is Imaginet On Demand? Imaginet is proud to announce our newest web-based training program called Imaginet On Demand, your source for the best Application Lifecycle Management (ALM) training on the internet. Imaginet On Demand is a subscription-based training program centric to the Visual Studio ALM tools, including Visual Studio, Team Foundation Server (TFS), Microsoft Test Manager, and Microsoft Visual Studio Lab Management. Learn the new tools of Visual Studio at your pace, from wherever you want. It's that simple!
![Page 28: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/28.jpg)
Need Help with YOUR Lab Management Setup?
• Includes designing, installing, and configuring Microsoft’s virtual test lab management software.
• Learn best practices for using with Lab Management
• Support and training for your team
• Includes a high-level ALM assessment
Imaginet’s Visual Studio 2012Lab Management 10-day Quickstart
Interested? Just email us at [email protected].
![Page 29: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/29.jpg)
Top Gun Academy Training Classes
• Other Imaginet Training Classes– ALM
• Microsoft Visual Studio & TFS 2012 – Skills Upgrade (2 days)• Overview Training with Microsoft Visual Studio 2012 ALM Tools (4 days)• Overview Training with Microsoft Visual Studio 2010 ALM Tools (4 days)• Testers Training with Microsoft Visual Studio 2012 ALM Tools (4 days)• Testers Training with Microsoft Visual Studio 2010 ALM Tools (4 days)• Developers Training with Microsoft Visual Studio 2012 ALM Tools (4 days)• Developers Training with Microsoft Visual Studio 2010 ALM Tools (4 days)• Imaginet On Demand Online Web Training
– Scrum/Kanban• Professional Scrum Foundations (PSF) (2 days)• Professional Scrum Master (PSM) (2 days)• Professional Scrum Developer (PSD) (5 days)• Professional Scrum Master (PSM) Using Microsoft ALM (3 days)• Accredited Core Kanban Using Microsoft ALM (3 days)
To register or for more information, please visit our website here: http://www.imaginet.com/ or contact us: [email protected]
![Page 30: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/30.jpg)
TFS / Visual Studio 2012
Remaining Workshops & Webcasts:
• Lean, Kanban, and TFS • December 3 (1:00-2:30pm CT)
• Approaches to Kanban with TFS• December 6 (1:00-2:30pm CT)• December 20 (1:00-2:30pm CT)
• Streamline Your Testing with Visual Studio 2012 Testing Tools• December 13 (1:00-2:30pm CT)
• Getting Started with Coded UI Testing: Building Your First Automated Test• December 17 (1:00-2:30pm CT)
![Page 31: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/31.jpg)
Email us at:[email protected]
ALM Planning & Implementation ServicesALM Planning • ALM Assessment & Envisioning Workshops
(3 or 5 days)• VS & TFS Migration Planning Workshop (5
days)• TFS Deployment Planning* (5 days)• Visual SourceSafe to TFS Migration
Planning* (3 Days)• Visual Studio Quality Tools Deployment
Planning* (5 days)
Upgrade• TFS 2010 Adoption Quick Start (5 or 10
days)• TFS 2012 Adoption Quick Start (5 or 10
days)• TFS 2010 Upgrade Quick Start (10 days)• TFS 2012 Upgrade Quick Start (10 days)
Remote Support• Remote Support for TFS & Visual Studio
Lab• Visual Studio Lab Management Quick Start
(10 days)
Testing• Manual Testing with Test Manager Quick
Start (5 days)• Visual Studio Testing Tools Quick Start (10
days)• Visual Studio Automated Testing Quick Start
(5 days)• Visual Studio Load Testing Quick Start (5 or
10 Days)
Builds• Automated Build & Release Management
Quick Start (5 days)• Automated Build Center of Excellence (CoE)
Database• Visual Studio Database Tools Quick Start (10
days)
Integrations• Team Foundation Server (TFS) & Project
Server Integration Quick Start (10 days)• TFS & Quality Center Integration/Migration
Quick Start (10 days)
![Page 32: Managing Test Labs Without the Headaches](https://reader035.vdocuments.net/reader035/viewer/2022062515/55d53489bb61eb335f8b4685/html5/thumbnails/32.jpg)
Phone: 1-800-989-6022Email: [email protected]
Website: www.imaginet.comFacebook: www.facebook.com/justimaginetTwitter: www.twitter.com/justimaginetSlideshare: www.slideshare.net/imaginet
Attend a Webinar: www.imaginet.com/webinarsAttend a Training Class: www.imaginet.com/training
Want to know more...?