microsoft testing tour - setting up a test environment

With TFS and Visual Studio

Angela Dugan

ALM Practice Manager

Polaris Solutions

Angela Dugan

User

Interface

Services

Business Processes

Business Rules and Logic

Service integrations

Data access

Identity

Data

Automated testing Unit testing Integration testing Performance testing Load testing

Manual testing User testing Ad-hoc exploratory testing Planned manual testing

Automated testing Keyword testing UI automation testing Performance testing

Continuous integrationsBuild | Deploy | Test

Testing toolboxRole tailored tools

Lab manager

Lab management services

Test execution services

Build services

Pluggable components

Test runners Build enginesLab

environmentsDiagnostic data

collectors

Modern apps run in diverse environments

Difficult to repro issues found

Replicating environments for test is time-consuming, costly

Virtualization reduces cost to provision environments

Templates allow a wide range of baselines to be spun up quickly and on demand

Snapshots capture states for reproducing test conditions and verifying defects

Dramatically reduced hardware and maintenance expenses

Improved quality and reliability of apps across platforms

Operations engaged in earlier phases of testing

On-premise | Cloud

Create and manage virtual or physical environments for Dev/Test

Take snapshots or revert to existing snapshots for any virtual machine

Deploy current or any build to environment

Interact with virtual machines through the environment viewer

Define test settings for environments

Test Agent

Controller

Register with Team

Project Collection

Team

Foundation

Server

Web Server

Collect Intellitrace

Information

Test Agent

Client

Network Emulation

Test Agent

Run Tests

Client

Collect Test Impact

Data

Test Agent

Run Tests

Database Server

Collect System

Information

Test Agent

Where to

run Tests?

Collect

Data?Affect

Machine

Test Controllers and Agents Test agent controller

manages test agents

Test agents run tests and collect

data or impact the system

Installed on the “client” machines

Three types of agentsTest Agent-Enables automated testing

Build Agent-Enables automated deployment

Lab Agent-Enables network isolation

Install from the Lab Management or TFS media

Can be installed/maintained using the VMPrepTool

Create new multi-machine environment choices

Create a new

environment using virtual

machine templates in

SCVMM

Create an

environment using

machines running on

SCVMM

Create new

environments on

existing machines

Quickly choose multiple

test suites to run after

deployment

Choose your environment,

and build, deploy and test in

that environment from a

single dialog

Snapshot environments

during manual testing to

increase reproducibility

Spin up virtual test environments

from within Test Manager, or attach a

virtual environment to a manual

testing session

Thumbnail view of each

machine in the environment

Environment snapshot

taken and attached as a

link with bug

Developers can quickly debug

issues on the exact same

testing environment

Test run results are attached to

specific builds and environments

Collect all the data required

to recreate bugs from virtual

environments

SCVMM Environment Standard Environment

Build-Deploy-Test

Snapshot / Restore

Share Bug Snapshots

Network Fencing

3rd Party Virtualization

Physical Machines

Lab Management is included with Visual Studio Premium/Test Pro

SCVMM license for dev/test is included

MSDNHeadless Hyper-V as the host OS

Guest OS license is part of MSDN subscription

Each person accessing the Virtual Machine Host (or accessing a virtual machine on that host) must have an MSDN subscription

ULTIMATE

Premium

Professional

Test

Professional

Team Explorer Everywhere

SharePoint

Office

Web Access

Creating VMsCreate and store VMs - MSDN doc

Prepare a domain controller VM

Manage virtual environmentsCreating virtual envs - MSDN doc

Creating and working with virtual envs

Concepts and guidelines

Creating network isolated environments

NetworkingNetworking basics

Network isolation

Topology 1 - Multiple AT, Load Balancer and Test network with firewall settings, controlling the test traffic in and out of Corp network

Network load balancer

Firewall rules

Topology 2 - Multiple ATs and DTs without load balancers and Test network with SAN based library and host

SAN support

Topology 3 - TMG, Windows NLB and with Test apps having DB tier outside of virtual environment

Setting up rules in Threat Management Gateway

Deployment and testing on a shared machine outside the envt

Topology 4 - Multiple ATs and DTs, load balancers and environments joined to a different domain

DNS conditional forwarding