project-x 3.0 quality criteria. qa criteria milestones Ø system integration complete (september)...

Project-X 3.0

Quality Criteria

QA Criteria Milestones System Integration Complete

(September)

Ready to start building production servers.

Project-X QA Complete (November)

QA accepts the software

Franchise GA (late-November)

Ready for shipment to external customer

System Integration Complete Criteria Code complete

Integration tests complete

Application integration and interoperability testing complete

No backlog of bugs

No OPEN bugs over 3 days old

System running in staging environment

System Integration Complete

QA assessment of progress against criteria

122

5%

10%

0%System setup and running instaging environment

Bug backlog

Buysite integration and testcomplete

Integration test complete

Goal = 0

Percent complete

Project-X QA Complete Criteria QA testing completed

Staging and Testing community testing complete

All bugs closed (Fixed or Postponed)

No Priority 1 or Priority 2 bugs in system

Final documentation reviewed and approved

Software ready for mass production and packaging

Project-X Franchise GA Criteria Final media verified

Documentation

Software media (i.e. CDs)

Packaging

System put into production

Marketing and sales collateral ready

Training materials are ready

Prof Serv, Customer Support, Deployment enabled

Staging and Testing Community Lab

Create a model of the “real world” in lab environment

Enable end-to-end tests with all products

Integrate 3rd party products and connectivity, such as suppliers, for testing and certification.

Provide a realistic environment to test all software, patches and configurations before rolling them into production.

Now building this lab for current products

Staging and Trading Community Testing Build the staging and trading community lab

Execute planned end-to-end testing of all products that will interact with system

Test both software and operational procedures

Verify documentation and deployment processes

Test and certify all initial external integrations

Dry-run “power-on” for live 3.0 service

QA Progress

Functional testing in process. Expect to complete in September.

Now tracking Bug Metrics

Now tracking Test Metrics

Quality Assurance Metrics

Bug Metrics - Week 33

88

122128

82

0

60

40

20

40

60

80

100

120

140Total

Open

Incoming

Fixed

Quality Assurance Metrics

Test Metrics - Week 33

0%

20%

40%

60%

80%

100%

XDK Performance

Not Run/Not Yet Done

Run/Task Completed

Passed/Successful

Major Categories of Testing and QA Tasks