project-x 3.0 quality criteria. qa criteria milestones Ø system integration complete (september)...
TRANSCRIPT
Project-X 3.0
Quality Criteria
QA Criteria Milestones System Integration Complete
(September)
Ready to start building production servers.
Project-X QA Complete (November)
QA accepts the software
Franchise GA (late-November)
Ready for shipment to external customer
System Integration Complete Criteria Code complete
Integration tests complete
Application integration and interoperability testing complete
No backlog of bugs
No OPEN bugs over 3 days old
System running in staging environment
System Integration Complete
QA assessment of progress against criteria
122
5%
10%
0%System setup and running instaging environment
Bug backlog
Buysite integration and testcomplete
Integration test complete
Goal = 0
Percent complete
Project-X QA Complete Criteria QA testing completed
Staging and Testing community testing complete
All bugs closed (Fixed or Postponed)
No Priority 1 or Priority 2 bugs in system
Final documentation reviewed and approved
Software ready for mass production and packaging
Project-X Franchise GA Criteria Final media verified
Documentation
Software media (i.e. CDs)
Packaging
System put into production
Marketing and sales collateral ready
Training materials are ready
Prof Serv, Customer Support, Deployment enabled
Staging and Testing Community Lab
Create a model of the “real world” in lab environment
Enable end-to-end tests with all products
Integrate 3rd party products and connectivity, such as suppliers, for testing and certification.
Provide a realistic environment to test all software, patches and configurations before rolling them into production.
Now building this lab for current products
Staging and Trading Community Testing Build the staging and trading community lab
Execute planned end-to-end testing of all products that will interact with system
Test both software and operational procedures
Verify documentation and deployment processes
Test and certify all initial external integrations
Dry-run “power-on” for live 3.0 service
QA Progress
Functional testing in process. Expect to complete in September.
Now tracking Bug Metrics
Now tracking Test Metrics
Quality Assurance Metrics
Bug Metrics - Week 33
88
122128
82
0
60
40
20
40
60
80
100
120
140Total
Open
Incoming
Fixed
Quality Assurance Metrics
Test Metrics - Week 33
0%
20%
40%
60%
80%
100%
XDK Performance
Not Run/Not Yet Done
Run/Task Completed
Passed/Successful
Major Categories of Testing and QA Tasks