tf-storage – benchmarking - vendors · © 2010 cisco and/or its affiliates. all rights reserved....
TRANSCRIPT
Cisco Confidential © 2010 Cisco and/or its affiliates. All rights reserved. 1
TF-Storage – Benchmarking - Vendors Andy Vallely
June 16th 2011
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2
• Budapest – Maciej Brzezniak
Slide above accredited to Maciej Brzezniak - PSNC
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 3
• Budapest – Maciej Brzezniak
Slide above accredited to Maciej Brzezniak - PSNC
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 4
• Budapest – Maciej Brzezniak
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 5
• EAL4 – Firewall Accreditation Fixed Hardward Platform Fixed Operating System Fixed Maintenance Level
Est Cost: $500,000 - $750,000
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 6
• Single Supplier (NOTE NOT VENDOR) Fixed Hardward Platform Fixed Operating System Fixed Maintenance Level Fixed testing procedure No two environments exactly the same
• Multi-Supplier Each responsible for own part in the system Fixed Hardward Platform Fixed Operating System Fixed Maintenance Level Fixed testing procedure No two environments exactly the same
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 7
• Vendor test to “vendor standard” Fixed Hardward Platform Fixed Operating System Fixed Maintenance Level Vendor test procedure – show product in best light
• NREN “Suspicious” See earlier slides
• Vendor test to “customer standard” High cost of additional testing
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 8
IEEE 829 Standard for Software Test Documentation IEEE 1008, a standard for unit testing IEEE 1012, a standard for Software Verification and Validation IEEE 1028, a standard for software inspections IEEE 1044, a standard for the classification of software anomalies IEEE 1044-1, a guide to the classification of software anomalies IEEE 830, a guide for developing system requirements specifications IEEE 730, a standard for software quality assurance plans IEEE 1061, a standard for software quality metrics and methodology IEEE 12207, a standard for software life cycle processes and life cycle data BS 7925-1, a vocabulary of terms used in software testing BS 7925-2, a standard for software component testing
© 2010 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 9
Should the NREN community (NRENs and Vendors/Suppliers) work together to develop a
standard for testing a complete system.
Thank you.