U.S. Department of EnergyOffice of Civilian Radioactive Waste Management

Software Qualification Statusand Software IssuesPresented to:DOE/NRC Quarterly QA Meetinga

Bill Watson "neration Manager,-,Sci enqo and Analysis.Be4K'eS d "compL

:7:=t=iL A A:: ::: A:: X:::: :: :(:: : :L: Y::::A

* ' 4 * )~~~~~~~~~~~~~~~~~~~~~ E~~~~~~~ f l f l 4 ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~ ~~ . M O U N T A I N~~~~~~~~~~~~~~.D 00;N a.0(

j-i/'

-jY

Software Qualification Goal

* The original goal was to qualify at least 80% ofsoftware used in the PMRs and their supportingAMRs at the time Rev 1 of the PMRs wassubmitted to DOE.

* The goal was met for Rev 0 PMRs (and ICNupdates) as well as supporting AMRs for TSPA-SR,Rev 0, ICN 1

I Y MSP Yucca Mountain ProjectlPreliminary Predecisional Draft Materials mtoo"a jey n , 3Wt, on Sotrepp 2

61 3WatsonSoftware.ppt 2

Presentation Organization

* Current status of software qualification

* Software issues arising recently and in the past

I Y m p Yucca Mountain ProjectPreliminary Predecisional Draft Materials Britoil I �, -�! �-- -- . -613_Watson_Software.ppt 3

Software Status Topics

* Software Qualification Applicability

- Software supporting PMRs and relatedAMRs for TSPA-SR

* Software Qualification Percentage by PMR

* Software Qualified by PMR

Unique Unqualified Software Codes

* LMVO-00-D-039 on Software Routines

Ym Yucca Mountain ProjectlPreliminary Predecisional Draft Materials 613_WatsonSoftware.ppt 4

Software Qualification Percent By PMRand Associated AMRs

* BIO

* DE

* EBS

* ISM

* NFE

90%

100%

96%

100%

99%

* SZ 89%

* UZ 98%

* WF 100%

* WP 100%

Note: The number of software packages varies asanalyses mature and are revised.

I Y M P Yucca Mountain ProjectlPreliminary Predecisional Draft Materials "p.X - B: f, ::::::::61 3WatsonSoftware.ppt 5

Software Qualified by PMRBIO PMR DE PMR

ant Completed: 90 PercentCompleted: 100%Perce

I ---- -- I

Ir

20

15

10

5-

-- --. ' ' U .-, -- --

Code Routines Macro

* Pending 0 1 0

* Completed 1 8 0

Author Input

0

0

EBS PMRPercent Completed: 96%

ISM PMRPercent Completed: 100%

m Pending

| Completed.. - -- --

... .Yu A u ig e c r m a PE A ...... e........ ... a .D M....t a .6... 3 W s o S a p p 6Y MpP Yucca Mountain ProjecttPreliminary Predecisional Draft Materials 61 3WatsonSoftwa re. ppt 6

Software Qualified by PMR (Continued)- -- - ~ ~ ~ _ _ . ...

NFEPMR SZ PMRPercent Completed: 99% Percent Completed: 89%

50

40

30

20

10

0U

40

30 _

20 - _

10

0Code Routines

| Pending 5 0

* Completed 9 33

WFPMRPercent Completed:

Macro Author InputI

0 0

0 I 0

100%UZ PMR

Percent Completed: 98%

80 -

60 -

40

20

0

IN Pending

Code Routines

3 029_ 86

20

15

10

5

Code Routines Macro Needed

Pending 0 0 0 0

* Completed 1 6 0 °

MacroAuthor Input

Needed

IN Completedl

0

12

0

0

... . . ... . .

Yucca Mountain Projectl- rlimin Predecisional Draft Materias613 Wason Sofwae~-tIY A P Yucca Mountain ProjectlPreliminary Predecisional Draft Materials 61 3WatsonSotwAare.ppt 7

Software Qualified by PMR (Continued)WP PMR

Percent Completed: 100%

20

15

10

5-

0 -

i Pending

In Completed

l

Code

02

Routines

08

Macro

0

0

Author InputNeeded

0

0

1- I . ._~~~uc Mont_ _rjclrlmnr Predecis.iona Drf Maeil 61_asn= Sfwarep 8

YY Yucca Mountain ProjecttPreliminary Predecisional Draft Materials 613_Watson Software.ppt 8

Unique Unqualified Software CodesThere are currently fourteen codes being managed inaccordance with AP-SI.1Q Revision 3, Section 5.10"Interim Use of Unqualified Software...".

IERMA SITEGEOLOGIST Version 6.0.1IFEHM 'Version 1.99

-H- .C . , ......... .. .... .. ... ...... ..... .eo 2 .1FEHM EVersion 2.10INFIL version 2.0INFIL version A2.alLAG RIT -Version 1.0NETPATH Version 2.13

"PEST Version 2.0P ETROSYS . version 7.60dSTO-UNSAT 'Version 1.OLVTOUGH2 Version 1.3TOUGH2 "Version 3.4.3TOUGHREACT Version 2.3

'UDEC 'Version 3.0.... Yuc M Projectl.rel.mina... . ..... ..... . D. ..... 6.3.t...e.. 9

Y MpP Yucca Mountain ProjecVlPreliminary Predecisional Draft Materials 613_WatsonSoftware.ppt9

Open Deficiency Report - DR-039* LVMO-00-D-039: Issued 02/15/2000

Brief Description:- Inaccurate documentation and validation of software routines and

macros

* Issue:- Some software routines documented as part of the Analysis Model

Reports (AMRs) are not adequately documented per AP-SI.1 Q.Issues include missing test information, missing source code, andlack of version control

* Solution:- Correct/Amend AMR documentation to ensure reproducibility and

defensibility of software routines. AMRs that are not revised will havetheir record packages appended to include missing information

- Issue new Software Management Procedure

- Raise Management Awareness

YAIp Yucca Mountain ProjecetPreliminary Predecisional Draft Materials 613_Watson_Soffvare.ppt 10

DR 39 Status 05/30/01 - Software routineshave been classified and placed in Bins

* A comprehensive review of 123 AMRs that support the 9 PMRs wasconducted. AMR software routine documentation classified into bins.

* Definition of Bins:- Bin 1: No single use routines/macros developed in AMR (Current Status: 31

AMRs).

- Bin 2: All software used in AMR were adequately documented in the AMR(Current Status: 31 AMRs).

- Bin 3: Commercial software (i.e. Built in-functions, math operators, or formulas)were not adequately documented inside the AMR (Current Status: 41 AMRs).

- Bin 4: Developed software (i.e. routines developed in C, FORTRAN, BASIC)including some use of commercial software were not adequately documentedin the AMR (Current Status: 20 AMRs).

* Working with authors/developers to resolve issues.Required corrections/additions are being made to AMRs or AMRRecord Packages.

* Commitment to close DR on or before 9/18/01YAIP Yucca Mountain ProjectlPreliminary Predecisional Draft Materials 613_WatsonSoftware.ppt 11

DR-039 Status 05/30/01Current BSC Status

* Total affected AMRs: 61, Bin 3: 41, Bin 4: 20 -- working withAuthor/Developer to resolve issues

- 38 Complete No issues (OQA has verified)- 23 working with Author/Developer to resolve issues- 61 Total AMRs

* Multi-Use Software Routines and Macros- Software Routine(s) Total 171 as of 6/04 Complete No issues 159- 12 Software Requirements Reviews have issues and will be resolved

as Software Deficiency Notices with DR-099- 171 Total SRRs

* Ongoing reviews for DIRS items supporting potential SRtechnical bases documents and SDDs

Y M pP Yucca Mountain ProjectlPreliminary Predecisional Draft Materials 613_WatsonSoftware.ppt 12

SOFTWARE QUALIFICATION ISSUES

* Software CAR

* Software DRs Outstanding/Pending

* Extent of Documents Affected Currently BeingAssessed

Yucca Mountain Projeot(Preliminary Predecisional Draft Materials 613_WatsonSoftware.ppt 13YM P Yucca Mountain Project/Preliminary Predecisional Draft Materials 613 WatsonSoftware.ppt 13

Software CAR Summary

* Procedural compliance difficulties as indicated byfailed installation tests documented in DR-099

* Failure to withdraw and/or Use Codes from SoftwareConfiguration Management (SCM)

* Lack of effective software process control,particularly in software development

* Lack of training, management oversight andcommunication, again, primarily in softwaredevelopment

Y M Yucca Mountain Project/Preliminary Predecisional Draft Materials 613_WatsonSoftware.ppt 14

t

OUTSTANDING/PENDING DEFICIENCYREPORTS

LVMO-00-D-099 (Open)

- Qualified software added to software baselinefailed to load during SCM installation verification

- This is a reproducibility issue in ConfigurationManagement.

* BSC-01-D-068 (Pending)- WAPDEG

- FEHM

- Version control issues

Y M>P Yucca Mountain Project/Preliminary Predecisional Draft Materials 613_WatsonSoftware.ppt 15

Actions Taken

* Assignment of Project Manager to facilitateresolution of issues

* BSC Management has requested a team ofspecialists from outside the project to assist in RootCause Analysis and recovery

* Stand-Down of software development andmodification during recovery

Extent of Condition evaluation has begun

* Root Cause Analysis team has been formed

* Root Cause Analysis began on Monday, June 4, 2001

Y MU P Yucca Mountain Project/Preliminary Predecisional Draft Materials 613_Watson_Software.ppt 16

Actions Planned

* Recommendations to be developed and evaluatedfrom Root Cause Analysis

* Actions to preclude recurrence will be developed toinsure that deficiencies noted will not recur

IY MSP Yucca Mountain ProjectPreliminary Predecisional Draft Materials 11"WI ^. El i I= AN 7y1= d 613_WatsonSoftware. ppt 17