06-0467_comparison nasa esa 2006

8/3/2019 06-0467_Comparison NASA ESA 2006

1/16

/ NationalAeronautics and SpaceAdministration Znd International Workshop on.k t Propulsion Laboratory Verification and Testing of Space Systems

Session 113Verification and Testing Standards

fiTitle 6 .""6Comparison of JPL and European Environmental y k%!:piTesting Standards ,.&i~.gG5,L?%-

Kin F. Man, John C. Forgrave, and Alan R. - l o f h a n

Speaker: Kin F. M an (kinernan@r/lp 1 . n a s a . g ~ )Jct Propulsion Laboratory, California Institute o f Technolo

4800 O ak Grove Drive, Pasadena, California 91 109, USA


2/16

National Aeronautics andSpaceAdministration Pd nternational Workshop onk t Propulsion Laboratory Verification and Testing of Space Systems

AgendaJPL Environmental Testing DocumentsEuropean Environmental Testing DocumentComparison of JPL and European Environmental TestingStandards- Test Policy- Documentation- Programmatics- Functional Testing- Reporting- Test Levels, Durations, and Margins (Dynamics, Thermal, EMC)

Summary and Conclusions


3/16

NationalAeronautics and Space Znd International Wurltshop on

JPL Environmental Testing Documents1. Flight Project Practices Rev. 5- Captures the approaches and methods for a standardized execution of flight

projects.2. Design Principles, Rev. 2- Captures the institutional standards for designing, verifying, and operating

flight systems.3. Spacecraft System Dynamic and Static Testing, Rev. 0- Specifies the standards and parameters for spacecraft-level dynamic and static

testing.4. Spacecraft System Thermal Testing, Rev. I- Specifies the standards and parameters for spacecraft-level thermal testing.5. Assembly and Subsystem Level Environmental Verification, Rev. 0- Specifies the standards and parameters for assembly and subsystem level

environmental testing and verification.Speaker:K n F. Man Torino 20/21/22 March 2086 3


4/16

Nat~onaleronautics and Space Znd InternationalWorkshop onVerification andTesting of Space Systems

European Environmental Testing DocumentCEN TC Space Engineering - Testing (EN

I I requirements for a space systemE N C

Secretariat:

and its constituents.

- Specifies the standardenvironmental and performance testPpace engineering- esting

Elenlent7 aupt-Element16rncnt iritroductf- EI4rnerzt centralICS:Descriptors:

- Document reviewed and approvedby ECSS (European Cooperation forI Space Standardization), which is acooperative effort of the EuropeanSpace Agency, National Space

Document type: European StandardDocument subtype:Document stage: Unique Acceptance ProcedureDocument language: E

EN 14824:2003 (E)

Agencies, and European industryassociations for the purpose ofdeveloping and maintainingcommon standards.

Speaker:Kin F. Man Torino 20/21/22 March 2006


5/16

NationalAeronaut~cs nd Space Znd InternationalWorkshop on

Focus of the ComparisonCompare environmental testing standards in these 2 documents:I. Assembly and Subsystem Level Environmental Verification, Rev. 02. Space Engineering - Testing (EN 14824:2003)

Compare environmental testing for flight hardware- Functional testing is also addressedCompare assembly (or equipment) level testing- Environmental testing of spacecraft tends to be more mission specificCompare Qual and FA- Protoflight is a subset of QuallFA (in general Qual levels and FA

durations)Highlight significant similarities and differences between JPL andEuropean standards

Speaker: Kin P. Man Torin0 20/21/22 March 2006 5


6/16

/ National Aeranautics and SpaceAdminislrat~on Pd nternationalWorkshop onVerification and Testing of Space SystemsTest Policy

Speaker: Kin F. Man Torino 28/21/22 March 2006 6

Paragraph#

44

4.1

Assembly and Subsystem LevelEnvironmental Verification (JPI,)Testing in lieu of analysis shall be used.....Environmental verificationrequirements shall be approved beforeenvironmental verification isperformed . .--ppropriate margin shall be appliedduring environmental testing.

Paragraph#

4.1.1 g4.11.1

4.8.1.la

Space Engineering - Testing (European)

Testing is the preferred verificationmethod ....Test standard documentation shallconsist of the test specification, testprocedure; and test report ..... o begenerated as part of the verificationdocumentation.Margins to both test levels and durationshould be applied to the environmentaltests.


7/16

National Aeronautics and SpaceAdministration Infernational Workshop on-,JetP'ropuisisnLaboratory Verification and Testing o f Space SystemsCalifornia instituteof Tectinelogy

Documentation

Speaker: Kin F. Man Torino 28/21/22 March 2006

Paragraph#

4.2

4.2

4.4.4

Assembly and Subsystem LevelEnvironmental Verification (JPL)

The Environmental Program for aproject shall be documented in project-approved and released documents.

The Environmental Programdocumentation shall specify theenvironmental Test and AnalysisMatrix (TAM) . .that apply to eachassembly.Environmental tests of flight hardwareshall be performed in accordance withapproved environmental test plans andprocedures.

Paragraph#

4.1.2a

4.1.2b

4.11.2.2

............... ....... ..4.11.3

xSpace Engineering - Testing (European)All equipment product specificationsshall indicate their intendedverification method . ..for each statedrequirement.. ..A dedicated test matrix shall beprepared defining the detailed types oftests to be implemented.

The test specification shall be preparedfor each major test activity described inthe test plan . ....................................................... ................................................ .........................................The test procedure shall be written inconformance with the test specification.-


8/16

NationalAeronautics and SpaceAdministration Znd Intcrnafional Worlcshop onVerification and Testing of Space Systems

Programmatics (1)Paragraph Assembly and Subsystem Level Space Engineering - Testing (European)

Environmental Verification (JPL)Assembly design and performance shallbe verified by test using the followingverification programs:a) Protoflight; orb) Qualification/Flight Acceptance (FA)

The test baseline definition shall bebased on the project model philosophy:a) Prototype approachb) Protoflight approachC) Hybrid approach

The Qua1 test for an assembly designshall be completed before FA tests.It is preferable to perform EMC testingprior to dynamics or thermal testing.

4.1.5

It is preferable to perform dynamicstesting before thermal testing.

Qualification testing should becompleted . ..prior to the initiation ofthe flight item manufacturing.pp - --The determination of test sequences

should be based on two mainconsiderations:

1. preserve the order in whichenvironments are encounteredduring the operational life; and

I I I 1 2. detect potential failures anddefects as early in the test sequenceas possible.

Speaker: Kin F. Man Torino 20/21/%2March 2006


9/16

NationalAeronautics and Space International Workshop on

Programmatics ( 2 )Paragraph Assembly and Subsystem Level

# Environmental Verification (JPL)- -4.4.3 Test articles shall be tested in flightconfiguration, including electricalcabling, connectors, and other flightfittings associated with the test article.

4.4.4 All tests shall be performed in anapproved test facility using properlycalibrated instrumentation and trainedtest personnel .....

Paragraph Space Engineering - Testing (European)#

4.4.6 The complete flight element (i.e. flightvehicle) should be used duringenvironmental testing .....

4.1.2 d3 The test plan shall specify the testfacilities........................................................................................

4.8.2.2a The accuracy of instruments used tocontrol or monitor the test parametersshall be verified periodically .....

.......................................................................................4.8.2.2b The accuracy of the instruments shallbe consistent with the tolerance for thevariable to be measured ............................................................................................4.8.2.2~ All instrumentation to be used fortesting shall be subjected to approvedcalibration procedures and shall bewithin the normal calibration period a tthe time of the test.

!I122March 2006


10/16

NationalAeronautics and Space International Workshop on

ParagraphProgran

Assembly and Subsystem LevelEnvironm ental Verification (JPL)When a failure or malfunction occursduring environmental testing, a P/FR(ProbledFailure Report) shall begenerated . .Environmental retests are performed:1)To complete the testing of h/w that

has failed during environmental test.2) To re-qualify flight hardware designwhere design changes, modifications,or configuration changes occur aftercompletion of initial qua1 testing.

3) To verify the flight worthiness ofrefurbished units as flight spares.

4) To verify the flight acceptability ofworkmanship performed as part ofthe rework not covered by (I), (2),or(3) above.

- - -The failure or anomalies occurredduring the testing activities, shall berecorded on a non-conformance report(NCR) . .

Paragraph#

There are five situations, which canresult in a retest:

1)Failure or anomaly duringqualification, acceptance orprotofligh testing

2) Implementation of a designmodification after completion ofqualification testing

3) Long duration storage of flighthardware after acceptance testing

4) Hardware to be re-flown5) Plight use of qualification hardware

Space Engineering - Testing (European)

Speaker: Kin F. M an Tsrino 20121122 March 2006


11/16

4 Nat~onal eronautrcs and SpaceAdm~ntstration Znd International Workshop onVerification and Testing of Space Systems

Functional TestingL rnParagraph Assembly and Subsystem Level Spac e Engineering - Test ing (Europ ean)

Env ironm ental Verif icat ion (JPL) IThe test procedure shall be written inconformance with the test specificationand specify the Step-by-stepinstructions for operation.

Required functional testing shall bedefined in a functional test procedure.

Functional testing shall be performedbefore, during, and after eachenvironmental test . .

4.11.3e

Functional and performance tests shallbe performed prior and followingenvironmental tests,

..........................................................................Equipment functional tests shall beperformed while the environment isbeing imposed, if the equipment isexpected to be (fully) operationalunder that environment.The qualification test levels shall

functional tolerances and identifiable exceed the maximum predicted levelslimits without any adjustments that are by a factor of safety which assuresnot possible during flight. that, even with the worst combination

of test tolerances, the flight levels shallSpeaker: Kin F. M a n T o r i n o 20/21/22March 2006 I I


12/16

NationalAeronauticsandSpaceAdministration Znd International Workshop onJet Propulsion Laboratory Verification and Testing of Space SystemsCalifornia institute sf Technology

Reporting

ETAS =Environmental Test Authorizat ion & S u m m a r y

Speaker: K in P, Man Tor ino 20/21/22 March 2006 12

Paragraph#

4.4.11Assembly a nd Subsy stem LevelEnv ironm ental Verif ication (JPI,)

Upon completion of each environmentaltest, the test reporting section of theETAS is updated . . This isirrespective of whether or not the testhas been satisfactorily completed.

Paragraph#

4.10a

..4.11.la3

Space Engineering - Test ing (Eu ropean)For an evaluation of the productperformance under the variousspecified test conditions, testmeasurements and the environmentalconditions on the products shall berecorded.".........................."......................................................=.....Test standard documentation shall

consist of the test report.


13/16

1 NationalAeronautics and Space Znd International Workshop on

Dynamics Test Levels, Durations, & Margins

MEFL = Maximum Expected Flight Level--- - Test not required

Dynamics TestAcoustics:

LevelDuration

Random Vibration:LevelDuration

Sine Vibration:LevelDuration

Pyro Shock:LevelDuration

Speaker: Kin F. Man 'Ie'oril~o0/21/22 March 2006 13

kL!li"%P ,Qualification (Qual)

MEFL + 3 dB2 min

MEFL + 3 dB2 minlaxisMission-specific

MEFL + 3 dB2 shocks/axis

European (EN 14824:2003);ccyptanceFAMEFL1 minMEFL

I inlaxis---

---

Qualification (Qual)

MEFL + 4 dB2 min

Flight Acceptance(FA)MEFL2 min

MEFL + 4 dB3.5 minlaxisMLFA .a 4 dR3 ~~stavelrm~r~

1 sweep up & d8wr1(5 1QOk4.z)MEFL + 6 dB3 shockslaxis

MEFL2 minlaxis---

ME[ L1 shocklaxis


14/16

National Aeronautics and Spaceadministration Pd nternational Workshop onVerification and Testing of Space Systems

Thermal Test Levels,Durations, & Margins

AFT = Allowable Flight Temperature

ThermalTestTemperature:Margin

LevelThermal Cycles:Operational Dwell:

ElectronicsNon-electronicsNon-Op. Dwell:(Electronics andnon-electronics)Temp Ramp Rate(dTIdt):

Torino 20121122March 2006 14

JPRQualification (Qual)The more severe of:

AFT -15 C to AFT+20 Cor

-35 to +75 C (Electronics)2-10 (max)

European (EN 14824:2003)Flight Acceptance (FA)

The more severe of:AFT-5Ct0AFT+5C

or-25 to +55 C (Electronics)

2-10 (max)

24 hr cold/ 144 hr hot24 hr cold124 hr hot8 hr cold18 hr hot

< 5 Clmin

Qualification (Qual)

MinPredicted-jOCMax Predicted+I0 C,

Hardware dependent8

Flight Acceptance(FA)Max Predicted +5 C,Min Predicted -5 CHardware dependent

4

8 hr cold1 60 hr hot24 hr cold124 hr hot8 hr cold18 hr hot

- 5 Clmin

16 hr cold116, hr hot(2 hr /cycle)

2 hr cold19 hr hot( Icycle only)< 20 Clmin

8 hr cold I 8 hr hot(2 hr /cycle)

2 hr cold1 2 hr hot( Icycle only)< 20 Clmin


15/16

NationalAeronautics and SpaceAdministration InternationalWorkshop onVerification and Testing of Space Systems

EMC Test Levels, Durations, & Margins

MEFL = Maximum Expected Flight LevelMinEFL = Minimum Expected Flight Level

EMC TestSusceptibility:(Radiated and

Conducted)Emission:(Radiated andConducted)Durations:

Speaker:Kin F. Man Torino 20121122 March 2006

JPL.Qualification (Qual)

MEFL 1- 6 dB

MinEFL - 6 dBOperate sufficiently to

exercise all operationalmodes

European (EN 14824:2003)Flight Acceptance(FA)--..

(grounding/isolation)---

(groundinglisolation)Operate sufficiently toexercise all operational

modes -

Qualification (Qual)+ 6 dB

- 6 dBDepending onoperating modes

Flight Acceptance(FA)---

---

Depending onoperating modes


16/16

National Aeronautics and SpaceI Adrnrnistrat~on Znd InternationalWorkshop onVerification and Testing of Space SystemsI Summary and Conclusions

Compared the JPL and European Environmental testingstandardsSimilarities in all categoriesMain Differences:- Dynamic test levels, durations, and margins (European higher)- Sine test (required for European, mission-specific for JPL)- Thermal test margins, cycles, and durations (JPL requires more

dwell time and fewer cycles)Would be advantageous to develop a US-EuropeanEnvironmental Testing Standard for Space Systems

And eventually develop an environmental standard involvingother space organizations (Japan, China, Russia, & others)

Speaker: IGa F. Man Torino 20121122 March 2006