test case items - oasis-open.org filetc-impexp-2-20 •problem –test case contains incorrect fresh...
TRANSCRIPT
Test Case Items
February, 2019
Problem
• Need to fix things in some test cases
• Need to adjust some things in the specification
QS-M-2-20
• Problem - Incorrect type
• Solution – Correct the type
-@@ -40,7 +40,7 @@
<Operation type="Enumeration" value="Create"/>
<ResultStatus type="Enumeration" value="OperationFailed"/>
<ResultReason type="Enumeration" value="GeneralFailure"/>
- <ResultMessage type="Enumeration" value="NOT_SAFE"/>
+ <ResultMessage type="TextString" value="NOT_SAFE"/>
<ResponsePayload>
</ResponsePayload>
</BatchItem>
QS-M-2-20
• Problem – Empty response payload on error
• Solution – Remove it – it should not be present
@@ -41,8 +41,6 @@
<ResultStatus type="Enumeration" value="OperationFailed"/>
<ResultReason type="Enumeration" value="GeneralFailure"/>
<ResultMessage type="TextString" value="NOT_SAFE"/>
- <ResponsePayload>
- </ResponsePayload>
</BatchItem>
</ResponseMessage>
BL-M-2-20
• Problem – Typo in Interop Identifier• Solution – Correct it – in both places
@@ -14,7 +14,7 @@
<Operation type="Enumeration" value="Interop"/>
<RequestPayload>
<InteropFunction type="Enumeration" value="Begin"/>
- <InteropIdentifier type="TextString" value="BL-M-2-10"/>
+ <InteropIdentifier type="TextString" value="BL-M-2-20"/>
</RequestPayload>
</BatchItem>
</RequestMessage>
@@ -218,7 +218,7 @@
<Operation type="Enumeration" value="Interop"/>
<RequestPayload>
<InteropFunction type="Enumeration" value="End"/>
- <InteropIdentifier type="TextString" value="BL-M-2-10"/>
+ <InteropIdentifier type="TextString" value="BL-M-2-20"/>
</RequestPayload>
</BatchItem>
</RequestMessage>
TC-LOGIN-2-20
• Problem – Error in return – missing Operation
• Solution – Correct it
@@ -297,7 +297,8 @@
<BatchCount type="Integer" value="1"/>
</ResponseHeader>
<BatchItem>
- <ResultStatus type="Enumeration" value="OperationSuccess"/>
+ <Operation type="Enumeration" value="Interop"/>
+ <ResultStatus type="Enumeration" value="Success"/>
<ResponsePayload>
</ResponsePayload>
</BatchItem>
TC-LOGIN-3-20
• Problem – Error in return – missing Operation
• Solution – Correct it
@@ -340,7 +340,8 @@
<BatchCount type="Integer" value="1"/>
</ResponseHeader>
<BatchItem>
- <ResultStatus type="Enumeration" value="OperationSuccess"/>
+ <Operation type="Enumeration" value="Interop"/>
+ <ResultStatus type="Enumeration" value="Success"/>
<ResponsePayload>
</ResponsePayload>
</BatchItem>
TC-LOGIN-2-20
• Problem – Error in return – missing Operation
• Solution – Correct it
@@ -261,6 +261,7 @@
<BatchCount type="Integer" value="1"/>
</ResponseHeader>
<BatchItem>
+ <Operation type="Enumeration" value="Query"/>
<ResultStatus type="Enumeration" value="OperationFailed"/>
<ResultReason type="Enumeration" value="InvalidTicket"/>
<ResultMessage type="TextString" value="Kmip"/>
TC-LOGIN-2-20
• Problem – Test Case / Specification Difference
• Solution – Correct Specification – matches intent(note – in three locations in this test case)
@@ -90,8 +90,10 @@
<Credential>
<CredentialType type="Enumeration" value="Ticket"/>
<CredentialValue>
+ <Ticket>
<TicketType type="Enumeration" value="Login"/>
<TicketValue type="ByteString" value="$TICKET_VALUE"/>
+ </Ticket>
</CredentialValue>
</Credential>
</Authentication>
PKCS11-M-1-20
• Problem – Test Case contains non-required item
• Solution – Correct it – correlation value is non-meaningful after C_Finalize call
@@ -111,7 +111,6 @@
<ResultStatus type="Enumeration" value="Success"/>
<ResponsePayload>
<PKCS_11Function type="Enumeration" value="C_Finalize"/>
- <CorrelationValue type="ByteString" value="$CORRELATION_VALUE"/>
<PKCS_11ReturnCode type="Enumeration" value="OK"/>
</ResponsePayload>
</BatchItem>
TC-IMPEXP-1-20
• Problem – Test Case contains incorrect Fresh
• Solution – Correct it – export does not alter Fresh and we should update the specification to make that clearer
@@ -139,7 +139,7 @@
<InitialDate type="DateTime" value="2018-12-19T19:24:26+10:00"/>
<State type="Enumeration" value="PreActive"/>
<LastChangeDate type="DateTime" value="2018-12-19T19:24:26+10:00"/>
- <Fresh type="Boolean" value="false"/>
+ <Fresh type="Boolean" value="true"/>
<Sensitive type="Boolean" value="false"/>
<AlwaysSensitive type="Boolean" value="false"/>
<Extractable type="Boolean" value="true"/>
TC-IMPEXP-2-20
• Problem – Test Case contains incorrect Fresh
• Solution – Correct it – export does not alter Fresh and we should update the specification to make that clearer
@@ -139,7 +139,7 @@
<InitialDate type="DateTime" value="2018-12-19T19:24:26+10:00"/>
<State type="Enumeration" value="PreActive"/>
<LastChangeDate type="DateTime" value="2018-12-19T19:24:26+10:00"/>
- <Fresh type="Boolean" value="false"/>
+ <Fresh type="Boolean" value="true"/>
<Sensitive type="Boolean" value="false"/>
<AlwaysSensitive type="Boolean" value="false"/>
<Extractable type="Boolean" value="true"/>
@@ -194,7 +194,7 @@
<ActivationDate type="DateTime" value="2000-02-02T00:00:00+10:00"/>
<State type="Enumeration" value="Active"/>
<LastChangeDate type="DateTime" value="2018-12-19T19:24:26+10:00"/>
- <Fresh type="Boolean" value="false"/>
+ <Fresh type="Boolean" value="true"/>
<Sensitive type="Boolean" value="false"/>
<AlwaysSensitive type="Boolean" value="false"/>
<Extractable type="Boolean" value="true"/>
TC-IMPEXP-3-20• Problem – Test Case contains incorrect Fresh• Solution – Correct it – export does not alter Fresh and we should update
the specification to make that clearer
@@ -135,7 +135,7 @@
<State type="Enumeration" value="PreActive"/>
<ProtectStopDate type="DateTime" value="2000-02-01T00:00:00+10:00"/>
<LastChangeDate type="DateTime" value="2018-12-19T19:24:26+10:00"/>
- <Fresh type="Boolean" value="false"/>
+ <Fresh type="Boolean" value="true"/>
<Sensitive type="Boolean" value="false"/>
<AlwaysSensitive type="Boolean" value="false"/>
<Extractable type="Boolean" value="true"/>
@@ -186,7 +186,7 @@
<State type="Enumeration" value="PreActive"/>
<ProtectStopDate type="DateTime" value="2000-02-01T00:00:00+10:00"/>
<LastChangeDate type="DateTime" value="2018-12-19T19:24:26+10:00"/>
- <Fresh type="Boolean" value="false"/>
+ <Fresh type="Boolean" value="true"/>
<Sensitive type="Boolean" value="false"/>
<AlwaysSensitive type="Boolean" value="false"/>
<Extractable type="Boolean" value="true"/>
@@ -272,7 +272,7 @@
<State type="Enumeration" value="PreActive"/>
<ProtectStopDate type="DateTime" value="2000-02-01T00:00:00+10:00"/>
<LastChangeDate type="DateTime" value="2018-12-19T19:24:26+10:00"/>
- <Fresh type="Boolean" value="false"/>
+ <Fresh type="Boolean" value="true"/>
<Sensitive type="Boolean" value="false"/>
<AlwaysSensitive type="Boolean" value="false"/>
<Extractable type="Boolean" value="true"/>
TC-IMPEXP-4-20• Problem – Test Case contains incorrect Fresh• Solution – Correct it – export does not alter Fresh and we should update
the specification to make that clearer
@@ -151,7 +151,7 @@
<InitialDate type="DateTime" value="2018-12-19T19:24:26+10:00"/>
<State type="Enumeration" value="PreActive"/>
<LastChangeDate type="DateTime" value="2018-12-19T19:24:26+10:00"/>
- <Fresh type="Boolean" value="false"/>
+ <Fresh type="Boolean" value="true"/>
<Sensitive type="Boolean" value="false"/>
<AlwaysSensitive type="Boolean" value="false"/>
<Extractable type="Boolean" value="true"/>
@@ -256,7 +256,7 @@
<InitialDate type="DateTime" value="2018-12-19T19:24:26+10:00"/>
<State type="Enumeration" value="PreActive"/>
<LastChangeDate type="DateTime" value="2018-12-19T19:24:26+10:00"/>
- <Fresh type="Boolean" value="false"/>
+ <Fresh type="Boolean" value="true"/>
<Sensitive type="Boolean" value="false"/>
<AlwaysSensitive type="Boolean" value="false"/>
<Extractable type="Boolean" value="true"/>
@@ -360,7 +360,7 @@
<InitialDate type="DateTime" value="2018-12-19T19:24:26+10:00"/>
<State type="Enumeration" value="PreActive"/>
<LastChangeDate type="DateTime" value="2018-12-19T19:24:26+10:00"/>
- <Fresh type="Boolean" value="false"/>
+ <Fresh type="Boolean" value="true"/>
<Sensitive type="Boolean" value="false"/>
<AlwaysSensitive type="Boolean" value="false"/>
<Extractable type="Boolean" value="true"/>
TC-IMPEXP-5-20
• Problem – Test Case contains incorrect Fresh
• Solution – Correct it – export does not alter Fresh and we should update the specification to make that clearer
@@ -144,7 +144,7 @@
<InitialDate type="DateTime" value="2018-12-19T19:24:27+10:00"/>
<State type="Enumeration" value="PreActive"/>
<LastChangeDate type="DateTime" value="2018-12-19T19:24:27+10:00"/>
- <Fresh type="Boolean" value="false"/>
+ <Fresh type="Boolean" value="true"/>
<Sensitive type="Boolean" value="false"/>
<AlwaysSensitive type="Boolean" value="false"/>
<Extractable type="Boolean" value="true"/>
@@ -218,7 +218,7 @@
<InitialDate type="DateTime" value="2018-12-19T19:24:27+10:00"/>
<State type="Enumeration" value="PreActive"/>
<LastChangeDate type="DateTime" value="2018-12-19T19:24:27+10:00"/>
- <Fresh type="Boolean" value="false"/>
+ <Fresh type="Boolean" value="true"/>
<Sensitive type="Boolean" value="false"/>
<AlwaysSensitive type="Boolean" value="false"/>
<Extractable type="Boolean" value="true"/>
MSGENC-HTTPS-M-1-20
• Problem – Test Case has ClientCorrelationValuein wrong location
• Solution – Correct it @@ -51,8 +51,8 @@
<ProtocolVersionMajor type="Integer" value="2"/>
<ProtocolVersionMinor type="Integer" value="0"/>
</ProtocolVersion>
- <ClientCorrelationValue type="TextString" value="MSGENC-HTTPS-M-1-20 step=1"/>
<MaximumResponseSize type="Integer" value="2048"/>
+ <ClientCorrelationValue type="TextString" value="MSGENC-HTTPS-M-1-20 step=1"/>
<BatchCount type="Integer" value="1"/>
</RequestHeader>
<BatchItem>
MSGENC-JSON-M-1-20
• Problem – Test Case has ClientCorrelationValuein wrong location
• Solution – Correct it @@ -51,8 +51,8 @@
<ProtocolVersionMajor type="Integer" value="2"/>
<ProtocolVersionMinor type="Integer" value="0"/>
</ProtocolVersion>
- <ClientCorrelationValue type="TextString" value="MSGENC-HTTPS-M-1-20 step=1"/>
<MaximumResponseSize type="Integer" value="2048"/>
+ <ClientCorrelationValue type="TextString" value="MSGENC-HTTPS-M-1-20 step=1"/>
<BatchCount type="Integer" value="1"/>
</RequestHeader>
<BatchItem>
MSGENC-XML-M-1-20
• Problem – Test Case has ClientCorrelationValuein wrong location
• Solution – Correct it @@ -51,8 +51,8 @@
<ProtocolVersionMajor type="Integer" value="2"/>
<ProtocolVersionMinor type="Integer" value="0"/>
</ProtocolVersion>
- <ClientCorrelationValue type="TextString" value="MSGENC-HTTPS-M-1-20 step=1"/>
<MaximumResponseSize type="Integer" value="2048"/>
+ <ClientCorrelationValue type="TextString" value="MSGENC-HTTPS-M-1-20 step=1"/>
<BatchCount type="Integer" value="1"/>
</RequestHeader>
<BatchItem>
XML and JSON
• Problem – time values without time zone
• Solution – note it during testing – not permitted as the other party does not know the time zone settings and cannot adjust
2019-02-26T06:09:36+00:00
2019-02-26T06:09:36Z
2019-02-26T06:00:36+09:00
2019-02-26T06:09:36
Interop Operation
• Problem – only a subset of 2.0 tests used it
• Solution – require it for all tests for interop
• BL-M-{1..13}-20
• TC-LOGIN-{1..3}-20
• TC-DLOGIN-{1..3}-20
• TC-IMPEXP-{1..5}-20
• TC-SETATTR-{1..3}-20
i.e. 27 out of the 188 defined test cases
Conclusion
• Simple updates from latest interop
• General consensus that testing went well
• Were things were handled differently for specific test cases – either interpretation was accepted during interop