industry day - smart dcc · industry day testing 7 june 2016 ... asset tracking dcc devices for...
TRANSCRIPT
![Page 1: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/1.jpg)
INDUSTRY DAY
Testing
7 June 2016
DCC Public
![Page 2: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/2.jpg)
AGENDA
Impact of Contingency Request on ‘Industry
Testing’ activities.
Interface Testing R1.2
End to End Testing R1.2
DCC Public 1
![Page 3: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/3.jpg)
CONTINGENCY REQUEST IMPACT
DCC Public
![Page 4: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/4.jpg)
PROPOSED DATE CHANGES
Proposed Testing Dates:
R1.2 User Entry Process Testing (UEPT): 4 July
R1.2 End-to-End Testing: 25 July
Other Dates:
DCCKI Live Certificates: 6 July
Remote Test Lab Service: TBC*
Prototype/Test CH (PTCH): TBC*
*Before R1.2 End to End Testing commences
DCC Public 3
![Page 5: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/5.jpg)
IMPACT ON TESTING PARTICIPANTS
UEPT Readiness Assessment will be based against 4 July start
date for Large Supplier Parties and other Parties that wish to
test at this point:
Data required from Systems Integrator (SI)*
Access to Test Issue management tool provided by SI
Entry Gate Meeting conducted by DCC
End to End Testing Service can be used as soon as it is
available and the Testing Participant has completed UEPT in
respect of a defined User Role:
Entry criteria must be met
Entry Gate Meeting conducted by DCC
* Test Data Plan provided to DCC for review on 6 June
DCC Public 4
![Page 6: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/6.jpg)
ADDRESSING CONCERNS
Please contact your Industry Testing Analyst to discuss impact of the
contingency request on a bilateral basis if you have any concerns.
Escalation contacts:
Industry Test Manager: Rupal Patel [email protected]
Project Director, Testing: Jane Eccles [email protected]
DCC Public 5
![Page 7: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/7.jpg)
INTERFACE TESTING
DCC Public
![Page 8: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/8.jpg)
INTERFACE TESTING SCOPE User Entry Process Testing (UEPT)
Change Of Supplier Test:
SI will co-ordinate the test between Large Supplier Parties conducting
UEPT in Interface Testing Stage
Devices used for UEPT will be transferred to another Large Supplier
and then back again
No overall loss of Devices
Will be conducted in parallel with/after UEPT
Details being finalised and will be discussed with TAG
Volume Test
SI will ask Parties conducting UEPT to send messages at same time to
DCC
Value of test will be reviewed with TDEG/TAG
DCC Public 7
![Page 9: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/9.jpg)
EARLY UIT CONNECTIVITY TESTING Parties can connect to DCC User Integration Testing (UIT)
environment:
UIT environment used for Pre-UEPT, UEPT and End to End Testing
Pre-requisites:
User Gateway Connection
SMKI Test Certificates
DCCKI Test Certificates (Parties need to complete DCCKI RAPP to
extent required to obtain Test Certificates)
Scope of Test: transmission of a message and receipt of a
response.
Successful response in Pre-UEPT guide
DCC Public 8
![Page 10: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/10.jpg)
PRE-UEPT Intended to de-risk UEPT
Service to enable Testing Participants to send 4 Service Requests
to DCC and receive valid (but standard) payload due 6 May 2016
Provision of service has been delayed due to multiple defects
Assurance activities on-going
No firm date for delivering Pre-UEPT yet available: pending
resolution of defects.
DCC Public 9
![Page 11: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/11.jpg)
RE-CAP OF UEPT
User Entry Process Testing:
Undertaken in each User Role that a Party wishes to operate within.
Reliance can be placed on Adaptor Provider Testing and on testing
undertaken in different Licensee roles
‘Adaptor Providers’ are able to test in all User Roles
Scope set out in Common Test Scenarios Document (CTSD)
DCC will provide Devices:
Aim – to conduct UEPT on actual meters used in SIT
Smart Energy Code enables UEPT to be undertaken on meter emulators
– if SEC Panel agrees that they are fit for purpose
Possible the UEPT undertaken against a mix of emulators and meters
Emulators being assured against ‘meter test harness’
DCC Public 10
![Page 12: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/12.jpg)
UEPT: PRE-TESTING ACTIVITIES
DCC Public 11
Activity TP DCC CSP SI DSP
Notification X
Initiation meeting X X
Manage slot booking X
Provision of meters X
Provision of Debug Capable PTCH
(DCPTCH)
X
Submit readiness reports X
Submit testing artefacts X
Review testing artefacts X
Provision of testing data X
Provision of Issue resolution tool X
Physical device set install X
Attend entry quality gate X
Approval to proceed certificate X
![Page 13: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/13.jpg)
UEPT: TESTING
DCC Public 12
Activity TP DCC CSP SI DSP
Conducting testing X
Commissioning of Device (Non-
supplier)
X X
Commissioning of Device (supplier) X
Manage Issue Resolution X
Triage of issues X X X X X
Remove faulty Devices and replace X
Provide storage for Devices X
Asset tracking for installed and stored
Devices
X
Maintenance of Debug Capable PTCH X
Maintenance of meters X
Environment/release management X X X X
![Page 14: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/14.jpg)
UEPT: POST TESTING ACTIVITIES
DCC Public 13
Activity TP DCC CSP SI DSP
Physical Device set removal X
Prepare Device for next Testing
Participant (TP)
X X
Submission of test evidence X
Review of test evidence X
Attend exit quality gate X
Issue test completion certificate X
Notify SEC Panel X
![Page 15: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/15.jpg)
UEPT PROCEDURAL STEPS
DCC Public
2. Conduct UEPT Initiation
Meeting and confirm DCC
Test Lab Booking
3. TP Completes
Connection forms, RAPP
Forms and produces TRR
4. DCC reviews TRR
and provides feedback
5. TP produces Test Artefacts
and DCC progresses Gateway
Connection and RAPP forms
7. UEPT Execution 8. UEPT Completion 10. UEPT Test
Completion Certificate 6. UEPT Entry Quality
Gate
9. UEPT Exit Quality
Gate
1. TP Completes
Notification form including
DCC Test Lab request
14
![Page 16: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/16.jpg)
END TO END TESTING
DCC Public
![Page 17: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/17.jpg)
Parties can use the End to End Testing Service in a specific User
Role when:
They have completed UEPT in that User Role; AND
The End to End Testing Stage has started
End to End Testing can be conducted in a DCC Test Lab or
Remote Test Lab
Parties are able to test meters of their own choice and their Back
Office Systems against the DCC UIT environment subject to
meeting the pre-requisites in the Testing Approach Document
inc:
Devices are developed against SMETS2 specification
Devices are ZigBee Sep 1.2 a) compliant
Parties need to comply with procedures for raising Testing Issues
Relevant training course undertaken to use the CSP Test Labs
END TO END TESTING
DCC Public 16
![Page 18: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/18.jpg)
DCC will provide meters that have been used successfully in SIT
for Parties to use during End to End Testing
Debug capable CH will be provided to support triage activities,
but will only be available in the DCC Test Labs
DCC will support triage and Testing Issue management activities
Change request has been raised to provide instrumented test CH
END TO END TESTING
DCC Public 17
![Page 19: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/19.jpg)
NON-SUPPLIER?
DCC Public 18
Can test using DCC Test Lab
Upon request:
Device sets will be provided by DCC
Installation of device sets will be completed by CSP
Commissioning of device sets will be completed by the Systems
Integrator and CSP
Testing Issue resolution and triage process identical to Supplier
Party testing process.
![Page 20: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/20.jpg)
END TO END TESTING: PRE TESTING
DCC Public 19
Activity TP DCC CSP SI DSP
Notification X
Initiation meeting X X
Manage slot booking X
Provision of meters X X
Ordering of Remote Test Lab (RTL) X
Ordering of PTCH for RTL X
Delivery of PTCH and RTL service X
Provision of PTCH for DCC Lab X X
Submit readiness reports X
Provision of testing data (non-supplier) X X
Provision of testing data (supplier) X X
Provision of Issue resolution tool X
Lab Induction meeting X X
Physical device set install for RTL X
Physical device set install for DCC Lab - Supplier X
Physical device set install for DCC Lab – non Supplier X
Attend entry quality gate X X
Approval to proceed certificate X
![Page 21: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/21.jpg)
END TO END TESTING: TESTING
DCC Public 20
Activity TP DCC CSP SI DSP
Conducting testing X
Commissioning of Device (Non-supplier) X X
Commissioning of Device (supplier) X
Manage issue resolution X
Triage of issues X X X X X
Remove faulty devices and replace –
DCC devices X
Remove faulty devices and replace – TP devices X
Provide storage for Devices – DCC Labs X
Asset tracking DCC Devices for installed and stored
devices – DCC Labs X
Maintenance of DCPTCH - DCC Labs X
Environment / release management X X X X
![Page 22: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/22.jpg)
END TO END TESTING: POST TESTING
DCC Public 21
Activity TP DCC CSP SI DSP
Physical device set removal - Supplier X
Physical device set removal - non Supplier X
Prepare lab and data for next TP X X
![Page 23: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/23.jpg)
END TO END TESTING PROCEDURAL STEPS
DCC Public
2. Conduct E2E Initiation
Meeting and confirm DCC
Test Lab Booking*
3. TP Completes
Connection forms*, RAPP
Forms* and produces TRR
4. DCC reviews TRR
5*. DCC progresses Gateway
Connection and RAPP forms
7. E2E Execution 8. E2E testing
Completion
6. E2E Entry Quality
Gate
1. TP Completes
Notification form including
DCC Test Lab request*
*if required; TP’s may already have completed
these as part of UEPT or EUCT/Pre-UIT
22
![Page 24: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/24.jpg)
CSP SUPPORT
1.0 DCC Public
![Page 25: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/25.jpg)
USE OF DCC TEST LABS
DCC Public 24
Pre-requisite Description Additional Information
Induction • All TPs attending the DCC Labs must
have attended an induction session in
advance
• Induction is mandatory
• Only those attending induction may
attend the Test Labs
• Induction will cover topics including: • Health, Safety and Environment
Induction
• Overview of Site and Facilities
• Test Lab and Office Tour
• Non-Disclosure Requirements
• Routine on arrival
• Contact information
• Administration
• Other relevant information
• DCC to capture attendee
details including: • Name
• Organisation
• Contact Details
• Vehicle Registration
• Event date
• Duration : 2 Hours (max)
• Dates to be published by DCC
in due course
Testing Slot • TP must have a confirmed “Test Slot”
booking with the DCC
• Booking information will be
passed to CSPs by DCC
Onsite Induction • On-site induction on the day of arrival • Site specific and Security
matters to be covered
![Page 26: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/26.jpg)
CSP SUPPORT Locations & Facilities
DCC Public 25
:
CSP Test Lab Location Facilities:
North & Scotland
(ARQIVA)
Arqiva
Crawley Court
Winchester
SO21 2QA
Lab opening Hours:
08:00 – 18:00 Mon-Fri
Facilities offered at the test labs include:
• Parking
• Coach transfer from local train
station**
• Desk allocation (not for 100%
utilisation)
• Wi-Fi Services
• Meeting Room booking facilities
• Canteen/Kitchenette
• Coffee areas
• Break out areas
• Separate Male/Female toilets
Note: may vary a little across sites or may be subject to some limitations
Central & South
(TELEFONICA)
Telefonica*
5 Reynoldston Close
(Brackmills Industrial Estate)
Northampton
NN4 7BX
Lab Opening Hours:
08:00 – 18:00 Mon-Fri
• * Second test lab will be provided at Runcorn if overflow required
• ** Arqiva only
![Page 27: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/27.jpg)
TEST LAB SERVICES1
DCC Public 26
1 subject to some volumetric limitations 4 Redacted CH logs to be provided due to security limitations 2 subject to size limitations 5 where technically possible 3 not in Telefonica test labs 6 TBC 7 At CSP discretion
Support Service Will Do Optional services7
Administration • Assistance with facilities and meeting
room bookings
• Contact support for induction and testing
slots
• Arranging Wi-Fi access
• Open to considering requests
Device Services • Physical installation of CH6 & Meters for
UEPT and non suppliers for E2E
• Physical swap out of faulty Devices
• Storage of spare devices
• Asset Tracking for PTCH & Meters
• Security of Devices
• Assistance (hands on)
• Meter upgrades & Changes (firmware &
certificates)5
Testing
Services
• Storage lockers for TP test equipment2
• Knowledge Sharing
• Assistance with service testing (within the
DCC Lab)
Remote
Cameras
• Web based camera service3
Triage Support • Assistance with diagnostics within CSP
solution4
• Zigbee HAN traffic capture
• Meter Stubs
• De-bug capable Prototype Testing CH
• Triage assistance for meters (with
assistance from meter manufacturers)
![Page 28: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/28.jpg)
REMOTE TEST LAB SERVICES1
DCC Public 27
1 subject to some volumetric limitations 2 At CSP discretion
Support Service Will Do Optional services2
Installation of
equipment at
remote site
• Carry out site survey
• Agree on suitable location for
remote test service equipment
ARQ: access node equipment
(Base Station)
TEF: Boost box
• Identify enabling work (to be
completed by the customer) before
CSP equipment can be installed
• ARQ: Supply & Install a test configuration
Base Station
• TEF: Supply necessary ‘plug and play’
Boost box(es) with installation guidance
• Supply of certified, registered
communications Hubs with on-going
• Configuration management
• Hardware and Firmware upgrades
(where required)
• Test Communication Hubs outside of the
warranty period
• Provide replacement PTCH
Testing
Services
• Practical knowledge sharing
Triage Support • Provide remote assistance to diagnose
faults with the supplied RTS equipment
• Support issue resolution/triage for test
execution in line with agreed processes
for E2E
• Confirm traffic generation of RTL lab
![Page 29: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/29.jpg)
GENERAL SUPPORT TO INDUSTRY
TESTING PARTICIPANTS
DCC Public
![Page 30: INDUSTRY DAY - Smart DCC · INDUSTRY DAY Testing 7 June 2016 ... Asset tracking DCC Devices for installed and stored ... Supply & Install a test configuration Base Station](https://reader031.vdocuments.net/reader031/viewer/2022021820/5ae78b9c7f8b9a6d4f8e3f92/html5/thumbnails/30.jpg)
Systems Integrator to manage Issue Resolution during office
hours
Testing Issues will be recorded in HP ALM or using spreadsheet
which will be held on DCC SharePoint in individual Party folder
Response times in line with guidelines agreed in Joint Test
Strategy (available on DCC website)
Regular teleconferences will be convened with Testing
Participants to discuss open Testing Issues.
Industry Test Support Analyst appointed to each Testing
Participant
INDUSTRY TESTING SUPPORT
DCC Public 29