practical usability testing of a molecular diagnostic system · “practical usability testing of a...
TRANSCRIPT
![Page 1: Practical usability testing of a molecular diagnostic system · “Practical usability testing of a molecular diagnostic system ... Exploratory Testing . ... Exploratory Testing 12](https://reader033.vdocuments.net/reader033/viewer/2022051321/5ad0253a7f8b9ad24f8d55ca/html5/thumbnails/1.jpg)
1
“Practical usability testing of a
molecular diagnostic system”
“it’s fun”
Romanian Testing Conference 2015!
May 2015
Patrick Duisters
1.0
![Page 2: Practical usability testing of a molecular diagnostic system · “Practical usability testing of a molecular diagnostic system ... Exploratory Testing . ... Exploratory Testing 12](https://reader033.vdocuments.net/reader033/viewer/2022051321/5ad0253a7f8b9ad24f8d55ca/html5/thumbnails/2.jpg)
Improve Quality Services B.V., The Netherlands 2
Patrick Duisters
● >15 years in Software Testing
& Quality Assurance
● Administrative, Technical, Medical,
Financial, Governmental, Automotive
● Test Consultant, Trainer, Auditor
● Certification & accreditation: Full CTEL
● [email protected] @PatrickDuisters www.improveqs.nl
![Page 3: Practical usability testing of a molecular diagnostic system · “Practical usability testing of a molecular diagnostic system ... Exploratory Testing . ... Exploratory Testing 12](https://reader033.vdocuments.net/reader033/viewer/2022051321/5ad0253a7f8b9ad24f8d55ca/html5/thumbnails/3.jpg)
3
Experiences & Observation
![Page 4: Practical usability testing of a molecular diagnostic system · “Practical usability testing of a molecular diagnostic system ... Exploratory Testing . ... Exploratory Testing 12](https://reader033.vdocuments.net/reader033/viewer/2022051321/5ad0253a7f8b9ad24f8d55ca/html5/thumbnails/4.jpg)
4
Agenda
● Context
● Usability & Standards
● Usability Program
● Deployment
● Results & Conclusion
![Page 5: Practical usability testing of a molecular diagnostic system · “Practical usability testing of a molecular diagnostic system ... Exploratory Testing . ... Exploratory Testing 12](https://reader033.vdocuments.net/reader033/viewer/2022051321/5ad0253a7f8b9ad24f8d55ca/html5/thumbnails/5.jpg)
5
Context: Product…
Molecular Diagnostics Platform: IVD: e.g. medical DNA analysis
● ‘Sample in – Result out’
● Reduced lead time
● Innovative & totally new
● EU & US
● Verification & Validation in a regulated environment
![Page 6: Practical usability testing of a molecular diagnostic system · “Practical usability testing of a molecular diagnostic system ... Exploratory Testing . ... Exploratory Testing 12](https://reader033.vdocuments.net/reader033/viewer/2022051321/5ad0253a7f8b9ad24f8d55ca/html5/thumbnails/6.jpg)
● Medical, EU & US
● Regulations & Regulatory bodies: i.e. FDA
● Risk management mandatory
● Norms & standards:
− ISO14971: MDs - Application of Risk Management to Medical
Devices
− ISO 62304: Medical device software - Software life cycle
processes
− ISO 62366: Medical devices – Application
of usability engineering to medical devices
6
Context: Environment…
![Page 7: Practical usability testing of a molecular diagnostic system · “Practical usability testing of a molecular diagnostic system ... Exploratory Testing . ... Exploratory Testing 12](https://reader033.vdocuments.net/reader033/viewer/2022051321/5ad0253a7f8b9ad24f8d55ca/html5/thumbnails/7.jpg)
What is Usability?
Usability: characteristic of the USER INTERFACE that establishes
EFFECTIVENESS, EFFICIENCY, EASE of USER LEARINING and
user SATISFACTION (ISO 62366:2007)
![Page 8: Practical usability testing of a molecular diagnostic system · “Practical usability testing of a molecular diagnostic system ... Exploratory Testing . ... Exploratory Testing 12](https://reader033.vdocuments.net/reader033/viewer/2022051321/5ad0253a7f8b9ad24f8d55ca/html5/thumbnails/8.jpg)
●User Friendliness
●Learnability
●Error Prevention
●Iterative Development & Testing
8
Elements of ISO 62366
![Page 9: Practical usability testing of a molecular diagnostic system · “Practical usability testing of a molecular diagnostic system ... Exploratory Testing . ... Exploratory Testing 12](https://reader033.vdocuments.net/reader033/viewer/2022051321/5ad0253a7f8b9ad24f8d55ca/html5/thumbnails/9.jpg)
Usability Program
● Reviews &
Testing
● Usability Testing
& survey
● Observations
& survey
9
Development
Verification
Validation
![Page 10: Practical usability testing of a molecular diagnostic system · “Practical usability testing of a molecular diagnostic system ... Exploratory Testing . ... Exploratory Testing 12](https://reader033.vdocuments.net/reader033/viewer/2022051321/5ad0253a7f8b9ad24f8d55ca/html5/thumbnails/10.jpg)
Deployment: Development
10
● Heuristic Analysis
● Exploratory Testing
![Page 11: Practical usability testing of a molecular diagnostic system · “Practical usability testing of a molecular diagnostic system ... Exploratory Testing . ... Exploratory Testing 12](https://reader033.vdocuments.net/reader033/viewer/2022051321/5ad0253a7f8b9ad24f8d55ca/html5/thumbnails/11.jpg)
Development: Heuristic Analysis
11
● Kick-off
● Logging template
● Analysis
● Start early / include!
http://www.nngroup.com/articles/ten-usability-heuristics/
![Page 12: Practical usability testing of a molecular diagnostic system · “Practical usability testing of a molecular diagnostic system ... Exploratory Testing . ... Exploratory Testing 12](https://reader033.vdocuments.net/reader033/viewer/2022051321/5ad0253a7f8b9ad24f8d55ca/html5/thumbnails/12.jpg)
Development: Exploratory Testing
12
● 4 sessions
● Charters
● Notes
● Video recordings
● Promissing results
![Page 13: Practical usability testing of a molecular diagnostic system · “Practical usability testing of a molecular diagnostic system ... Exploratory Testing . ... Exploratory Testing 12](https://reader033.vdocuments.net/reader033/viewer/2022051321/5ad0253a7f8b9ad24f8d55ca/html5/thumbnails/13.jpg)
Verification: Use Cases
14
● User centered
● Product Life Cycle
● Primary operating functions
● Frequently used functions
● Use cases
- Basic
- Alternatives
- Exceptions
![Page 14: Practical usability testing of a molecular diagnostic system · “Practical usability testing of a molecular diagnostic system ... Exploratory Testing . ... Exploratory Testing 12](https://reader033.vdocuments.net/reader033/viewer/2022051321/5ad0253a7f8b9ad24f8d55ca/html5/thumbnails/14.jpg)
Verification: Preparation
15
● Test environment
● Test procedures: level of detail
● Questionnaire (SUMI based)
● User selection
![Page 15: Practical usability testing of a molecular diagnostic system · “Practical usability testing of a molecular diagnostic system ... Exploratory Testing . ... Exploratory Testing 12](https://reader033.vdocuments.net/reader033/viewer/2022051321/5ad0253a7f8b9ad24f8d55ca/html5/thumbnails/15.jpg)
Verification: Execution
16
● Introduction
● “User training”
● Test procedures
● Questionnaire (SUMI based)
● Debrief
● Results
● Reporting
![Page 16: Practical usability testing of a molecular diagnostic system · “Practical usability testing of a molecular diagnostic system ... Exploratory Testing . ... Exploratory Testing 12](https://reader033.vdocuments.net/reader033/viewer/2022051321/5ad0253a7f8b9ad24f8d55ca/html5/thumbnails/16.jpg)
Deployment: Validation
17
1
![Page 17: Practical usability testing of a molecular diagnostic system · “Practical usability testing of a molecular diagnostic system ... Exploratory Testing . ... Exploratory Testing 12](https://reader033.vdocuments.net/reader033/viewer/2022051321/5ad0253a7f8b9ad24f8d55ca/html5/thumbnails/17.jpg)
● Subjective vs. Objective
● Expected results & Findings:
− Verification
− User Friendliness
− Learnability
− Error Prevention
● Standards can be helpful,
e.g. treat as heuristics
● Proof required? Practical solutions
● It’s FUN!
18
Results & Conclusion