technology appraisal of medical devices at nice – methods and practice mark sculpher professor of...
TRANSCRIPT
![Page 1: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/1.jpg)
Technology Appraisal of Medical Devices at NICE – Methods and Practice
Mark SculpherProfessor of Health EconomicsCentre for Health Economics
University of York, UK
![Page 2: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/2.jpg)
Outline
• Policy context of NICE• NICE methods• Are devices different?• The role of randomised trials• When do we have sufficient evidence?• Impact of NICE guidance
![Page 3: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/3.jpg)
Background
• Brief overview of NICE• NICE’s decisions on devices• NICE’s methods: requirement for decision making• Are devices different?• The impact of NICE guidance
![Page 4: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/4.jpg)
The National Institute for Health and Clinical Excellence (NICE)
• Following election of Labour government 1997• Prolonged controversy about ‘post code prescribing’ in
the UK National Health Service• Wish to ‘de-politicize’ decisions about which
technologies to cover in NHS• Desire to use best available methods to address difficult
questions• Focus on drugs but devices also included
![Page 5: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/5.jpg)
The NICE process
Selection Assessment Appraisal
• Specific technologies• Lacking in transparency• Subject to some criteria
• Independent group• Review plus model• Good methods supported• Assess company submissions• 6 months or more• Companies can also provide unpublished data
• Multi-disciplinary committees• Take information from range of sources• Range of decisions possible
![Page 6: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/6.jpg)
NICE decisions overall
Recommendation Number % ‘Yes’ 27 23% ‘Yes, with major restrictions’ 38 32% ‘Yes, with minor restrictions’ 30 26% ‘No, 22 19% Total 117 100%
Source: Raftery, BMJ 2006.
![Page 7: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/7.jpg)
NICE and medical devices (1)
NICE ID
DISEASE/CONDITION Health Technology
‘Yes, should be used’
‘Yes, can be used’
Yes, Major rstrcts
Yes, Minor Rstrtcts
No, due to Cost Eff.
No, due to insuff. evidence
2 Primary total hip replacement
Hip prostheses X
4 Ischaemic heart disease Coronary artery stents X 8 Hearing Hearing aid technology X 10 Asthma, under 5s Inhaler systems X
11 Arrhythmias Implantable cardioverter defibrillators X
17 Colorectal cancer Laparoscopic surgery X
18 Inguinal hernia, recurrent and bilateral
Laparoscopic surgery X
18 Inguinal hernia, primary Laparoscopic surgery X 38 Asthma, older children Inhaler devices X 44 Hip resurfacing Metal on metal X
49 Central venous catheters 2-D imaging ultrasound guidance device X
49 Central venous catheters Audio-guided Doppler ultrasound guidance device
X
Source: Raftery, BMJ 2006.
![Page 8: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/8.jpg)
NICE and medical devices (2)
NICE
ID DISEASE/CONDITION Health Technology
‘Yes,
should
be
used’
‘Yes,
can be
used’
Yes,
Major
rstrcts
Yes,
Minor
Rstrtcts
No,
due to
Cost
Eff.
No, due to
insuff.
evidence
56 Stress incontinence Tension-free vaginal tape (Gynecare TVT) X
59
Severe depressive illness, catatonia, prolonged or severe manic episode
Electroconvulsive therapy (ECT) X
59 Schizophrenia: schizophrenia
Electroconvulsive therapy (ECT) X
71 Coronary heart disease (angina or MI)
Bare-metal stent X
71 Coronary heart disease (angina or MI)
Drug eluting stent X
73 Coronary artery disease
MPS with SPECT, X
78 Heavy menstrual bleeding
Fluid filled balloon, microwave ablation X
83 Inguinal hernia repair Laparoscopic surgery X
Source: Raftery, BMJ 2006.
![Page 9: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/9.jpg)
NICE and methods
• 2004 guidance more prescriptive than most international guidelines
• Based on a clear view about the use of economic evaluation for decision making
• Included the concept of the Reference Case
National Institute for Clinical Excellence (NICE). Guide to the Methods of Technology Appraisal. London: NICE, 2004.
![Page 10: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/10.jpg)
The requirements of economic evaluation for NICE-decision making
Objective function Generic measures of health; QALYs
Decision problem Clarity about population; full specification of options
Appropriate time horizon
Evidence base
Context
Time over which options might differ
Inclusion of all relevant evidence
Relevant to specific decision maker(s)
Uncertainty Quantify decision uncertainty; feed in research prioritisation
![Page 11: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/11.jpg)
NICE’s preferred methodology – the Reference Case
Source: National Institute for Clinical Excellence (NICE). Guide to the Methods of Technology Appraisal. London: NICE, 2004.
![Page 12: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/12.jpg)
What is the appropriate framework for economic evaluation?
Evidence synthesis
Decision analysis
• Systematic review• Meta-analysis• Mixed treatment comparisons• Differing endpoints and follow-up• Patient-level and summary data
• Structure reflecting disease • Incorporation of evidence on range of parameters• Facilitates extrapolation and separation of baseline and treatment effects• Probabilistic methods
![Page 13: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/13.jpg)
Are devices different?Decision problem
• Need to include all relevant alternatives to the technology of interest– May include pharmaceuticals– May include sequences and other strategies (e.g. diagnostic)
• Need to define relevant populations and sub-populations
• May differ between jurisdictions
No clear differences between devices and pharmaceuticals
![Page 14: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/14.jpg)
Are devices different?Evidence base
• Less likely to need trials for regulatory purposes• Does not mean should not be used for reimbursement• Typical ‘regulatory’ trials have limitations for economic
evaluation• The evolution of devices over time
– Not unique to devices– Has implications for evidence gathering– Need larger longitudinal studies, sub-groups on device types– Comparators may also be changing over time
![Page 15: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/15.jpg)
Limitations of trials as a vehicle for decision making
Trial limitations
Inappropriate or partial comparisons
More than one trial
Partial measurement
Unrepresentative practice
Intermediate outcomes
Limited follow-up
No trials
NICE Examples
Temozolomide (recurrent malignant glioma)
Drugs for Alzheimer’s
Riluzole (resource use)
Glycoproteins
Beta interferon (MS)
Implantable cardioverter defibrillators
Liquid-based cytology
![Page 16: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/16.jpg)
Distinguishing types of parameters in models
Type of parameter
Baseline events risks
Relative treatment effects
Resource use/costs
Quality of life/utilities
Sources
RCT control groupsObservational
RCTs preferred
RCTs or observational
RCTs or observational
Synthesis issues
Often long-termOften by sub-group
Usually limited head- to-head data
Formal synthesis rare
Frequent need to mapFormal synthesis rare
Cost-effectiveness models invariably draw evidence from multiple sources
![Page 17: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/17.jpg)
Making trials more ‘naturalistic’The design continuum
Comparators Placebo controlled
All relevant comparators
Measurement Few efficacy and safety endpoints
Resource use, QoL
Follow-up Shortest acceptable for registration
Long-term follow-up
Patients Tightly defined
Reflective of full range of likely patients
Practice Highly protocolised
Reflective of routine practice
![Page 18: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/18.jpg)
When is there sufficient evidence to reimburse?
Decision uncertainty Implications of getting it wrong
Value of perfect information
• What is the probability of the wrong decision?• Joint effect of uncertainty in all inputs
What are the implications of a wrong decision in terms of resources and health?
=
• Sets an upper bound on the value of further research• Can be calculated overall and for individual parameters• Calculated per patient and across a population of patients
X
Sufficient evidence exists if it is not cost-effective to undertake further research
![Page 19: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/19.jpg)
Evidence on impact of NICE decision on the NHS
![Page 20: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/20.jpg)
Evidence on Orlistat for obesity
Source: Sheldon et al. BMJ 2004;329:999.
![Page 21: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/21.jpg)
Evidence on ICDs for arrhythmias
Source: Sheldon et al. BMJ 2004;329:999.
![Page 22: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/22.jpg)
What influences uptake?
Source: Sheldon et al. BMJ 2004;329:999.
![Page 23: Technology Appraisal of Medical Devices at NICE – Methods and Practice Mark Sculpher Professor of Health Economics Centre for Health Economics University](https://reader033.vdocuments.net/reader033/viewer/2022051819/5518bd7055034638098b47a4/html5/thumbnails/23.jpg)
Conclusions
• NICE part of an international trend towards greater use of economics in decision making
• NICE is prescriptive about methods• Few differences between drugs and devices which
affect appropriate methods• Impact of NICE guidance has been variable