Download - WORKPLACE- BASED ASSESSMENT
![Page 1: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/1.jpg)
www.londondeanery.ac.uk
Faculty Development
WORKPLACE- BASED ASSESSMENT
![Page 2: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/2.jpg)
COURSE OBJECTIVES
By the end of the course participants will have:
• Described the educational principles that underpin workplace-based assessment (WPBA)
• Discussed key issues in the implementation of WPBA
• Compared types of assessment in common use
• Considered the use of WPBAs to develop proficiency in trainee practice
• Explored ways to use WPBAs as developmental opportunities and to aid reflection
![Page 3: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/3.jpg)
WORKPLACE-BASED ASSESSMENTS
• Experiences – Of using WPBAs
• Challenges – What are the limitations and challenges of the current system of WPBA?
• Constraints – What prevents learners and trainers from maximising effectiveness?
• Opportunities – What educational opportunities arise from their use?
![Page 4: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/4.jpg)
TRAINEE-REPORTED CHALLENGES
• Lack of clear role/responsibility
• Knowing what is expected of them
• Competing demands on time
• Limited opportunity to be observed or to receive feedback
• Unclear about immediate relevance of WPBAs
![Page 5: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/5.jpg)
LEARNING IN POSTGRADUATE TRAINING
Traditional approaches:
• Immersion
• Professional knowledge – cases,
reasoning
• Professional skills – history/exam
• Technical skills – procedures
• Professional socialisation – attitudes and
behaviours
• Continuing professional development
WPBAs tools:
• Case-based discussion (CBD)
• Mini clinical evaluation (CEX)
• Directly observed procedural skills (DOPs)
• Multi-source feedback (MSF)
![Page 6: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/6.jpg)
WHY DO WE ASSESS?
• Patient safety and standards of care
• To ensure we are training correctly
• To develop trainees
![Page 7: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/7.jpg)
WHAT IS ASSESSMENT?
• ‘A systematic procedure for measuring a trainee’s progress or level of achievement
against defined criteria to make a judgement about a trainee’ (GMC 2010)
• A check of the learning that has taken place
• ‘About getting to know our students and the quality of their learning’ (Rowntree 1977)
![Page 8: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/8.jpg)
TYPES OF ASSESSMENT
• Formative – Aids learning through constructive feedback
• Summative – Determines levels of competence for progression
• Appraisal – Formal review of progress
![Page 9: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/9.jpg)
AUTHENTICITY OF CLINICAL ASSESSMENT – MILLER’S PYRAMID
Miller (1990)
Knows
Shows how
Knows how
Does
Pro
fess
ion
al a
uth
enti
city
Pro
fess
ion
al a
uth
enti
city
Behaviour
Cognition
![Page 10: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/10.jpg)
Actual performance assessment (WPBA)
MILLER’S PYRAMID – 1990
Knows
Shows how
Knows how
Does
Procedural competence assessment (OSCE), simulation
(Clinical) context-based tests, MCQ, essays
Factual tests, MCQ, essays
![Page 11: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/11.jpg)
WHAT DO WE ASSESS?
Clinical knowledge and skills
Practical skills
Interpersonal skills and judgement
Professional behaviours
Case-based discussion (CBD)
Direct observation of procedures (DOPs)
Direct observations of non-clinical skills
(DONCS)
360º appraisal (360)
![Page 12: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/12.jpg)
WHAT DO YOU WANT FROM ASSESSMENT?
• Clear purpose
• Fair
• Clearly related to the learning that has taken place
• Tests what should be assessed rather than what is easy to assess
• Helps to improve performance if formative, or reliably sorts out the pass from the
fail if summative
• Multi-faceted
• Reliable
![Page 13: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/13.jpg)
WORKPLACE-BASED ASSESSMENT
• Assessment for learning (formative)
• Assessment of learning (summative)
• Learning is at its most powerful when it is authentic (workplace)
• Valid but not always reliable assessor (subjective versus objective)
• Reliability when part of many
• Learning by doing, reviewing, reflection
![Page 14: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/14.jpg)
FORMATIVE AND SUMMATIVE
ARCP
Reports from Educational supervisors
CEX, DOPs, PBAs, OSATs,CBDs, PATs, TABs, MSFs
![Page 15: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/15.jpg)
6
5
4
3
2
1
ARCP
FORMATIVE AND SUMMATIVE
EarlyWPBAs
MidWPBAs
LateWPBAs
![Page 16: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/16.jpg)
TRAINEES SHOULD BE ‘SAFER’
• Spread assessments through job
• As many assessors as possible
• Feedback as well as scores
• Evidence it all (follow-up actions)
• Reflect on what they do
![Page 17: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/17.jpg)
WORKPLACE-BASED ASSESSMENT
COMPETENCE
CO
NS
CIO
US
NE
SS
Conscious competence
(C/C)Conscious incompetence
(C/IC)
Unconscious incompetence
(UC/IC)
Unconscious competence
(UC/C)
![Page 18: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/18.jpg)
WORKPLACE-BASED ASSESSMENT
COMPETENCE
CO
NS
CIO
US
NE
SS C/CC/IC
UC/IC UC/C
1. What do you think you did well?
2. I think you did well at…4. I think you could improve…
3. What could you improve?
![Page 19: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/19.jpg)
FEEDBACK
‘Giving feedback is not just to provide a judgement or evaluation. It is to provide
[develop] insight. Without insight into their own limitations, trainees cannot process
or resolve difficulties’
(King 1999)
![Page 20: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/20.jpg)
FEEDBACK
• Allows an individual to identify what they have done/are able to do effectively
• Gives suggestions about alternative approaches to a task to improve effectiveness
• Allows the learner to identify ongoing learning needs
• Both challenges and supports the subject
![Page 21: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/21.jpg)
FEEDBACK DOS AND DON’TS
Do Don’t
Do it close to the observation Avoid inappropriate place/time
Describe the specific behaviour Judge the person
Only comment on what you see Generalise
Give examples of what was good and why Break confidentiality
When identifying areas for improvement suggest alternatives
Be vague
Give follow-up actions for development Avoid specifics
![Page 22: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/22.jpg)
GIVING FEEDBACK – REFLECTION
• How do you think it went? (insight check)
• What went well?
• Examples of the good
• What could be improved/how?
• ‘I noticed…’
• ‘If you were doing it again…’ (ask/suggest)
Describe gap between current and desired performance
Agree a plan and how to get there
![Page 23: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/23.jpg)
WORKPLACE-BASED ASSESSMENT
WBA Competencies Examples of Assessors Setting
Mini-CEXCommunication with patient,
physical examination, diagnosis, treatment plan
Educational/ Clinical Supervisors, senior trainee
Clinic, A&E, ward, community
CBDClinical judgement, clinical
management, reflective practice
Educational/ Clinical Supervisors, senior trainee
Multiple areas covered by a challenging case
DOPsTechnical skills, procedures
and protocols.
Educational/ Clinical Supervisors, senior trainee
multi professional team (MPT) Clinic, A&E, ward,
theatre
Mini-PATMSFTAB
Team-working, professional behaviour
Trainee’s MPTMultiple areas covered
by MPT
PBA/OSATTechnical skills, procedures and protocols, theatre team-working
Consultant or ST5 + traineeClinic, A&E, ward,
theatre
![Page 24: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/24.jpg)
CLINICAL SKILLS
• What kinds of clinical skills do trainees need to develop?
• Where do they have a chance to do this?
• When in your working week can you offer the opportunity to develop trainees’
clinical skills?
• How can this be recorded and used to develop trainees?
![Page 25: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/25.jpg)
MINI-CEX
![Page 26: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/26.jpg)
MINI-CEX – ALL IN A DAY’S WORK
• History taking
• Physical examination
• Communication
• Clinical judgement
• Professionalism
• Organisation and efficiency
• Overall clinical care
The bulleted areas are to be rated as one of the following:
1 – below expectations
2 – below expectations
3 – borderline
4 – meets expectations
5 – above expectations
6 – above expectations
![Page 27: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/27.jpg)
MULTI-SOURCE FEEDBACK
• Trainee-centred:
‘How do you think you are settling in?’
‘What sort of feedback do you think you have had?’
‘What do you think about what I have said?’
• Balanced:
Strengths from MSF/last post before concerns
Provides possible explanation for poor comments
Personally values confidence
• Seeks specifics:
‘Why do you feel we don’t value confidence?’
Asks for reasons for the comments
‘Can you think of a situation where a clinical decision you made…’
![Page 28: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/28.jpg)
MULTI-SOURCE FEEDBACK
• Clarifies difficult areas:
‘Do you think some people may not feel valued as part of the team?’
‘I think it’s an important thing for you to do’ (ask others)
• Action plan:
Reflective case-based discussion next week
Action plan
• Perspective/Honesty:
Re the issues
Re the possible outcome
![Page 29: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/29.jpg)
PRACTICAL
In pairs:
• One assumes role of supervisor
• One assumes role of trainee
• Using the data for Dr M and Dr K, feed back the results of the MSF to one another
• Two sessions of 10 minutes each
![Page 30: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/30.jpg)
CASE-BASED DISCUSSION
• What benefits are offered by case-based discussion (CBD)?
• Where can CBDs take place?
• When can they happen?
• Who can be involved?
![Page 31: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/31.jpg)
CASE-BASED DISCUSSION
![Page 32: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/32.jpg)
CASE-BASED DISCUSSION – TYPES
• Short case/long case/viva
• Knowledge-based
• Management of patient
• Multi-disciplinary team
• Decision making
• Ethical
• Reflection
• Developmental change
![Page 33: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/33.jpg)
CASE-BASED DISCUSSION – AREAS
• Medical record keeping
• Clinical assessment
• Investigation and referrals
• Treatment
• Follow-up and future planning
• Professionalism
• Overall clinical care
![Page 34: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/34.jpg)
CASE-BASED DISCUSSION – SUMMARY
• Summative and formative components
• Based on what has happened not what would happen
• Explores reasoning
• Questioning to ‘dig deep’
• Promotes learning and new insights if used well
• Just ticks the boxes if done badly
![Page 35: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/35.jpg)
TAKING IT BACK TO PRACTICE
• What have you learned today about WPBAs – key messages?
• Where, when and how will you be involved in WPBAs?
• In what ways could you plan more effective ‘supervised learning experiences’ for trainees
with identified learning needs?
• How will you encourage documentation of learning?
![Page 36: WORKPLACE- BASED ASSESSMENT](https://reader036.vdocuments.net/reader036/viewer/2022081415/568159a6550346895dc705e5/html5/thumbnails/36.jpg)
RECORDING LEARNING
• Reflective writing
• Log book
• Portfolio
• Evidence of: teaching, presentations, observation notes, peer discussions, journal clubs,
e-learning, multi-disciplinary teams, leadership, etc.