mass project evaluation annie paton [email protected]
TRANSCRIPT
![Page 2: MASS Project Evaluation Annie Paton anne@indigops.com](https://reader035.vdocuments.net/reader035/viewer/2022072011/56649ddf5503460f94ad95f9/html5/thumbnails/2.jpg)
Agenda Indigo Background Overall Evaluation Format Internal Evaluation Topics Evaluation Focus & Objectives Baseline & Monitoring Information
![Page 3: MASS Project Evaluation Annie Paton anne@indigops.com](https://reader035.vdocuments.net/reader035/viewer/2022072011/56649ddf5503460f94ad95f9/html5/thumbnails/3.jpg)
Indigo Background MASS application development & evaluation Local authorities, colleges, charities European Funding
ESF, ERDF, Interreg, LLP High success rate Project Management, Monitoring & Evaluation
Other Services Varied experience Evaluation
£16.5 million projects ESF, ERDF, LLP, Lottery & government funding Transnational (A1 for Jobs, Leonardo) Target group (ESF – LTP – Disengaged school children)
![Page 4: MASS Project Evaluation Annie Paton anne@indigops.com](https://reader035.vdocuments.net/reader035/viewer/2022072011/56649ddf5503460f94ad95f9/html5/thumbnails/4.jpg)
Format Interim Report
August 2010 Report on progress Adhering to timescales & milestones Any barriers to success
Final Report September 2011 Draw conclusions on design, implementation &
success Inform stakeholders of results & impact Stimulate support for mainstreaming Identify further innovation
![Page 5: MASS Project Evaluation Annie Paton anne@indigops.com](https://reader035.vdocuments.net/reader035/viewer/2022072011/56649ddf5503460f94ad95f9/html5/thumbnails/5.jpg)
Internal/Self Evaluation Simona (RO) Self evaluation feeds into external Communication
Effectiveness, frequency, methods, barriers Twice, middle & end (online survey)/ observation
Partnership Meetings Effectiveness, structure, content, cultural aspects Learn & adapt Short post meeting questionnaire
Team working Involvement, motivation & commitment Partner level
![Page 6: MASS Project Evaluation Annie Paton anne@indigops.com](https://reader035.vdocuments.net/reader035/viewer/2022072011/56649ddf5503460f94ad95f9/html5/thumbnails/6.jpg)
Topics
Leonardo Other topics
Innovation * Validity * Dissemination * Valorisation * Transnationality Partnership
Design & Methodology
Project Management & Delivery
Feasibility of Products
Progress
![Page 7: MASS Project Evaluation Annie Paton anne@indigops.com](https://reader035.vdocuments.net/reader035/viewer/2022072011/56649ddf5503460f94ad95f9/html5/thumbnails/7.jpg)
Focus Project Aim 1 – To enable professionals in
Greece, Sweden, Netherlands & Romania to understand the need/value of adapting VET systems in a shift towards learning outcomes....
Project Aim 3 – Ensuring the professionals have the competencies to deliver VET to disaffected groups which is meaningful and conducive to learning and employment outcomes....
Dissemination & Valorisation of results
![Page 8: MASS Project Evaluation Annie Paton anne@indigops.com](https://reader035.vdocuments.net/reader035/viewer/2022072011/56649ddf5503460f94ad95f9/html5/thumbnails/8.jpg)
Project Aim 1 Evaluation Objectives
How feasible is use of EQF to map soft skills at partner level?
Is the value of soft skills within VET in partner countries relevant and recognised?
How effective are the materials and tools for assessment within classroom context?
- Methodologies- Benchmarking (desk research/ consultation)- Partner questionnaire (PM level & tutor level)- Analysis of progress of relevant work
packages/documentation review
![Page 9: MASS Project Evaluation Annie Paton anne@indigops.com](https://reader035.vdocuments.net/reader035/viewer/2022072011/56649ddf5503460f94ad95f9/html5/thumbnails/9.jpg)
Project Aim 3 Evaluation Objectives
What is the impact of the methodologies used in the piloting on disaffected learners?
How do the outcomes for the group compare with that of the outcomes in the past?
Do learners find the tools easy to use? Do the materials meet the requirements of
trainers/tutors? Is there evidence to support employment
outcomes for the group?
![Page 10: MASS Project Evaluation Annie Paton anne@indigops.com](https://reader035.vdocuments.net/reader035/viewer/2022072011/56649ddf5503460f94ad95f9/html5/thumbnails/10.jpg)
Project Aim 3 Evaluation Methodologies
Consultation with piloters (twice, mid point & end) Consultation with tutors (twice, mid point & end) Analysis of outcomes for piloters Comparative analysis with past outcomes Limited budget, best way for each partner,
questionnaire or telephone interviews.
![Page 11: MASS Project Evaluation Annie Paton anne@indigops.com](https://reader035.vdocuments.net/reader035/viewer/2022072011/56649ddf5503460f94ad95f9/html5/thumbnails/11.jpg)
Baseline Information & Monitoring Understand current situation Current learning & employment outcomes for
learners Control group for comparison How do you monitor learners? How do you monitor tutors & teachers? Use of English
![Page 12: MASS Project Evaluation Annie Paton anne@indigops.com](https://reader035.vdocuments.net/reader035/viewer/2022072011/56649ddf5503460f94ad95f9/html5/thumbnails/12.jpg)
Next Steps.... Formalise the framework – Annie Produce a time plan - Annie Send baseline survey - Annie Keep in touch......All