How to write a ReportOn Assessment

Source: AUN Secretariat

2

Report Preparation

Objectives of Feedback• Level of performance based on AUN-QA

guidelines and criteria• Key strengths of university/faculty/programme• Areas for improvement

Quality Assessment Process (Check) Guide 53-66

3

Report Preparation• Verify evidence

• Areas which meet criteria• Areas which are best practices

• Areas which need improvement• Areas which are major weaknesses

• Confirm areas in doubt• Agree on improvement areas• Presentation of findings at closing meeting• Using AUN-QA Assessment Results Template• Final report

Review Assessment

Findings

Identify Strengths

Establish Areas for Improvement

Clarify

Prepare Final Report

Establish Rating• Establish and agree on level of performance or rating• Reconciliation of ratings between teams for common criteria

Quality Assessment Process (Check) Guide 53-66

4

Desktop Assessment

AUN-QA Assessment Planning Template (Programme Level)

Quality Assessment Process (Do) Guide 53-66

5

Desktop AssessmentExample of Assessment Planning using the Programme Level Template

Quality Assessment Process (Do) Guide 53-66

6

7-Point Rating ScaleScore Value Interpretation Quality & Improvement

Interpretation

1 Nothing (no documents, no plans, no evidence) present

Absolutely inadequate; immediate improvements must be made

2 This subject is in the planning stage Inadequate, improvements necessary

3 Documents available, but no clear evidence that they are used

Inadequate, but minor improvements will make it adequate

4 Documents available and evidence that they are used

Adequate as expected (meeting the AUN-QA guidelines and criteria)

5 Clear evidence on the efficiency of the aspect

Better than adequate (exceeding the AUN-QA guidelines and criteria)

6 Example of best practices Example of best practices

7 Excellent (world-class or leading practices)

Excellent (world-class or leading practices)

After completing the score for each criterion/statement, compute the score for the overall opinion and overall verdict

Report Preparation

Quality Assessment Process (Check) Guide 53-66

7

Report PreparationGuidelines for Feedback

• Feedback must be:– Objective– Based on evidence– Encouraging– Part of a “learning” process

• Feedback must NOT:– Ridicule– Mandate solutions– Be insensitive to the overall effort– Ignore the achievement made

Quality Assessment Process (Check) Guide 53-66

8

Writing Feedback

• Use clear, simple, grammatically correct and complete sentences

• Avoid jargons or acronyms

• Be constructive– Use positive tone– Be specific– Fall within the criteria

• Be non-prescriptive – state observations and evaluations

Quality Assessment Process (Check) Guide 53-66

Report Preparation

Report Preparation

Samples of Feedback

Poor Comment“Staff training needs are revised and frequently met”

Good Comment“Staff training needs are revised and updated annually. Training was provided to assist staff to operate and maintain equipment and to take proactive approach to address students’ needs”

9Quality Assessment Process (Check) Guide 53-66

Report PreparationSamples of Feedback

Poor Comment“The university sets aside a high 3% of their funds for research”

10Quality Assessment Process (Check)

Good Comment“Some 3% of the funds are allocated for research activities. The fund is used for the research of new technologies and the commercialisation of new inventions. Staff are allowed to tap into this fund to finance their projects upon approval from the research evaluation committee”

Guide 53-66

Report PreparationSamples of Feedback

Poor Comment

“The university does not conduct survey to receive feedback from its stakeholders”

11Quality Assessment Process (Check)

Good Comment“Based on the interview, there is little evidence of the university gathering feedback from students, alumni and employers about the curriculum. This prevents the university from determining and incorporating labour market needs for curriculum development and improvement”

Guide 53-66

12

Report PreparationAUN-QA Assessment Results Template (Programme Level)

Quality Assessment Process (Check) Guide 53-66

13

Report PreparationExample of AUN-QA Assessment Results Report(Programme Level)

Quality Assessment Process (Check) Guide 53-66

14

Presentation of Assessment Findings

The purpose of the closing meeting is to:– present the key results of the assessment to key

management staff– highlight the key strengths and areas for improvement

rather than the ratings– ensure that the results of the assessment are clearly

understood– provide an opportunity for clarification– confirm of assessment findings– conclude the assessment

Quality Assessment Process (Check) Guide 53-66

15

Assessment Report & Recommendations

Final Report• Executive summary

– Introduction– Summary of the Results of Assessment

• Criteria and their scores• Overall verdict• General comments

– Conclusion• Results of Assessment

Quality Assessment Process (Act) Guide 53-66

Report on the Quality Assessment at Programme Level for Bachelor of ____________________________ at the Faculty of ______________, University of _______________________

Introduction

This report documents the findings on the quality assessment at programme level for the Bachelor of __________________________ at the Faculty of ______________, University of ____________ on _____________. The quality assessment was carried out by _________________ from ____________ and __________ .The report is based on the information provided in the self-assessment report, on- site verification of the documentation and interviews with selected stakeholders including faculty staff, students, alumni and employers.

Results of Assessment

The assessment framework is based on the AUN Actual Quality Assessment at Programmed Level. The assessment covers 15 criteria and each criterion was assessed based on a 7-point scale. A summary of the assessment results is as follows

15 criteria with corresponding scores

The Department of _______________________ has put in place quality assurance approaches to address the criteria spelt out in the AUN-QA guidelines. Of the 15 criteria, 9 criteria were rated “better than adequate” especially in programme outcomes, specification and structure & content; student assessment; staff and student quality; facilities & infrastructure; quality assurance of teaching & learning and output. 5 criteria were rated “adequate as expected” and 1 criterion on stakeholders feedback was rated as “inadequate but minor improvements will make it adequate”.

A summary of the key strengths and areas for improvement is tabulated below

A detailed report of the quality assessment at programme level for the Bachelor of _________________________ is attached.

Conclusion

Based on the self-assessment report, evidences and interviews, the Bachelor of __________________________________ fulfilled all except one criterion. Overall the quality assurance implemented for the programme is between adequate as expected and better than adequate.

Report prepared by:

Date

Enc. Assessment Results

22

Desktop AssessmentExample of Assessment Planning using the Programme Level Template

Quality Assessment Process (Do) Guide 53-66