data for quality assurance...why is data for qa important? • data-driven decision-making •...

Data for Quality AssuranceAn Integrated Approach

Why is Data for QA Important?

• Data-driven decision-making

• Quality enhancement – noting and building on good practice

• Identification of issues and risks for follow up and loop closing

• Supporting assurance of equivalence across teaching locations

• Increased institutional knowledge of risks

• Empowering staff by providing the information needed to fulfil academic roles

Why is Data for QA Important?

• Enhancing our national standing and reputation (Student Experience) – building

on AUQA audit (2006), and preparing for TEQSA re-registration.

• Supporting compliance with Higher Education Standards Framework that came

into effect in January 2017:

• Standard 5.3.1-2 – periodic review of courses

• Standard 5.3.3 – regular interim monitoring of the quality of teaching, student progress and the

overall delivery of units

Why is Data for QA Important?Policy Improvements

“Delay of getting policy

into practice….

You need academics to

buy into this change, and

data is a way of

evaluating the impact of

changes.”

Plan (Policy)

Act (Practice)

Review (Data)

Improve (Impact)

Where did we start?Information, information everywhere. But what to use?

Comparative Student Outcomes(400+ pages of tables)

SMP Central

The VisionWhat is it that we want to achieve?

Data should be:

• Accessible – eliminate time to ‘find’ the correct information

• Standardised – everyone working off the same data set

• Complete – present all the information needed to perform the task

• Future Proof – add new information as it becomes available

This should allow for greater efficiencies and remove duplication between processes

Solution – 7 Data ReportsWhat data is needed to meet academic needs?

Subject Level

Assessment Committee Report

Yearly Subject Data Report

Subjects of Interest Report (School

Summary)

Course Level

Comprehensive Course Review Data

Report

Courses of Interest Report (Faculty

Summary)

Campus Level

Collaborative Delivery / Campus

Review Data Report

Institutional Level

Institutional Data Summary

• Data available to all staff

via Faculty Moodle sites

• One-stop-shop for data

and reporting

Integrated DataHow do staff access the reports?

ExampleCourse Review Report Course Data Overview

Our quality committee set up the Data for Quality Assurance Working Group and

undertook the following process:

The ProcessHow did we get there?

1. Develop initial prototype (based on policy requirements)

2. Prototype discussed at the Working Group

3. Make necessary amendments

4. Conduct broad consultation sessions

5. Feedback is documented and changes were made where possible

6. Unresolved feedback & prototypes presented to Working Group

7. Prototypes to quality committee for approval

8. Business owner and Working Group Chair - final approval

What did we learn?Creating Change

• Don’t be afraid to start again

• It takes time – be the squeaky wheel

• Inter-unit cooperation is paramount

• Need a data warehouse

• Need to build a common

understanding

• Need to engage stakeholders in

development

• Training and communication is

essential

What’s next for UOWFurther enhancements

• Rollout of the reports

• Embedding into processes – ensuring we close the loop

• Continued training and communication

• Inclusion of missing data sources

• Development of finer-grained Learning & Teaching KPI’s

• Changing the culture - community of practice

Australian Quality Framework (2013) 2nd Edition, viewed 6th Nov 2016,

http://www.teqsa.gov.au/regulatory-approach/higher-education-standards-framework

Rowan, L 2003, 'Back from the brink: Reclaiming 'quality' in the pursuit of a transformative

education agenda', Quality Learning Research Priority Area, Deakin University, Working

Paper Number One. http://www.deakin.edu.au/__data/assets/pdf_file/0004/366448/back-

from-brink.pdf

TEQSA (2015) Higher Education Standards Framework, www.teqsa.gov.au/regulatory-

approach/higher-education-standards-framework

TEQSA (2016) National Register of Higher Education Providers,

http://www.teqsa.gov.au/national-register

UOW (2016) Academic Integrity policy

http://www.uow.edu.au/about/policy/UOW058648.html

UOW (2015) Academic Quality Framework

http://www.uow.edu.au/quality/aqp/quality/index.html

UOW (2016) Teaching and Assessment Policy Suite,

https://www.uow.edu.au/about/policy/alphalisting/UOW222910.html

References

Just some of the Data for Quality

Assurance Working Group

Closer Title