data for quality assurance...why is data for qa important? • data-driven decision-making •...
TRANSCRIPT
Data for Quality AssuranceAn Integrated Approach
Why is Data for QA Important?
• Data-driven decision-making
• Quality enhancement – noting and building on good practice
• Identification of issues and risks for follow up and loop closing
• Supporting assurance of equivalence across teaching locations
• Increased institutional knowledge of risks
• Empowering staff by providing the information needed to fulfil academic roles
Why is Data for QA Important?
• Enhancing our national standing and reputation (Student Experience) – building
on AUQA audit (2006), and preparing for TEQSA re-registration.
• Supporting compliance with Higher Education Standards Framework that came
into effect in January 2017:
• Standard 5.3.1-2 – periodic review of courses
• Standard 5.3.3 – regular interim monitoring of the quality of teaching, student progress and the
overall delivery of units
Why is Data for QA Important?Policy Improvements
“Delay of getting policy
into practice….
You need academics to
buy into this change, and
data is a way of
evaluating the impact of
changes.”
Plan (Policy)
Act (Practice)
Review (Data)
Improve (Impact)
Where did we start?Information, information everywhere. But what to use?
Comparative Student Outcomes(400+ pages of tables)
SMP Central
The VisionWhat is it that we want to achieve?
Data should be:
• Accessible – eliminate time to ‘find’ the correct information
• Standardised – everyone working off the same data set
• Complete – present all the information needed to perform the task
• Future Proof – add new information as it becomes available
This should allow for greater efficiencies and remove duplication between processes
Solution – 7 Data ReportsWhat data is needed to meet academic needs?
Subject Level
Assessment Committee Report
Yearly Subject Data Report
Subjects of Interest Report (School
Summary)
Course Level
Comprehensive Course Review Data
Report
Courses of Interest Report (Faculty
Summary)
Campus Level
Collaborative Delivery / Campus
Review Data Report
Institutional Level
Institutional Data Summary
• Data available to all staff
via Faculty Moodle sites
• One-stop-shop for data
and reporting
Integrated DataHow do staff access the reports?
ExampleCourse Review Report Course Data Overview
Our quality committee set up the Data for Quality Assurance Working Group and
undertook the following process:
The ProcessHow did we get there?
1. Develop initial prototype (based on policy requirements)
2. Prototype discussed at the Working Group
3. Make necessary amendments
4. Conduct broad consultation sessions
5. Feedback is documented and changes were made where possible
6. Unresolved feedback & prototypes presented to Working Group
7. Prototypes to quality committee for approval
8. Business owner and Working Group Chair - final approval
What did we learn?Creating Change
• Don’t be afraid to start again
• It takes time – be the squeaky wheel
• Inter-unit cooperation is paramount
• Need a data warehouse
• Need to build a common
understanding
• Need to engage stakeholders in
development
• Training and communication is
essential
What’s next for UOWFurther enhancements
• Rollout of the reports
• Embedding into processes – ensuring we close the loop
• Continued training and communication
• Inclusion of missing data sources
• Development of finer-grained Learning & Teaching KPI’s
• Changing the culture - community of practice
Australian Quality Framework (2013) 2nd Edition, viewed 6th Nov 2016,
http://www.teqsa.gov.au/regulatory-approach/higher-education-standards-framework
Rowan, L 2003, 'Back from the brink: Reclaiming 'quality' in the pursuit of a transformative
education agenda', Quality Learning Research Priority Area, Deakin University, Working
Paper Number One. http://www.deakin.edu.au/__data/assets/pdf_file/0004/366448/back-
from-brink.pdf
TEQSA (2015) Higher Education Standards Framework, www.teqsa.gov.au/regulatory-
approach/higher-education-standards-framework
TEQSA (2016) National Register of Higher Education Providers,
http://www.teqsa.gov.au/national-register
UOW (2016) Academic Integrity policy
http://www.uow.edu.au/about/policy/UOW058648.html
UOW (2015) Academic Quality Framework
http://www.uow.edu.au/quality/aqp/quality/index.html
UOW (2016) Teaching and Assessment Policy Suite,
https://www.uow.edu.au/about/policy/alphalisting/UOW222910.html
References
Just some of the Data for Quality
Assurance Working Group
Closer Title