graduate outcomes survey (gos) 2015 preparations quality indicators for learning and teaching

Graduate Outcomes Survey (GOS) 2015 Preparations

Quality Indicators for Learning and Teaching

Just before we get started…

• Who am I?

• How questions will be handled

• Resources available after the webinar

GOS 2015 Preparations 2

Overview

1. Overview of the Graduate Outcomes Survey

2. The role of the Social Research Centre

3. The role of Institutions

4. Reminders and prize draws

5. Student engagement including marketing materials

6. In field monitoring & targets (no response rate target!)

7. Troubleshooting


GOS November ‘cycle’

• Graduation Ceremony awareness (August – October)

• Pre-survey awareness (late October)• Online data collection (November)• Supplementary telephone collection

(December - January)• Data file preparation – interim files (February)


Sampling

• A transition year for the GOS…• Ideally, GOS sampling is centralised to maximise

consistency and data quality• This is the case for nearly three quarters of

institutions participating in the November collection

• We will be working with institutions to support them to sample centrally for the May collection


Sampling (2)

• Option A – centralised, very similar to the SES Interim PS file submitted to the department File processed and provided to SRC Sample selected File returned to institutions to append personal information and flag

any graduates who have become ‘out-of-scope’

• Option B – transition option Institutions provide a Minimum Dataset containing only the

information required to execute the survey. This is a ‘cut-down’ version of the file that would have been used for the AGS.

Personal information is included in this file.


The Graduate Outcomes Questionnaire

• Covers key topic areas including: Graduate labour force and further study outcomes

The nature of the work or study after graduation

The extent to which graduates believe their skills or education match their current position

Whether graduates feel they were adequately prepared for employment or study

Feedback about how they could have been better prepared for employment or study


Our role


• To manage the fieldwork, which includes: ‘Sampling’ Email activity

• Content

• Opt-outs

• Enquiries - helpdesk and inbox

• Response maximisation strategy– Email invitations and reminders– Prize draws

Monitoring responses • at a national level, and

• for individual institutions

The role of Institutions

To support response maximisation – critical for the GOS as this is the recruitment platform for the Employer Satisfaction Survey

• Raise awareness Faculties and academic staff Activity plan Marketing activities


Graduate Engagement

Institutions will be provided with an activity plan in the GOS 2015: Collection Guide

• Variations to the activities outlined in the GOS Collection Guide need to be agreed upon with the Social Research Centre.

• Prefer the core materials are used The GOS 2015: Collection Guide will be made available

after this webinar


Institution Activity Plan Importance of consistency in messaging and

communications Transparency and comparability of approach Centralised messaging and communications

was very effective for the SES


Institution Activity Plan Possible lead up activities:

• Introductory emails to graduates from institution management

• Social media campaign launch

• Posters (hard copy or electronic)

• Alumni or institution intranet or web page web-tiles

Ensure whitelisting strategies are in place


Institution Activity Plan Possible in-field activities:

• Social media posts and engagement

• Posters (hard copy or electronic)

• Institution intranet or web page web-tiles

• Alumni engagement (e.g., share on LinkedIn, Alumni newsletter or other communications)

Response rate updates


Marketing Guide and Materials

Communication Templates Social Media Artwork Posters Web tiles and web display materials Slides


Communication Templates

General Information Staff email template Graduate email template Teaching Staff email template


Social Media-awareness


Social Media- in field


Posters


Web Display Ads Awareness


Web Display Ads Open


Web Display Ads Closing


Slides


Reminders and prize draws• One email invite & 7 reminders

Based on what works Staggered sends


Activity Date

Survey live / email invitation 2-Nov

Reminder 1 5-Nov

Reminder 2 10-Nov

Reminder 3 14-Nov

Reminder 4 17-Nov

Reminder 5 21-Nov

Reminder 6 24-Nov

Reminder 7 28-Nov

Reminders and prize draws (2)• Letters will be sent between November 4 and November 6

and are expected to arrive between November 5 and November 13 depending upon address of graduates and Australia Post delivery times.

• Out-of-scope additional populations will only receive a hardcopy non-response letter if this was included in the quotation provided by the Social Research Centre.


Reminders and prize draws (3)

Each weekly prize pool will be made up of three $1,000, five $500 and ten $250 prepaid VISA gift cards.


Activity Date

Prize draw period opens/Fieldwork starts 2-Nov

Prize draw 1 close 8-Nov

Prize draw conducted 9-Nov






Online collection closes 30-Nov


In field monitoring & targets

Targets• For information – we are seeking to achieve as many

responses as we can• Will be sent out prior to fieldwork• Vary from institution to institution • Based on 45 study areas • Reporting on the website under 21 study areas (with

a view to reporting at the 45 level in the future)



Overview of progress by:• Study Area• Gender• Qualification• CEQ/PREQ



Downloadable raw data can be used to:• Create pivot tables

• Drill down to specific areas of interest

• Non-identifiable




administrator

Perhaps remove this slide - it has SESID

November GOS – key dates

• (Please note – data files are not finalised until the second collection round is complete)


September 07 (passed) Closing date for additional populations

October 02 Closing date for additional questions

October 16 Closing date to book optional telephone interviewing (CATI)

November 02 – November 30 Data collection – online

December 2015 – January 2016 Data collection – CATI (optional)

February 2016 Interim data file production

Trouble shooting

Forward to – [email protected]

•Graduates’ concerns raised with you

•Survey functionality queries

•Please do not pass this email along to the graduate, they can make contact at [email protected]


mailto:[email protected]


Working with the QILT team

• We are always available to

answer questions (no matter how vague)

provide advice about research methodology or data collection

• If you have been liaising with a specific person, please contact them directly, otherwise, [email protected] will always work.



To summarise…

• We are available for all types of queries

• Reminders and prize draws are in good hands

• Institutions are well placed to engage graduates with the national marketing materials with consistent branding

• Please contact us to discuss supplementary marketing strategies

• Institutions can monitor and disseminate internal outcomes during fieldwork using the reporting module

• In-field queries or concerns from students to be directed to [email protected]



A quick SES update…

• SES is still in progress for a small number of institutions

• Thank you for the prompt replies to coding queries

• Raw verbatims will be issued in an interim file and data dictionary the week of October 6th

• Direct queries about SES files to the QILT inbox [email protected]



Finally…

• The GOS 2015: Collection Guide will be made available after this webinar.

• Questions?


graduate outcomes survey (gos) 2015 preparations quality indicators for learning and teaching

Documents

preparations gos

preparations overviewoverview

gos sampling

gos collection guide

graduate outcomes survey

collection guidevariations

personal information

graduate labour force