graduate outcomes survey (gos) 2015 preparations quality indicators for learning and teaching

Graduate Outcomes Survey (GOS) 2015 Preparations

Quality Indicators for Learning and Teaching

Just before we get started…

• Who am I?

• How questions will be handled

• Resources available after the webinar

GOS 2015 Preparations 2

Overview

1. Overview of the Graduate Outcomes Survey

2. The role of the Social Research Centre

3. The role of Institutions

4. Reminders and prize draws

5. Student engagement including marketing materials

6. In field monitoring & targets (no response rate target!)

7. Troubleshooting

GOS 2015 Preparations 3

GOS November ‘cycle’

• Graduation Ceremony awareness (August – October)

• Pre-survey awareness (late October)• Online data collection (November)• Supplementary telephone collection

(December - January)• Data file preparation – interim files (February)

GOS 2015 Preparations 4

Sampling

• A transition year for the GOS…• Ideally, GOS sampling is centralised to maximise

consistency and data quality• This is the case for nearly three quarters of

institutions participating in the November collection

• We will be working with institutions to support them to sample centrally for the May collection

GOS 2015 Preparations 5

Sampling (2)

• Option A – centralised, very similar to the SES Interim PS file submitted to the department File processed and provided to SRC Sample selected File returned to institutions to append personal information and flag

any graduates who have become ‘out-of-scope’

• Option B – transition option Institutions provide a Minimum Dataset containing only the

information required to execute the survey. This is a ‘cut-down’ version of the file that would have been used for the AGS.

Personal information is included in this file.

GOS 2015 Preparations 6

The Graduate Outcomes Questionnaire

• Covers key topic areas including: Graduate labour force and further study outcomes

The nature of the work or study after graduation

The extent to which graduates believe their skills or education match their current position

Whether graduates feel they were adequately prepared for employment or study

Feedback about how they could have been better prepared for employment or study

GOS 2015 Preparations 7

Our role

GOS 2015 Preparations 8

• To manage the fieldwork, which includes: ‘Sampling’ Email activity

• Content

• Opt-outs

• Enquiries - helpdesk and inbox

• Response maximisation strategy– Email invitations and reminders– Prize draws

Monitoring responses • at a national level, and

• for individual institutions

The role of Institutions

To support response maximisation – critical for the GOS as this is the recruitment platform for the Employer Satisfaction Survey

• Raise awareness Faculties and academic staff Activity plan Marketing activities

GOS 2015 Preparations 9

Graduate Engagement

Institutions will be provided with an activity plan in the GOS 2015: Collection Guide

• Variations to the activities outlined in the GOS Collection Guide need to be agreed upon with the Social Research Centre.

• Prefer the core materials are used The GOS 2015: Collection Guide will be made available

after this webinar

GOS 2015 Preparations 10

Institution Activity Plan Importance of consistency in messaging and

communications Transparency and comparability of approach Centralised messaging and communications

was very effective for the SES

GOS 2015 Preparations 11

Institution Activity Plan Possible lead up activities:

• Introductory emails to graduates from institution management

• Social media campaign launch

• Posters (hard copy or electronic)

• Alumni or institution intranet or web page web-tiles

Ensure whitelisting strategies are in place

GOS 2015 Preparations 12

Institution Activity Plan Possible in-field activities:

• Social media posts and engagement

• Posters (hard copy or electronic)

• Institution intranet or web page web-tiles

• Alumni engagement (e.g., share on LinkedIn, Alumni newsletter or other communications)

Response rate updates

GOS 2015 Preparations 13

Marketing Guide and Materials

Communication Templates Social Media Artwork Posters Web tiles and web display materials Slides

GOS 2015 Preparations 14

Communication Templates

General Information Staff email template Graduate email template Teaching Staff email template

GOS 2015 Preparations 15

Social Media-awareness

GOS 2015 Preparations 16

Social Media- in field

GOS 2015 Preparations 17

Posters

GOS 2015 Preparations 18

Web Display Ads Awareness

GOS 2015 Preparations 19

Web Display Ads Open

GOS 2015 Preparations 20

Web Display Ads Closing

GOS 2015 Preparations 21

Slides

GOS 2015 Preparations 22

Slides

GOS 2015 Preparations 23

Reminders and prize draws• One email invite & 7 reminders

Based on what works Staggered sends

GOS 2015 Preparations 24

Activity Date

Survey live / email invitation 2-Nov

Reminder 1 5-Nov

Reminder 2 10-Nov

Reminder 3 14-Nov

Reminder 4 17-Nov

Reminder 5 21-Nov

Reminder 6 24-Nov

Reminder 7 28-Nov

Reminders and prize draws (2)• Letters will be sent between November 4 and November 6

and are expected to arrive between November 5 and November 13 depending upon address of graduates and Australia Post delivery times.

• Out-of-scope additional populations will only receive a hardcopy non-response letter if this was included in the quotation provided by the Social Research Centre.

GOS 2015 Preparations 25

Reminders and prize draws (3)

Each weekly prize pool will be made up of three $1,000, five $500 and ten $250 prepaid VISA gift cards.

GOS 2015 Preparations 26

Activity Date

Prize draw period opens/Fieldwork starts 2-Nov

Prize draw 1 close 8-Nov

Prize draw conducted 9-Nov

Prize draw 2 close 15-Nov

Prize draw conducted 16-Nov

Prize draw 3 close 22-Nov

Prize draw conducted 23-Nov

Prize draw 4 close 29-Nov

Online collection closes 30-Nov

Prize draw conducted 30-Nov

In field monitoring & targets

Targets• For information – we are seeking to achieve as many

responses as we can• Will be sent out prior to fieldwork• Vary from institution to institution • Based on 45 study areas • Reporting on the website under 21 study areas (with

a view to reporting at the 45 level in the future)

GOS 2015 Preparations 27

In field monitoring & targets

Overview of progress by:• Study Area• Gender• Qualification• CEQ/PREQ

GOS 2015 Preparations 28

In field monitoring & targets

GOS 2015 Preparations 29

In field monitoring & targets

GOS 2015 Preparations 30

In field monitoring & targets

Downloadable raw data can be used to:• Create pivot tables

• Drill down to specific areas of interest

• Non-identifiable

GOS 2015 Preparations 31

In field monitoring & targets

GOS 2015 Preparations 32

November GOS – key dates

• (Please note – data files are not finalised until the second collection round is complete)

GOS 2015 Preparations 33

September 07 (passed) Closing date for additional populations

October 02 Closing date for additional questions

October 16 Closing date to book optional telephone interviewing (CATI)

November 02 – November 30 Data collection – online

December 2015 – January 2016 Data collection – CATI (optional)

February 2016 Interim data file production

Trouble shooting

Forward to – qilt@srcentre.com.au

•Graduates’ concerns raised with you

•Survey functionality queries

•Please do not pass this email along to the graduate, they can make contact at gos@srcentre.com.au

GOS 2015 Preparations 34

Working with the QILT team

• We are always available to

answer questions (no matter how vague)

provide advice about research methodology or data collection

• If you have been liaising with a specific person, please contact them directly, otherwise, qilt@srcentre.com.au will always work.

GOS 2015 Preparations 35

To summarise…

• We are available for all types of queries

• Reminders and prize draws are in good hands

• Institutions are well placed to engage graduates with the national marketing materials with consistent branding

• Please contact us to discuss supplementary marketing strategies

• Institutions can monitor and disseminate internal outcomes during fieldwork using the reporting module

• In-field queries or concerns from students to be directed to qilt@srcentre.com.au

GOS 2015 Preparations 36

A quick SES update…

• SES is still in progress for a small number of institutions

• Thank you for the prompt replies to coding queries

• Raw verbatims will be issued in an interim file and data dictionary the week of October 6th

• Direct queries about SES files to the QILT inbox qilt@srcentre.com.au

GOS 2015 Preparations 37

Finally…

• The GOS 2015: Collection Guide will be made available after this webinar.

• Questions?

GOS 2015 Preparations 38