symposium on learning outcomes a toolkit for assessment october 16-17, 2014 eaton chelsea hotel...
TRANSCRIPT
![Page 1: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/1.jpg)
Symposium on Learning
Outcomes A Toolkit for Assessment
October 16-17, 2014Eaton Chelsea Hotel
Toronto, Ontario
Introductory Plenary Session
What’s Working in the Learning
Outcomes Toolbox?
Eileen DeCourcy
Leesa
Wheelahan
Paul Stenton
Peter Wolf
Cindy Hazell
Ross Finnie
![Page 2: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/2.jpg)
Learning Outcomes
EILEEN DECOURCY
OCTOBER 16, 2014
![Page 3: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/3.jpg)
3
Refining, Implementing and Assessing Learning Outcomes in Curriculum
Systematic Approach to Achieving Constructive Alignment
1. Curriculum Design/Development/Renewal Process2. Faculty Training and Development on LO 3. Infrastructure/Physical Space
![Page 4: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/4.jpg)
4
Curriculum Development & Renewal
• Ontario Degree Qualifications Framework
• Program Renewal• Instructional Design
Software (COSSID)• Online course design
and review process
![Page 5: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/5.jpg)
5
Faculty Training & DevelopmentBeliefs/intentions/actions do not always align
Course design as an enactment of beliefs on teaching and learning
Underlying beliefs of teachers (Teaching Perspectives Inventory)
![Page 6: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/6.jpg)
6
Infrastructure & Physical Space
![Page 7: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/7.jpg)
7
LO Assessment Tool Kit
• Linkage matrix in curriculum mapping(Technology)
• Benchmarking Teaching/Learning/Assessment strategies
• Student performance (Relevant learning and authentic assessment – portfolios etc.)
![Page 8: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/8.jpg)
Symposium on Learning
Outcomes A Toolkit for Assessment
October 16-17, 2014Eaton Chelsea Hotel
Toronto, Ontario
Introductory Plenary Session
What’s Working in the Learning
Outcomes Toolbox?
Eileen DeCourcy
Leesa
Wheelahan
Paul Stenton
Peter Wolf
Cindy Hazell
Ross Finnie
![Page 9: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/9.jpg)
Symposium on Learning
Outcomes A Toolkit for Assessment
October 16-17, 2014Eaton Chelsea Hotel
Toronto, Ontario
Introductory Plenary Session
What’s Working in the Learning
Outcomes Toolbox?
Eileen DeCourcy
Leesa
Wheelahan
Paul Stenton
Peter Wolf
Cindy Hazell
Ross Finnie
![Page 10: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/10.jpg)
Considerations for an Outcomes-Based Culture
Peter Wolf
2014 Learning Outcomes Conference
![Page 11: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/11.jpg)
• Faculty-Driven• Discipline-Based• Collaborative• Evidence-Based• Learning-
Centered• Facilitated
Curriculum Development &
Assessment
Institutional & Program
Outcomes
Program Assessment Processes
Institutional Tools & Systems
Internal Alignment
Student Engagement
Considerations for an Outcomes-Based Culture
Best Practices
![Page 12: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/12.jpg)
• Faculty-Driven• Discipline-Based• Collaborative• Evidence-Based• Learning-
Centered• Facilitated
Curriculum Development &
Assessment
Institutional & Program
Outcomes
Program Assessment Processes
Institutional Tools & Systems
Internal Alignment
Student Engagement
Considerations for an Outcomes-Based Culture
•Definitions •Rubrics•Communication
•Engagement
•Multiple stakeholders •Assessment Plan•QA alignment•Continuous improvement
•Align accreditation/review/QA
•Connect relevant systems•Learning analytics •Collection, assessment, reporting systems
•Policies & practices•Recognition - DOE, P&T, awards
•Educational development• Integrated systems
•E-portfolios, capstone experiences, etc.
•Integrate co-, extra- and non-curricular
•Outcomes-based course selection/validation option
Best Practices
![Page 13: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/13.jpg)
• Faculty-Driven• Discipline-
Based• Collaborative• Evidence-
Based• Learning-
Centered• Facilitated
Curriculum Development &
Assessment
Institutional & Program Outcomes
Program Assessment Processes
Institutional Tools & Systems
Internal Alignment
Student Engagement
Considerations for an Outcomes-Based Culture
•Definitions •Rubrics•Communication
•Engagement
•Multiple stakeholders •Assessment Plan•QA alignment•Continuous improvement
•Align accreditation/review/QA
•Connect relevant systems•Learning analytics •Collection, assessment, reporting systems
•Policies & practices•Recognition - DOE, P&T, awards
•Educational development• Integrated systems
•E-portfolios, capstone experiences, etc.
•Integrate co-, extra- and non-curricular
•Outcomes-based course selection/validation option
Best Practices
![Page 14: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/14.jpg)
Symposium on Learning
Outcomes A Toolkit for Assessment
October 16-17, 2014Eaton Chelsea Hotel
Toronto, Ontario
Introductory Plenary Session
What’s Working in the Learning
Outcomes Toolbox?
Eileen DeCourcy
Leesa
Wheelahan
Paul Stenton
Peter Wolf
Cindy Hazell
Ross Finnie
![Page 15: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/15.jpg)
Symposium on Learning
Outcomes A Toolkit for Assessment
October 16-17, 2014Eaton Chelsea Hotel
Toronto, Ontario
Introductory Plenary Session
What’s Working in the Learning
Outcomes Toolbox?
Eileen DeCourcy
Leesa
Wheelahan
Paul Stenton
Peter Wolf
Cindy Hazell
Ross Finnie
![Page 16: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/16.jpg)
Credit transfer
Leesa Wheelahan
Symposium on Learning Outcomes:A toolkit for assessment
16 & 17 October, 2014
![Page 17: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/17.jpg)
Trust is most important
• Mapping learning outcomes only one element of credit transfer
• Zones of mutual trust – what ONCAT represents
• Trust at 2 levels – systemic & institutional• Trust an outcome of high levels of social
capital • Trust doesn’t develop spontaneously
![Page 18: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/18.jpg)
Institutional principles
• Prioritise & plan no. of pathways • Don’t have pathways for every program• Range from most to least expensive• Given expense, develop pathways to
achieve strategic goals• Nested awards are better for social
inclusion than dual-awards
![Page 19: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/19.jpg)
Institutional implications
• Strongly supportive institutional cultures reduce ‘cost’, build trust
• Effective governance arrangements needed• Boundary spanner – report to someone senior • Funding & resources• Universities need to provide pathways to at
least some high demand pathways• Joint institutional strategies needed
![Page 20: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/20.jpg)
Further reading
• The Australian National Centre for Vocational Education Research (NCVER) publications are free
• You will need to register, but that’s all• This is a link to all their publications on
pathways• http://goo.gl/dCvXDf
![Page 21: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/21.jpg)
Symposium on Learning
Outcomes A Toolkit for Assessment
October 16-17, 2014Eaton Chelsea Hotel
Toronto, Ontario
Introductory Plenary Session
What’s Working in the Learning
Outcomes Toolbox?
Eileen DeCourcy
Leesa
Wheelahan
Paul Stenton
Peter Wolf
Cindy Hazell
Ross Finnie
![Page 22: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/22.jpg)
Symposium on Learning
Outcomes A Toolkit for Assessment
October 16-17, 2014Eaton Chelsea Hotel
Toronto, Ontario
Introductory Plenary Session
What’s Working in the Learning
Outcomes Toolbox?
Eileen DeCourcy
Leesa
Wheelahan
Paul Stenton
Peter Wolf
Cindy Hazell
Ross Finnie
![Page 23: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/23.jpg)
WHAT’S WORKING IN THE LEARNING OUTCOMES
TOOLBOX?
Cindy Hazell, October/2014
Learning Outcomes, Credit Transfer & Mobility
![Page 24: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/24.jpg)
Learning Outcomes, Credit Transfer & Mobility
Practitioner’s perspective
Facilitating, not guaranteeing, CT
Reconciling tension between institutional/faculty variations, local responsiveness vs. mobility and transfer
Within and Between Institutions, Faculties, Campuses, Modes of Delivery
![Page 25: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/25.jpg)
Learning Outcomes, Credit Transfer & Mobility
Some Promising Practices
C to C Transfer - Program, Subject Outcomes (e.g. CCVPA Transfer Protocol)
C to C Transfer - “Mid-stream exit” Outcomes (CCVPA project, 2012)
New Program Development –Defining diploma vs. degree level curriculum; Bridging Programs (PEQAB “Degree Standard”)
Diploma to Degree Pathways (C-C; C-U) - Gap Analysis and Bridging (www.peqab.ca)
Designing Dynamic Bilaterals (new partners, new pathways, changing curriculum) - using Curriculum Mapping (ONCAT project calls)
![Page 26: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/26.jpg)
Learning Outcomes, Credit Transfer & Mobility
Some ChallengesI. Different cultures, academic traditions;
speaking the same language?II. Trust & credibility (“guardians of quality”)III. Liberal arts, electives - maximizing choice
and breadth vs. transferability (HEQCO Tuning ++)
IV. Accrediting bodies – content, resource-dependent, time-based
…..But LO’s offer opportunities to mitigate these!
![Page 27: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/27.jpg)
Symposium on Learning
Outcomes A Toolkit for Assessment
October 16-17, 2014Eaton Chelsea Hotel
Toronto, Ontario
Introductory Plenary Session
What’s Working in the Learning
Outcomes Toolbox?
Eileen DeCourcy
Leesa
Wheelahan
Paul Stenton
Peter Wolf
Cindy Hazell
Ross Finnie
![Page 28: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/28.jpg)
Symposium on Learning
Outcomes A Toolkit for Assessment
October 16-17, 2014Eaton Chelsea Hotel
Toronto, Ontario
Introductory Plenary Session
What’s Working in the Learning
Outcomes Toolbox?
Eileen DeCourcy
Leesa
Wheelahan
Paul Stenton
Peter Wolf
Cindy Hazell
Ross Finnie
![Page 29: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/29.jpg)
What’s Working in the Learning Outcomes Toolbox?: Employability/Student Success
A New Tool:
2014 Learning Outcomes Symposium October 16, 2014Paul Stenton, Deputy Provost and Vice Provost, University Planning
29
![Page 30: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/30.jpg)
30
Employability is a Priority
30(Canadian University Survey Consortium, First-Year Student Survey 2013)
“… ensure that students graduate with skills that respond to local and provincial labour market needs and contribute to
social development.”(Ontario’s Differentiation Policy Framework for Postsecondary Education)
Government:
Students:
![Page 31: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/31.jpg)
31
Periodic program reviews
Current Employment Outcomes Data
Episodic, high-level, delayed:
Ontario University Graduate Survey (OUGS)
National Baccalaureate Graduate Outcomes Survey
National Graduate Survey (Statistics Canada)
Canadian Occupational Projection System and sectoral labour market studies (ESDC – Employment and Social Development Canada)
![Page 32: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/32.jpg)
32
Magnet is a network where students and alumni create profiles and connect to employment opportunities that match their skills and interests
Automates short-listing of candidates
Provides real-time supply and demand labour market insight for institutions
Launched September 2014
Underlying software incubated by Ryerson’s Digital Media Zone
Funded by Ministry of Training, Colleges and Universities
Magnet: A Tool for Connecting Students to the Labour Market
![Page 33: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/33.jpg)
33
Students/Alumni create a profile of their education, skills, and employment history.
Employers specify what they’re looking for in their ideal candidate using the same skills taxonomy.
Magnet notifies employers about top matching candidates.
Employers evaluate matches and invite ideal candidates to connect through Magnet.
Students/alumni decide whether to connect with employers through Magnet.
How Does Magnet Work?
Students/Alumni Magnet Employers
![Page 34: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/34.jpg)
34
Labour force trends: Learn about trends in local labour force needs
Skills/jobs taxonomy: Same taxonomy used by students/alumni and employers
Potential feedback loop: Potential insights into labour market skills in demand
Network to-date: 26,000 students and 1,300 employers have participated
Rapidly growing network and mineable database
www.magnet.today
Data Mining: Feedback to Colleges and Universities
![Page 35: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/35.jpg)
Symposium on Learning
Outcomes A Toolkit for Assessment
October 16-17, 2014Eaton Chelsea Hotel
Toronto, Ontario
Introductory Plenary Session
What’s Working in the Learning
Outcomes Toolbox?
Eileen DeCourcy
Leesa
Wheelahan
Paul Stenton
Peter Wolf
Cindy Hazell
Ross Finnie
![Page 36: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/36.jpg)
Symposium on Learning
Outcomes A Toolkit for Assessment
October 16-17, 2014Eaton Chelsea Hotel
Toronto, Ontario
Introductory Plenary Session
What’s Working in the Learning
Outcomes Toolbox?
Eileen DeCourcy
Leesa
Wheelahan
Paul Stenton
Peter Wolf
Cindy Hazell
Ross Finnie
![Page 37: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/37.jpg)
Post-Schooling Outcomes of University
Graduates: A Tax Data Linkage
Approach
Ross Finnie ([email protected])
![Page 38: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/38.jpg)
1998 Cohort – Social Science Graduates
![Page 39: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/39.jpg)
Mean Earnings of 1998 Cohort ($2011) – Social Science Graduates
1 2 3 4 5 6 7 8 9 10 11 12 130
20,000
40,000
60,000
80,000
100,000
120,000
Years After Graduation
![Page 40: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/40.jpg)
Mean Earnings of 1998 Cohort ($2011) – Social Science Graduates
1 2 3 4 5 6 7 8 9 10 11 12 130
20,000
40,000
60,000
80,000
100,000
120,000
Years After Graduation
![Page 41: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/41.jpg)
Mean Earnings of 1998 Cohort ($2011) – Social Science Graduates
1 2 3 4 5 6 7 8 9 10 11 12 130
20,000
40,000
60,000
80,000
100,000
120,000
Years After Graduation
![Page 42: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/42.jpg)
Mean Earnings of 1998 Cohort ($2011) – Social Science Graduates
1 2 3 4 5 6 7 8 9 10 11 12 130
20,000
40,000
60,000
80,000
100,000
120,000
Years After Graduation
![Page 43: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/43.jpg)
Mean Earnings of Selected Cohorts ($2011) – Social Science Graduates
1 2 3 4 5 6 7 8 9 10 11 12 130
20,000
40,000
60,000
80,000
100,000
120,000
Years After Graduation
![Page 44: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/44.jpg)
Adding Other Cohorts: 1998 + 2000, 2004, 2008
![Page 45: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/45.jpg)
Mean Earnings of 1998 Cohort ($2011) – Social Science Graduates
1 2 3 4 5 6 7 8 9 10 11 12 130
20,000
40,000
60,000
80,000
100,000
120,000
Years After Graduation
![Page 46: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/46.jpg)
Mean Earnings of Cohorts ($2011)
1 2 3 4 5 6 7 8 9 10 11 12 130
20,000
40,000
60,000
80,000
100,000
120,000
Years After Graduation
![Page 47: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/47.jpg)
Mean Earnings of Selected Cohorts ($2011) – Social Science Graduates
1 2 3 4 5 6 7 8 9 10 11 12 130
20,000
40,000
60,000
80,000
100,000
120,000
Years After Graduation
![Page 48: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/48.jpg)
Comparing Social and Humanities Graduates
![Page 49: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/49.jpg)
Mean Earnings of Selected Cohorts ($2011)
1 2 3 4 5 6 7 8 9 10 11 12 130
20,000
40,000
60,000
80,000
100,000
120,000
Social Science
1 2 3 4 5 6 7 8 9 10 11 12 130
20,000
40,000
60,000
80,000
100,000
120,000
Humanities
![Page 50: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/50.jpg)
The Story: Starting levels vs. increases over time – the
importance of a longer-run perspective
![Page 51: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/51.jpg)
Comparing Graduates Across All Faculties
![Page 52: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/52.jpg)
Mean Earnings of Selected Cohorts ($2011)
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Social Science
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Humanities
![Page 53: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/53.jpg)
Mean Earnings of Selected Cohorts ($2011)
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Health
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Social Science
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Humanities
![Page 54: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/54.jpg)
Mean Earnings of Selected Cohorts ($2011)
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Health
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Social Science
1 3 5 7 9 11 130
20,00040,00060,00080,000
100,000120,000
Mathematics and Natural Sciences
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Humanities
![Page 55: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/55.jpg)
Mean Earnings of Selected Cohorts ($2011)
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Health
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Social Science
1 3 5 7 9 11 130
20,00040,00060,00080,000
100,000120,000
Mathematics and Natural Sciences
1 3 5 7 9 11 130
20,00040,00060,00080,000
100,000120,000
Engineering and Computer Science
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Humanities
![Page 56: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/56.jpg)
Mean Earnings of Selected Cohorts ($2011)
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Business
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Health
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Social Science
1 3 5 7 9 11 130
20,00040,00060,00080,000
100,000120,000
Mathematics and Natural Sciences
1 3 5 7 9 11 130
20,00040,00060,00080,000
100,000120,000
Engineering and Computer Science
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Humanities
![Page 57: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/57.jpg)
Numerous Stories:- starting levels - increases over time- stability vs. variability
A unique new perspective
![Page 58: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/58.jpg)
Those Near the Top, in the Middle, at the Bottom
![Page 59: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/59.jpg)
Quintile Means: 1998 Cohort – No Top Quintile
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Business
1 3 5 7 9 11 130
20,00040,00060,00080,000
100,000120,000
Engineering and Computer Science
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Health
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Social Sciences
1 3 5 7 9 11 130
20,000
40,000
60,000
80,000
100,000
120,000
Humanities
1 3 5 7 9 11 130
20,00040,00060,00080,000
100,000120,000
Mathematics and Natural Sciences
![Page 60: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/60.jpg)
Post-98?
![Page 61: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/61.jpg)
2008 Recession: First Year Earnings ($2011)
20062007
20082009
20102011
35,000
40,000
45,000
50,000
55,000
60,000
Business
20062007
20082009
20102011
35,000
40,000
45,000
50,000
55,000
60,000
Health
2006 2007 2008 2009 2010 201135,000
40,000
45,000
50,000
55,000
60,000
Social Science
2006 2007 2008 2009 2010 201135,000
40,000
45,000
50,000
55,000
60,000
Mathematics and Natural Sciences
2006 2007 2008 2009 2010 201135,000
40,000
45,000
50,000
55,000
60,000
Engineering and Computer Sciences
2006 2007 2008 2009 2010 201135,000
40,000
45,000
50,000
55,000
60,000
Humanities
![Page 62: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/62.jpg)
Just a taste…
![Page 63: Symposium on Learning Outcomes A Toolkit for Assessment October 16-17, 2014 Eaton Chelsea Hotel Toronto, Ontario Introductory Plenary Session What’s Working](https://reader036.vdocuments.net/reader036/viewer/2022070323/56649dc75503460f94abb8ae/html5/thumbnails/63.jpg)
Post-Schooling Outcomes of University Graduates:
A Tax Data Linkage Approach
Ross Finnie ([email protected])