Finding FactorsUsing exploratory factor analysis to test a performance measure
Roseanne SovkaBC Ministry of Advanced Education and Labour Market Development
PNAIRP Conference 3-5 October 2010
Outline
Background Method Results Next steps
Background
BC Accountability Framework All public post-secondary institutions Annual process 14 performance measures Webpage:
http://www.aved.gov.bc.ca/framework/welcome.htm#std
Background
Skill development performance measure Average of 7 survey questions Bachelor, Diploma & Certificate students
Why these questions? Similar for all credential types?
Method
Exploratory factor analysis Data reduction technique Underlying factors (latent variables) explain
the relationship between variables
Results
Using survey results for diploma, associate degree and certificate students There is a factor structure Skill development is one of the factors Includes questions from performance
measure Explanatory power 46%
Results Performance measure
Results
Using survey results for Apprenticeship students There is a factor structure Skill development is one of the factors Similar to diploma and certificate students Some differences Explanatory power 47%
Results Performance measure
Results
Using survey results for baccalaureate students Fewer questions available Somewhat different question wording and
response sets
Results
Using survey results for baccalaureate students There is a factor structure Skill development is one of the factors Similar to other student groups Some differences Explanatory power 36%
Results Performance measure
Comparison
All groups had a skills factor The same questions grouped with the
skills factor Variation in explanatory power Variation in non-skills factors
Conclusion
Robust skill development factor Different student groups Different questions and response scales
Objective rationale for performance measure
Next steps
Accountability Framework committee is considering the results
Any questions?
Finding FactorsUsing exploratory factor analysis to test a performance measure
Roseanne SovkaBC Ministry of Advanced Education and Labour Market Development
PNAIRP Conference 3-5 October 2010
