so you really want to be assessed by us ? assess yourself ... · assessed by us ? assess yourself...
TRANSCRIPT
S o y o u r e a l l y w a n t t o b e a s s e s s e d b y u s ? A s s e s s
y o u r s e l f f i r s t !
( U s i n g u p f r o n t S e l f - s e l e c t i o n a n d S e l f -A s s e s s m e n t t o o l s i n l a r g e s c a l e s e l e c t i o n
p r o c e s s e s )
Gilles Guillard – EPSO Nicoletta Vullo - PROMETRIC
European Personnel Selection Office
9/11/2015 2
▪ EPSO selects highly qualified staff for :
The EU Institutions
9/11/2015 3
EU selection process – Annual cycles
9/11/2015 4
A few figures
9/11/2015 5
▪ Since creation of EPSO in 2003: ▪ Over 600.000 candidates have participated in EPSO
selection processes
▪ Over 450.000 EPSO candidates have taken a computer-based test delivered with Prometric
▪ Over 52.000 CBT exams have been delivered in 2014
▪ Between 1 and 2 % of all candidates in EU open competitions are successful and can be recruited
▪ Some competitions have attracted up to 52.000 applicants for approx. 300 positions offered
What is the issue ?
9/11/2015 6
▪ EPSO is bound by law to test all applicants but only very few will be successful… ▪ High financial costs for the organisation
▪ Risks of delay for timely completion of the selection processes
▪ Potential large gaps in cultural/organisational fit in the initial pool of candidates
▪ Potential large gaps in ability and skills compared to requirements to pass the first phase of the competition
Solution ?
9/11/2015 7
▪ Use technological solution provided by Prometric to support the introduction of compulsory Self-selection and Self-assessment
▪ For selection process with a high level of attractiveness, all potential candidates must take several online tests before being allowed to apply
▪ SST and SAT are tools to support the decision-process of individuals to apply or not to EU selection procedures
Application process
9/11/2015 8
First assess your potential fit with the organisation…
9/11/2015 9
…then assess your abilities and skills prior to actual tests
9/11/2015 10
Self-selection EU Career, My Career (I)
9/11/2015 11
▪ First online compulsory test ▪ Objective: raising awareness about
applicants' potential fit within EU Institutions ▪ Focus on 3 key areas: ▪ Organisational citizenship behaviour
▪ EU working environment
▪ Professional skills attitudes
Self-selection EU Career, My Career (II)
9/11/2015 12
▪ Compulsory but not eliminatory ▪ Now available in 24 EU languages ▪ Accessible online 24/7 only during application
window (usually one month) ▪ MCQ (+/- 20 questions) ▪ Timed + pass mark ▪ Possibility to see correct answer/feedback
immediately (educational/branding) ▪ Content developed in-house (psychologists +
SMEs) and now adapted to specific job profiles
EU Career, My Career
9/11/2015 13
EU Career, My Career
9/11/2015 14
Self-assessment (I)
9/11/2015 15
▪ Second suite of online test ▪ Objective: provide potential applicants with
a free testing experience to allow them to assess their chances of success ▪ Different tests: ▪ Cognitive abilities (VR, NR, AR)
▪ SJT
▪ Specific skills tests (e.g. language proficiency for Translators)
Self-assessment (II)
9/11/2015 16
▪ Compulsory but not eliminatory ▪ Available in 24 EU languages (SJT in 3 languages) ▪ Accessible online 24/7 during application window
(usually one month) AND beyond to allow practice and familiarisation with types of tests
▪ MCQ (generally 50 % of questions compared to actual exam)
▪ Timed + pass mark ▪ Correct answers are NOT given away ▪ Content extracted from actual EPSO item bank and
used in past competitions ("second life" of items)
Self-Assessment (VR)
9/11/2015 17
Self-Assessment (NR)
9/11/2015 18
Feedback ?
9/11/2015 19
Feedback EU Career, My Career
9/11/2015 20
Feedback Self-assessment tests
9/11/2015 21
Prometric
9/11/2015 22
▪ A trusted and market leader of technology-enabled testing and assessment
▪ Committed to a set of values that get the right test to the right location at the right time and to the right test taker
▪ Supporting candidates worldwide who take more than 9 million tests each year
▪ http://www.prometric.com
▪ We support the EPSO since 2005 in their effort to select the right candidate for the right job and in making the selection process better, faster and at a less expense;
▪ We have implemented innovative, tailored solutions to meet the EPSO needs, including: ▪ Multiple choice exams;
▪ Case Studies;
▪ Audio-Video exams;
▪ E-Trays;
▪ In the EU24 languages and across all the EU28 member states and WW
Suppor ting the EPSO
9/11/2015 23
▪ Tailored solution: ▪ A full integration between the EPSO registration process and the
IBT testing environment, including seamless navigation and consistent look and feel;
▪ No login or data entry by candidates to access the exams;
▪ A dynamic presentation of content in multiple languages;
▪ Candidate support in the three EU languages
IBT Implementation
9/11/2015 24
IBT Landing Page
9/11/2015 25
IBT exams delivered – 2014 over view
26
500,000 IBT tests & surveys delivered To a total of 270,000 candidates In up to 24 languages Minimal candidate complaints
Cycle Exam Title Test volume Pass rateAST 3 Self-assessment Part I: Reasoning test 57,815 30%AST 3 Self-Assessment Part II: Professional skills test 12,297 33%AD Compulsory self-assessment Part I 200,252 10%AD Compulsory self-assessment Part II SJT 100,449 25%ADL Self-Assessment Translators Part I Reasoning Tests 15,892 11%ADL Compulsory Self-Assessment Part II Language Test 17,907 51%General EU CAREER, MY CAREER? 50,194 51%General EU-LAUFBAHN, MEINE LAUFBAHN? 8,998 64%General UNE CARRIERE EUROPEENNE, UNE CARRIERE POUR MOI? 12,545 53%General EPSO Enquête de satisfaction - French 4,450 n/aGeneral EPSO Survey - English 17,958 n/aGeneral EPSO Umfrage - German 4,513 n/a
503,270
Some of the lessons learned
9/11/2015 27
▪ Reduced number of actual applicants (between 25 to 50 % compared to SST/SAT): costs and testing constraints driven down
▪ Increased commitment and motivation of actual applicants (decreasing number of dropouts)
▪ Extremely positive feedback from test takers on SST/SAT
▪ Increased transparency in EU selection processes
Future prospects ?
9/11/2015 28
▪ Comparative assessment of quality of successful candidates and scores achieved in SST/SAT (requires data capture at an early stage) ?
▪ SST/SAT compulsory AND eliminatory ? ▪ Migration of EPSO exams from IBT to the new TC Net
platform ▪ Next Generation - Provides the benefits of Web 2.0 and RIA standards ▪ Maintainability – Built on the ASP.NET platform ▪ Usability - Implements HTML5 leveraging its rapid response capabilities and
enhanced UI ▪ Design & Security –
▪ 3-tier architecture
▪ WCAG2.0/508
▪ PCI compliance and Architectural Security Risks audited by independent 3rd party
Thank you !
9/11/2015 29
▪ White paper available, just ask for it !
▪ Contact details:
▪ EPSO – Gilles GUILLARD – Head of Unit "E-selection and test development" + 32 (0)2 299 50 20 / mailto:[email protected]
▪ Prometric – Nicoletta VULLO – Director of Account Management + 39 340 7798 460 / mailto:[email protected]
QUESTIONS ?