presentation on 2009 exams and 2008 national statistics

7/28/2019 Presentation on 2009 Exams and 2008 National Statistics

1/26

IPECC Meeting

May 25 - 26, 2009

Presented by

SOPEEC CoordinatorofExaminations


2/26

IPECC Meeting May 25 - 26, 2009 2

Outline

I. What is SOPEEC

II. Power Engineer Certification(PEC) Syllabi & Curriculum

III. 2009 Exams

IV. Preparing for SOPEEC Exams

V. Statistics & Trends

VI. Summary


3/26


I. What is SOPEEC

A committee delegated by and

responsible to Canadian Association ofChief Inspectors (ACI)

Formed in 1972

A National committee


4/26


II PEC Syllabi & Curriculum

Deadline for writing:

Old 2nd Class December 31, 2009

Old 1st Class August 31, 2011

5th to 1st Class Syllabi enhancedSyllabi and Curriculum documents

posted on SOPEEC website

2 new topics added to 5th Class


5/26


II. PEC Syllabi & Curriculum

5 year Syllabi, Curriculum, Course

Material and Exam Bank review cycleestablished in 2006

Completed 5th to 3rd Class review andstarting the 2nd Class review this year

5th and 4th Class course materialrevised. 3rd Class in progress


6/26


II. PEC Syllabi & Curriculum

Require to establish a Logical

progression from 5th

to 1 Class for keysyllabus topics

Need input from industry to definesyllabus topics in line with moderntechnology, complex operation andenvironmental requirements


7/26


III. 2009 Exams

Using improved format and layout

established in 2008

Enhancing system for review &construction of new exams

Adding more diagrams & charts


8/26


III. 2009 Exams

Selecting an equal # of questions based onsyllabi

Using best practices for construction of essay& multiple choice exams

Improving specificity and clarity of essay

questions

Assigning marks based on number of keyconcepts for consistency among Examiners


9/26


IV. Preparing SOPEEC Exams

a) Essay-type Questions

b) Sketches

c) Mechanical Drawings

d) Calculation Questions

e) ASME Code Questions

f) Multiple Choice Questions


10/26


a ) Es sa y t y p e Qu e s t i o n s ( 1 )

Sample questions posted to website

Questions based on topics listed in syllabus

Majority of questions from course material

Other questions from Act and Regulations,

Codes and Standards, and operationexperience


11/26


a ) Es sa y t y p e Qu e s t i o n s ( 2 )

Make good use of materials allowed in examroom

Study key equipment & principles ofoperation, purposes, applications, limitations,advantages & disadvantages

Read questions carefully

Answer question asked according to marksassigned


12/26


b ) Sk e t c h e s

Use blank page for sketches

Use the whole page to show keycomponents in detail

Label key components

Include essential dampers, valves,fittings, protection devices andinstruments and controls


13/26


c ) M e ch a n i c a l D r a w i n g s

Bring all necessary tools

Use proper scale that fit on a 11 by 17 paper

Understand different types of lines, theirapplications and line thickness required

Provide line dimensions

Draw complete and detailed diagrams


14/26


d ) Ca l c u l a t i o n Q u e s t i o n s ( 1 )

Write out the equation

Define all variables and show units

State assumptions

Show all steps


15/26


d ) Ca l c u l a t i o n Q u e s t i o n s ( 2 )

Check units in each step

Eliminate unknowns

Substitute numbers at the end toobtain the answer


16/26


e ) A SME Co d e Q u e s t i o n s

Codes are not written for studying or training

Locate code paragraphs that apply to thespecific equipment or task

Read the paragraph and understand theeffect

Follow directions from each code paragraphto read all related paragraphs


17/26


f ) M u l t i p l e Ch o i ce Q u e s t i o n s

Read the question carefully

Predict an answer before looking at thechoices of answers

Read each answer carefully

Choose the answer that best answers the

question

Manage your time (average 1.4 minutes perquestion)


18/26


V. Statistics and Trends (1)10 Year Trend for Total Exams Attempted per Class

CLASS 99/00 00/01 01/02 02/03 03/04 04/05 05/06 06/07 07/08 08/09

First 529 536 565 672 564 605 648 604 557 845

Second 1581 1759 1958 2053 2006 1982 2217 1994 2197 2612

Third 3272 3349 3335 3317 3439 3572 3544 3816 4088 4472

Fourth 3423 3687 4113 4114 4084 3934 4356 4580 4485 5147

Fifth N/A N/A N/A N/A N/A N/A N/A 515 444 516

Total 8805 9331 9971 10156 10093 10093 10765 11509 11771 13592

10 Year Trend for Total Exams Attempted Per Class

5 Year Trend for Total Exams Attempted Per Class


19/26



CLASSTen

Years

Five

Years

Last

Year

Current

Year

1

Year

5

Years

10

Years

First 529 605 557 845 51.71% 39.67% 59.74%

Second 1581 1982 2197 2612 18.89% 31.79% 65.21%

Third 3272 3572 4088 4472 9.39% 25.20% 36.67%

Fourth 3423 3934 4485 5147 14.76% 30.83% 50.37%

Fifth N/A N/A 444 516 16.22% N/A N/A

TOTAL 8805 10093 11771 13592 15.47% 34.67% 54.37%

% Change for Exams

Attempted


20/26



Exams Attempted by Class (Average)

0

2000

4000

6000

8000

10000

12000

14000

16000

99-00 00-01 01-02 02-03 03-04 04-05 05-06 06-07 07-08 08-09

10 YEAR TREND

NumberofExamsAttempted

1st Class 2nd Class 3rd Class 4th Class 5th Class Total


21/26


V. Statistics and Trends (2)

10 Year Average Percentage Pass by Class

High Low SD

Ten

Years

Five

Years

2007-

2008

2008-

2009

Over

10 Years

Over

5 Years

One

Year

1st 69 57 4 63 64 61 69 9% 7% 13%

2nd 65 51 4 57 59 56 57 0% -3% 2%

3rd 69 56 4 63 60 58 59 -7% -1% 1%

4th 64 55 3 61 59 58 58 -4% -1% 1%

5th 55 48 3 52 52 50 55 6% 6% 9%

-4%

% Change

3

Accumulated Average

% of Candidates Passing Over

AccumulatedTen Year Average

March 31, 1999 - 2009

65 55 61 -1%57 4%59Average 59


22/26



10 Year Percentage Pass by Class

1999 2005 2008 2009

%

Change

%

Change

%

Change

1st 57 66 58 69 21% 6% 19%

2nd 54 59 52 57 6% -4% 10%

3rd 67 64 56 59 -12% -8% 4%

4th 63 61 55 58 -8% -5% 7%5th 0 0 48 55 N/A N/A 13%

Average 63 62 55 59 -6% -5% 7%

Average % of Candidates Passing % Change from 2009


23/26



10 Year Percentage Pass by Class

Percent Pass by Class

57

63

66

59

66

66 65 64

58

69

5455

61

51

57

59

65

60

52

57

67

64

69

67

64 64

59 59

56

59

63

61

6463

6261

6061

55

58

52

48

55

45

50

55

60

65

70

99-00 00-01 01-02 02-03 03-04 04-05 05-06 06-07 07-08 08-09

10 YEAR TREND

PercentagePassed

1st Class 2nd Class 3rd Class 4th Class 5th Class


24/26



2008 Comparison by Class

71.8%74.9%66.4%Revised 1st

68.8%74.7%64.9%Old 1st

% ofCandidates

Passing

AveragePassing

Mark

AverageMark

Class

60.9%73.5%65.9%5th

55.5%73.5%66.5%4th63.8%72.5%66.6%3rd

64.0%74.8%63.6%Old 2nd

50.5%73.2%60.9%Revised 2nd

Note: Data is based on one jurisdiction only


25/26


VI Summary

A lot of good work has been done to

bring us to this stage.

However, there is still a lot of work tobe done for continuous improvement.


26/26


VI Summary

As a team, the Colleges, Industries,

Publishers, and Jurisdictions areworking together in the right direction.

Thank you everybody for yourcontribution and support.

presentation on 2009 exams and 2008 national statistics

Documents