update on the national board dental examinations - adea€¦ · update on the national board dental...

Update on the National Board

Dental Examinations

American Dental Education Association

San Diego, California

March 2011

© 2011 Joint Commission on National Dental Examinations,

American Dental Association. All rights reserved.

Research &

Development/Psychometrics

Tsung-Hsun Tsai, Ph.D

[email protected]

mailto:[email protected]

Updates

Research

• the highest score reliability is found at the pass/fail point,

• high score reliability is found on the current content structure with 8-10 cases on Part II, and

• psychometrically defensible models and procedures are developed to detect aberrant responses for computer-based examinations.



Updates

Planned 2011 Part II Practice Analysis

Domain of entry-level dentistry

65 revised, consolidated clinical competencies of the New General Dentistry

criticality

Survey frequency

ad hoc

content review Data analysis



Updates

New Item Types

• Multiple correct answers, extended matching, and ordering are coming to National Board Examinations in 2012.

• These new item types will be scored objectively with a well defined scoring rubric.

• Responses on these new item types must match the scoring rubric exactly in order to get a score of "1" for the item. If there is no exact match, the score for the item will be "0". There is no partial credit.



Updates

• For example, for an item with multiple

correct answers and four options: A, B, C,

and D, if the correct answers are B

and D, both B and D and no other options

must be selected to get a score of "1".

Otherwise, the score for this item will be

"0."



Updates

Multiple Correct Answers From the following list, select the three symptoms associated with candidosis. A. Small blisters B. Parasitic in nature C. Reduced prothrombin D. Fungal in nature E. Bruxism F. Maladsorption syndrome G. Bacterial in nature



Updates

Extended Matching For each symptom listed below, select the correct

disorder from the list provided.



Symptom

Disorder

___ 1. White patches easily removed with light abrasion

___ 2. Buccal lesion with erythematosus surface

___ 3. Dorsal tongue carcinoma

___ 4. Paterson - Kelly Syndrome

___ 5. Abdominal pain, diarrhea, weight loss, fever

___ 6. Multiple bluish - purple macules or plaques on

lower extremities

___ 7. Hairy tongue

A. Squamous cell carcinoma

B. Candidosis

C. Syphilis

D. Iron deficiency

E. Crohn’s disease

F. Sjögren syndrome

G. Kaposi sarcoma

H. Paget’s disease

I. Hypothyroidism

J. Septicemia

Updates

Ordering

Order the citric cycle as it occurs. Match each letter

with its proper sequence number



Don’t Forget

• The implementation of Pass/Fail reporting

for candidate performance on National

Boards will take effect on January 1, 2012.

After that date, passing candidates will

receive the status of Pass, “P”, while

failing candidates will receive raw score

information for each discipline with the

status of Fail, “F”.



Don’t Forget

• The dental school profiles will be

discontinued on January 1, 2012 when

score reporting on the National Board

examinations becomes Pass/Fail.

The Joint Commission is developing a

model for providing feedback to dental

schools for evaluation purposes.



• Trends in candidate performance and failure rates on Part I and Part II based on reference groups are presented in Figures 1 to 4 below.

• A reference group is defined as candidates who took the examination for the first time and who enrolled in accredited dental schools.

Score Trends



Figure 1. Part I Average Scores



85.4 85.1 85.5 85.4 85.1 85.7 83.0 81.5 82.6 82.3

49

54

59

64

69

74

79

84

89

94

99

2001 2002 2003 2004 2005 2006 2007 2008 2009 2010

Figure 2. Part II Average Scores



81.9 82.0 81.7 81.5 82.7 81.2 81.1 81.6 79.2 79.8

49

54

59

64

69

74

79

84

89

94

99

2001 2002 2003 2004 2005 2006 2007 2008 2009 2010

Figure 3. Trend in the Failure Rates for Part I



05

101520253035404550

2001 2002 2003 2004 2005 2006 2007 2008 2009 2010

7.6 10.0 9.5 10.0 13.4

7.8 3.5

7.4 5.2 5.3

Figure 4. Trend in the Failure Rates for Part II



05

101520253035404550

2001 2002 2003 2004 2005 2006 2007 2008 2009 2010

6.4 5.5 5.6 7.2 5.6 6.0 6.4 5.3

13.5 10.6

Transition to a Single Exam

Test Administration Updates

Laura M. Neumann, DDS, MPH

Interim Secretary, JCNDE

[email protected]

mailto:[email protected]

Transition to a Single Exam

• Parts I & II will disappear; to be replaced by

single, comprehensive exam

• JCNDE Committee for and Integrated Exam

(CIE) leading process

• Information and progress

– JCNDE Newsletters

– CIE website (pending)

– Questions and feedback to [email protected]

Integrated Exam – Current status

• Model for domain of general dentistry defined

o65 clinical competencies cross-link with

10 areas of scientific foundation

knowledge

oValidation in progress

• Practice analysis planned for mid-2011 >

establish test specifications

• Anticipated implementation – at least 4 years

Policy Updates

• Score reports effective 1/1/12: P or F … no

numerical score unless candidate tested prior

to that date.

• Candidates who have passed may not retest

unless required by state board

• DENTPIN™ required to apply/test.

DENTPIN™

• 8-digit unique personal identifier

• Candidate/student must register him/herself

• Used by:

– DAT, NBDE I & II, NBDHE

– ADEA AADSAS

– TMDSAS

– PASS

– CAAPID

• 35,221 DENTPINs assigned since 2009

Exam Administration Trends

2008 2009 2010

Part I 8,044 9,209 7,696

Part II 6,232 6,449 7,185

NBDE Part I Volume by Month

0

200

400

600

800

1000

1200

1400

1600

1800

2000

2008

2009

2010

NBDE Part II Monthly Volume

0

200

400

600

800

1000

1200

1400

1600

1800

2000

2008

2009

2010

Testing Accommodations Volume

-

20

40

60

80

100

120

140

Jan Feb Mar Apr May June Jul Aug Sep Oct Nov Dec

2009

2010

Reschedule /No-Show Volume

NBDE I NBDE II

Reschedule No-Show Reschedule No-Show

5,483 71%

472 1,610 22%

180

Irregularities

• NBDE I: 1,984

• NBDE II: 2,551

• Incidents resulting in action/penalty:

41 warning letters

31 notices of violation/penalty

o30 appeals

• 4 granted

• 27 denied, including 8 wait time to

retest reduced

See our video:

Cheating Helps No One

http://www.ada.org/2667.aspx

http://www.ada.org/2667.aspx

Questions

• Joint Commission on National Dental

Examinations

211 E. Chicago Ave., Suite 600

Chicago, Illinois 60611

Fax: (312) 587-4105

http://www.ada.org/JCNDE.aspx.

http://www.ada.org/JCNDE.aspx

update on the national board dental examinations - adea€¦ · update on the national board dental...

Documents