ExaminerNational Board of Medical Examiners3750 Market StreetPhiladelphia, PA 19104-3102

www.nbme.org

Spring/Summer 2014 Volume 61, Number 1

The Membership of the National Boardof Medical Examiners held its 100thAnnual Meeting in Washington, DC onApril 3-4, 2014. The meeting beganwith a plenary session on the morningof April 3 that included the roll call; wel-come remarks by the Chair, Dr. Lewis R.First; ratification of appointments of rep-resentative members; and approval ofthe 2013 Annual Meeting minutes.

NBME Centennial Activities

On April 3 and 4, the NBMEMembership heard presentations andparticipated in activities related to cele-brating this 100th Annual Meeting ofthe NBME Membership marking thebeginning of NBME’s centennial year.

Blue Book Examination

At the start of the meeting prior to theofficial call to order, Dr. First directed asession during which meeting partici-pants used blue books and a No. 2 pen-cil to answer essay questions drawnfrom the NBME’s first examination,administered in 1916. In a subsequentsession later in the meeting, StepCommittee Chairs Drs. Yasyn Lee andWilliam Raszka displayed scans of audi-ence responses to this exercise, com-mented on them, and presented infor-mation comparing current knowledge to

In This Issue:

1 The 100th Annual Meeting of theMembership of the National Board

of Medical Examiners

1 Protecting the Integrity of the USMLE®

7 Robyn Tamblyn Receives the 2014 John P. Hubbard Award

8 Introducing NBME U

9 Joining Forces Update

11 New Collaboration for Veterinary Assessments (CVA)

12 Introducing Our Centennial Video: What Is the NBME?

13 2015 John P. Hubbard Award Call for Nominations

scientific and medical knowledge ofthese topics in 1916.

100th Annual Meeting Welcome

Dr. First welcomed special guests, includ-ing NBME Executive Board alumni, pastrecipients of NBME’s DistinguishedService Award, senior staff retirees, guestrepresentatives of national medicalorganizations and peer organizations,and a descendant of NBME’s founder,Dr. William L. Rodman. Dr. First wel-comed guests joining the meeting viawebcast and provided information onsocial media and other methods of com-municating during the meeting. Heasked meeting participants to think

Since its inception in 1992, the USMLE has delivered over twomillion individual test administrations to both domestic andinternational medical students and graduates. Measuresdesigned to achieve a secure testing environment for these high-stakes examinations are the primary reason the majority of the

examinees pass through without incident. Examples of these security measures includesecure handling of test materials from the development to delivery stage, identitychecks by proctoring staff, video recording of all test administrations, and routine sta-

(continued on page 10)

(continued on page 4)

© 2014 NBME

The 100th Annual Meeting of the Membershipof the National Board of Medical Examiners

Protecting the Integrity of the USMLE®

FOR STUDENTS

2

1 Attendees completing the blue book exercise

2 Dr. Lewis First presents opening remarks

3 Dr. Donald Melnick discusses the formation of the

NBME in 1915

4 Actor portraying NBME founder Dr. William Rodman

5 Actor portraying Dr. B. D. Harrison of Michigan,

who opposed the formation of the NBME

6 Centennial Steering Committee Chair,

Dr. Ruth Hoppe

7 Dr. Melnick presenting certificate of appreciation

to Rodman descendant, Ms. Eunice Packer Murphy

The 100th Annual Meeting of theNational Board of Medical Examiners

1

2

3

54

7

6

3

1 Dr. First presents Distinguished Service Award

to Dr. Roger Berkow

2 Dr. First presents Distinguished Service Award

to Dr. Kathleen Liscum

3 Dr. First presents Distinguished Service Award

to Dr. Joseph Zenel, Jr.

4 Dr. First presents Distinguished Service Award

to Dr. Frank Celestino

5 Actor portraying Dr. John P. Hubbard interacts

with video of Dr. Edithe Levit

6 Panel discussion led by Dr. Tallia and including

Drs. Piemme, Kirch and Chaudhry

7 President emeritus Dr. L. Thompson Bowles

8 Attendees watching the debut of the centennial

video

9 Dr. Hoppe with staff members Ann King and

Gail Furman

10 University of Maryland School of Medicine’s

Hippocratic Notes entertaining at dinner

5

76

8

9 10

41 2 3

4

about and email their ideas on coreprinciples that NBME needs to protectand that might be used as themes forthe 2015 Centennial Meeting. He notedthat this 100th Annual Meeting wasbeing held at the Willard Hotel becauseit was the site of NBME’s May 5, 1915meeting of organization. He provided anoverview of the rest of the meeting.

1915-1950: Creating Standards andan Unusual Opportunity to Be ofBenefit to the General Public

Dr. Melnick led a session on the 1915founding of the NBME and its evolutionto 1950. His presentation began byfocusing on the medical regulatory,national, and international environmentsurrounding the founding of the NBME.As Dr. Melnick profiled the founders andoriginal members, actors playing Dr. B.D.Harrison of the Michigan State Board ofRegistration in Medicine and NBME’sfounder, Dr. William L. Rodman, provideda living history portrayal. Using languagefrom publications authored by each doc-tor during the period of NBME’s found-ing, the actors playing Drs. Harrison andRodman depicted the controversy withinthe medical community through a debateof the pros and cons of Dr. Rodman’sproposal to establish the NBME.

Following the living history portrayal, Dr.Kenneth Ludmerer spoke about the envi-ronment in medicine and medical educa-tion that spawned interest in creating aNational Board of Medical Examiners,including Dr. Abraham Flexner’s study ofmedical education published in 1910.

Dr. Melnick focused attention on thecontributions of NBME’s founder and hisson, Drs. William Rodman and J. StewartRodman, respectively, including StewartRodman’s lifetime of service to theNBME. Ms. Eunice Packer Murphy,granddaughter of Stewart Rodman,accepted a certificate recognizing theimmense contributions of the Rodmanfamily to the creation and success of theNBME. Dr. Melnick presented informa-tion on financial support provided forthe creation and early continuance ofNBME through donations from organiza-tions such as the Carnegie Foundation.He concluded this session by notingevents in NBME history between 1915and 1950, including a change from asix-day to three-part examination in1922 and expansion of examination usefrom the 1920s to 1950.

1950-1970: “Ever More Precisely”and the Science of Measurement

NBME staff member Dr. Howard Wainerdiscussed key events in the history oftesting for medical licensing. Noting theconfluence of the 100th anniversary ofthe founding of the NBME and the4,000th anniversary of the founding oftesting, Dr. Wainer provided a “whirlwindtour” of the pathway from 1986 BC inChina, attributed with discovery of thefundamental tenet of testing, to themodern era of assessment of health pro-fessionals. Dr. Wainer emphasized thespecial role played by Dr. John P.Hubbard, NBME’s chief executive from1950 to 1974, in transforming the exam-inations and growth of services of theNBME.

Following Dr. Wainer’s presentation, anactor portraying Dr. Hubbard interactedwith video clips of Dr. Edithe Levit inter-viewing a retired Dr. Hubbard aboutmemories of his career and his leader-ship of the NBME. PowerPoint slidesincluded demonstration of discontinuedtesting formats: the patient-manage-ment problem and a component of thePart III examination using motion pic-tures. Via an audience response system,Dr. First engaged meeting participants inteams competing to answer a series oftest questions drawn from 1950-1960archival materials.

1970-1990: Evaluation along theContinuum; NBME Goals, Priorities,and Collaborations

Dr. Alfred Tallia led an hour-long sessionexploring two topics from eras in NBMEhistory. The first topic focused onNBME’s 1973 publication of the Reportof the Committee on Goals andPriorities (“GAP Committee”) of theNational Board of Medical Examiners,Evaluation in the Continuum of MedicalEducation, also known as the GAPReport. The second topic focused on thecollaboration among multiple organiza-tions represented by the Task Force toStudy Pathways to Licensure and its1989 publication, A Proposal for aSingle Examination for MedicalLicensure.

Using a talk show format, Dr. Tallia inter-viewed guest panelists: Drs. HankChaudhry of the Federation of StateMedical Boards, Darrell Kirch of theAssociation of American MedicalColleges, and Thomas Piemme, original

(The 100th Annual Meeting , continued from page 1)

member of the GAP Committee. Theyexplored connections of recommenda-tions studied in the 1973 and 1989publications with later changes inassessment of health professionals,recent and current activities echoingthese recommendations, and the hopefor a future state in which increased col-laboration among peer organizations inmedical education, assessment, and reg-ulation leads to shared approaches toadvancement in the assessment andpractice of medicine.

Dr. Tallia used an audience response sys-tem to engage meeting participants inanswering samples of test items drawnfrom 1970-1980 archival materials.

1990 to the Present: “ContinuousImprovement”

In a 90-minute afternoon session onApril 3, meeting participants divided intosix small groups to rotate among NBMEstaff demonstrations of products andservices: NBME U (see page 8), Pivio,multimedia in assessments, clinical skillsassessment, the Global EvaluationManagement System and CustomizedAssessment Services, and Primum®

Computer-based Case Simulations.

Presentation of the 2014Hubbard Award

During the April 3 Annual Meetingluncheon, the 2014 John P. HubbardAward was conferred on Dr. RobynTamblyn in recognition of her remark-able leadership in assessment, includingher work to study the link between eval-

uation programs and actual outcomes ofcare (see page 7).

Why Do We Volunteer to Servethe NBME?

On April 3, Dr. Ruth Hoppe explored thevolunteerism at the heart of manyNBME activities and to which individualspresent at the 2014 Annual Meetingwere important contributors. Dr. Hoppepresented selected excerpts of submis-sions collected in advance of the meet-ing from individuals reflecting on theirtime as volunteers for the NBME.Themes reflected in the submissionsincluded learning and growth (gettingmore than giving); satisfaction in a highpurpose (giving to the profession and tocommunity and making a difference);working amid high standards of excel-lence; and fun and friendship. Dr. Hoppeelicited additional comments on NBMEexperiences from the audience.

Debut of NBME CentennialVideo

At a reception prior to the AnnualMeeting dinner on April 3, Dr. L.Thompson Bowles introduced the firstpublic viewing of NBME’s centennialvideo, “What Is the NBME?” The videois available at www.nbme.org.

State of the Board

In a morning session on April 4 that wasmoderated by NBME Vice Chair LynnCleary, the NBME Chair, President, andTreasurer provided PowerPoint presenta-tions linking NBME past and present.

Dr. First’s presentation included notablefirsts in NBME history, key past eventsand evolution of NBME governance andstructure, examples of parallels betweenhistorical governance issues and thework of NBME governance today. Dr.First also shared expressions of appreci-ation for the extraordinary contributionsof NBME volunteers and staff to accom-plishing the mission and goals of theNBME.

Dr. Melnick’s presentation included areview of NBME programs and servicesover the past 100 years. Dr. Melnicktraced NBME development and growthin pursuit of its mission: services forlicensing authorities and medicalschools; assessment for internationalgraduates; services for sister organiza-tions; and services for medical students,residents, and practicing doctors.

Ms. Suzanne Anderson’s presentationincluded an overview of NBME fiscal his-tory, including decades with no exami-nation fee increases, long periods inwhich revenue was provided primarily byexternal contributions and charitablefunding, and no reserves or investmentsto support operations and developmentuntil later years.

Reports of the Executive Board,Treasurer, and Audit Committee

After receiving written reports from theExecutive Board, Treasurer, and AuditCommittee, the NBME Membershipacted to accept these reports as agroup.

5

(continued on page 6)

Amendments to NBME Bylaws

Dr. First provided comments supplement-ing agenda materials on updates tothree sections of the NBME Bylaws toreflect the restructuring of USMLE over-sight committees arising from theComprehensive Review of USMLE. Afterproviding an opportunity for discussionof the amendments, the Membershipapproved the amendments to theBylaws.

“An Unusual Opportunity to Beof Benefit to the GeneralPublic” – Revisited

Ms. Suzanne Anderson introduced a ses-sion inspired by part of a sentenceincluded in the May 5, 1915 minutes ofthe NBME meeting of organization. Thetext appears to be attributed to Dr.Rodman, NBME’s founder: “The Boardnow seemed to have an unusual oppor-tunity to be of benefit to the generalpublic.” Ms. Anderson spoke of the ini-tial words in the first sentence ofNBME’s mission statement, addressingthis core component of NBME’s purpose:“To protect the health of the publicthrough state of the art assessment ofhealth professionals.” She describedcontributions to NBME’s public engage-ment made possible by the activities ofthe Public Stakeholders Committee,which had been established in 2008.She noted its work products and recom-mendations, including the establishment

of an Office of Public Engagement, forwhich a full time staff program officerwas appointed in 2013.

Ms. Anderson introduced Mr. DavedeBronkart, the author of Let PatientsHelp: A Patient Engagement Handbook.One of the world’s leading advocates forpatient engagement, Mr. deBronkartprovided a presentation highlighting hishealthcare experiences and calling forsupport from healthcare professionalsand patients to be equal partners inpatients’ health.

Core Principles

Near the end of the meeting, Dr. Clearypresented ideas submitted throughoutthe meeting on core principles thatNBME needs to protect and that mightbe used as themes for the 2015Centennial Meeting. Using audienceresponse, Dr. Cleary collected rankingsfrom meeting participants on the princi-ples submitted.

Preview of NBME CentennialYear

Dr. Hoppe, Chair of the CentennialSteering Committee, summarized NBMEplans for its centennial year, beginningwith this 100th Annual Meeting andconcluding with the Centennial Meetingon May 4-5, 2015. Other events includeNBME appearances at other annualorganizational meetings, monthly staffevents featuring NBME moments in his-tory, a display incorporating historical

items, centennial gifts and mementos,and a gala dinner for staff in April 2015.

Dr. Tallia, Chair of the CentennialProducts Committee, provided informa-tion on the centennial video (see page12), plans to launch a centennial historywebsite, NBME U learning modules (seepage 8), and potential publication of acentennial compendium.

Dr. Graham McMahon, Chair of theCentennial Meeting Program Committee,described the Centennial PrizeCompetition, “Innovation in FutureAssessment of Health Professionals,”and plans to judge competition finalistsand announce the prize winner at theMay 4-5, 2015 Centennial Meeting.

Dr. W. T. Williams, Jr., Chair of theCentennial Philanthropy Committee,announced that the recipients of theNBME Centennial Awards Program forLatin America are three consortia ofmedical schools in Argentina, Chile, andMexico.

Distinguished Service Awards

Dr. First presented the Edithe J. LevitDistinguished Service Award to fourmembers concluding terms of service: Drs.Roger Berkow, Frank Celestino, KathleenLiscum, and Joseph Zenel, Jr. Dr. Firstdirected attention individually to theirvaluable contributions and many years ofloyal NBME service, and he expressedhope for their continued connections withthe NBME in other capacities.

6

(The 100th Annual Meeting , continued from page 5)

related to NBME’s mission to protect thehealth of the public, such as the rela-tionship of test scores and practice per-formance, validation of the outcomes ofcertification and licensure examinations,and pioneering work in the methodologyto show the link between evaluationprograms and actual outcomes of care.As noted by colleagues, Dr. Tamblyncompletely fulfills, in a stellar fashion, allfour categories of achievement for theaward. She was one of the pioneers inthe development of performance assess-ment, working with the giants in thefield, such as Howard Barrows, the veryfirst Hubbard Award recipient.

"Dr. Tamblyn’s extraordinary academiccareer has resulted in a plethora of the-

matically related, sequentially developedstudies to assess the overall issue ofwhether the public is being protected inthe healthcare system. She has been apioneer in use of standardized patientsand practice-based assessment andfeedback. As one example, Dr. Tamblyn’suse of large data sets and online feed-back systems to document, guide, andpromote quality in prescribing practicesis both innovative and unique. She hasset a standard that few, if any, havebeen able to emulate.

"A strong case can be made that thecurrent widespread acceptance and uti-lization of performance-based assess-ment in medical education, both in theUS and beyond, is due in large part tothe seminal work that she did, startingwith the development of OSCEs, includ-ing training regimes for standardizedpatients, and moving toward the valida-tion of the outcomes of certification andlicensure examinations.

"Dr. Tamblyn’s work has had nationwideand global impact. Consistent with hergoal to help ‘protect the public,’ many ofher studies were enabled by effectivecollaboration between academic andregulatory bodies, no small feat. No oneelse in North America of whom I amaware has had such a major impact onassessment of performance in the work-

7

PROFILE

Robyn Tamblyn, BScN, MSc, PhD wasselected as the recipient of the 2014John P. Hubbard Award. The award isgiven to individuals who have madeoutstanding contributions to the pursuitof excellence in the field of evaluation inmedicine. John J. Norcini, PhD, Chair ofthe 2014 Hubbard Award Committee,announced Dr. Tamblyn’s selection at theAnnual Meeting of the NBMEMembership on April 3, 2014.

In presenting the award, Dr. Norcinistated: "In recognition of her outstand-ing contributions to evaluation in medi-cine, I am pleased to announce that therecipient of the 2014 Hubbard Award isRobyn Tamblyn. Dr. Tamblyn’s contribu-tions include seminal work in this field

Robyn Tamblyn Receives the 2014 John P. Hubbard Award

Dr. Tamblyn with members of the 2014 Hubbard Award Committee and Drs. First and Melnick

(continued on page 12)

NBME U is an online collection of lessons for individuals interested in learning a range of topics relevant tohigh-quality assessment. NBME U was conceived as a “give back” to the academic medicine community aspart of our centennial celebration. Lessons are provided free to learners through May 2015. The centennialyear course, Assessment Principles, Methods, and Competency Framework, includes the following lessons:

Visit the NBME U learning portal to enroll today: https://nbmeu.desire2learn.com

*NBME U is not an educational institution, and the information and services provided through the NBME U website are not part of an accreditedor state-approved educational program.

8

Introducing NBME U*

Section Lesson Title (Lessons in bold are currently available. The remaining lessons will be added throughout the year)

Principles General Lesson on Assessment—Types of AssessmentTest Blueprinting I: Selecting an Assessment MethodTest Blueprinting II: Creating a Test BlueprintScoring PrinciplesTest Score Reliability OverviewValidity and Threats to ValidityCombining Scores for Making DecisionsSetting the Cut ScoreHow to Report Results: Feedback to Trainees and Programs

Method: Multiple-Choice Questions(MCQs)

Purposes, Types, and Educational Uses of MCQsAssessing Application of KnowledgeStructuring MCQsMCQ Flaws and How to Avoid ThemWriting MCQs to Assess Application of Clinical Science KnowledgeWriting MCQs to Assess Application of Basic Science KnowledgeStrategies for Organizing Item Writing and ReviewIncorporating Graphics and Multimedia into MCQsTest Statistics and Generalizability Theory for MCQ ExamsSetting Pass/Fail StandardsItem Analysis and Key Validation

Method: Objective Structured Clinical Examination (OSCE)

Working with Standardized Patients for AssessmentAn Introduction to the Use of Generalizability Theory in OSCEsReality Check: Promoting Realism in Standardized PatientsStandardized Patient Quality ControlScoring and Validating Rating ScalesTraining RatersElements of Case DevelopmentConsiderations in Designing Exam Space

Method: Workplace-based Assessment Brief Overview of Common Methods and RationaleDelivering an Effective Feedback SessionAssessing Routine Behaviors Over Multiple OccasionsEncounter-based MethodsValidity Issues: Strategies to Improve Reliability and Validity

Competencies Professionalism

NBMESM

INSIDE THE NBME

In the spring/summer 2012 issue of theExaminer, NBME announced its commit-ment to the Joining Forces initiative, aprogram launched by First Lady MichelleObama and Dr. Jill Biden to recognizeand honor America’s veterans and mili-tary families. Facilitating and improvingwellness among the troops, veterans andtheir families is a major goal of JoiningForces. The fall/winter 2013 issue of theExaminer described plans for the forma-tion of task forces of content expertsfrom the Veterans Administration, theUniformed Services University of theHealth Sciences, and physicians from allbranches of the military. These taskforces will develop test questions on thepsychological and physical problems ofveterans, returning deployed servicemenand women, and the families of de-

ployed servicemen and women, to be in-cluded in the USMLE Step examinationsand to develop a medical school subjectexamination dedicated to this topic.

The NBME is deeply grateful for the sup-port of the Veterans Administration,which awarded a fixed price contract tothe NBME to fund two 12-14 membertask forces each year for two years inorder to generate rapidly the examina-tion content needed to cover this impor-tant topic.

Each of the two task forces will comprisecontent experts of relevant subject do-mains, including traumatic brain injury,blast injuries, rehabilitation from blast in-juries, spinal cord injuries (acute careand ongoing care), hearing loss, environ-mental toxin exposure, infectious dis-eases endemic to western Asia,post-traumatic stress disorder, depres-sion, suicidal ideation, anxiety, alcoholand drug use (including prescription druguse), military sexual trauma, intimatepartner violence, and psychological andpsychiatric conditions of families of de-ployed servicemen and women (includ-ing spouses, significant others andchildren).

NBME Member Karen Sanders, DeputyChief, Office of Academic Affiliations, Vet-erans Health Administration, was instru-mental in helping NBME obtain thefunding and support for this initiative.“Due to the increasing importance ofveteran-related health issues, and espe-cially the recognition of mental health is-sues of returning service members andveterans, the VA has entered into thiscontract with NBME,” says Dr. Sanders.“The VA hopes that embedding thesetopics into the USMLE will increase theformal placement of these items intomedical school curricula. The USMLE isthe first but not the last licensing examthat the VA hopes to influence in termsof veteran and military health content.We will be working with other disciplinesand their licensing exams.”

The NBME expects to introduce new mil-itary health content into the USMLE Stepexaminations beginning in 2015. By2016, the content will be covered in allthree Steps of the USMLE.

For more information on Joining Forces, please visitwww.whitehouse.gov/joiningforces.

9

Joining Forces Update

OUT & ABOUT

10

tistical analyses designed to flag anom-alous performance.

However, occasional attempts to subvertthe examination process necessitate acontinuous review of the security meas-ures undertaken to curtail efforts toundermine the USMLE. Examples of thisinclude the security measures undertak-en prior to testing day, beginning withtest item development committee mem-bers, who are required to sign a securityand non-disclosure agreement that pre-cludes subsequent involvement with testpreparation courses.

Security measures also exist at the pointof registration. Applicants are requiredto submit a notarized certification ofidentity with a photograph, which isshared between all three registrationentities (NBME, ECFMG, FSMB).Additionally, when an examinee’s appli-cation has been approved, a test form isidentified for that examinee from a ran-dom pool of test forms; any subsequentattempts by the examinee require theassignment of a test form from a sub-group of test forms separate and apartfrom any other test form pool. Thisassures that examinees are not seeingtest content administered to them previously.

On testing day, prior to testing, numer-ous security measures are carried out byexamination proctors to ensure compli-ance with USMLE policies and proce-dures. Proctors play a critical role duringthe testing day, as their vigilance often

deters and/or detects breaches of securi-ty by examinees. In addition to videoand audio surveillance, proctors arerequired to monitor the testing area andwalk through it frequently throughoutthe day. They are also required to submitreports to NBME, alerting the programof any deviation from the standard testadministration or possible testing infrac-tion by examinees.

The USMLE also maintains a qualityassurance program as part of ensuringits testing vendor, Prometric, is compli-ant with test administration protocols,which includes delivering a “reportcard” to each of the Prometric sites. Thisreport card is based on information fromexaminees, as well as “secret shopper”visits. In some instances, the outcome ofa secret shopper visit has resulted in thesuspension of USMLE test administra-tions at that site.

After testing day, in addition to ongoingquality assurance activities, all proctorreports are routed to USMLE staff forreview. Some may be dismissed asbenign; others may trigger a more for-mal review and/or investigation andmay result in a referral to the USMLECommittee for Individualized Review(CIR), which meets approximately five tosix times per year, for review and adjudi-cation of allegations of irregular behav-ior and score validity. Some examples ofirregular behavior include, but are notlimited to, seeking, providing, and/orobtaining unauthorized access to exami-nation material, altering or falsifyingUSMLE documents, possession of unau-thorized materials in the secure testing

area, and proxy testing. The sanctionsthat the CIR imposes can include anno-tation of the USMLE transcript, reportingto the FSMB Board Action Data Bank,and a bar from sitting for any USMLEexamination for a specified period oftime – one to three years is the norm,although lifetime bars can and havebeen imposed.

One of the major challenges facing theUSMLE involves examinee “chatter” fol-lowing test administrations, particularlywhen examinees share exam contentonline. To address this issue, USMLEstaff routinely monitors internet sitesfocused on the USMLE. Additionally, var-ious measures have been implementedto prevent and/or discover the disclosureof proprietary examination content,including ongoing research by USMLEstaff, the implementation of a securitytip line, and statistical analyses toreview anomalous performance, whichmay be triggered by an unusually largeincrease in score from one administra-tion to the next, performance at orbelow chance level, or unusual responsepatterns.

The security measures mentioned repre-sent only a sample of the efforts thatstaff from all three registration organiza-tions undertakes to ensure the USMLEremains secure and uncompromised. Ifyou would like more information aboutsecurity efforts or have questions relatedto information listed in this article,please visit USMLE’s website atwww.usmle.org/security.

(Protecting the USMLE® , continued from page 1)

On February 27th, Dr. Donald E. Melnick,NBME President, and Dr. John R. Boyce,Executive Director of the National Boardof Veterinary Medical Examiners(NBVME), signed an agreement, threeyears in the making, establishing a newcollaboration between the NBME andthe NBVME to co-sponsor the NorthAmerican Veterinary Licensing Examina-tion (NAVLE).

Dr. Melnick noted that “the NBME is veryexcited about this opportunity to joinforces with another organization thathas exactly the same kind of mission —that has been focused on protecting thehealth of our nation through assessmentof professionals.” This collaboration rep-resents a significant step forward in the“One Health” movement to strengthenconnections between physicians, veteri-

narians, public health professionals, envi-ronmental scientists, and other health-related science professions. Bothorganizations believe there is great op-portunity in drawing closer ties betweenhuman health and the health of animalsand our environment.

The two organizations have a long his-tory of working together. The NBVMEhas been a client of the NBME throughcontractual agreements since 1998. Withthe evolution of this client-vendor rela-tionship into the present collaborativerelationship, the organizations aim to in-crease efficiency, foster enhancements tothe NAVLE program, and encourage thedevelopment of new exam item types.

On May 2, representatives from NBVMEand NBME came together for the firstGovernance Committee meeting of thenewly formed CVA. The committee pro-posed a list of several possible enhance-ments to the NAVLE that will be furtherdeveloped by staff to be explored duringthe next several meetings of this gover-nance group.

11

New Collaboration for Veterinary Assessments (CVA)

INSIDE THE NBME

Drs. Boyce and Melnick signing the agreement to co-sponsor the NAVLE.

12

place, coupled with feedback mecha-nisms that have the potential to changebehavior and influence credentialingand licensing practices.”

Dr. Tamblyn is Professor of Medicine andEpidemiology at McGill University,Scientific Director for the Institute forHealth Services and Policy Research at

the Canadian Institutes for HealthResearch, and Medical Scientist atMcGill University Health Centre.

The NBME established the HubbardAward in 1983 in special tribute to thelate John P. Hubbard, MD. Honoring Dr.Hubbard as a principal, guiding force ofthe NBME, this award acknowledges hiscreative and inspired leadership of theorganization during his 25-year tenure

as its chief executive. Dr. Tamblyndeservedly joins the ranks of the distin-guished individuals whom the NBMEhas honored over the years with thisprestigious award. The 2014 HubbardAward Committee, chaired by John J.Norcini, PhD, included as membersFreda M. Bush, MD, Kevin W. Eva, PhD,Kenneth M. Ludmerer, MD, MA, MiguelA. Paniagua, MD, and Mark R.Raymond, PhD.

As part of our centennial celebration, the NBME has developed a 10-minute video to describe our organization, its history, itswork today, and its hopes for the future. The video is both humorous and informative, and we hope you will take a few minutesto view it on our website: www.nbme.org.

When you visit the newly designed home page of our website, please take a few additional minutes to explore our plans for thecentennial year, NBME U (see page 8), the Awards Program for Latin America and other activities.

INSIDE THE NBME

Introducing Our Centennial Video: What Is the NBME?

(Robyn Tamblyn , continued from page 7)

13

2015 John P. Hubbard Award Call for Nominations

INSIDE THE NBME

The NBME invites nominations for the 2015 John P. Hubbard Award. This award recognizes individuals whohave made a significant and sustained contribution to theassessment of professional competency and educationalprogram development at any level along the continuumof medical education and delivery of healthcare.

It is expected that the successful candidate will havedemonstrated outstanding achievement in one or more ofthe following areas:

• A substantial record of fostering the development of evaluation methods and/ormeasurement techniques; or

• Personal contributions to basic or applied research in the creation or improvement ofassessment methodology; or

• Accomplishment in improving the quality of evaluation at an organizational level; or

• Contributions through the education or mentoring of students, colleagues, fellows, orgraduate students, to further progress in evaluation.

Please visit www.nbme.org for more information on the Hubbard Award. The deadlinefor submissions is September 10, 2014.

John P. Hubbard