the elpac test - a case study meetings seminars and workshops/lpri... · icao – eurocontol...

ICAO – EUROCONTOL Workshop on Language Proficiency Requirements ImplementationLangen, September 6th & 7th 2007

ELPACEnglish Language Proficiency for Aeronautical Communication

Strategies for test development and sustainability

The ELPAC test - a case study

Adrian EnrightEUROCONTROL

(European Organisation for the Safety of Air Navigation)Luxembourg


ELPAC

Approaches to test development

Test development strategies

Sustaining the ELPAC Test


Test specifications

Experience as PRICE SG member

ICAO criteria + holistic descriptors

Needs analysis

Assessing ICAO levels 4 and 5

ELPAC rating scale = ICAO scale


Test development team

Project leader:Adrian Enright, Eurocontrol

Language testing expert:Magdalena Večeřová, Czech Republic

ATC and English language experts (part time)

Bulgaria, Czech Republic, France, Germany, Hungary, Spain and Eurocontrol

Language testing consultant (part time)Dr. Rita Green, United Kingdom


ELPAC Glossary

Aviation terms explained1. “light chop” …


“Light chop”

With acknowledgements to Martin Germans

Radar, we’ve got some light chop at this level …


Support

Software:ENOVATE S.A. Norway

Validation:Lancaster University, England

Stakeholders:ANSPs

NSAs

Controllers …


Cycle of test development

Item writingItem writing

TriallingTrialling

AnalysisAnalysis

EvaluationEvaluation

ModificationModification

ReviewReview

FeedbackFeedback


ELPAC






Test papers

Guidelines

Rating scale

Trialling

External validation

Sample tests

Informing stakeholders


Test Papers

Paper 1 – Listening ComprehensionInternet basedTrained & accredited marker

Paper 2 – Oral InteractionNon-visual & visual communicationTrained & accredited examiners (2)–interlocutor & assessor

ICAO Levels 4 & 5


Supporting material

Guidelines for administrators, markers, examiners, test takers…Bio dataFeedbackSelf-assessment of proficiency in EnglishReports


ELPAC Glossary

Aviation terms explained2. “heavy …”


“Heavy…”


Maastricht, Speedbird 124 Heavy …

Speedbird 124. Maastricht heavy, go ahead …


Trialling

5 trialling exercises+/- 700 controllers21 States Workshops for administrators and examinersSample versions available since January 2007


Validation

Internal on a regular basis

External by Lancaster University, UKInitial May 2006

Final June 2007

For an executive summary of the report go to www.elpac.info (ELPAC Validation)


Communicating

Essential to keep all stakeholders informed of progress in test development:

Air Navigation Service ProvidersNational Supervisory AuthoritiesAir traffic controllers

By means of:PresentationsBriefingsSample test versions (www.elpacsample.info)Web site (www.elpac.info)


ELPAC






Develop action plan

Licence Agreement

Training workshops

Test maintenance

User Group


1. Implementation

1. Sign Licence Agreement with EUROCONTROL

2. Testing personnel satisfactorily complete self-study package and training workshop

3. Successful participants recommended for accreditation

4. Passwords and access to ELPAC given to National Administrator


ELPAC Glossary

Aviation terms explained3. “Division of airspace …”



Division of airspace …


2. Maintenance

Regular feedback from ELPAC Test administrators

Continuous trialling of new items

New versions available

Set up “User Group”

Evaluate test performance

Annual workshops for examiners


ELPAC September 2007

ELPAC development completed on time

Project validated by Lancaster University

Licence agreement signed by at least 16 States/Organisations

Accreditation workshops start 10.09.07

Testing for approximately 4000 controllers will start end September


How far are you going to go without a language proficiency endorsement in your

licence?

March 5th 2008

May 17th 2010


ELPACELPAC

English Language Proficiency for English Language Proficiency for Aeronautical CommunicationAeronautical Communication

Adrian Enright

EUROCONTROL

ELPAC Project Leader

www.elpac.info

www.elpacsample.info

the elpac test - a case study meetings seminars and workshops/lpri... · icao – eurocontol...

Documents