icao language proficiency workshop st petersburg, russian federation 24-26 th may 2011 the english...

ICAO Language Proficiency WorkshopICAO Language Proficiency WorkshopSt Petersburg, Russian FederationSt Petersburg, Russian Federation

24-2624-26thth May 2011 May 2011

The English for Aviation Language Testing System

Testing System Description

EALTSEALTS English for Aviation Language Testing SystemEnglish for Aviation Language Testing System

Test PartnersTest PartnersCAA International LtdCAA International LtdLanguage Testing & Assessment Services LtdLanguage Testing & Assessment Services LtdLocal Test Centres Local Test Centres

Test ProductsTest ProductsCAAiCAAi ICAO Expert Level 6 Assessment ICAO Expert Level 6 Assessment (CAAi ICAO ELSA)(CAAi ICAO ELSA)CAAi English for Aviation Language Test CAAi English for Aviation Language Test (CAAi EALT)(CAAi EALT)


ICAO GuidanceICAO Guidance

ICAO Language Proficiency SeminarsICAO Language Proficiency Seminars (Montreal 2004 and 2007)(Montreal 2004 and 2007)

ICAO Language Proficiency Regional WorkshopsICAO Language Proficiency Regional Workshops (Regional Locations 2005-2011)(Regional Locations 2005-2011)

ICAO DocumentsICAO DocumentsICAO Doc. 9835 AN/453 Manual on the Implementation of ICAO Doc. 9835 AN/453 Manual on the Implementation of

ICAO ICAO Language Proficiency Requirements (Sept 2004 & Sept 2010)Language Proficiency Requirements (Sept 2004 & Sept 2010)ICAO Doc. AUD001 ICAO Language Proficiency Requirements ICAO Doc. AUD001 ICAO Language Proficiency Requirements – Rated Speech Samples (Version 1.2 ICAO 2007)– Rated Speech Samples (Version 1.2 ICAO 2007)ICAO Cir 318-AN/180 Language Testing Criteria for Global ICAO Cir 318-AN/180 Language Testing Criteria for Global

Harmonisation (July 2008)Harmonisation (July 2008)ICAO Cir 323-AN/185 Guidelines for Aviation English Training ICAO Cir 323-AN/185 Guidelines for Aviation English Training (March 2010)(March 2010)


EALTS DevelopmentEALTS Development ICAO complianceICAO compliance Aviation industry validationAviation industry validation Primary and secondary test users (consultation & feedback)Primary and secondary test users (consultation & feedback) Models of Models of Best Practice Best Practice in language testingin language testing ALTE Code of PracticeALTE Code of Practice VRIP Principles VRIP Principles Quality of ServiceQuality of Service


Testing System Components

CAAi ICAO Expert Level 6 Assessment For native or near native speakers of English

CAAi English for Aviation Language Test For non-native speakers of English

EALT Test of Listening

EALT Test of Speaking

Adaptations for pilot and controller license holders

Four pilot adaptations (FH, FL, RH, RL)

Three controller adaptations (G/T, APP, ACC)


CAAi ICAO Expert Level 6 Assessment

Adherence to ICAO guidance Adherence to ICAO guidance Formal validation of Expert Level 6 proficiencyFormal validation of Expert Level 6 proficiency Assessment of features of language beyond work-related Assessment of features of language beyond work-related

contextcontext Language assessment Language assessment eventevent rather than a language rather than a language testtest Consideration of an individual’s linguistic historyConsideration of an individual’s linguistic history Qualified, trained and certificated assessorsQualified, trained and certificated assessors Documentation of the assessment procedure and resultsDocumentation of the assessment procedure and results

Where the CAAi ICAO ELSA may invalidate the award of anWhere the CAAi ICAO ELSA may invalidate the award of an

Expert Level 6 rating, an individual may be referred to the EALT.Expert Level 6 rating, an individual may be referred to the EALT.


CAAi ENGLISH FOR AVIATION LANGUAGE TEST (EALT)CAAi ENGLISH FOR AVIATION LANGUAGE TEST (EALT)

A test of plain English in the context of aviationA test of plain English in the context of aviation

Allowing candidates to demonstrate extent of ability to:Allowing candidates to demonstrate extent of ability to:

1.1. communicate effectively in voice-only and face-to-face situations; communicate effectively in voice-only and face-to-face situations; 2.2. communicate with accuracy and clarity on common, concrete and communicate with accuracy and clarity on common, concrete and

work-related topics;work-related topics;3.3. use appropriate communicative strategies to exchange messages use appropriate communicative strategies to exchange messages

and to recognise and resolve misunderstandings (e.g. to check, and to recognise and resolve misunderstandings (e.g. to check, confirm, or clarify information) in a general or work-related context;confirm, or clarify information) in a general or work-related context;

4.4. handle successfully and with relative ease the linguistic challenges handle successfully and with relative ease the linguistic challenges presented by an aviation-related complication or unexpected turn of presented by an aviation-related complication or unexpected turn of events;events;

5.5. use a dialect or accent which is intelligible to the aeronautical use a dialect or accent which is intelligible to the aeronautical community.community.

(Ref: ICAO Holistic Descriptors of operational language proficiency)(Ref: ICAO Holistic Descriptors of operational language proficiency)


ENGLISH FOR AVIATION LANGUAGE TESTENGLISH FOR AVIATION LANGUAGE TEST (EALT)(EALT)

EALT Test of ListeningEALT Test of Listening Semi-direct objective test of aural comprehensionSemi-direct objective test of aural comprehension On-line internet mediatedOn-line internet mediated 25 communications25 communications Single task type (multiple choice task)Single task type (multiple choice task) SAY AGAIN optionSAY AGAIN option AdaptiveAdaptive Multiple versions (each a unique test events)Multiple versions (each a unique test events) Simultaneous marking and assessmentSimultaneous marking and assessment


EALT Test of ListeningEALT Test of Listening

Level 2 comprehension checkLevel 2 comprehension check

Candidate hears:Candidate hears:

Tape-script:Tape-script:

ACFTACFT Wareham Tower. Helicopter AE, at the hangars, ready for departure.Wareham Tower. Helicopter AE, at the hangars, ready for departure.

T-AIRT-AIR Helicopter AE, Wareham Tower. At the hangars, cleared for take-off.Helicopter AE, Wareham Tower. At the hangars, cleared for take-off.

ACFTACFT Cleared for take-off, Helicopter AE.Cleared for take-off, Helicopter AE.

(( 5 second pause) 5 second pause)

StatementsStatements

AA Helicopter AE is on the apron.Helicopter AE is on the apron.


BB Helicopter AE is cleared for take off.Helicopter AE is cleared for take off.

(( 5 second pause before the start of the next recording) 5 second pause before the start of the next recording)


EALT Test of ListeningEALT Test of ListeningCandidate screenCandidate screen

Candidate hears:Candidate hears:

Tape-script:Tape-script:

ACFTACFT Centre, Moonfleet 844. We are being intercepted by a military aircraft…Centre, Moonfleet 844. We are being intercepted by a military aircraft…correction, two military aircraft. One is now flying alongside to starboard. I correction, two military aircraft. One is now flying alongside to starboard. I have lost visual contact with the other. I think it’s above or behind us.have lost visual contact with the other. I think it’s above or behind us.

ACCACC Roger, Moonfleet 844. The aircraft are not transponding. You are very close Roger, Moonfleet 844. The aircraft are not transponding. You are very close to restricted military airspace at the moment. Suggest you turn south.to restricted military airspace at the moment. Suggest you turn south.

ACFTACFT Moonfleet 844. Roger. The pilot of the military jet to starboard is pointing to Moonfleet 844. Roger. The pilot of the military jet to starboard is pointing to the south also. Am turning away now.the south also. Am turning away now.

ACCACC Roger, Moonfleet 844. Continue turn and confirm new heading.Roger, Moonfleet 844. Continue turn and confirm new heading.


StatementsStatements

AA Moonfleet 844 is being intercepted by two military aircraft.Moonfleet 844 is being intercepted by two military aircraft.


BB One of the aircraft is flying alongside to starboard, the other to port.One of the aircraft is flying alongside to starboard, the other to port.


CC Moonfleet 844 has entered restricted military airspace.Moonfleet 844 has entered restricted military airspace.


DD Moonfleet 844 is turning south heading 190 degrees.Moonfleet 844 is turning south heading 190 degrees.

(( 5 second pause before the start of the next recording) 5 second pause before the start of the next recording)


EALT Test of ListeningEALT Test of ListeningCandidate screenCandidate screen


ENGLISH FOR AVIATION LANGUAGE TEST (EALT)ENGLISH FOR AVIATION LANGUAGE TEST (EALT)

EALT Test of SpeakingEALT Test of Speaking Direct face-to-face standardised interviewDirect face-to-face standardised interview Paired candidatesPaired candidates Paired examinersPaired examiners Range of professionally relevant tasksRange of professionally relevant tasks Elements of face-to-face and voice only communicationElements of face-to-face and voice only communication Multiple independent assessments (Multiple independent assessments ( livelive and and post-testpost-test)) Assessors with AOE applying the predictive criteria of the ICAO Assessors with AOE applying the predictive criteria of the ICAO

Holistic Descriptors of operational language proficiencyHolistic Descriptors of operational language proficiency Assessors with LSE applying the descriptive, linguistically Assessors with LSE applying the descriptive, linguistically

analytic criteria of the ICAO Rating Scaleanalytic criteria of the ICAO Rating Scale


EALT Test of SpeakingEALT Test of Speaking

Task 1: Inform and describeTask 1: Inform and describe

Task type Task type and and formatformat

The interlocutor leads the interaction with the two candidates with a The interlocutor leads the interaction with the two candidates with a series of spoken prompts on familiar topic frames drawn from the series of spoken prompts on familiar topic frames drawn from the candidates’ own specific environment of aviation operations.candidates’ own specific environment of aviation operations.

FocusFocus

Responding to prompts requiring information and description and Responding to prompts requiring information and description and expanding on responses. General language of professional and expanding on responses. General language of professional and operational interaction and communications in the context of operational interaction and communications in the context of aviation on common, concrete and work-related topics.aviation on common, concrete and work-related topics.

TimingTiming 5-6 minutes5-6 minutes



Task 2: Monitor, check, confirm, clarify and reportTask 2: Monitor, check, confirm, clarify and report


Two-way discussion between the candidates. Two-way discussion between the candidates.

In a voice only exchange, candidates check, confirm and clarify the In a voice only exchange, candidates check, confirm and clarify the nature and details of a situational complication or non-routine nature and details of a situational complication or non-routine incident presented as a radio-telephone communication in a incident presented as a radio-telephone communication in a recorded aural prompt. One candidate may be nominated to recorded aural prompt. One candidate may be nominated to present a brief report in plain English.present a brief report in plain English.

FocusFocus

Aural comprehension; expressing factual details; turn-taking Aural comprehension; expressing factual details; turn-taking (initiating and responding appropriately); checking, confirming and (initiating and responding appropriately); checking, confirming and clarifying; collaborating in the exchange of information; negotiating clarifying; collaborating in the exchange of information; negotiating agreement and understanding; expressing agreement and/or agreement and understanding; expressing agreement and/or disagreement; describing incidents and events; reporting disagreement; describing incidents and events; reporting communications (gist and details); making a concise oral report.communications (gist and details); making a concise oral report.



EALT Test of EALT Test of SpeakingSpeakingTask 3: Explain and discussTask 3: Explain and discuss


Individual long speaking turn followed by questions or comment Individual long speaking turn followed by questions or comment from the listening candidate.from the listening candidate.

The candidates are required in turn to present a briefing of The candidates are required in turn to present a briefing of approximately 2 minutes’ duration on a given scenario of a specific approximately 2 minutes’ duration on a given scenario of a specific aviation-related unusual circumstance or emergency situation. aviation-related unusual circumstance or emergency situation. Candidates structure their responses following a series of Candidates structure their responses following a series of generalised prompts. The listening candidate is instructed to ask generalised prompts. The listening candidate is instructed to ask one or two rounding-off questions or to comment further at the end one or two rounding-off questions or to comment further at the end of the speaking candidate’s turn. of the speaking candidate’s turn.

FocusFocusSustaining a long turn; managing discourse by giving specific Sustaining a long turn; managing discourse by giving specific information; explaining and discussing the communication information; explaining and discussing the communication requirements of unusual circumstances or emergency situations.requirements of unusual circumstances or emergency situations.



EALT Assessment and RatingsEALT Assessment and Ratings

EALT Test of ListeningEALT Test of ListeningSimultaneous, automated, objective assessmentSimultaneous, automated, objective assessment


IIndependentndependent ‘live’ and post-test subjective assessments‘live’ and post-test subjective assessments

Assessment combining evidence from a minimum of five Assessment combining evidence from a minimum of five independent sources to achieve scores in each of the independent sources to achieve scores in each of the discrete features of speech and a final rating.discrete features of speech and a final rating.

EALT Test ReportEALT Test Report EALT Appeal ProcessEALT Appeal Process


With thanksWith thanks

Further detailsFurther [email protected]@ealts.com

www.ealts.comwww.ealts.com

(CAAi EALT sample and demonstration material available)(CAAi EALT sample and demonstration material available)

[email protected]@caainternational.com

www.caainternational.comwww.caainternational.com

icao language proficiency workshop st petersburg, russian federation 24-26 th may 2011 the english...

Documents

language testconsideration

aviation english training

icao cir

icao documentsicao

accealts english

aviationrelated complication

assessment adherence

assessment procedure