the national foreign language exams for the state certificate of foreign language proficiency in...
TRANSCRIPT
The National Foreign Language Exams for the State Certificate of Foreign Language Proficiency in Greece: The KPG
examination suite
http://rcel.enl.uoa.gr/kpg
21/04/23 1
Professor Bessie Dendrinos, Professor Bessie Dendrinos, President of the KPG Examination Board President of the KPG Examination Board
Hellenic Ministry of Culture, Education and Religious AffairsHellenic Ministry of Culture, Education and Religious AffairsNational & Kapodistrian University of Athens, Aristotle University of Thessaloniki National & Kapodistrian University of Athens, Aristotle University of Thessaloniki
& Computer Technology Institute of the University of Patras & Computer Technology Institute of the University of Patras
21/04/23 2
National Strategic Reference Framework (NSRF) – 2007-2013
The multilingual CALT platformPlatform for the e-training of oral
examiners and script raters (http://galaxy.cti.gr/e-kpg-devel23/)
The KPG e-school (http://rcel.enl.uoa.gr/kpgeschool/)
21/04/23 3
21/04/23 4
Both the computer-based and the paper-based KPG exams contain common:
proficiency scaling (aligned to the 6 level scale of the Council of Europe)
illustrative descriptors (aligned to the CEFR)
accompanying criterial features
(constructivist) view of language-in-use21/04/23 5
The exam suite is based on a generic (portable across languages) methodological framework suitable for describing language performance across proficiency levels.
21/04/23 6
And… across languages, the exams:
test common competences and strategies
are regulated by common specifications
use a common test-task typology
21/04/23 7
Authoring tool Piloting tool Test player
21/04/23 8
21/04/23 9
Diagram showing the flow of roles, and work required to insert test tasks and give final approval
The KPG CALT is developed to test both comprehension and production:
The first part tests:reading comprehensionlistening comprehensionlanguage awareness
21/04/23 10
The CALT is not item but task based. The smallest unit of the comprehension
part is a task, not an item. Three test tasks comprise a ‘testlet’. The candidate’s performance in each
testlet determines what testlet level s/he will be served next.
21/04/23 11
Each testlet is composed of three tasks:
1)One reading comprehension task2)One language awareness task 3)One listening comprehension task There is a common (across languages)
formula as to the mix of the types of tasks that each testlet contains.
21/04/23 12
The KPG CALT contains 10 task types giving us in all 12 types of testlets.
Each task is composed of 5 items as follows: a) items testing comprehension of a
source (written or audio) text b) items testing awareness of correct and
appropriate use of language
21/04/23 13
3 tasks comprise a testlet 3 testlets comprise a testing unit 3-5 testing units comprise a
complete a complete test for each of the lower
levels (Α1-Β1) contains 3 testlets (45 items in total)
a complete test for each of the higher levels (B2-C2 level) contains 4 testlets (60 items).
21/04/23 14
The candidate chooses the level of the testlet s/he wants to start with and then if s/he is successful on 50% of the
items, the next testlet is of the same level
his/her success is below 50%, the next testlet is of lower level
If his/her success is above 50%, the next testlet is of higher level
21/04/23 15
Digital e-test typology
21/04/23 16
21/04/23 17
21/04/23 18
21/04/23 19
21/04/23 20
21/04/23 21
21/04/23 22
21/04/23 23
21/04/23 24
21/04/23 25
21/04/23 26
Production performance is also computer based
The tests on reading and listening comprehension determine the level of the speaking and writing tests in which candidates will be asked to participate
21/04/23 27
TESTING SPEAKING &ORAL MEDIATION
TESTING WRITING & WRITTEN MEDIATION
21/04/23 28
Similar test tasks across languages are aimed to assess context specific:
oral performance, stimulated by visual or multimodal texts in the target language oral mediation performance, stimulated by texts in the home language
21/04/23 29
21/04/23 30
Diese Fotos stammen aus Ihrem elektronischen Familienalbum. Welche Personen sind auf den Fotos abgebildet? Wann und warum wurde jedes einzelne Foto gemacht?
21/04/23 31
A tuo parere, prima della ripresa di queste due fotografie, che cosa può essere accaduto? E cosa hanno in comune i due avvenimenti?
21/04/23 32
Dinos cómo crees que se sienten estas personas y por qué.
21/04/23 33
Tell your friend Edward about two games he knows almost nothing about: backgammon and jenga.
Click here to speak
Similar test tasks across languages are aimed to assess context specific:
writing performance, stimulated by cues, visual or multimodal texts in the target language written mediation performance, stimulated by texts in the home language
21/04/23 34
21/04/23 35
21/04/23 36
Escribe un e-mail (60-70 palabras) a tu amiga Valentina para hablarle de un bonito lugar de tu ciudad donde estuviste ayer. Cuéntale:1. Qué tipo de lugar era2. Dónde está exactamente3. Qué hiciste allí
21/04/23 37
21/04/23 38
21/04/23 39
It’s a management system linked to the Authoring Tool.
Its purpose is to manage trial runs (or the piloting) of each test task, in real-time conditions, with a view to examining the task’s validity.
21/04/23 40
Groups of tasks are packed in groups and piloted by sample population of candidates
Depending on how well the tasks have ‘behaved’, they may be considered: good enough to be inserted in the Test
Bank partially problematic and in need of
amendments seriously problematic (warranting serious
modification or ditching)21/04/23 41
The PT has been designed to measure basic indices with an inbuilt statistics system
The functions of the PT are available to the members of the language-specific author team who have been assigned the role of ‘task evaluator’ and/or the role of ‘Administrator’.
21/04/23 42
They are managed as follows: The user ‘characterizes’ a total
number of tasks on the basis of the task. typology and creates test packages
Token are created for the sample population who will use them.
Indices of statistical interest are worked out for results and ultimately findings.
21/04/23 43
www.rcel.enl.uoa.gr
21/04/23 44