Development of educational assessment in Ukraine

Liashenko O. I., doctor of educational science, professor, chief scientific secretary of Academy of

Educational Sciences of Ukraine

International symposium-2007“Improvement and supporting of educational

assessment practice: Ukrainian and European experience”

2

From the history of the issue 70-80-s – study of knowledge, ability and skill level in

different subjects among secondary school students 1993-94 – state certification of school-leavers using test items 1996-2002 – establishment of independent assessment of

professional competence for health sector (Testing Board at Ministry of Public Health of Ukraine)

1999-2001 – “Independent Testing” project of “Renaissance” foundation (4 universities)

2001-2005 – project of Ministry of Education and Science, Academy of Pedagogical Sciences and Renaissance foundation “Centre of testing technologies”

UNDP Project “Equal access to quality education” International TRAST project “True Assessment” 2005-2008 – pilot independent external assessment of

academic achievements of secondary school graduates

3

Study of knowledge, ability and skill level of students

All general subjects are included Non-test format – written papers Level-based methods of task development – 3-4 levels Sample – 400-500 students from each grade, 7-10

domains of each subject Non-standardized criteria of result assessment and

processing Interpretation of derived data – in a journal or bulletin

of Ministry of Education before August teacher meetings

4

State certification of school-leavers (1993-94)

Two stages – school-leaver certification and university entrance selection (results are added up)

Uniform tasks for everyone (a booklet in each subject) for three levels

Non-standardized result processing by teachers of respective schools

Mass falsification, because teachers perceived this certification form as a check of their skillfulness

No result interpretation

5

Projects “Independent Testing” and “Centre of testing technologies”

The project was initiated by four universities (Kyiv, Lviv, Kharkiv universities, Kyiv Mohyla Academy)

Combination of international experience (expert involvement) and native experience (experience of Kyiv Mohyla Academy, Lviv National University)

Development of standardized testing technology Pilot independent assessment of academic achievement in

three subjects (Ukrainian, mathematics, history) Establishment of regional centres network Organization and realization of monitoring studies ordered

by the World Bank

6

Elements of educational quality assessment in Ukraine

Independent external assessment of academic achievements of secondary school-leavers

Participation in international inspections of education quality (TIMSS, PISA, CIVIC etc)

Collection, analysis and popularization of information about socio-economic and educational factors that define the state of functioning of education system at all levels

Preparation of analytical materials about education quality in Ukraine at different educational levels and in different subject fields

7

Monitoring of education quality (inspection levels)

at a local level - analysis of activity of an educational institution, prediction of psycho-educational results of activities of educational institutions and municipal system of education on the whole

at a regional level - analysis of the state of functioning of the regional education system

at a national level - analysis of the state of functioning of the national educational system, prediction of its development prospects with the purpose to develop public policy in education

at an international level - determination of functioning level of educational system in the context of international standards, comparative analysis with other countries

8

Functions of external assessment of school-leavers’ achievements

Combination of two functions – certification (state certification) and selection (selection of university entrants)

Independent assessment of students’ knowledge and skill level in different subjects

Unbiased (objective) student treatment during their assessment

Standardization of academic achievement assessment by modern methods

Monitoring of education quality at a level of educational institutions (rating of secondary schools)

Corruption control during admission to higher educational institutions

9

Development of independent external assessment

2006 Number of students – 41

818 Subjects – Ukrainian,

maths, history Regional centres – 4 Share of general number

of students– 10%

2007 Number of students – 116 327 Subjects – Ukrainian, maths,

history; on pilot base – physics, chemistry, biology

Regional centres – 9 Share of general number of

students – 26% (Kyiv – 94,2%; Kharkiv – 81,8%)

10

Monitoring studies in Ukraine

spontaneous initiative studies of different aspects of education in the regions;

2004-2005 - quality monitoring of primary and maths-and-science education by order of the World Bank (using TIMSS method )

2007- monitoring of academic achievements in mathematics of the 4th grade students

2007 - monitoring research of maths-and-science education of the 4th and 8th grade students as provided by program TIMSS-2007

2010 – expected participation in PISA inspection