turkey school evaluation national measurement and evaluation implementations

TURKEY

School Evaluation

National Measurement and

Evaluation Implementations

Overwiev

2 General Overwiev to Turkish Education System

National Assessment Tools Transition System From Basic Education to Secondary

Education (TEOG) Transition System From Secondary Education to Higher

Education (OSYS)

International Assessment Tools PISA TIMSS

A new National Assessment Study

General Overview to Turkish Education System

3

Transition System from Basic Education to

Secondary Education

4

Transition System from Basic Education to Secondary Education

• Central Common Examination – 8th Grade

• 2 exams – one in fall, one in spring term.

• If a lesson has two exams in one term, first one is conducted centrally,

• If a lesson has three exams in one term, second one is conducted

centrally

5


To strengthen relationship among the teacher, school and student.

To make the role of school and teachers more active in the education process.

To enable the simultaneous implementation of education curriculum country-wide

To minimize the exam anxiety by spreading the evaluation process to a wider time frame.

Tracking and evaluating of the students gains and the implementation of education curriculums objectively.

6 AIMS


• Subjects:

• Turkish

• Mathematics

• Science

• Revolution History

• Foreign Language (English, German, French and Italian)

• Education of Religion and Ethics (for Juadism and Armenian Community)

7


Term Turkish Mathematics

Education of Rel.

and Ethics

Science

Revolution

HistoryEnglish

2013-

2014

Fall 12.315 8.089 12.794 10.618 11.275 7.863

Spring 13.666 8.931 13.362 10.899 11.278 10.010

2014-

2015

Fall 11.983 7.628 15.880 11.143 11.190 9.358

Spring 13.380 8.684 15.254 10.774 12.079 8.425

8 Mean Performances by

years*

*There are 20 items in each

sub-test.


9Discrimination Index by

SubjectsSubjects

Discrimination Index

Turkish 0,696

Mathematics 0,601

Education of Religion and Ethics

0,765

Science 0,691

Revolution History 0,655

Foreign Language 0,649

All 0,568

SubjectsReliability

Level

Turkish0,852

Mathematics0,813

Education of Religion and Ethics

0,862

Science0,877

Revolution History0,850

Foreign Language0,838

All 0,963

Reliability Levels by Subjects

Subjects Item Difficulty

Turkish 0.669

Mathematics 0.434

Education of Religion and Ethics 0.763

Science 0.539

Revolution History 0.604

Foreign Language 0.421

All 0,572

10 Item Difficulty by Subjects



11

Number Of The Students Attending A Central Common Exam In Each Lesson

Turkish 1.235.891Mathematics 1.236.867Education of Religious Ethics 1.235994Science 1.235.681The History of Revolution 1.236.463Foreign Language 1.221.269

TOTAL 7.402.165


12

Item Development

Group

Editorial Group

Item Developers

Academicians Assessment Experts

String Group

ITEM DEVELOPMENT


13

Safety Precautions

Item development in a safe and isolated environment.

Printing in a safe and isolated environment.

Distribution of boxes with security locks to schools.

Different types of booklets.

Cheat control via computer program.


14

Year-end Performance Score ( out of 300 points

scale)

6, 7 and 8th grades

Weighted Performance Score (out of 700 points

scale)

Center Common Examinations

Scores used for placement (500 points scale)

(Year-end Performance Score+Weighted Performance

Score)/2

SCORING


EXPERIENCES

Process evaluation instead of outcome evaluation.

Increasing quality of teacher-made tests.

Unity in implementation of curriculum.

Less anxiety with help of make-up sessions.


EXPERIENCES

Feedback on curriculums.

Increasing significance of schools instead of courses

outside schools.

More usage of testing and evaluation technics by

teachers.

Data track by years.

Analysis of factors affecting students’ performance.

17



DIFFICULTIES ENCOUNTERED

Excessive number of students – increasing work load

and need for more staff.

Need for objective testing tools to assess extracurricular

activities

Planning to integrate open-ended questions.

Transition System From Secondary Education to Higher Education

19


Two exams for each lesson per term.

Prepared by the school branch group teachers collectively – enabling a unity in curriculums within school.

Analyses are made related to results, acquisition and program.

If necessary supplementary courses in schools are given by the teachers.

20

Two-stage examination – 12th grade.

Higher Education Examination (YGS) – First Stage

Undergraduate Placement Examination (LYS) – Second Stage

21


Questions for assessing the skills of the candidates weighted with those questions from the common curriculum of the Grade 9 of all high school types.

Interpreting

Usage of logical and judgment skill

Assessing analytical skills.

22 Higher Education Examination (YGS)



4 subjetcs - 40 items in each test.

Turkish

Social Sciences

Basic Mathematics

Science


Performing more than 140 score - Vocational School of

Higher Education.

Performing more than 180 – Chance for

Undergraduate Placement Examination.



More difficult than YGS.

Five different examination. 1. Mathematics, Geometry Exam (LYS 1), 2. Science (Physics, Chemistry, Biology) Exam (LYS 2), 3. Turkish Language and Literature, Geography 1 Exam

(LYS 3), 4. Social Science (History, Geography 2, Philosophy

group) Exam (LYS 4), 5. Foreign Language Exam (LYS 5)

25 Undergraduate Placement Examination (LYS)


The gap between the exam questions and the curriculum was removed.

The distributions and the numbers of the questions in the exam were determined according to the fields.

Thanks to the new structure, by integrating the richness of questions in the exam and the curriculum, the school absenteeism in the last grade of the high school was prevented.

26 Using results for Quality


27 Stats for OSYS

High School Vocational School Total

Those having the Privilege

of Preference (Including

Transition without

Examination)

1.144.744 866.046 2.010.790

Those having Preferred a

Field704.557 535.243 1.239.800

Number of the Candidates having the privilege of Preference and who have preferred a Field


28 Percentage of Placed and not Placed Students in Higher Education


Average Standard Deviation

Number of Candidate

Turkish 15,8 7,5 1.944.933

Social Science 10,7 6,8 1.944.933

Basic Mathematics 5,2 8,1 1.944.933

Science 3,9 7,3 1.944.933

29 2015 YGS Average and Standard Deviations


Percentage of

Candidates

Scoring 140 or

more

Percentage of

Candidates

Scoring 180 or

more

Female 92,08 72,26

Male 87,4 66,01

Total 89,55 68,89

302015 YGS Success Distribution According to Sex

46%54%

Male- Female Distribution in 2015 YGS

Fe-maleMale


31 Distribution of Number of Correct Answers of All Tests in 2013-2015 YGS


INTERNATIONAL ASSESSMENTS

-PISA-

32

PISA in TURKEY

* Participation and progress since 2003.33

PISA in TURKEY

"It is clear that there is a significant increase trend in all three domains but still not enough. This needs other requirements. It is surely beyond doubt that we are working to fullfill these requirements. We believe this is not only a general evaluation but also an opportunity for self-criticism that we consider our failings."

34 Results of 2012

Nabi AVCIMinister of National Education

PISA in TURKEY

After each cycle and releasing of the results, National Preliminary and Final Reports are prepared and sent to the units of Ministry of National Education, universities and other stakeholders. PISA results are taken into consideration especially while revising education curriculum. Besides, academicians in the universities benefit from the findings and the results of PISA while conducting studies on the education systems in Turkey and the world.

35 How Results Are Used

PISA in TURKEY

4 seminars before administration of PISA 2015. For provincial director of national education For coordinators from provincial directorate of national

education. For school coordinator from each school. For test administrators from Ministry of National Education

Brochures, introductory booklets and guidebooks for PISA 2015 were distributed to the participants

36 Preparations for PISA 2015

PISA in TURKEY

PISA 2015 Main Study between April 02-22.

61 cities – 192 schools and 5904 students.

A test administrator from Ministry for each school

2-3 ‰ data loss.

Data submission at the end of June 2015.

37 Statistics for PISA 2015

INTERNATIONAL ASSESSMENTS

-TIMSS-

38

TIMSS in TURKEY

* Participation and progress since 199939

8th Grade Science Performances 8th Grade Mathematic Performances

TIMSS in TURKEY

TIMSS educational research study has a high prestige among educational and academicals environments in Turkey. After each cycle attended TIMSS national reports are prepared. Turkey’s success in TIMSS studies and the evaluation of Turkish Education System in school, family, teacher and socio-economic contexts Many academicians use the results and findings of TIMSS studies while conducting researches on the education system and education policy makers pay regard to TIMSS national reports, results and conducted researches while making educational policies in Turkey.

40 Using Results

TIMSS in TURKEY

4 seminars before administration of TIMSS 2015. For provincial director of national education For coordinators from provincial directorate of national

education. For school coordinator from each school. For test administrators from Ministry of National Education

Brochures, introductory booklets and guidebooks for TIMSS 2015 were distributed to the participants

41 Preparations for TIMSS 2015

TIMSS in TURKEY

TIMSS 2015 Main Study between 23 March – 22

April.

78 cities – 498 schools and about 15000 students.

A test administrator from Ministry for each school

Minimized data loss.

Data submission in beginnig of July 2015.

42 Statistics for TIMSS 2015

New National Assessment Tool

Aim of the Study To assess students’ ability of applying their knowledge

and competences learned in school to real-life situations at the end of basic education.

Other targeted sub-aims are designed to: Assess students’ higher-order thinking skills through knowledge. Assess effectiveness of current curriculums. Monitor performance by years through standard tests. Provide reliable data for addressing aspects of education reforms.

43

New National Assessment Tool

44

Thank you…

turkey school evaluation national measurement and evaluation implementations

Documents

basic education

secondary education

education process

secondary education

italian education of

education of religious

subjects transition

aims slide