Evaluation skillsG Balasubramanian

Individual position on a learning curve Position in a given learning cohort Position in a given universe

Why evaluate?

A marking scheme contains value points for assessment.

They are suggestive. The evaluator has the flexibility to award so

long as the value point is reflected.

What does a marking scheme contain?

It reduces ambiguity in evaluation It reduces subjectivity in evaluation Ir provides standards for evaluation. It is a normative tool for the entire universe

of the examinees.

What is the relevance of marking scheme to an evaluator?

Identification of schools/ candidates Focus on the remuneration by increasing

the quantity of evaluated papers Poor computation of marks No standardized procedures for addition or

recording.

Threats to effective evaluation

Normal Distribution Curve

It reflects the performance profile of examinees in a given situation.

It shows a meaningful profile when the volume of the examinees is large

It is just an indicator. There is no pre-condition that it has to

remain always normal. The standard curve is never forced on a

cohort

What is the meaning of a Bell curve?

In all normal conditions the curve is skewed. Skewing could be positive or negative.

The skewing of the curve

When the question paper is too easy. When the evaluation is quite liberal and

subjective. When the given cohort are high profile and

high performing learners. When the volume of the examinees is quite

less. When the marking scheme is not objective

When does positive skewing occur?

When the question paper is quite difficult. When the questions are out of focus or

syllabus. When the performance profile of the learners is

low When the learning experiences have been

inadequate When the evaluation is quite tight and

rigorous. When the marking scheme is not objective

When does a negative skewing occur?

What is J-effect?

Undue emphasis on a given mark Psychological pressure on examiners to

award a given mark Moderation or standardization focusing on a

given mark Student performances targeting a given

mark

What causes J-effect?

Standard Deviation The Standard Deviation is a measure of how

spread out numbers are. Its symbol is σ (the greek letter sigma) The formula is easy: it is the square root of

the Variance. The Variance is defined as: The average of

the squared differences from the Mean.

What is standard deviation?

Standard deviation is the measure of dispersion away from the mean, or average, value

What does standard deviation indicate?

Relating the mean score of a school in a subject with that of the Board score.

Relating the distribution profile of the learners of a school with that of the Board.

How do we assess the performance of a school?

Should we give full marks to an answer if it is correct?

yes No

Why not? Why should I?

Perceptional variations Indifference in observations Oversights Misconceptions about answers/questions

What kind of variations could occur during evaluation?

Lack of focus/attention Speed of assessment Personal preferences Poor handwriting Styles of answers Ideological differences

Issues in evaluation

Case relating to the question ◦ The most ideal man I know

Some examples of poor assessment

Give an example of Antibiotics.

If the examiner doesn’t know

Issues in evaluation

Does the teacher have adequate knowledge?

Does the teacher have adequate competence?

Does the teacher take the task with seriousness it deserves?

Mindsets in evaluation

What are its strengths?

What are its demerits?

Team Evaluation

Monitoring Mentoring Supervising

Inter-teacher variability

The format of writing a letter

Case Study 1

Lack of knowledge of the subject area

Case study 2

All students getting the same marks in a given subject

All students getting the same marks in Maths and sciences

Case study 3

Data Entry errors

Case study 4