assessment. workshop outline testing and assessment why assess? types of tests types of assessment...
TRANSCRIPT
Assessment
AssessmentWorkshop OutlineTesting and assessmentWhy assess?Types of testsTypes of assessmentSome assessment task typesBackwashQualities of a good testHow to increase reliabilityEvaluation of test materials (course books,
Cambridge tests)Discussion/ reflection on testing issues
Testing Vs AssessmentTesting is one way, and one way only, of
finding out about the performance or progress of learners.
Examples would include giving learners a picture dictation (this gives us information about listening and spelling) giving them a correct the error text (this gives us information about writing/spelling/vocabulary/ grammar), or a giving matching exercise (this gives us information about reading/listening comprehension, vocabulary/grammar).
Testing Vs Assessment
Assessment refers to the different ways we can measure our learners’ progress or performance.
We can measure progress or performance, for example, by observing learners’ work in class, asking them what they find easy of difficult, testing them, or by looking at their homework.
Why assess?
to provide feedback to learners on their progress (e.g. what they have done well and what they need to improve)
to provide feedback to learners on their achievement (ie how much they have learned at a particular point in time)
Why assess?
to get information about learners’ ability to understand or use target language structures or vocabulary – help teachers know how to help their learners
to get information about learners’ skills development
Why assess?
to find out whether learners like or dislike specific classroom activities (you could collect this information by asking and by observing)
For diagnostic purposes: to use information about learners’ strengths and weaknesses to provide information which can feed in to planning
Why assess?
to let learners know what standards they need to reach
to see whether learning objectives are being achieved
to provide records for schools
to provide information to parents
Types of Tests
1.Achievement test – measure what learners have learnt on a language course – usually given at the end of the course
2.Placement test – used before the beginning of courses, to determine learners’ language levels’ and based on this information ‘place’ them in the classes most appropriate for them
Types of Tests
3.Diagnostic test – identify learners’ strengths and weaknesses. Helps teachers to make decisions on what needs to be taught
4.Progress test – measure learners’ progress during a language course
Types of Tests
5. Proficiency test - measures language ability and based on what is needed for a particular purpose, e.g., English for secretaries, English for car mechanics etc
6. Summative test – end of year/end of course test measuring learners’ overall achievement of course objectives
Types of Tests
7.Objective test – scored according to ‘right’ or ‘wrong’ answers, ie, non-judgmental on part of examiners
8.Subjective test – compared to objective tests, the examiner judges learners’ answers
9.Oral test – measures learners’ speaking abilities
Types of AssessmentContinuous assessment
Learners are assessed regularly throughout their course, to provide both teachers and learners information on what they can do and identify any areas of weaknesses.
Formative assessment/evaluation This is developmental. It provides information about
learners’ understanding and helps to identify problems and give feedback to learners on what they need to do to improve. It is not graded pass/fail.
Types of AssessmentFormal assessment/evaluation
This involves the use of tests given to all learners in an institution studying at the same level. Learners receive a grade or score which indicates whether they have passed or failed.
Informal assessment/evaluation This is subjective, often carried out during normal
lesson activities. Teachers observe learners carrying out tasks and make judgements on how well they are performing.
Types of Assessment
Peer assessment/evaluation Learners provide feedback to their classmates
on their work.
Self-assessment/evaluation Learners monitor their own progress and
decide how well they are doing and which aspects they need to work on.
Some Assessment Task TypesOpen comprehension questionsTrue/ FalseMatchingSentence completionMultiple choiceClozeSentence transformationGap-fillEssaysRole plays
Backwash
Backwash = the effect of testing on teaching and learning Harmful
Backwash Beneficial
BackwashBackwash harmful if the test content
and test techniques are at variance with the objectives of the course.
Backwash beneficial when the test can improve language education, and integrate all parts of language competence.
Qualities of a Good Test
1. Validity2. Reliability3. Practicality
ValidityA test is valid if it tests what it sets out to
test.
ValidityContent validityConstruct validityFace validityPredictive validityConcurrent validity
ReliabilityTo have a reliable test, the results should be
consistent over time.
ReliabilityTest reliability (high if sample size is large;
low if sample size is small)Scorer reliability (high objective types; low
subjective types)
Practicality
A test should be economical in terms of Time MoneyResources (human, equipment, etc.)
How to increase reliability
1. Take enough samples of behaviour2. Do not allow candidates too much freedom 3. Write unambiguous items4. Provide clear and explicit instructions5. Ensure that tests are well laid out and
perfectly legible
How to increase reliability
6. Candidates should be familiar with test format and testing techniques
7. Provide uniform and non-distracting conditions of administration
8. Use items that permit scoring as objective as possible
9. Make comparisons between candidates as direct as possible
How to increase reliability
10.Provide a detailed scoring key11.Train scorers12.Agree acceptable responses and appropriate
scores at the outset of scoring13.Identify candidates by numbers, not names14.Employ multiple, independent scoring
References
Hughes, Arthur (2001) Testing for Language Teachers, CUP
TKT Essentials – materials on Assessment Types and Assessment activities (English global products: The British Council 2008)