Represented by Gemma Bellhouse, Test Production Manager

Language Testing Forum, University of Oxford, 20–22 November 2015

Example: Graded Examinations in Spoken English interactive prompt GESE Grade 12 (C2)

Example 3 (resubmitted)Some people claim that the tabloid press and sensationalist journalism and media around the world merely reflects society and does not shape it. I sometimes wonder if that really is the case.

Resubmission:Some people claim that the tabloid press and sensationalist journalism and media all around the world simply reflects a society and does not shape it. I sometimes wonder if that really is the case.

Prompt after panel edit:Some people claim that sensationalist journalism all around the

world simply reflects a society and doesn’t shape it. I wonder if that really is the case.

Final live prompt:Some people claim that sensationalist journalism simply reflects a society and doesn’t shape it. I wonder if that really is the case.

The Test Production Process

Stage 1 � Item writers are recruited

� Initial and ongoing training

www.trinitycollege.com/GESE

Stage 2(see examples)

� Items are commissioned

� Items are pre-edited in-house

� Items are accepted or rejected

� Items are resubmitted in line with feedback

� Items are edited by a panel

� Items are typeset and proofread

Stage 3� Items are trialled/pretested

� Items are reviewed for bias

� Items are banked or rejected

Stage 4� Exam materials/test papers go live

� Post-test analysis

Examples: Graded Examinations in Spoken English interactive prompts GESE Grade 10 (C1)

Example 1 (resubmitted)Nowadays entertainment seems to be too focused on technology with downloads readily available to phones, computers and tablets. If we continue this way I fear that real social interaction will become a thing of the past.

Resubmission:Nowadays technology seems to have taken over in all areas of life, especially entertainment. If this trend continues I think that the consequences can only be detrimental to traditional family pastimes.

Prompt after panel edit:Nowadays technology seems to have taken over many areas of life, especially entertainment. If this trend continues, I think that the consequences will be detrimental to traditional family pastimes.

Final live prompt:Nowadays technology seems to have taken over many areas of life, especially entertainment. If this trend continues, I think that the consequences will be detrimental to traditional pastimes.

Example 2 (rejected)These days people spend a lot of time campaigning on environmental issues. However, in my opinion there can be no rational debate on these issues until people understand the science involved.

ThE JouRnEy oF a TEST iTEm

Pre-editing feedback: Similar to old task: DVD vs cinema; and too dependent

on technology. Tighten up the phrasing.

Pre-editing feedback:Reject: Requires specific scientific knowledge

Pre-editing feedback:Edit to avoid UK bias: ‘tabloid’.