construction of multiple choice test items by oshinyadi p.o

8/11/2019 Construction of Multiple Choice Test Items by Oshinyadi P.O.

1/22

1

ABSTRACT

During several weeks of combined observation, collection and construction of Scheme of Work at

the Ultimate College School, Ota, an objective test item was deliberated on to use for a Welcome

test to a new session for the S.S Two classes. For this report, a fifty -item multiple choice tests

will be developed in Chemistry subject based on their last term learning experience. Test items

were rigorously administered by the use of the six different stage-principles of test construction.

In this case, the construction process will only cover the first two stages (i.e. the planning stage

and the item development stage)


2/22

2

INTRODUCTION

Objective test was introduced into classroom evaluation to overcome the limitation of

essay test in about five fifty years ago in Nigeria (Ajayi, 2012). Objective test items can

be categorized generally as the supply item, selection item and rank-order item

types. In actual fact, the objectivity in objective test is in the scoring procedure, in which

case, marks are awarded only on relevant grounds of prescribed criteria that are

universally stable. In essence, its scoring cannot be influenced by personal preferences,

bias and prejudices of the examiner.

Considering the different ways objectives test items could be constructed, we have the

following sub-categories:

i. Completion Item Type

ii. Short-answer Item Type

iii. Alternative-response Item Type

iv. Matching Item Type

v. Rank-order Item Type

vi. Multiple-choice Item Type

Multiple-Choice Item Type

This type of objective test consists of items that have the questions or tasks followed

with more than two options or alternatives out of which the testee is to select (Cheung

& Bucat, 2002).

Characteristics of Multiple-Choice Item Type

a. Stem: This is the part of the item which specifies the task to be performed. It is

framed either in the form of a question, direction or an incomplete statement.


3/22

3

b. Options: These are possible or alternative answers provided for the stem. They all

must be plausible.

c. Key: This is the correct options to the stem

d.

Distractors: These are the incorrect options which of course must be plausible

Suggestions for Writing Multiple-Choice Item Type

- Ensure the stem is clearly worded to specify the task to be performed.

- Avoid the use of negative statements as much as possible in test items.

- Underline, italicize or write in capital letters the use of negative words in the

stem of your test items

- Limit as much as possible the use of negative words like, NOT, EXCEPT to the

stem of test item.

- Begin every option to a question form of the stem in capital letter.

- Avoid too lengthy stem

- Arrange your options to tasks requiring arithmetical operations or other

technical issues using numerical or alphabetical order as the case may be.

-

Ensure there is only one correct option to the stem

- Make sure all the distractors are plausible

- Keep all the options at an approximate equal length

- Avoid the use of all the above as an option

- Limit the use of none of the above option as much as possible

- Restrict the number of options within a range of three to five for a multiple-

choice test

- Avoid the use of overlapping options

- Avoid repetition of words in the options

- Avoid the use of highly technical distracters

- Do not give irrelevant clues to the correct answer


4/22

4

- To measure the higher mental processes, cast the item in a novelsituation.

Techniques of Test Construction

This Report on the construction of fifty-item multiple choice test utilizes the techniques

of test construction (Ajayi, 2012). The principles of test construction involve six major

stages:

i. The Planning Stage

ii. Item Development Stage

iii. Item-reviewing and Editing

iv.

Administration of pool of test-items

v. Item Analysis

vi. Item Selection

The Planning Stage

At the Ultimate College, Ota, planning and construction of test is a rigorous exercise

that requires great care, time, energy and resources of the school. Questions were raised

about the intention of the following:

i. Defining the purpose of the test:The purpose of the test (welcome test) was

defined to assess the general level of competence of the students and also to

assess their readiness for the new academic session.

ii. Defining objectives of the test: The objectives of the test were defined for

instruction and evaluation and were in specific behavioural terms (i.e.

specific, measurable, achievable, realistic and time-bound) as achieved during

the last academic session. The objective also obeyed the levels of cognitive

domain i.e. knowledge, comprehension, application, analysis, synthesis, and


5/22

5

evaluation. The objectives of the test using the last session scheme of work on

chemistry contains the following cognitive domains:

a.

Knowledge:Items here focused on recall of previously learnt materials and basic

terms students are expected to know. Brought in this level are:

- Define the term molar mass of a substance

- Define electrovalency

- Identify the different types of acids

- Identify compounds of efflorescent, deliquescent, and hygroscopic

- Relate the two allotropes of carbon

-

Identify the products of destructive distillation of coal- Use the various fractions of petroleum distillation for their uses

- Define exothermic and endothermic reactions

b.

Comprehension: Items here imply understanding or skills for explanation. Brought

in this level are:

- Describe the laws of chemical combination

- Obtain the molar mass of compounds

- State the properties of the various types of bonding

- State Charles and Boyles Laws

- Explain the basicity of an acid

- Explain the industrial preparation of carbon(iv)oxide

- Explain cracking of petroleum products

- State LeChatelliers principle

-

Point out the effects of temperature and pressure on a typical chemical reaction

- Describe the principles of thermodynamics

c. Application: This connotes the skill to make use of acquired knowledge in new

and concrete situations. Brought in this level are:

- Apply Charles Law in calculating the molecular mass of a gas


6/22

6

- Estimate the empirical formula of a compound

- Describe how to prepare the oxides of carbon

- Identify the products formed in a chemical reaction with their physical and

chemical properties

- Describe how to remove hardness from water

d. Analysis: It connotes the ability to breakdown materials into their component

parts. Brought in this level are:

- Differentiate between electrovalent and covalent compounds

- Differentiate between diamond and graphite

-

Interpret the decomposition of the various metallic trioxocarbonate(iv) salts- Describe the trends when bubbling carbon(iv)oxide through lime water

- Describe the trends in dissolution of chlorine in water

e.

Synthesis: This refers to the ability to put parts together to form a new whole.

Brought in this level are:

- With the aid of a well-labelled diagram, prepare hydrogen in the laboratory by

using zinc metal.

f. Evaluation: It refers to the ability to judge, appraise or justify the value of

materials for a purpose. Brought in this level are:

- Justify whether a specific reaction is spontaneous or not.

NOTE: Items under each of the instructional objectives were based on consensus

judgement by teachers in the Science Department of the School.

iii.

Content Specification: The content entails the learning experience highlighted

topic by topic in the syllabus. These topics were found highly relevant to the

stated objectives. For adequate coverage, the scheme of work or lesson note is

relevant in this situation for the construction of the multiple-choice test items.

For the purpose of this test, we have the following main themes:


7/22

7

a. Chemical Formulae and Reactions: Under here, we have:

- Definition of molar mass of a substance

- Calculating molar mass of compounds

-

Calculating empirical and molecular formula of compounds

b. Chemical Combination: Under here, we have:

- Law of conservation of matter

- Law of definite proportions

- Law of multiple proportions

c. Chemical Bonding: Under here, we have:

-

Definition of electrovalency- Properties of the types of bonding

d. Gas Laws: Under here, we have:

- Charles law

- Boyles law

- General gas equation

- Calculations on these laws

e. Acids, Bases and Salts: Under here, we have:

- Definition of an acid

- Basicity of an acid

- Properties of acids, bases and salts

- Meaning of Efflorescent, deliquescent and hygroscopic

f. Carbon and its Compounds: Under here, we have:

-

Meaning of allotropy

- Allotropes of carbon and their uses

- Coal, types and its destructive distillation

- Oxides of carbon and its preparation and uses

- Compounds of carbon


8/22

8

g. Industrial Chemistry: Under here, we have:

- Meaning of petrochemicals

- Fractions of petroleum distillation

-

Heavy and fine chemicals

- Cracking

h. Types of Reactions: Under here, we have:

- Basic terms involved

- Exothermic and endothermic reactions

- LeChateliers principle

i.

Chemical Equilibrium: Under here, we have:- Effects of temperature, pressure, light, catalyst

- Spontaneity of reactions

j. Water and its Compounds

- Structure and uses of water

- Hardness of water

- Removal of hardness

k. Hydrogen and its Compounds

- Hydrogen; occurrence

- Properties of hydrogen

- Uses of hydrogen

iv. Preparation of Test Blueprint: This is the most crucial stage in construction of

multiple-choice test items. In preparing this, the combination of objective and

subject matter are used giving a two-way grid consisting of process objective

in one-axis and content in one-axis. Along the horizontal axis, we have the

content, while the process objectives are listed along the vertical axis.


9/22

9

Table 1: Table of Specification for 50 Multiple-Choice Test Items

Content Knowledge

(15%)

Comprehension

(30%)

Application

(30%)

Analysis

(10%)

Synthesis

(10%)

Evaluation

(5%)

Total

(100%)

Definition of molar

mass of a substance3%

1 1 2

Calculating molar

mass of compounds

4%

1 1 1 3

Calculating empirical

and molecular

formula of

compounds 4%

1 1 1 3

Law of conservation

of matter 3%

1 1 2

Law of definiteproportions 3%

1 1 2

Law of multiple

proportions 3%

1 1 2

Definition of

electrovalency 3%

1 1 2

Properties of the

types of bonding 4%

1 1 1 3

Charles law, Boyles

law, General gas

equation,

Calculations on theselaws 6%

1 1 1 1 4

Definition of an acid

3%

1 1 2

Basicity of an acid 2% 1 1

Properties of acids,

bases and salts 4%

1 1 1 3

Meaning of

Efflorescent,

deliquescent and

hygroscopic 4%

1 1 1 3

Meaning of allotropy2%

1 1

Allotropes of carbon

and their uses 3%

1 1 2

Coal, types and its

destructive

distillation 3%

1 1 2

Oxides of carbon and 1 1 2


10/22

10

its preparation and

uses 3%

Compounds of

carbon 2%

1 1

Meaning of

petrochemicals 2%

1 1

Fractions of

petroleum distillation

3%

1 1 2

Heavy and fine

chemicals 2%

1 1 1

Cracking 2% 1 1

Types of Reactions:

Basic terms involved

4%

1 1 1 3

Exothermic and

endothermic

reactions 5%

1 1 1 1 4

LeChateliersprinciple 3%

1 1 2

Effects of

temperature,

pressure, light,

catalyst 4%

1 1 1 3

Spontaneity of

reactions 2%

1 1

Structure and uses of

water 4%

1 1 1 3

Hardness of water

2%

1 1

Removal of hardness

2%

1 1

Hydrogen;

occurrence 2%

1 1

Properties of

hydrogen 3%

1 1 2

Uses of hydrogen 1% 1 1

Total 70

NOTE: The weighting given to each cell is a matter of judgement based on time and

content taught during the last academic session.


11/22

11

Item Development Stage

Item writing is a very crucial stage in that the way it is handled can mar the whole

exercise of multiple-choice test item construction. The writing of multiple-choice items

entails two parts: The stemsand the options.

Using the characteristics of multiple-choice test items given above, an illustration of

how the items will be constructed is given below:

Which is of the following gases will turn lime water milky? [Stem]

(a) Hydrogen gas [Distractor] [Option]

(b) Oxygen gas [Distractor] [Option]

(c) Carbon(II)oxide [Distractor] [Option]

(d) Carbon(IV)oxide [Key] [Option]

Seventy test items were first written to care for the outcome of item review and editing.

During the construction of the fifty multiple-choice test items, the suggestions forwriting multiple-choice item type were strictly adhere to. The items were written and

crossed checked with their previous examination test items so that it does not match to

prevent duplication of test items. The test blue print was kept in view when the test

items were being written. Also in mind, was the content validity of the item written

which are in line with the specification or objectives of the test.

The following below are the list of seventy test items to be reviewed:


12/22

12

THE ULTIMATE COLLEGE, OTA

WELCOME TEST

SESSION: 2014/2015 TIME: 0hr 50minsCLASS: SSS TWO SUBJECT: CHEMISTRY

INSTRUCTION: ANSWER ALL QUESTIONS

1. The molar mass of hydrogen ion

is..

(a) 1g

(b) 2g

(c) 1gmol-1

(d) 2gmol-1

2. The volume of 80g of sulphur(iv)oxide

at STP is..

(a) 28cm3

(b) 28dm3

(c) 280cm2

(d) 280dm3

3. Calculate the percentage of chlorine in

magnesium chloride

(a) 25.26%

(b) 71.7%(c) 74.7%

(d) 77.7%

4. .. is regarded as the simplest

formula of the compound

(a) Molar mass

(b) Empirical formula

(c) Molecular formula

(d) Avogadros number

5. If the molar mass of the compound, CH3

is 30. Find the molecular formula

(a) C4H8

(b) CH3

(c) C2H5

(d) C2H6

6. Solids, liquids, and gases all have fixed

masses

(a) True

(b) False

(c) all of the above

(d) None of the above

7.

..bonding arises from the sharing

of electrons among atoms

(a) Ionic

(b) Dative

(c) Non-ionic


13/22

13

(d) Hydrogen

8. The type of bond that exists in NH4

is..

(a) Dative bond

(b) Metallic bond

(c) Covalent bond

(d) Van der waals force

9. The kinetic theory of matter states

that.

(a) the minimum kinetic energy of thegas is proportional to the volume of the

gas

(b) the maximum kinetic energy of a gas

is inversely proportional to the volume

(c) the average kinetic energy of the gas

molecules is proportional to the

temperature of the gas

(d) the collision between the molecules

are inelastic

10. In liquid boiling takes place at a fixed

temperature while evaporation takes

place at

(a) fixed temperature

(b) constant temperature(c) average temperature

(d) all temperature

11. Convert 303K to 0C

(a) 300C

(b) 30K

(c) 2730C

(d) 3330C

12. The ideal gas equation can be

represented by

(a) V (1/P) T

(b) V 1/PT

(c) T 1/V

(d) V T

13.

Which of the following shows GrahamsLaw of diffusion

(a) r 1/d

(b) r d

(c) r 1/d

(d) 1/r 1/d

14. Avogadros Law can be stated as

(a) different volumes of liquids contain

the same number of molecules

(b) equal mass of all solids under the

same conditions contain the same

number of molecules

(c) rate at which gases diffuse are

inversely proportional to the square of

their vapour densities(d) equal volumes of all gases under the

same conditions of temperature and

pressure contain the same number of

molecules.


14/22

14

15. The temperature at which the volume of

all gases is zero is the

(a) absolute temperature

(b) Celsius scale

(c) constant temperature

(d) pressure

16. Ethanoic acid is found in ..

(a) vinegar

(b) milk

(c) lime

(d) protein

17. The following are mineral acids except

(a) CH3COOH

(b) HCl

(c) HNO3

(d) H2SO4

18. Acids that ionize completely in water to

give hydrogen ions and anions are

(a) strong acids

(b) dilute acids

(c) concentrated acids

(d) weak acids

19. The reaction of acid with

trioxocarbonate(iv) yield/liberate

(a) carbon(iv)oxide

(b) carbon(ii)oxide

(c) hydrogen gas

(d) carbonates

20. All of the following statements are true

except

(a) addition of water to concentrated

acid

(b) carbon(iv)oxide dissolves in water to

form weak acid

(c) acids are used in the production

fertilizers

(d) sulphur(iv)oxide dissolves to form

trioxosulphate(iv) acid in water.

21. .is a basic hydroxide which is

soluble in water

(a) Base

(b) An alkali

(c) An acid

(d) Salt

22. Which of the following is an acid salt?

(a) Na2SO4

(b) KHSO4

(c) Ba(OH)2

(d) Na2Zn(OH)4

23.

Tetraoxosulphate(iv) acid is a dryingagent but cannot be used to dry

ammonia because

(a) it is too hygroscopic

(b) it reacts to form ammonium

tetraoxosulphate(vi)


15/22

15

(c) it is too volatile

(d) it is not stable for drying gas

24. Substances that absorb water from the

atmosphere and dissolve in it to form an

aqueous solution are

(a) efflorescents

(b) deliquescents

(c) hygroscopic

(d) drying agents

25.

is the hardest and purestform of naturally occurring carbon

(a) Graphite

(b) Diamond

(c) Coal

(d) Charcoal

26. The destructive distillation of coal yields

the following except

(a) coke

(b) ammoniacal liquor

(c) coal

(d) coal tar

27. The destructive distillation of wood

yields the following except(a) wood charcoal

(b) pyroligneous acid

(c) ammoniacal liquor

(d) wood gas

28. 4N2(g)+ CO2(g)+ C(s) 4N2(g) +

2CO(g). The above equation shows the

production of .

(a) coke

(b) water gas

(c) producer gas

(d) synthesis gas

29. The two important oxides of carbon

are

(a) CO2and CO3

(b) CO and HCO(c) CO and CO2

(d)CO2and CO32-

30. apparatus is used to provide

a supply of gas whenever it is needed in

the laboratory

(a) Dessicator

(b) Conical flask

(c) Kipps apparatus

(d) Leisbigs condenser apparatus

31. Which of the following is used to

remove carbon(iv)oxide in a mixture of

gases?

(a) Alkaline pyragollol(b) Soda ash

(c)Ammonical solution of

copper(i)ethanoate

(d) Sodium hydroxide


16/22

16

32. The chief source of hydrocarbon is

(a) alkanes

(b) wood

(c) coal

(d) crude oil

33. The ability of carbon atoms to form long

chains or rings is known as.

(a) carbonization

(b) neutralization

(c) allotropy(d) catenation

34. Which of the following is a heavy

chemical?

(a) Dyes

(b) Drugs

(c) Paints

(d) Tin

35. Which of the following can be used as

starting raw material in the manufacture

of trioxonitrate(v) acid?

(a) Salt

(b) Coal

(c) Petroleum(d) Air

36. The internal energy possessed by every

substance due to its structure and

physical state is known as

(a) heat of reaction

(b) rate of reaction

(c) enthalpy

(d) entropy

37. The energy change which accompanies

a chemical reaction is known as..

(a) heat of combustion

(b) heat of neutralization(c) heat of reaction

(d) heat of formation

38. 2H2(g)+ O2(g)2H2O(l) +571.16KJ. From

the above equation, what is the heat

energy evolved when one mole of water

is formed?(a) 280KJ

(b) 285.58KJ

(c) 290.58KJ

(d) 571.16KJ

39. The decomposition of water into

hydrogen and oxygen is.

(a) an exothermic reaction

(b) a catalytic reaction

(c) an endothermic reaction

(d) a Bosch Process


17/22

17

40. ..measures the degree of

disorderliness of a system

(a) Enthalpy

(b) Heat content

(c) Entropy

(d) Gibbs free energy

41. H = U + p V. From the above

equation, the system is

(a) liquid

(b) solid

(c) gaseous(d) all of the above

42. Hydrogen can be found free in the

following except

(a) atmosphere

(b) volcanic gases

(c) gasoline

(d) sun and the stars

43. .. is the lightest substance known

(a) Acids

(b) Oxygen

(c) Hydrogen

(d) Metal

44. During the laboratory preparation of

oxygen, the decomposition of KClO3 is

catalyzed by

(a) Hg

(b) O2

(c) KCl

(d) MnO2

45. A gas that rekindles a glowing splint

and forms brown fumes when passed

through Nitrogen(ii)oxide is

(a) H2

(b) O2

(c) NO

(d) N2O

46.

Which of the following does NOTbelong to the halogen family?

(a) Chlorine

(b) Fluorine

(c) Fluospar

(d) Bromine

47. Which of the following is diatomic?

(a) Sodium

(b) Potassium

(c) Chlorine gas

(d) Zinc

48. The decomposition of ozone

yields

(a) water(b) halogen gases

(c) oxygen

(d) triozonide


18/22

18

49. Cl2(g)+ 2NaOH(aq)NaClO(aq)+ NaCl(aq)

+ H2O. From the above equation, NaOH

is.

(a) hot

(b) cold

(c) cold dilute

(d) hot concentrated

50. The two important oxides of carbon

are

(a) CO2and CO3

(b) CO and HCO(c) CO and CO2

(d)CO2and CO32-

51. Carbon(iv)oxide can be removed from

air by passing it through.

(a) caustic soda

(b) concentrated sulphuric acid

(c) quicklime(d) lime water

52. Concentrated tetraoxosulphate(vi)acid

and fused calcium chloride are not

suitable for drying ammonia gas

because

(a) they react with the gas

(b) they are volatile

(c) they are deliquescent

(d) they are soluble

53. The decomposition of

ammoniumdioxonitrate(iii)

yields.. and

(a) nitrogen and steam

(b) nitrogen and ammonia

(c) steam and oxygen

(d) steam and ammonia

54. Nitrogen reacts with magnesium to

form..

(a) Mg3N2

(b) Mg2N3

(c) MgN

(d) Mg4N6

55. Which of the following is suitable for

drying NH3gas in the laboratory?(a) CaO

(b) CuO

(c) H2SO4

(d) CaCl2

56. N2(g)+ 3H2(g) 2NH3(g)+ heat. The

reaction above is .

(a) Contact process

(b) Haber Process

(c) Frasch Process

(d) Solvay Process

57. Which of the following is an alkaline

gas?

(a) NO

(b) NH3

(c) N2

O(d) N2O5

58. 3CuO(s)+ 2NH3(g)3Cu(s)+ 3H2O + N2(g).

From the reaction above, ammonia acts

as..

(a) an acid


19/22

19

(b) a reducing agent

(c) an oxidizing agent

(d) drying agent

59. Which of the following oxides of

nitrogen is known as laughing gas?

(a) NO

(b) N2O

(c) N2O3

(d) NO2

60. Exposure of nitrogen(ii)oxide to air

gives.

(a) nitrogen(i)oxide(b) nitrogen(iv)oxide

(c) nitrogen

(d) hydrazine

61. Which of the following reaction is used

for purifying or removing

nitrogen(ii)oxide from mixture of gases?

(a) 2Cu + 2NO2CuO + N2

(b) 2NON2+ O2(g)

(c) FeSO4+ NO FeSO4.NO(aq)

(d) 3MnO4-+ 4H++ 5NO3Mn2++

5NO3-+ 2H2O

62. Sulphur is insoluble in water but soluble

in..

(a) PbS

(b) Steam(c) CS2

(d) NH4OH(aq)

63. .. is the ability of an

element to exist in two or more different

forms in the same physical state

(a) Isotopy

(b) Isomerism

(c) Allotropy

(d) Tautomerism

64. P4+ 3SX. Identify X

(a) PS

(b) PS2

(c) P4S3

(d) P3S4

65. Which of the following gases is collected

by downward delivery?

(a) Oxygen(b) Hydrogen

(c) Hydrogen Sulphide

(d) Carbon(ii)oxide

66. Kipps apparatus is used for

intermittent supply of the following

gase in the laboratory except

(a) hydrogen sulphide

(b) carbon(iv)oxide

(c) hydrogen

(d) nitrogen

67. The main source of hydrocarbon

is.

(a) gas

(b) coal

(c) coke(d) petroleum

68. Hydrocarbons are composed mainly of

.. and .

(a) carbon and nitrogen

(b) carbon and oxygen


20/22

20

(c) hydrogen and oxygen

(d) carbon and hydrogen

69. Hydrogen is divided into

and

(a) acyclic and cyclic

(b) alkanes and alkenes

(c) aromatic and cyclic

(d) aliphatic and aromatic

70. .. is the ability to form

chains whether straight or branched

(a) homologous

(b) saturated(c) molecule

(d) catenation


21/22

21

Conclusion

After several weeks of planning and developing test items, the two stages presented in

this report could well be developed further through: Item-reviewing and Editing,

Administration of pool of test-items, Item Analysis, and Item Selection to make up for the

required fifty-item multiple choice test (the Welcome Test). This fifty-item multiple

choice test upon administration can be established to constitute an Achievement Test in

Chemistry with the use of concurrent validity and test-retest reliability.


22/22

22

REFERENCES

Ajayi, O. A. (2012). Essentials educational measurement and evaluation. Abeokuta:

Complete Publication.

Burton, S. J; Sudweeks, R. R; Merrill, P. F; & Wood, B.(1991). How to prepare better

multiple choice test items: Guidelines for university faculty .

Cheung, D. & Bucat, R. (2002) How can we construct good multiple-choice items? Presented

at the Science and Technology Education Conference, Hong Kong, June 20-21,

2002.

Haladyna, T. M. (1999). Developing and validating multiple-choice test items, 2ndedition.

Lawrence Erlbaum Associates,.

Haladyna, Thomas M. & Downing, S. M. (1989). Validity of a taxonomy of multiple-

choice item-writing rules.Journal of Applied Measurement in Education, 2(1), 51-78.

Morrison, S. and Free, K. (2001) Writing multiple-choice test items that promote and

measure critical thinking.Journal of Nursing Education 40: 17-24.

Obemeata, J. O.; Ayodele, S. O. & Araromi, M. A. (1999). Evaluation in Africa in honour of

E.A Yoloye. Institute of Educaton, Unversity of Ibadan, Ibadan.

construction of multiple choice test items by oshinyadi p.o

Documents