statistics.caricom.orgstatistics.caricom.org/.../scoring_guidelines.docx · web viewliteracy...

<< Replace/Add/delete logo(s)>>

COMMON FRAMEWORK FOR A LITERACY SURVEY PROJECT

Literacy SurveyScoring Guidelines

<< Insert Date>><< Insert other relevant information on cover page of Guide>>

ContentsGeneral Scoring Standards and Guidelines................................................................................1

Filter Booklet Scoring Guide..........................................................................................................7

Locator Booklet Scoring Guide...................................................................................................15

Main Booklet Scoring Guide........................................................................................................31

Literacy Survey

General Scoring Standards and Guidelines

Litera c y Survey <<year of survey>> – G e ne r al Scoring Guidelines


SCORING STANDARDS

The purpose of scoring standards is to ensure that the scoring of task booklets is consistent across all scorers within a country and between countries.

Accurate scoring is a key component in the quality control for the assessment. The quality control procedure should be set up to achieve scoring accuracy by monitoring scoring reliability throughout the scoring period. Consistency of scoring across scorers within a country as well as across countries is necessary.

The scoring standards required for a literacy assessment are:

1.The scoring of assessment booklets will be conducted according to the Scoring Guide (Annex A).

2.Countries will hire a team of scorers. A minimum of 5 scorers is required. A scorer should be able to score 750 assessment booklets.

3.Countries will send at least one lead scorer to the Training of Trainers scorer training that will be facilitated by an international consultant. The lead scorer will subsequently be responsible for training the country's team of scorers.

4. The quality/ reliability of scoring within each country will be checked by the re- scoring of 20% of assessment booklets by a second scorer. This re-scoring operation will achieve an inter-rater agreement of at least 95%.

5.A random sample of 10% of assessment booklets will be selected and submitted to an independent scoring process. The objective of this independent re-scoring process is to detect and correct systematic variation in the application of the standard scoring rubrics. The independent re-scoring will likely be carried out by another country sharing the same language or an international consultant/ firm. This step is required to detect and correct systematic variation in the application of the standard scoring rubrics (i.e. any inter-country scoring bias).

SCORING GUIDELINES

1.It is preferable to hire the team of scorers in time to be involved in the scoring of the pilot data.

2.A centralized scoring after data collection is preferred as quality control is more efficient and communication concerning scoring issues may be more efficient.

3.The participating scorers will not be required to reconcile individual cases during the re- scoring quality control operations.

Countries will be required to send at least one lead scorer to the scorer training


provided by an international consultant/ firm. The international consultant/ firm will be required to deal with questions that arise during scoring and to inform countries of new findings and changes in policy as scoring progresses.

Scoring of Paper and Pencil Assessment Items

All assessment questions are open-ended. Most questions require simple scoring, e.g., the response is clearly either correct or incorrect. A few items will require more complex scoring, e.g., in cases where the response is a short paragraph. In general, countries should budget 15 minutes per case for scoring.

Countries will use the standardized scoring rubrics (Scoring Guide- See Annex C) in the scoring process. By rendering all elements of scoring explicit, these rubrics will serve to minimize the amount of variance between individual scorers. An international consultant/ consulting form will be provided the software to manage the scoring process and related quality assurance procedures.


Scoring values

Correct Score

Allowable value: 1

A correct score is assigned if the response provided by the respondent matches the response described in the Scoring Guide.

Incorrect Score

Allowable value: 7

An incorrect answer will always be scored 7.

For questions that were not answered but have some writing on the page such as question marks, dashes, etc., that indicate that the respondent has seen the stimulus but did not know the response, the score value will be 7.

Refusal or Not Done

Allowable value: 0

Questions that were not answered and left completely blank will be assigned the score value of 0. This means that there is nothing written on the stimulus or question page.

General Scoring Rules

During the scoring activities of the survey, it is imperative that scorers follow instructions in theis Scoring Guides. To facilitate this task, a list of “General Scoring Rules” has been compiled for all to follow. While an effort has been made to include all cases, it is possible that some scenarios may have been overlooked. Therefore, in cases where it is not clear whether or not a response is correct, it is important that scorers bring such cases to the attention of the scoring manager or supervisor for a decision.

1


"[ ]" square brackets and "( )" parenthesis

In thise Scoring Guides, text that is delimited by the use of "[ ]" square brackets provides special instructions to scorers. In most instances, such text clarifies or emphasizes important points for consideration while scoring an item.

Text, units of measurement, etc. that are delimited by the use of "( )" parentheses are common additions that respondents may have included as part of their response. The text within the parentheses is not considered essential for a response to be correct, and should not be considered as alternate responses, but rather should be considered complementary information (see 'complementary information' below).

Correct response

Responses should be considered correct only when they are identical to, or equivalent to, the responses in the Scoring Guide.

In this regard, spelling and grammar mistakes should be ignored while scoring an item.

Underlining, circling, writing

• If respondents chose to underline, circle, or otherwise indicate their responses, rather than write them in the space provided, or chose to write the response rather than underline or circle the response, scorers should consider these as acceptable ways to indicate an answer, and score accordingly.

• Underlining or circling that extends beyond the start or end of a sentence containing the correct response will be considered correct only when the underscore starts and/or ends on the same physical line that the sentence starts or ends and does not contain any contradictory information. If a respondent underlines more than the statement or sentence by extending the underscore or circle to a new sentence on a different line, the response will be considered incorrect.

• If the underlined, circled, etc. responses were not cross-referenced to specific questions by the use of arrows, question numbers, etc., scorers will give respondents the benefit of the doubt and assume that respondents linked their responses to correlating questions when possible. For example: if three questions requiring written responses were left blank but the respondent underlined all three appropriate passages (and ONLY the three appropriate passages), then all three responses would be scored


2correct even if arrows, question numbers, etc., were not used to cross-reference the

underlined passages to specific questions.

• If two correct passages and one incorrect passage were underlined, then the scorer would score the two passages as correct and the other one as inc o rrect .

• If the respondent underlined a variety of passages indiscriminately, thus nullifying the possibility of linkage between questions and answers, then all three questions would be scored as i n correct .

Complementary Information

In all cases, information that is complementary does not cause a response to be incorrect.

Text, units of measurement, etc. that are delimited by the use of "( )" parentheses are commonly found additions that respondents may have included as part of their response. The text within the parentheses is not considered essential for a response to be correct and should not be considered as alternate responses, but is instead considered to be complementary information.

However, the Scoring Guides may not necessarily include all the limitations of what is allowable and what is not allowable. Consequently, Scorers will have to exercise judgment in determining the boundaries and limitations of what constitutes a correct response. Supervisors should be consulted when a clear delimiter between a correct and an incorrect response can't beestablished. In other words if you are not sure whether the answer is correct, consult your supervisor.

Contradictory Information

It is possible that a respondent will underline or write more than is required. It is important that the scorers read the information carefully and decide whether or not it is contradictory. By this we mean that the underlined information nullifies the correct answer because the answer contains part or all of an incorrect answer. In other words, the respondent’s answer no longer supports the correct response.

3


Illegible answers

Illegible answers should be scored as incorrect.

Frequently Asked Questions

1. What if a response contains two or more different answers?

Ascertain which answer is intended as the response by seeing where the respondent answered. For example, if the respondent writes one answer on the response line and a second answer in the margin, score the answer which is written on the response line. Unless the respondent has explicitly indicated otherwise, assume that the response written in the proper space is the intended response.

2. What if both answers are written in the proper space?

In these cases, you must differentiate between whether the information is complementary or contradictory: complementary information does not undermine the correct response, while contradictory information results in an incorrect answer.

Answers that contain the correct response and complementary information should be assigned a scored 1.

Answers that include the correct response as well as contradictory information should be scored 7.

3. Are decimal points and denominations necessary?

Unless explicitly stated otherwise in the scoring guide for a particular item, decimal points or the equivalent are necessary for a response to be considered correct.Denominations and labels (such as am/pm, liters, etc.) are not necessary if they are placed in parentheses in the scoring guide.

4

Literacy Survey

Filter Booklet Scoring Guide

Litera c y Survey <<year of Survey>> – Filter Booklet Scoring Gu i de


Job Announcement Question 1Question 1. Circle the number of additional employees the company wants to hire.

Scoring Guide:1: Circles 207: Any other response0: Question refused / not done

[Underlined or written response is also valid.]

Election Results Questions 2-3Question 2. Which candidate received the fewest votes?

Scoring Guide:1: (G.F.) Reynolds7: Any other response0: Question refused / not done

[Underlined or circled response is also valid.]

Question 3. What was the total number of votes cast in the election?

Scoring Guide:1: 2297: Any other response0: Question refused/not done


1


Killer Whales Questions 4-8Question 4. Why do the killer whales come to Tysfjord?

Scoring Guide:1: Mentions at least ONE of the following:

• they follow the herring• to look for the herring OR to feed on the herring

7: Any other response0: Question refused/not done

[An underlined or circled response is also valid for this question.]

Question 5. According to the article, how old can killer whales get to be?

Scoring Guide:1: 50 (years old)7: Any other response0: Question refused/not done

[An underlined, circled, or abbreviated response is also valid for this question.]Question 6. During which months does the herring fishing operation take place in Tysfjord?

Scoring Guide:1: From October to January7: Any other response0: Question refused/not done


Question 7. According to the article, what is a “whale safari”?


• Looking at whales from a boat• A tour that takes people out to watch whales• A tourist attraction in Tysfjord


Question 8. List 3 examples mentioned in the article that show the social behavior of killer whales.

Scoring Guide:1: Mentions all THREE of the following:

• Live in schools• Male spends life with mother of his offspring• Cooperate when feeding or looking for herring



2


Library Card Questions 9-10Question 9. Sign your name on the line that reads “signature”.

Scoring Guide:1: Signs name on library card7: Any other response0: Question refused/not done

Question 10. Please circle the date when this library card will expire.

Scoring Guide:1: Circles 15/1/087: Any other response0: Question refused, not done


Smith Foods Injury Types Questions 11-12Question 11. What type of injury happened the most often?

Scoring Guide:1: Strained backs (40%)7: Any other response0: Question refused/not done


Question 12. What is the total percentage of injuries that were due to bruises or cuts?

Scoring Guide:1: 37(%)7: Any other response0: Question refused/not done


UNICEF Charity Question 13Question 13. Underline the sentence that gives the cost of a vaccination.

Scoring Guide:1: Underlines the sentence or the part of the sentence that contains “15

cents”.7: Any other response0: Question refused/not done

[Circled or written response is also valid.]

3

of 51

Litera c y Survey <<Year of Survey>> – Filter Booklet Scoring Gu i de

Coca Cola Bottles Question 14Question 14. Here is a photograph of Coca-Cola bottles. In total, how many bottles are in the

two full cases?


Nuts Question 15Question 15. How much would half a pound of nuts cost?

Scoring Guide:1: ($) 2.257: Any other response0: Question refused/not done

Charity Ad Question 16Question 16. Circle the telephone number given in the advertisement below.

Scoring Guide:1: Circles (Tel: (01)31382007: Any other response0: Question refused/not done

[Underlined or written response is also valid.]

Tyre Sale Ad Question 17Question 17. How much do you save on one tyre?

Scoring Guide:1: ($) 277: Any other response0: Question refused/not done

4

Literacy Survey <<Year of Survey>> – Filter Booklet Scoring Guide

Kraft Envelopes Ad Questions 18-21Question 18. How much does one box of 17X22” envelopes cost?



Question 19. How much does each box of 22X27” envelopes cost if you buy two boxes?



Question 20. How many envelopes are there in each box?

Scoring Guide:1: 25 (envelopes)7: Any other response0: Question refused/not done


Question 21. You want to buy 14X18” envelopes. How many boxes must you buy to get the $8.97 per box price?

Scoring Guide:1: 5 boxes OR 5 OR 5 or more7: Any other response0: Question refused/not done


5

Literacy Survey

Locator Booklet Scoring Guide

Litera c y Survey <<Year of Survey>> – Loc a tor Booklet Scoring Guide


Preschool Rules Questions 1-3Question 1. What is the latest time children should arrive at preschool?

Scoring Guide:1: 9:00 (a.m.)7: Any other response0: Question refused / not done

Question 2. What are the two rules about taking medicine to the preschool?

Scoring Guide:1: Mentions or underlines BOTH of the following:

• (Medications) have to be in original, (labeled) container• (Medications) must be signed into the medication sheet (located in

each classroom)7: Any other response0: Question refused/not done


Question 3. Underline the statements that explain the rules about clothing.

Scoring Guide:1: Underlines at least TWO of the following three sentences:

• Dress your child comfortably and bring a change of clothing.• Please bring your child fully dressed, no pajamas.• Please no jewelry or candy.

7: Any other response0: Question refused / not done

TV Sale Ad Question 4Question 4. How much would you have to pay for this TV during the sale?

Scoring Guide:1: ($) 255.00 or ($) 2557: Any other response0: Question refused/not done

1


Raincoat Ad Question 5Question 5. The regular price of the coat advertised is $80.

What is the price during the sale?

Scoring Guide:1: ($) 72.00 or ($) 727: Any other response0: Question refused/not done

Tea candles Questions 6 - 7Question 6. In this box there are 105 tea candles.

In how many layers are these tea candles packed in the box?

Scoring Guide:1: 3 (layers), (optionally add: with 7 x 5 or 35 in each layer)7: Any other response0: Question refused/not done

[Respondent may use equivalent terms, such as "stack," instead of layers.]

Question 7. What is the total weight of 500 boxes in pounds?

Scoring Guide:1: 750 (pounds/lbs.) (about)7: Any other response0: Question refused/not done

Gas Gauge Question 8Question 8. The gas tank in this car holds 48 gallons.

About how many gallons of gas remain in the tank? (Assume the gas gauge is accurate.)

Scoring Guide:1: Any answer that falls in the range of 33 to 39 (gallons) (about or

approximately)7: Any other response0: Question refused/not done

2


Price Tags Questions 9 - 11Question 9. If you bought all these items, and paid with a $20 bill, how much change

would you get?


Question 10. If you buy a quarter of a pound of Brie how much would you pay?


Question 11. Which of these items was packed first?


• The Gouda cheese• the one packed on 17/5/08• the one that costs $3.05


3


Photo & Envelopes Questions 12 - 14Question 12. Measure the photo. What are its dimensions in inches?

Scoring Guide:1: 7.5 by 10, or 7-1/2 by 10 (in. or ") (approximately) [in any order] Allow any

measure from 7-3/8 to 7-5/8 by 9-7/8 to 10-1/8 (in. or ")7: Any other response0: Question refused/not done

Copies of the photo are to be mailed to every person in the photo.Mailing envelopes are available in the following sizes: C6 (6" x 9"), C5 (9" x 12"), C4 (10" x 13").

Question 13. Which size envelope is the smallest that could be used without folding the photo?

Scoring Guide:1: 9(in. or ") x 12(in. or ") (envelope) [in any order], or C57: Any other response0: Question refused/not done

Question 14. The envelopes are available only in packages of 10.How many packages need to be bought to mail a photo to each person in the picture?

Scoring Guide:1: 3 or "three" (packages)7: Any other response0: Question refused/not done

4


Ozone Questions 15 - 18Question 15. According to the article, what is the major cause of the decomposition of the

ozone layer?

Scoring Guide:1: chlorofluorocarbons OR CFCs7: Any other response0: Question refused/not done

Question 16. Underline the word that says what “CFC” stands for.

Scoring Guide:1: Underlines the word “chlorofluorocarbons”7: Any other response0: Question refused/not done

Question 17. Which plants mentioned in the text slow down their growth process in high concentrations of ozone?

Scoring Guide:1: Mentions BOTH of the following:

• (Spring-sown) wheat• Clover


Question 18. What is the benefit of the ozone layer?

Scoring Guide:1: Protection from (ultraviolet) radiation7: Any other response0: Question refused/not done

5


Solution Question 19Question 19. On the diagram of the container draw a line for 1/3.

Scoring Guide:Note: Scoring requires the use of a template

Note:

1: A line is drawn on the container located somewhere between the two dotted lines on the transparent template provided.


Use the template provided for Question 39. You must check that the size of the drawing of the container in the template matches the actual size of the drawing in the printed test booklet. Otherwise you will need to reduce or enlarge it to match. In the template, the shaded area measures 8 mm above the exact line for 1/3 and4 mm below it. It does not include the line indicating 1/4.

Craft Questions 20 - 21Question 20. Fill in the correct amount for the green fabric in the sales slip (on the opposite

page.)

Note:

Scoring Guide:1: ($) 1.30 or ($) 1.31 or ($) 1.32 is written in the space to the right of

$5.25 on the sales slip or anywhere on the page.7: Any other response0: Question refused/not done

‘1’ captures permissible rounding to the nearest $.05 as well as rounding to the nearest cent or merely omitting the extra digit. Correct answers must be written in the conventional currency format (2 decimal places in most countries).

Question 21. In the space below, draw a 2 1/2" by 4" rectangle as a pattern for cutting some of the strips.

Note:

Scoring Guide:1: A rectangle that fits within the US inches template.7: Any other response0: Question refused/not done

Use the template provided for Question 60. Use a transparent template with the rectangle and allowed imprecision (+ or - 1/8 ") shaded in. Double check the inner and outer measurements of the shorter and longer lines of the template in inches, just in case photocopying creates a distortion.

6


Baltic Stock market Questions 22-26Question 22. According to the graph, which country has the largest market capitalization?

Scoring Guide:1: Russia7: Any other response0: Question refused, not done

Question 23. Identify two countries whose market capitalization is estimated to be between 10 and 15 billion dollars.

Scoring Guide:1: Mentions both of the following:

• Czech Republic• Hungary

7: Any other response0: Question refused, not done

Question 24. According to the graph, what is the average daily turnover for Poland?

Scoring Guide:1: (About) ($) 45 million [accept any number between 43-47]

[Note: “million” is a required part of the correct response]7: Any other response0: Question refused, not done

Question 25. Identify the three countries that are listed in the graph for average daily turnover but not for market capitalization.


• Bulgaria• Ukraine• Slovakia


Question 26. According to the article, what are two possible benefits of consolidating the Baltic markets?


• improve liquidity• attract larger investors


7


Generic Medicine Questions 27 - 30Question 27. According to the article, in which two countries is the national market share of

generic medicines the same?


• Portugal• France


Question 28. In how many countries does the generic drug market account for 10% or more of total drug sales?

Scoring Guide:1: Five (Denmark, Germany, Netherlands, Ireland, and USA)7: Any other response0: Question refused/not done

Question 29. According to the article, what are the reasons generic drugs should be used rather than brand-name drugs?

Scoring Guide:1: Must mention or paraphrase BOTH of the following:

• They are as effective (as brand-name drugs)• They are less expensive (than brand name drugs)


Question 30. List two reasons given in the article for the limited use of generic drugs.

Scoring Guide:1: Mentions at least TWO of the following:

• Doctors AND/OR pharmacists prefer to prescribe brand name (original)medicines

• (Pharmacists have) financial reasons (for selling brand name medicines)• (Doctors AND/OR pharmacists have) psychological reasons (for selling

brand name medicines)• Patients are skeptical of generic drugs/drugs that differ in color from the

ones they are used to• Hospitals seldom use generic drugs


8


Lavan San Bleach Questions 31 - 34Question 31. How much Lavan San Bleach should you use when washing clothes in the

washing machine?

Scoring Guide:1: ¾ cup OR 180 ml7: Any other response0: Question refused/not done

Question 32. How long should you wait to drink water after you have added bleach to disinfect it?

Scoring Guide:1: 45 minutes7: Any other response0: Question refused/not done

Question 33. If you are washing clothes by hand, when should you use detergent?


• After you have washed with bleach• After the clothes have soaked in bleach for 30 minutes• After the clothes have been rinsed


Question 34. If you have a complaint about Lavan San Bleach, what should you do?


• Call (800 76253)• Write (to Mrs. Robles, P.O. Box No 66349 Caracas 1061)


9


Blood Alcohol Questions 35 - 39Question 35. According to the National Board of Health, a man should not drink more than

how many units of alcohol per week?

Scoring Guide:1: 21 (units of alcohol a week)7: Any other response0: Question refused/not done

Question 36. According to the article, what are the three things that determine blood alcohol levels?

Scoring Guide:1: Must mention or paraphrase at least THREE of the following:

• How quickly you drink• The number of units of alcohol you drink• Your weight• Whether you are a man or a woman.


Question 37. What determines the number of grams of alcohol that are broken down per hour?

Scoring Guide:1: (Your body) weight7: Any other response0: Question refused/not done

Question 38. How many of grams of alcohol are there in a glass of port wine?

Scoring Guide:1: 12 (grams of alcohol)7: Any other response0: Question refused/not done

Question 39. Use the information in the table to compare blood alcohol levels for men and women of similar weight.

Scoring Guide:1: Any response that includes a comparison stating that ‘women have a

higher concentration’ OR that ‘men have a lower concentration’ [Do not accept copying numbers from the table without a comparison statement]


10


Map Questions 40 - 41

Question 40. Following the shortest path apparent on this map, approximately how far is it in miles from Techmedia Computers to the gas station?

Note:

Scoring Guide:1: Any value between and including 1.5 and 3 (miles)7: Any other response0: Question refused/not done

Convert all numbers to decimal form. That is, 2 1/4 (miles) would be considered (for scoring purposes) as 2.25

Question 41. A customer, who is at the desk, asks you how to get to Pleasanton, a neighboring town. You explain the turns and trace the path on the map.

Follow the instructions written under the map on the opposite page and mark the path directly on the map with your pen.

Scoring Guide:1: Path that ends at the south end of Cypress

(see correct route marked by 1 on the map below)7: Any other response0: Question refused/not done

11


TMN Anti-theft Questions 42-45Question 42. List all the documents you need in order to be able to ask for your mobile

telephone to be blocked.


• Proof of purchase (of the mobile phone)• Proof that you have reported the theft OR loss (to the authorities)• (A properly completed) liability form (available from any TMN shop, on

which you should include the make, model and IMEI number of the mobile phone)


Question 43. According to the brochure, what function does the numeric IMEI code play in the company’s anti-theft service?

Scoring Guide:1: Mentions or paraphrases at least ONE of the following:

• Provides (a unique) identifier (code) for your phone (in case it is lost or stolen)

• The company needs to know the code in order to block your serviceOR unblock your service


Question 44. What does the brochure say are the current benefits of the anti-theft service?

Scoring Guide:1: Mentions or paraphrases at least TWO of the following:

• To dissuade people from stealing mobile phones• So that mobile phones cannot be improperly used by third parties if

they are stolen or lost• To make it possible to get the mobile phone back if it is recovered• Blocks or prevents undesired use of your mobile phone (on any

Portuguese mobile network)

[If response includes GSM networks, this should be considered an incorrect response and receive a code 7]


Question 45. Which document must you submit both to block and unblock your mobile phone?

Scoring Guide:1: (A properly completed) liability form7: Any other response0: Question refused/not done

12


Exercise Equipment Questions 46 - 49Question 46. Which muscles will benefit most if you use the gym bench?

Scoring Guide:1: Abdominal (muscles)7: Any other response0: Question refused/not done

Question 47. List all the effects indicated on the chart for which using the rowing machine is rated “Very good”.

Scoring Guide:1: Mentions ALL of the following:

• Leg strength• Abdominal muscles• Overall muscle building• Joints


Question 48. Which piece of equipment listed received the largest number of“Ineffective” ratings?

Scoring Guide:1: Dumb-bells AND/OR weights7: Any other response0: Question refused/not done

Question 49. State any precautions mentioned in the chart that specifically apply to using a rowing machine.

Scoring Guide:1: Learn how to row correctly first so you won’t hurt your back [or equivalent –

must mention both learning to row correctly and that this is associated with back injury]


13


14

Literacy Survey

Main Booklet Scoring Guide

Litera c y Survey <<Year of Survey>> – M ain Booklet Scori n g Guide


Osler’s Web Questions 1 - 4

Question 1. List two things we are told about the funding of Elaine de Freita’s research.Scoring Guide:1: Mentions any TWO of the following:

• She was funded by patient activists.• Her funds evaporated as a consequence of a CDC paper.• Her funding was sporadic


Question 2. What is the main difference in opinion between Hillary Johnson andWilliam Reeves concerning the cause of CFS?

Scoring Guide:1: Mentions or paraphrases:

Hillary Johnson insists that it is a contagious disease, while WilliamReeves disputes that.


Question 3. According to the text, what are the latest scientific findings about CFS?


• (CFS may be) caused by low blood pressure• (CFS may be) treatable with drugs and a sodium rich diet• Not caused by infectious agent OR Can’t be traced from one locale to

another7: Any other response0: Question refused/not done

Question 4. Where does the title Osler’s Web come from?

Scoring Guide:1: From a 19th Century physician (who stressed listening to patients)7: Any other response0: Question refused/not done

1


Baltic Stock market Questions 5 – 10

Question 5. According to the article, what rankings in market capitalization will the joint Baltic stock market have in Central and Eastern Europe?

Scoring Guide:1: (Split) 5th and 6th (places with the Slovenian stock market)7: Any other response0: Question refused/not done

Question 6. According to the graph, which country has the largest market capitalization?

Scoring Guide:1: Russia7: Any other response0: Question refused, not done

Question 7. According to the graph, what is the average daily turnover for Poland?

Scoring Guide:1: (About) $45 million [accept any number from 43-47]

[Note: “million” is a required part of the correct response]7: Any other response0: Question refused, not done

Question 8. According to the article, what are two possible benefits of consolidating the Baltic markets?


• improve liquidity• attract larger investors


Question 9. Identify two countries whose market capitalization is estimated to be between 10 and 15 billion dollars.


• Czech Republic• Hungary


2


Question 10. Identify the three countries that are listed in the graph for average daily turnover but not for market capitalization.


• Bulgaria• Ukraine• Slovakia


3


Dice Questions 11 - 12

Question 11. You roll two dice, one after another. You roll a three on the first die.What is the chance that you will also roll a three on the second die?

Scoring Guide:1: Mentions ONE of the following:

• 1/6 or 1:6 or "one sixth" or "one out of six" (or similar expressions)• Any value between and including 0.166 and 0.17 (e.g., 0.1666,

0.167, 0.16667, etc)• Any value between 16.6 % or 17 % (e.g., 16.66%, 16.7%,

16.6667% etc.)7: Any other response0: Question refused/not done

Question 12. You roll two six-sided dice at the same time.What is the chance you will roll two sixes?


• 1/36 or 1:36 or "one thirty-sixth" or "one out of thirty six" (or similar expressions)

• Any value between 0.027 and 0.03 (e.g., 0.0277,0.0278, 0.028, etc)• Any value between 2.7 % and 3 % (e.g., 2.77%, 2. 78%, 2.8%, etc.)


4


TMN Anti-theft Questions 13- 16Question 13. List all the documents you need in order to be able to ask for your mobile

telephone to be blocked.


• Proof of purchase (of the mobile phone)• Proof that you have reported the theft OR loss (to the authorities)• (A properly completed) liability form (available from any TMN shop, on

which you should include the make, model and IMEI number of the mobile phone)


Question 14. According to the brochure, what function does the numeric IMEI code play in the company’s anti-theft service?


• Provides (a unique) identifier (code) for your phone (in case it is lost or stolen)

• The company needs to know the code in order to block your serviceOR unblock your service


Question 15. What does the brochure say are the current benefits of the anti-theft service?

Scoring Guide:1: Mentions or paraphrases at least TWO of the following:

• To dissuade people from stealing mobile phones• So that mobile phones cannot be improperly used by third parties if

they are stolen or lost• To make it possible to get the mobile phone back if it is recovered• Blocks or prevents undesired use of your mobile phone (on any

Portuguese mobile network)

[If response includes GSM networks, this should be considered an incorrect response and receive a code 7]


Question 16. Which document must you submit both to block and unblock your mobile phone?

Scoring Guide:1: (A properly completed) liability form7: Any other response0: Question refused/not done

5


Light Bulbs Questions 17- 20

Question 17. According to the article, what are the three types of light bulb?


• Incandescent• Halogen• Fluo-compact OR Fluorescent (Tubes)

7: Any other response.0: Question refused / not done.

Question 18. Circle the rating of the type of light bulb that has the highest power rating in watts.

Scoring Guide:1: Circles 1,500 W [under tube-shaped halogen]2: Circles tube-shaped halogen light bulb7: Any other response.0: Question refused / not done.

Question 19. Which type of filament-free light bulb makes it possible to obtain a light similar to that produced by incandescent light bulbs?

Scoring Guide:1: Spherical Fluo-compact7: Any other response.0: Question refused / not done.

Question 20. According to the article, what is the main difference between the way incandescent and halogen light bulbs generate light?


• The type of gas surrounding the filament.• The filament in a halogen is surrounded by halogen gas but the gas in an

incandescent light bulb is different.7: Any other response.0: Question refused / not done.

6


Complaints Question 21

Question 21. In a management meeting, a manager showed the graph and claimed: “There was a huge drop in the number of customer complaints in 2007 compared to 2006”.

Does the graph support the manager’s claim? Explain your answer.

Scoring Guide:1: EITHER:

• (No) Explanation makes a judgment that the drop is not huge: Examples:

- The real/actual drop is not as large as it looks in the graphgiven the actual numbers (450 to 440, or a drop of 10), or

- the graph exaggerates the size of the drop because the scaledoes not start from zero, or

- the graph is not shown in full.• (Yes) explanation says that there is a drop of about 10 complaints but

even a small reduction is important.7: Any other response0: Question refused/not done

Notes:1. Although the expected answer would disagree with the claim that the drop was huge, we

do allow an answer that agrees and gives a valid reason for that opinion. Both answers need to give evidence that they have referred to the vertical scale on the graph.

2. If the answer is the expected one that disagrees with the claim, it can do so either directly or by inference, as in the answer, "They only dropped from 450 to 440." The word, "only" indicates the disagreement.

3. If the answer agrees with the claim, the explanation that even a drop of 10 is important must be explicitly stated. Thus, while an example like, “Yes, there was a drop of 10 complaints” does refer to the scale, it does not say why a drop of 10 from450 should be considered huge and should be coded as a 7.

7


Compound Interest Question 22

Question 22. If you invested $1000, is it true your money will be doubled after 7 years? Support your answer with the results of your calculations.

Scoring Guide:1: YES or ALMOST or NO or NOT QUITE (in 7 years) with EITHER of the

following:• exact calculation of ($)1,948.72 or ($)1,948.71 (or rounded variants)• A computational ‘rule of thumb’ as the basis for deciding whether the

amount is doubled. (An example is “the rule of 72”, which says that dividing 72 by the interest rate gives you roughly the number of

years it will take the initial amount to double)7: Any other response0: Question refused/not done

8


Temperature Scale Questions 23- 24

Question 23. Use the scale on the "Handy Hint" to estimate what 12 degrees Celsius would be in degrees Fahrenheit.

Scoring Guide:1: Any answer from 52 (°F) to 55 (°F) (about) or (approximately) or (~)7: Any other response0: Question refused/not done

Question 24. Use the scale to estimate what the high temperature predicted for Bangkok would be in degrees Celsius (if the scale were extended).

Scoring Guide:1: Any answer from 38 (°C) to 40 (°C) (about) (approximately) (~)7: Any other response0: Question refused/not done

9

Litera c y Survey <<Year of Survey>> – M ain Booklet Scori n g Guide Memory Training Questions 25- 28

Question 25. Which part of the brain is regarded as the seat of speech memory?

Scoring Guide:1: (The) hippocampus7: Any other response0: Question refused/not done

Question 26. What scientific discovery could, according to Allison Sekuler, completely change therapy in rehabilitation after a stroke?


• The brain is not committed to channels formed by experience• The brain can seek out new paths for the transfer of information.


Question 27. What is researcher Siegfried Lehrl’s simple recipe for preventing the degeneration of intellectual capacity, and keeping the grey matter fit?

Scoring Guide:1: Mentions at least one of the following:

• Take an interest in new things• (Sustained) training


Question 28. The text states that seniors are more often the cause of road accidents because, when concentrating on the road in front of them, they overlook traffic from the sides. In the researchers' view, what might be the cause of this?


• Older people have problems if they have to deal with two things at once• The hippocampus is being used and is blocked for other tasks


10


Coca Cola Cans Questions 29- 30

Question 29. What is the price per can during the sale?


• 30 (¢) or “thirty (cents)”• ($).30 or ($)0.30• ($) .3 or ($) 0.3

7: Any other response, including .30 ¢0: Question refused/not done

Question 30. What is the percent of this discount?

Scoring Guide:1: 20 (%) or “twenty (percent)”7: Any other response0: Question refused/not done

11


Tiles Question 31

Question 31. How many tiles are needed to cover the kitchen floor?


• 198 or "at least 198"• About or approximately 200• 189


Note: The answer 189 is correct if someone excluded the 9 tiles already laid. Since this response indicates the goal of accurate counting was met, it is scored as correct.

12


Inflation Questions 32- 34

Question 32. In which month was the prediction of the rate of inflation the most accurate?

Scoring Guide:1: ONE of the following:

• August OR “A”• August clearly identified on the graph itself.


Question 33. Between which two months did the actual rate of inflation go up the most?

Scoring Guide:1: (between) February and March OR “F-M”

• Accept wording that mentions both February and March.• Reject answers that mention only one month.


Question 34. Please estimate: what was the average actual rate of inflation per month during last year? Explain how you figured this out.

Scoring Guide:1: 0.6 (%) or .6 (%) or any number between 0.58 - 0.62, [may or may not

include an explanation]7: Any other response0: Question refused/not done

13


Water Chlorination Questions 35 -39

Question 35. According to the brochure, how does chlorine differ from other disinfectants?


• It remains in the water system for a period of time• It provides protections against any possible growth of coliform bacteria

(as water travels from the reservoirs through pipes to your tap)• It ensures that bacteria cannot survive in the water supply


Question 36. According to the brochure, what happens to the chlorine in treated water if you put a jug in the refrigerator and let it sit for a while?

Scoring Guide:1: (The chlorine) evaporates7: Any other response0: Question refused/not done

Question 37. Based on the information included in this brochure, what can you infer are some of the arguments people make against treating drinking water with chlorine?

Scoring Guide:1: Mentions at least TWO of the following:

• Chlorine isn’t safe• Adding chlorine poses health risks• High chlorine levels on some days may be dangerous• Chlorine makes water smell and/or taste bad


Question 38. According to the brochure, chlorine has been used to disinfect public water supplies since what year?


14


Question 39. The brochure maintains that chlorine is a “natural” way to treat drinking water. What evidence is included to support that argument?


• It breaks down into chloride which is a naturally occurring salt• It breaks down into chloride which is found in the oceans, rivers, earth

and in the human body• The chlorine in the water supply is the same chlorine found in table salt


15


Blood Alcohol Questions 40- 44

Question 40. According to the National Board of Health, a man should not drink more than how many units of alcohol per week?

Scoring Guide:1: 21 (units of alcohol a week)7: Any other response0: Question refused/not done

Question 41. What determines the number of grams of alcohol that are broken down per hour?

Scoring Guide:1: (Your body) weight7: Any other response0: Question refused/not done

Question 42. According to the article, what are the three things that determine blood alcohol levels?

Scoring Guide:1: Must mention or paraphrase at least THREE of the following:

• How quickly you drink• The number of units of alcohol you drink• Your weight• Whether you are a man or a woman.


Question 43. How many of grams of alcohol are there in a glass of port wine?

Scoring Guide:1: 12 (grams of alcohol)7: Any other response0: Question refused/not done

Question 44. Use the information in the table to compare blood alcohol levels for men and women of similar weight.

Scoring Guide:1: Any response that includes a comparison stating that ‘women have a

higher concentration’ OR that ‘men have a lower concentration’ [Do not accept copying numbers from the table without a comparison statement]


16


Wine Questions 45- 47

Question 45. One gallon of wine is approximately equal to five bottles of wine.Approximately how many bottles of wine did an average person in Spain drink in 1996?


• 50 (approximately, about, almost, etc.) (bottles)• 49.8 (bottles)• 49 (approximately, about, almost, etc.) (bottles)


Question 46. In which countries did people drink an average of more than a gallon of wine each month?

Scoring Guide:1: Mentions all four countries: France, Italy, Portugal, Luxembourg OR

their ranking numbers: 1, 2, 3 and 4 OR “the first four countries”.7: Any other response0: Question refused/not done

Question 47. Can you conclude from the information in the table that the total amount of wine consumed in Spain in 1996 was more than in the United States?Explain why or why not.

Scoring Guide:1: Mentions the need to consider the size of the population in each country in

EITHER of these ways:• (No) Explains the need to consider the size of the population in each

country before making a conclusion.For example, “There are more people in the US than in Spain.”

• (Yes) or (No) Explains a consideration of the countries’ population by estimating the population sizes,For example: Spain (estimated population, 50 million), multiplied by10 = 500 million gallons while USA (estimated population, 200 million) multiplied by 2 = 400 million gallons.

[Note –computations and conclusions will vary depending on the estimates used.]


Note:Correct answers can make the point about the need to consider population in a general way. Or they may attempt to go further, making assumptions about the size of the two populations and carrying out the comparison. In this case, the conclusion can be either ‘yes’ or ‘no’, dependingon the assumptions made.

17


Price plans Questions 48 – 51Question 48. What are the two major factors referred to in the advertisement that you

should consider when determining which membership plan is best for you?


• When you will make most of your calls OR The time of day when you will make most of your calls

• The number of minutes you expect to use per month OR How much time you expect to use each month


Question 49. What is meant by the phrase, “Standard monthly charges apply retroactively to all minutes for the month?”

Scoring Guide:1: Respondent paraphrases or gives example of the following:

Monthly call charges are determined by total usage for that month2: Respondent copies or underlines:

The more you talk, the less you pay.7: Any other response0: Question refused / not done

Question 50. Identify two calls listed in the brochure that would be free of all charges.

Scoring Guide:1: Mentions at least two of the following:

• Emergency numbers• Customer care• 1-800 numbers or 0800 numbers


Question 51. Which two rate plans have the same monthly fee?

Scoring Guide:1: Mentions BOTH (Orange) plus 100 AND (Orange) personal7: Any other response0: Question refused/not done

18


BMI Questions 52- 53

Question 52. A man weighs 200 lbs. His height is 71 inches.What is his weight zone?

Scoring Guide:1: Overweight (zone) OR “between 25 and 29 BMI”

[Do NOT accept specific BMI values within the range, such as 27.8]7: Any other response0: Question refused/not done

Question 53. A woman weighs 144 pounds. Her height is 66 inches.What is her BMI? (Use the formula)


• 23.1405 or rounded variant• (about) 23, or "a little over 23" or "slightly over 23"• Due to various common rounding and truncating procedures, other

answers can be considered as correct.

Examples:- Rounded or truncated variants of 23.076923. (Respondent

rounded to two decimal places before dividing.)- Rounded or truncated variants of 23.15789. (Respondent

truncated to two decimal places before dividing.)Note: For other “precise” answers whose value is a little more than 23, scorers should attempt to trace the computations that were used.


19


Energy Reserves Questions 54- 57

Question 54. Circle the name of the country in South America with the lowest percentage of oil reserves.

Scoring Guide:1: Circles Bolivia [must circle Bolivia under South America and under Oil

Reserves]7: Any other response0: Question refused/not done

Question 55. Explain why the figures belonging to oil reserves in Argentina are different in each graph.

Scoring Guide:1: Mentions or paraphrases ONE of the following:

• The number of countries are different• There are more countries in South America (than in MERCOSUR)• In one graph Argentina is considered as part of South America and in

the other as part of MERCOSUR [or equivalent answer]• In one pie chart the oil reserves of Argentina are compared to those of

all of South America and in the other they are compared only to those of MERCOSUR

• The reserves of Argentina are higher in comparison to the four countries of MERCOSUR than to all the other countries in South America


Question 56. Within the MERCOSUR, does Chile have a larger percentage of oil or gas reserves?

Scoring Guide:1: Gas7: Any other response0: Question refused/not done

Question 57. According to the information in the set of graphs, how many million cubic meters of gas are there in South America?

Scoring Guide:1: 6.429 (cubic meters of gas)7: Any other response0: Question refused/not done

20

statistics.caricom.orgstatistics.caricom.org/.../scoring_guidelines.docx · web viewliteracy...

Documents