data management seminar, 9-12th july 2007, hamburg entering data part 2

Data Management Seminar, 9-12th July 2007, Hamburg

Entering Data Part 2

Data Management Seminar, 9-12th July 2007, Hamburg2

Table of Content

1 Introduction

2 Sequence of Variables

3 Entering Data

4 Material Needed for Data Entry

5 Example: Entering Achievement & Reliability Data

6 Hands-On Training:

Entering Test & Reliability Data


EnterAchievement and

Reliability Data

CompleteStudent

Information

EnterBackground Data

EnterAchievement and

Reliability Data

Data Entryand Verification

3


1 Introduction


3 Entering Data

4 Material for Data Entry

5 Example: Entering Student Achievement Data


Entering Achievement and Reliability Data

Table of Content

4


Markers evaluate students responses to constructed-response items

Interpretation is based on Marking Guides provided by the International Study Center

Up to 2 points are assigned– Code 2 is worth 2 points– Code 1 is worth 1 point– Code 0 is worth 0 points (or means invalid)– Code 9 means missing

Code is written at prepared places in the Achievement Booklets or Constructed-Response Items Marking Sheets, so key puncher can enter them later

Mark Constructed-Response Items

5


50% of sampled students 120 booklets of booklet type 1, 2 and 3

Reliability markers will be recorded on separate Constructed-Response Items Marking Sheet for Double Marking and later entered in the Reliability Data File

3R

Reliability Marking

6


Contain student responses to multiple-choice and constructed-response items

Should contain one record for each COMPLETED Student Test Booklet

Student Test Data File

7


Contain reliability codes for constructed-response items

Should contain one record for each COMPLETED marking sheet

Reliability Marking Data File

8


File Naming Convention

Data File Target Grade

Resp. Level Type

Student Achievement I S A

Student Questionnaire I S G

Student Reliability I S R

European Module Student Questionnaire

I S E

Latin American Module Student Questionnaire

I S L

Teacher Questionnaire

I T G

School Questionnaire I C G

National Context Survey

I N G


Identification variables

IDPUNCH – 3 digits, identifies the key puncher

IDSTUD – 8 digits

IDCHECK – 3 digits, in combination with unique ID

Identification Variables – I

10


Identification variables IDBOOK – 1 digit– Applies to Student Achievement and Reliability Data File only– Identifies the booklet that was administered to the student – Used to filter the set of questions to be displayed to the key puncher

Identification Variables – II

11


Identification variablesTest Data Files:IDSCORA – 3 digits, identifies marker for the main marking (Student Achievement Data File)IDSCORR – 3 digits, identifies marker for the reliability marking (Student Reliability Data File)

– Usage of those variable permits identification of systematical marking errors for individual markers

– Assigning procedure suggested is:- Codes for Marking Team A (Set A) start with

1xx- Codes for Marking Team B (Set B) start with

2xx– Codes for both variables must be different for one

and the same student

Identification Variables – III

12


Identification Variables – III

101201

13


Identification variablesIndicator variables

CHECK01, CHECK02,…, CHECKn

– 1 digit, avoid column shifts

– Only entering blank space is allowed

– Appear when – Transition is made between ID- and TOKEN-variables

– Transition is made between the test booklets (Student Achievement and Reliability Data File only)

– The booklet ends

Indicator Variables – I

14


Identification variablesIndicator variables

Student Achievement and Reliability Data File:

TOKEN01 to TOKEN06

– 1 digit, indicates availability of data, 3 codes1 – Instrument available, but empty2 – Instrument not available or lost3 – Instrument available with responses

– TOKENxx appears after CHECKn variable and before survey instrument variables of the corresponding booklet

Indicator Variables – II

15


Identification variablesIndicator variablesTest instrument variables

Test Instrument Variables

16


Variable Value

IDBOOK

IDPUNCH

IDSCORA

IDSTUD

IDCHECK

CHECK01

TOKEN05

CE294M1...31

Sequence in Student Achievement File

201

201

17

5

5

80010104

80010104844

844

111

Booklet 5


1 Introduction


3 Entering Data





Table of Content

18


Key punchers shall be able to enter the data the easiest way possible:– For multiple-choice items – enter checked category

First option Enter 1Second option Enter 2…

Coding of Multiple-Choice Items

Enter 1Enter 2Enter 3Enter 4

19


Key punchers shall be able to enter the data the easiest way possible:– For constructed-response items – enter value

indicated by marker

Coding Constructed-Response Items

0 Enter 0

20


Missing Codes

21

M issing Values Valid Values

Default

6, 96, 996, ...

Invalid

7,97,997,...

Omitted

9, 99, 999, ...

Not Administered

8, 98, 998, ...


Omitted response (9, 99)– Non-response

Enter 9

Omitted Codes – I

22


Omitted response (9, 99)– Non-response– Booklet not completed at all

Omitted Codes – II

23

Do not enter record in WinDEM.


Invalid response (7, 97)– Invalid response

Invalid Codes - I

Enter 7

24


Invalid response (7, 97)– Invalid response

Invalid Codes - II

Enter 7

25


Not administered (8, 98)– Respondent was not administered a section of the booklet

Booklet

1

Booklet

2

Booklet

3

Booklet

4

Booklet

5

Booklet

6

Questions in all other booklets are coded to

Not Administered later at the IEA DPC!

Not Administered Codes – I

26


Enter 8

Not Administered Codes – II

Not administered (8, 98)– Respondent was not administered a section of

the booklet– Question (or page) was misprinted (or missing) in

the booklet

27


Required Information

Required information for entering test data Student Tracking Form (column 9 or 12)

– Student Achievement Test Booklet

Required information for entering reliability marking data Student Tracking Form (column 9 or 12)

– Constructed-Response Items Marking Sheet for Double Marking (Reliability Marking Sheets)

29


1 Introduction


3 Entering Data





Table of Content

30


Start WinDEM

Create Student Test Data File from codebook file ISADEUF2.sdb

Show WinDEM Example – I

D:\Seminar Examples\4_Work_WinDem\ISADEUF2.sdb

31


Enter...

1. Student label information

2. Booklet data

Show WinDEM Example – II

32


1 Introduction


3 Entering Data





Table of Content

33


Hands-On TrainingSchools 8001 and 8502

What you will need: Student Tracking Forms

– Student Achievement Test Booklets (Tab6)

– Reliability Marking Sheets (Tab7)

– Codebooks in

What you will have to do: – Start WinDEM (Start Programs WinDEM_ICCS09_FT

WinDEM_ICCS09_FT)

– Create a data file from corresponding codebook

(WinDEM menu FILE NEW DATA FILE)

– Enter data from booklet labels, booklets and Reliability Marking Sheets

20 minD:\Seminar Examples\4_Work_WinDem

Login: user / bird

34


Hands-On TrainingEntering ACH Data for both Schools

What you will need: Student Tracking Forms (Tab6)

– Student Achievement Test Booklets (Tab6)

– Codebook in


WinDEM_ICCS09_FT )


(WinDEM menu FILE NEW DATA FILE: ISADEUF2.dbf)

– Enter data from booklet labels and booklets

D:\Seminar Examples\4_Work_WinDem\ISADEUF2.sdb

35


Hands-On TrainingEntering REL Data for both Schools What you will need: Student Tracking Forms (Tab7)

– Reliability Marking Sheets (Tab7)

– Codebook in


WinDEM_ICCS09_FT )


(WinDEM menu FILE NEW DATA FILE: ISRDEUF2.dbf)

– Enter data from booklet labels and Reliability Marking Sheets

D:\Seminar Examples\4_Work_WinDem\ISRDEUF2.sdb

36

data management seminar, 9-12th july 2007, hamburg entering data part 2

Documents