student assessments: are t hey f air f or i nternational s tudents ?

12
Student Assessments: Are They Fair For International Students? Connie Eudy & Li Jin Program for Instructional Excellence The Florida State University 1

Upload: elke

Post on 23-Feb-2016

39 views

Category:

Documents


0 download

DESCRIPTION

Student Assessments: Are T hey F air F or I nternational S tudents ?. Connie Eudy & Li Jin Program for Instructional Excellence The Florida State University. Commonly Used S tudent A ssessments. Multiple choice Short essay Group project Class presentation Case study Final paper - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Student Assessments:  Are  T hey  F air  F or  I nternational  S tudents ?

1

Student Assessments: Are They Fair For International Students?

Connie Eudy & Li JinProgram for Instructional Excellence

The Florida State University

Page 2: Student Assessments:  Are  T hey  F air  F or  I nternational  S tudents ?

Commonly Used Student Assessments

• Multiple choice• Short essay• Group project• Class presentation• Case study• Final paper• Field experience (intern, etc.)

2

Page 3: Student Assessments:  Are  T hey  F air  F or  I nternational  S tudents ?

Barriers for International Students

• Language barriers: reading, writing, speaking• Life experience: contextual knowledge,

confidence, cultural difference• Time: will longer time be helpful• Grader bias

3

Page 4: Student Assessments:  Are  T hey  F air  F or  I nternational  S tudents ?

Fairness Issue in Student Assessments

How these barriers may affect the fairness of the student assessments--

Q1: What types of tests are fair for international students?

Q2: What types of tests are unfair for international students?

Q3: What factors may have contributed to the unfairness? (why is it unfair?)

4

Page 5: Student Assessments:  Are  T hey  F air  F or  I nternational  S tudents ?

Research Method

Instrument: A survey consisted of 12 questions

Participants: 63 Graduate students at a south-eastern public university

Data: International students’ responses (15) vs. domestic students’ responses (48)

5

Page 6: Student Assessments:  Are  T hey  F air  F or  I nternational  S tudents ?

Definitions of Fair and Unfair

• Three questions to collect opinions on fairness– 1. Do you think it is fair to compare the scores of international students to the scores of domestic students in the

following types of tests?– 2. An international student can perform as well as an domestic student in the following types of tests when they

have the same level of knowledge on the subject.– 3. An international student may perform as well as a domestic student in the following types of tests when they

have the same level of critical-thinking skills.

• When more than ¾ of the responses are strongly agree & agree, the test is reported as fair. Otherwise, it is reported as unfair (as less fair). This criteria is arbitrary.

• 50% cutting off threshold was used to identify contributing factors.

6

Page 7: Student Assessments:  Are  T hey  F air  F or  I nternational  S tudents ?

7

Types of tests reported as fair/unfair for international students

All Responses International Student Responses

Domestic Student Responses

Fair Multiple ChoiceShort EssayGroup ProjectCase Study

Multiple ChoiceShort Essay

Multiple ChoiceShort EssayGroup ProjectCase StudyField ExperienceFinal Paper

Unfair Class PresentationField ExperienceFinal Paper

Class PresentationField ExperienceFinal PaperCase StudyGroup Project

Class Presentation

Page 8: Student Assessments:  Are  T hey  F air  F or  I nternational  S tudents ?

8

Factors contributing to the unfairness for each test type

Test Type All Responses International Student Responses

Domestic Student Responses

Multiple Choice English-reading skills none English-reading skills

Short Essay TimeEnglish-writing skillsEnglish-reading skills

English-writing skillsTimeEnglish-writing skillsEnglish-reading skills

Group Project English-speaking skillsContextual knowledge

English-speakingContextual knowledge English-readingConfidenceCultural difference

English-speaking skillsContextual knowledge

Class Presentation English-speaking skillsConfidenceContextual knowledge

English-speaking skillsConfidence

English-speaking skillsConfidenceContextual knowledge

Page 9: Student Assessments:  Are  T hey  F air  F or  I nternational  S tudents ?

9

Factors contributing to the unfairness for each test types (continued)

Test Type All Responses International Student Responses

Domestic Student Responses

Case Study English-writing skillsEnglish-reading skillsContextual knowledge

English-writing skillsEnglish-reading skillsContextual knowledgeCultural difference

English-writing skillsEnglish-reading skillsContextual knowledge

Final Paper English-writing skillsEnglish-reading skills

English-writing skills

Time

English-writing skillsEnglish-reading skills

Field Experience English-speaking skillsContextual knowledge

English-speakingContextual knowledge TimeConfidenceCultural difference

English-speakingContextual knowledge

Page 10: Student Assessments:  Are  T hey  F air  F or  I nternational  S tudents ?

10

Comparison of factors contributing to the unfairness

All Responses International Student Responses Domestic Student Responses

English-reading skills; Contextual knowledge

English-writing skills; English speaking skills; Contextual knowledge; Confidence; Cultural difference

English-reading skills; Contextual knowledge

English writing skills; English speaking skills

TimeEnglish-reading skills

English-writing skillsEnglish-speaking skills

Confidence ; Time

Confidence; Time

Page 11: Student Assessments:  Are  T hey  F air  F or  I nternational  S tudents ?

Conclusions and Discussions• International students reported that 5 out of

the 7 types of tests were unfair.• Domestic students reported that only one out

of 7 types of tests were unfair.

11

Page 12: Student Assessments:  Are  T hey  F air  F or  I nternational  S tudents ?

Conclusions and Discussions• The factors contributing to the unfairness of

the tests reported by international students did not match with those factors reported by domestic students for any of the tests.

12