the effect of students’ perceptions of the learning environment on mathematics achievement
DESCRIPTION
The effect of students’ perceptions of the learning environment on mathematics achievement. Explaining the variance in Flemish TIMSS 2003 data. W. Schelfhout , G. Van Landeghem, A. Van den Broeck, & J. Van Damme, K.U.Leuven. 2nd IEA International Research Conference. TIMSS 2003 - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/1.jpg)
1
The effect of students’ perceptions of the learning
environment on mathematics achievement
Explaining the variance in Flemish TIMSS 2003 data
W. Schelfhout , G. Van Landeghem, A. Van den Broeck, & J. Van Damme, K.U.Leuven
2nd IEA International Research Conference
![Page 2: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/2.jpg)
2
• TIMSS 2003
• Mathematics achievement
• Constructivism
![Page 3: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/3.jpg)
3
TIMSS 2003
![Page 4: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/4.jpg)
4
TIMSS 2003 international
• Flanders: 5213 pupils 8th grade pupils in 276 classes in 148 schools
• Math and science achievement
• Pupils’, teachers’ and principals’ questionnaires
![Page 5: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/5.jpg)
5
TIMSS 2003 Flemish extras
• Parents’ questionnaire
• Additional questions in pupils’, teachers’ and principals’ questionnaires
• Spatial and numerical intelligence test
• Two classes per school
![Page 6: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/6.jpg)
6
A-stream vs. B-stream
Classes Number of schools
Two A 109
One A 10
One B 10
Two B 19
Total 148
A = general B = vocational
![Page 7: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/7.jpg)
7
Mathematics achievement
![Page 8: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/8.jpg)
8
Math achievement
• TIMSS 2003 Rasch score
• 8th grade math achievement in Flanders
• 4908 pupils in 268 classes in 144 schools
• A-stream: 4328 pupils in 224 classes in 119 schools
• B-stream: 580 pupils in 44 classes in 25 schools
![Page 9: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/9.jpg)
9
Math achievement
Basic statistics
N Mean SD
A-stream 4328 152.8 (0.4) 8.3
B-stream 580 137.0 (0.7) 7.2
Variance Components
% pupil % class % school
A-stream 69% 17% 15%
B-stream 80% 2% 18%
![Page 10: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/10.jpg)
10
Intelligence (A-stream)
Basic statistics
N Mean SD
A-stream 4374 52.0 (0.5) 11.6
Variance Components
% pupil % class % school
A-stream 72% 12% 16%
Correlation with math achievement: 0.62
![Page 11: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/11.jpg)
11
Intelligence as a predictor of math achievement (A-stream)
Dependent variable: Math N = 4266 A-stream pupils
Model 1 Model 2
Fixed Intercept 152.8 (0.4) 152.0 (0.2)
Explained variance
INT 0.37 (0.01)
Random 2school 9.9 (2.5) 3.1 (0.9) 68%
2class 11.6 (1.9) 4.0 (0.8) 66%
2pupil 47.1 (1.0) 35.9 (0.8) 24%
Deviance 29023.67 27714.97
![Page 12: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/12.jpg)
12
Constructivist learning environment
![Page 13: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/13.jpg)
13
Measurements
• Pupils’ questionnaire (Flemish part): 33 (4-point) items
• Teachers’ questionnaire (Flemish part): 6 (5-point) items
![Page 14: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/14.jpg)
14
Scales, pupils’ questionnaire• Activation (ACTIV)• Clarity (CLAR)• Authentic (AUTH)• Motivation (MOTIV)• Feedback (FEEDB)• Cooperation (COOP)
• Constructivism (TIMSS 1999) (CP)
![Page 15: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/15.jpg)
15
‘Activation’ scale (11 items, = 0.76)
In the math class … … the teacher asks about relationships between
different parts of the subject material during tasks. (8) … … the teacher gives small clues that help us to find
solutions by ourselves. (22) … … during team work or when I am working on my
own, the teacher inquires after the time I need to solve a problem. (33)
![Page 16: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/16.jpg)
16
‘Clarity’ scale (7 items, = 0.82)
In the math class … … the teacher bears in mind pupils’ remarks when
searching for suitable assignments or practice materials. (3)
… … the teacher keeps the class under control. (9) … … it’s thanks to the teacher’s approach that I
understand the subject matter well. (29)
![Page 17: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/17.jpg)
17
‘Authentic’ scale (3 items, = 0.74)
In the math class … … the teacher gives examples of situations in daily
life where the subject matter can be applied. (1) … each new chapter starts with examples from
daily life that clarify the new subject. (5) …situations are described that can happen in the
real world and that need a mathematical solution. (14)
![Page 18: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/18.jpg)
18
‘Motivation’ scale (4 items, = 0.76)
In the math class … … the teacher makes sure that I get interested in
the subject matter. (2) … the teacher uses an agreeable diversity of
approaches in his/her teaching. (4) … we work in a pleasant manner. (12) … I feel that the subject matter will be useful to me
later. (21)
![Page 19: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/19.jpg)
19
‘Feedback’ scale (3 items, = 0.70)
In the math class … … the teacher explains the solution after an
exercise. (18) … the teacher repeats the subject matter when it is
not properly understood by some pupils. (26) … the teacher clarifies errors in tests. (28)
![Page 20: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/20.jpg)
20
‘Cooperation’ scale (2 items, = 0.74)
In the math class … … we have the opportunity to ask other pupils to
explain their way of solving a problem. (27) … we have the opportunity to discuss our
approach to math problems with other pupils. (32)
![Page 21: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/21.jpg)
21
‘Constructivism’ scale (6 items, = 0.73)
Combines items from the scales Activation (2 items) (15) (33) Clarity (1 item) (3) Authentic (1 item) (5) Cooperation (both items) (27) (32)
![Page 22: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/22.jpg)
22
Scales, pupils’ questionnaireBasic statistics
Scale N Mean SD
Activation 4620 2.56 0.48
Clarity 4690 2.99 0.62
Authentic 4829 2.16 0.74
Motivation 4715 2.38 0.71
Feedback 4855 3.21 0.69
Cooperation 4834 2.22 0.85
CP 4738 2.21 0.63
![Page 23: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/23.jpg)
23
Scales, pupils’ questionnaireVariance components
Scale % pupil % class % school
Activation 87% 6% 7%
Clarity 72% 19% 9%
Authentic 79% 9% 12%
Motivation 79% 17% 4%
Feedback 78% 14% 9%
Cooperation 85% 10% 5%
CP 79% 12% 9%
![Page 24: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/24.jpg)
24
Scale teachers’ questionnaire
• 6 item scale (CT), = 0.74
• Items closely related to CP items
• Range 1 to 5; mean = 3.16; SD = 0.64; N = 256 classes
• Variance components: class 48%, school 52%
![Page 25: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/25.jpg)
25
Class level constructivism variables
8 class level indicators of ‘constructivism’:
• Class means of 7 scales from pupils’ questionnaire
• Scale CT from teachers’ questionnaire
![Page 26: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/26.jpg)
26
Class level constructivism variablesBasic statistics in A-stream
Scale N Mean SD
Activation 227 2.56 0.19
Clarity 227 3.01 0.35
Authentic 227 2.08 0.33
Motivation 227 2.34 0.34
Feedback 227 3.24 0.35
Cooperation 227 2.15 0.36
CP 227 2.15 0.28
CT 216 3.15 0.65
![Page 27: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/27.jpg)
27
Class level constructivism variablesVariance components in A-stream
Scale % class % school
Activation 67% 33%
Clarity 69% 31%
Authentic 69% 31%
Motivation 95% 5%
Feedback 65% 35%
Cooperation 91% 9%
CP 86% 14%
CT 47% 53%
![Page 28: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/28.jpg)
28
Class level constructivism variablesCorrelations in A-stream
CLAR AUTH MOTIV FEEDB COOP CP CT
ACTIV 0.80 0.56 0.72 0.77 0.57 0.78 0.16
CLAR 0.47 0.75 0.88 0.55 0.71 0.16
AUTH 0.59 0.41 0.40 0.69 0.14
MOTIV 0.67 0.60 0.76 0.14
FEEDB 0.52 0.66 0.12
COOP 0.85 0.19
CP 0.19
![Page 29: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/29.jpg)
29
Class level constructivism variablesCorrelations with class mean math achievement (A-stream)
ACTIV 0.12
CLAR 0.14
AUTH -0.16
MOTIV 0.00
FEEDB 0.09
COOP -0.04
CP -0.14
CT 0.12
![Page 30: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/30.jpg)
30
Single predictor modelsExample
Dependent variable: Math N = 4328 A-stream pupils
Model 1 Model 2
Fixed Intercept 152.8 (0.4) 152.8 (0.4)
ACTIV 2.9 (1.7)
Random 2school 9.9 (2.5) 9.6 (2.4)
2class 11.6 (1.9) 11.5 (1.9)
2pupil 47.0 (1.0) 47.0 (1.0)
Deviance 29431.02 29428.04
![Page 31: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/31.jpg)
31
Single predictor modelsSummary
Variable N Coeff. p-value
Activation 4328 2.9 (1.7) 9%
Clarity 4328 1.8 (0.9) 6%
Authentic 4328 -1.5 (1.0) 14%
Motivation 4328 -0.1 (0.9) 89%
Feedback 4328 1.1 (0.9) 25%Cooperation 4328 -0.8 (0.9) 39%
CP 4328 -1.9 (1.1) 10%
CT 4088 0.9 (0.5) 9%
![Page 32: The effect of students’ perceptions of the learning environment on mathematics achievement](https://reader036.vdocuments.net/reader036/viewer/2022062409/56815058550346895dbe586f/html5/thumbnails/32.jpg)
32
Conclusion
• Major intake differences between classes and schools (cf. intelligence)
• Indications of marginally significant effects of some aspects of teaching as perceived by the students: activation and clarity