barber. teachers' practices relation to students' civic engagement in three countries
TRANSCRIPT
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
1/26
1
TEACHERS PRACTICES IN RELATION TO STUDENTS CIVIC ENGAGEMENT IN
THREE COUNTRIES
Carolyn Barber
Department of Human Development
University of Maryland, College Park
3304 Benjamin Building
College Park, MD 20742
Phone: 301-405-5427
Fax: 301-405-2891
Email: [email protected]
Paper prepared for the Second IEA International Research Conference
Washington, DC November 2006
Session Topic: CivEd
The comments and assistance of Amy Hendrickson and Judith Torney-Purta are gratefully
acknowledged.
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
2/26
2
TEACHERS PRACTICES IN RELATION TO CIVIC ENGAGEMENT IN THREE
COUNTRIES
The development of civic knowledge, skills, and dispositions does not take place in a vacuum;
rather, it is influenced extensively by ones proximal and distal surroundings. This belief was central
to the development of the IEA Civic Education Study (CIVED: Torney-Purta, Lehmann, Oswald, &
Schulz, 2001). In the conceptual framework guiding this study (commonly referred to as the
Octagon Model), Torney-Purta and colleagues place the individual at the center of a complex
system, most immediately surrounded by teachers, parents, peers, and others who are responsible for
translating to the individual the social goals and values of a society. As the CIVED study is focused
on adolescents, who spend a considerable amount of time participating in school activities both inside
and outside of class, the consideration of how school acts as a catalyst for development is especially
important to consider.
The theoretical frameworks set forth by Bronfenbrenner (1988) and Lave and Wenger (1991),
which each served as background for the development of the Octagon model, can help in
understanding more specifically why schools (and why teachers in particular) are important to
consider in understanding adolescents civic development. In the tradition of Bronfenbrenner, one
can think of teachers as acting as a students microsystem, in which they influence students through
direct interaction with them. Through these interactions, teachers own attitudes can be passed onto
students. Teachers who think that learning about civic education is important can instill in their
students an appreciation for the beliefs and behaviors that are necessary for active democratic
citizenship. This transmission is most effective when teachers are confident in what they teach. In
summary, teachers beliefsboth about themselves and about their subject matterhave the potential
to greatly influence students civic development (see Pajares, 1992; Shulman, 1986).
In the communities of practice framework, different teachers practices provide students with
different opportunities to rehearse the skills needed for civic engagement. Teachers who regularly set
up opportunities to actively engage in learning (e.g., by allowing students to research a topic
themselves rather than having them rely on teachers lectures) give students a chance to exercise the
cognitive skills associated with civic engagement. In many cases, teachers may frame such
engagement in the context of group work, which additionally requires students to practice working
with other students from diverse backgrounds. Further, teachers may shape students civic attitudes
by creating situations in which students practice learning about ideas related to specific aspects of
civic development. An appreciation for cultural diversity, for example, may be encouraged by
providing students with activities specifically related to this area. Finding inspiration for such new
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
3/26
3
ideas, however, can be difficult. Analyses of textbooks and content standards in the United States
revealed that such sources often focused on the most conventional definitions of civic engagement,
such as voting and government structure (Gonzales, Reidel, Avery, & Sullivan, 2001; Gonzales,
Reidel, Williamson, Avery, Sullivan, & Bos, 2004). As a result, teachers who wish to provide
students with such opportunities may need to look beyond the usual standards and curriculum
manuals for guidance.
Previous Analyses of Teachers Effects on Students in the IEA Civic Education Study
Several previous analyses of data from the IEA Civic Education Study have begun to link
characteristics of teachers to students civic development. These studies either used single items or
simple composites (using classical test theory techniques) from the teacher survey to create variables,
or focused on those items which most closely mirrored those items available from the student survey.
Torney-Purta, Richardson, and Barber (2005) acknowledged in their review of literature on the
knowledge and beliefs of teachers of civic-related subjects that few studies explicitly linked the
characteristics of teachers to student outcomes. They sought to fill a gap in this literature by
following up a series of descriptive analyses of teachers with simple multilevel models connecting
teachers training and confidence in teaching political topics to students civic knowledge in three
countries. In the United States, students of teachers who reported participating in civic-related
professional training had significantly higher civic knowledge than did students of teachers without
such teaching. Such training was not significant in Hungary; however, Hungarian students with
teachers reporting high confidence in teaching political topics had higher civic knowledge than did
students with less confident teachers.
The effects of teachers on students civic development are not limited to civic knowledge.
Additional analysis of United States teachers by Torney-Purta and colleagues (Torney-Purta, Barber,
& Richardson, 2005) revealed that students whose teachers had participated in civic-related
professional activities also had higher expectations of informed voting than students who did not. In
addition, students with teachers who had a university degree in a civic-related subject also had higher
expectations of informed voting than those who had teachers with no such degree. The effect of
teachers degree, however, was smaller than the effect of teachers participation in professional
activities.
More recent analysis has included teacher variables formed from composites of items in more
complex models of student outcomes. An analysis by Torney-Purta, Barber & Wilkenfeld (in press)
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
4/26
4
found that United States students whose teachers found the use of official standards and curricular
guidelines very important to their planning had stronger expectations of informed voting than did
students whose teachers found them less important. This effect stood after controlling for several
characteristics of students and schools including ethnicity, home background, school socioeconomic
status, and openness of classroom climate for discussion. In the same analysis, Torney-Purta and
colleagues found that the gap between Latino and non-Latino students in positive attitudes toward
immigrants was larger in schools where teachers more regularly used interactive activities such as
role-playing and group projects. In these schools, Latino adolescents attitudes toward immigrant
rights were even more positive, while no difference in attitudes was observed for non-Latino students.
Torney-Purta and colleagues interpreted this finding as evidence that the interactive activities, which
encouraged students to become more actively engaged in their schoolwork, led to Latino adolescents
increased identification with the immigrant population regardless of whether they themselves were
born in the United States. Homana and Barber (this volume), in analysis of how a schools citizenship
education climate can contribute to civic development, also found that the use of interactive class
activities by teachers in the United States is a significant predictor of students civic knowledge. In
this analysis, teacher reports of the activities used in their classrooms were included in a model with
many other aspects of school citizenship education climate considered as predictors of knowledge,
including extracurricular activity participation, learning about cooperation, classroom discussion
climate, and students individual reports of their classroom activities.
While the majority of analyses on teachers in the CIVED study did not employ item response
theory (IRT) techniques, a study of teachers norms of conventional and social-movement citizenship
conducted by Husfeldt and Barber (2005) involved the creation of IRT scales using a partial credit
model (Masters & Wright, 1997). The scales created in this analysis mirrored the citizenship norms
scales created for students (see Torney-Purta et al., 2001). Follow-up multilevel analysis linking
teachers concepts of citizenship to student outcomes found significant effects of teachers citizenship
concepts on students attitudes toward conventional citizenship norms and their confidence in the
value of school participation in Germany, Hungary, and the United States; and additionally predicted
students social-movement citizenship norms and expectations of participating in political activities in
Hungary only.
Summary: The Current Analysis
In summary, several analyses have begun to consider how teachers experiences, practices, and
beliefs can influence students civic development along several dimensions. In order to gain more
information, however, more sophisticated measurement and analytical techniques need to be used.
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
5/26
5
One hallmark of the CIVED study (and of IEA studies more generally) is the use of IRT scales to
measure students knowledge, skills, attitudes, and behaviors. IRT methods are preferable to scales
made using classical test theory techniques in a cross-national study like this for two reasons: they
allow for the more precise estimation of respondent characteristics based on fewer items, and they can
easily be tested to ensure scale comparability across countries or age cohorts (Hambleton,
Swaminathan, & Rogers, 1991). The development of IRT scales based on the teacher survey will
improve researchers ability to study civic-related teachers and their role in civic development.
IRT scales are only practical, however, when scale is thought to capture individual differences
in a given behavior or attitude (Lubke, 2006). For certain behaviors or attitudes, there may be fewer
individual differences to capture. For example, while a nationally-representative sample of students
or adults (or even teachers more specifically) may differ widely in their view of the importance of
civic education, the sample of civic-related teachers of 14-year-olds surveyed as part of the CIVED
study may demonstrate considerably less variation. One could argue that these teachers would not
choose to teach civic-related subjects if they did not find the subject at least somewhat important!
Similarly, there may not be many individual differences in how teachers use planning materials. In
either case, it may be more correct to say that certain groups of teachers exist with distinct patterns of
importance beliefs or of planning habits, and that response to certain items can indicate category
membership. When categorical variables (e.g., the likert-scales used in CIVED survey items) are
thought to indicate category membership rather than location on a continuous scale, latent class
analysis is an appropriate technique to analyze the data (Dayton, 1998). Just as IRT analysis results in
scales that can be used in future analyses, latent class analysis results in categorical group
membership variables that can be used in similar ways.
The purpose of this current study is twofold: to create a series of variables measuring teachers
confidence, classroom activity usage, importance beliefs, and planning habits using IRT and latent
class analytic techniques, and then to use the resulting variables to predict characteristics students
civic engagement and development in a multilevel analysis. This analysis will focus on Australia,
England, and the United States, which are three countries that had major policy iniatives related to the
formal teaching of civic education around the time of the CIVED study (e.g. 1998 Crick Report in
England; Civic Expert Group report 1994 in Australia, The National Commission on Civic Renewal
in the U.S. 1998).
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
6/26
6
Data
The International Association for the Evaluation of Educational Achievement (IEA), a
consortium of educational research institutes in nearly 60 countries has been conducting comparative
education studies for nearly 50 years. In the early 1990s some member countries asked for a study of
civic education that included measures of young people's civic-related attitudes and behaviors. Their
aim was to study schools' intentions and practice relating to democracy. The IEA organization
brought to this effort a wide network of research institutes in different countries and a wealth of
technical and methodological expertise in cross-national comparative education research. Included in
this network were several experts in the areas of Rasch scaling and polytomous IRT models.
The CIVED study consisted of two stages. Case studies were conducted in the first phase of the
study that were used as the basis for a consensus process to develop content specifications for a test of
students civic knowledge (with right and wrong answers) and surveys of political attitudes and civic
behavior, as well as surveys administered to teachers and school administrators. In the second phase,
an International Steering Committee and National Research Coordinators developed an instrument (a
student test and survey) that would be suitable for younger and older adolescents and would take
about two class periods to complete.
Nationally representative samples of students in the modal grade for 14-year-olds (a total of about
90,000 students from 28 countries) were tested in 1999; upper secondary students ranging in age from
16 to 19 (a total of about 50,000 students from 16 countries) were tested in 2000. Torney-Purta and
colleagues (2001) described the scaling and analysis of the 28 countries surveying 14-year-olds, while
Amadeo, Torney-Purta, Lehmann, Husfeldt, and Nikolova (2002) described the same work conducted
in 16 countries assessing upper secondary students.
Teachers in the IEA Civic Education Study
A survey of teachers experiences and attitudes was also developed and administered in Phase 2 of
the study. Teachers were administered a survey in 27 of the 28 countries that surveyed 14-year-olds,
making data available on teachers in every country surveyed except Colombia. In each school where
14-year-old students were tested, between one and three teachers were identified as teachers of civic-
related topics, as they taught subjects such as government, national history, social studies, and social
sciences. While it was preferred that the three sampled teachers were the teachers of the class of
students who filled out the survey (i.e., they taught these students), other teachers of civic-related
disciplines were surveyed if information from one or more teachers of the tested students could not be
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
7/26
7
obtained. The student samples were nationally representative of 14-year-olds; however, the samples
of teachers were not representative of civic-related teachers.
The teacher survey consisted of three sections: work experience and education, views on civic
education, and the teaching of civic-related subjects, activities, and lessons. The items in each of these
three sections were designed to provide contextual information on students in-school civic education
experiences. Losito and Mintrop (2001) provide additional information on how teachers were
selected for surveying, as well as an overview of results from the teachers survey reported on an
item-by-item basis.
Methods
This current study focuses on data from the civic-related teachers of 14-year-old students from
England, Australia, and the United States. The decision to focus on 3 countries rather than 27 came
from a desire to explore in depth how certain items, and scales made from these items, functioned
differently in different countries (in Barber, 2006). Statistical analyses of differential item functioning
require comparisons among groups (e.g., Swaminathan & Hambleton, 1990), which becomes
extremely complicated when analyzing 27 groups at a time but is more reasonable when exploring
only three at a time. The 3 particular countries were chosen because they were all from a similar
language background, meaning that there were fewer questions about how items translated across
samples from different countries, because they were from a similar cultural background, and because
civic education has been a relevant policy topic in each country. Additional information on the
education systems for each of these countries, which further outline similarities and differences in the
civic education systems of these three countries, can be found in the Phase 1 book of case studies by
Torney-Purta and colleagues (1999).
A total of 589 civic-related teachers who reported that they taught the students in a tested class
were surveyed in these three countries (Australia n = 244, England n = 271, United States n = 74: see
Husfeldt & Barber, 2005, for a description of the selection process). More civic-related teachers were
surveyed in Australia and England as compared to the United States because more than one teacher
was linked to a classroom of students (see Losito & Mintrop, 2001, for details).
Variables
The items of interest for this study come from the section of the teacher survey relating to the
teaching of civic-related subjects, activities, and lessons. In particular, the analysis focuses on items
relating to teachers frequency of activity use and their confidence in teaching political topics, and
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
8/26
8
extends upon two previous, exploratory analyses of teachers items conducted by researchers
affiliated with the CIVED study (Torney-Purta et al., 2005, in press).
Use of classroom activities. Previous analysis has shown that the use of classroom activities is a
multidimensional construct (Torney-Purta et al., 2001). In the analysis of data from the student
survey of the CIVED study (Schulz & Sibberns, 2004), a two-factor model of students perceptions of
classroom experiences were found to best fit the data: one dimension relating to an open classroom
climate for discussion, and another focusing on the perception of a lecture-centered environment.
Many students who perceived an open discussion climate also perceived a very lecture-oriented
classroom.
Similarly, in analysis of data from teachers, exploratory analyses suggest the presence of several
dimensions of classroom experience. In particular two dimensions thought to be of greatest
theoretical importance to the study of teacher practices are selected for analysis here. The more
traditional classroom activities are thought to be teacher-centered, in the sense that teachers are
responsible for administering materials that students must use, assessments that students must take,
and questions that students must answer. Five items were thought to relate to the use of such
activities. Teachers were asked to rate on a scale of 1 (never) to 4 (very often) how often the
following events happened in their classrooms:
The teacher chooses the issues to be discussed in class. Students study textbooks. Students work on drill sheets or work sheets. The teacher asks questions and the students answer. The teacher lectures and the students take notes.
Items relating to this idea are thought to measure the importance that teachers place on interactive
classroom activities of any type. The three items chosen as indicators for this construct (based on
above exploratory analysis and on analysis reported by Torney-Purta et al., in press) are:
Students work on projects that involve gathering information outside of school Students work in groups on different topics and prepare presentations Students participate in role play and simulations
Confidence in teaching political topics. A teachers confidence can refer to many things,
including both their level of comfort with the subject matter and their efficacy in teaching itself
(Schulman, 1986). While very few items in the CIVED study capture teachers pedagogical efficacy,
many are designed to measure their level of comfort in teaching various civic-related topics. Even in
focusing solely on the subject matter of civics, however, teaching confidence is a multi-dimensional
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
9/26
9
construct. Teachers may feel very adept at teaching about the political process or about systems of
government, but may feel differently about teaching topics less traditionally thought of as civics,
such as womens rights or cultural diversity. Indeed, preliminary exploratory factor analysis of the
items addressing teachers confidence in teaching political topics reported by Torney-Purta and
colleagues (2005) found at least three such dimensions.
Torney-Purta and colleagues focused on two of these dimensions which were thought to be most
prevalent in civics and other related classes cross nationally in their exploratory analysis of teachers
confidence. This current analysis will extendupon this by further analyzing these same two
dimensions. For the first dimension, five items were selected that were thought to best relate to
conventional political issues. These five items were thought by experts in the field of civic education
to be most important to civic education, and most comparable in meaning across countries (Torney-
Purta et al., 2005). Teachers were asked their level of confidence for dealing with the following
topics, with possible answers ranging from not at all confident to very confident:
National Constitution and state/political institutions Citizens rights and obligations Different conceptions of democracy Elections and electoral systems The judicial system
The second dimension was hypothesized to represent the confidence that teachers had in teaching
topics that dealt more with social issues, rather than with political systems. The items thought to
indicate confidence in this area asked teachers, How confident do you feel to deal [sic] with this
topic:
Equal opportunities for women and men Cultural differences and minorities The media
Importance of teaching civic-related topics. In addition to reporting their confidence in teaching
various civic-related topics, teachers were also asked to indicate how important they felt that each
topic was. Teachers responded to each item on a four-point scale: not important, less important,
important, or very important. Two sets of items measuring the importance that teachers give to civic-
related topics were identified that matched the two sets of items measuring teachers confidence. One
set measures teachers belief in the importance of teaching political topics, and the other measures
teachers belief in the importance of teaching social topics.
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
10/26
10
An important difference between teachers belief in the importance of activities and their
confidence in teaching them is the extent to which there are individual differences among teachers
views of the importance of thee subjects. While the items in the teacher survey may be able to capture
individual differences in teachers confidence levels on a continuum, the items related to importance
are better suited for identifying categories of teachers who find certain activities to be more or less
important. One reason for this difference has to do with the specific group of teachers being studied.
Civic-related teachers are unlikely to find many (if any) civic-related subjects unimportant to teach,
although some may find certain subjects more or less important. This is reflected in the fact that only
a small percentage of teachers report that they find teaching many subjects not important or a little
important. (In fact, there are several items for which no teacher reports that the subject is
unimportant.) Thus, while teacher confidence is analyzed here using IRT techniques, which place
teachers response on a scale, teacher importance will be analyzed here using latent class analysis
techniques.
Use of planning materials. Similarly, teachers responses to items relating to their use of
materials when planning civic-related lessons are not thought to fall on a continuous scale. Instead,
they are thought to reflect membership into one of several categories, or types, of activity usage. In
particular, two categories of activity materials are suggested by the items. On one hand, several items
capture the extent to which teachers use official materials in planning. Teachers were asked to report
on a scale of 1 (not important) to 4 (very important) each of the following sources:
Official curricula or curricular guidelines or frameworks Official requirements or standards in civic education [Approved] textbooks
On the other hand, the other items in this set reflected the extent to which teachers used outside,
unofficial sources in their planning. Using the same scale, teachers were asked to report how
important each of the following sources were to their planning:
Your own ideas as to what is important to know in civic education Original sources (such as constitutions, human rights declarations) Materials published by commercial companies, public institutes, or private foundations Self-produced materials The media (newspapers, magazines, television)
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
11/26
11
Measurement of Teachers Practices
Item response theory. Items thought to be measure teachers beliefs and practices on a continuum
(i.e., their preference for certain activities and their confidence in teaching certain subjects) were
analyzed using a series of generalized partial credit models (GCPM: Muraki, 1992). One model was
estimated for each dimension outlined above, for a total of four models (conventional activities,
interactive activities, political teaching confidence, social teaching confidence). A GCPM analyzes
five parameters, or characteristics, of items with four categories: the items overall difficulty, three
category thresholds (or the relative difficulty of one item response category as compared to the
others), and the items discrimination (or the extent to which the item responses separate the higher
scorers on the overall scale from the lower scorers). Previous IRT analysis of student data from the
CIVED study has relied on partial credit models, which take into account overall difficulty and
category thresholds, but not discrimination (which is fixed to a value of 1: see Schulz & Sibberns,
2004). Here, the greater flexibility afforded to the model by estimating discrimination was thought to
ensure a better fit for an analysis specifically tailored to civic-related teachers of 14-year-olds.
Item parameters were estimated using PARSCALE 4.1. (duToit, 2003). A senate weight was
employed when estimating parameters within PARSCALE that both took into account the national
representation of students to whom the teacher was linked, and allowed each of the three countries to
contribute equally to the estimation of item parameters, regardless of sample size. After an initial
estimation of item parameters, additional analyses were conducted to ensure item fit and to remove
items which did not fit the model. Following this test of item fit and the removal of items not fitting,
scale scores were created in PARSCALE and set to have a mean of 10 and a SD of 2, in line with
other attitudinal scales created from CIVED data. Finally, additional analyses with these new scales
was conducted to ensure that each item functioned similarly as an indicator of its scale across all three
countries.
Latent class analysis. For the analysis of items thought to indicate membership in particular
categories (e.g., of importance beliefs or of planning habits), a series of latent class analyses were
performed using MPlus 4.1 (Muthn & Muthn, 2006). In a latent class analysis, response patterns
are analyzed as they are thought to indicate membership in any number of categories, or latent
classes, as requested by the researcher. The software estimates parameters for the conditional
probability of choosing a given response option given latent class membership. In this analysis, there
were four conditional probabilities (one for each possible response option) for each item in each class
estimated. For example, if a set of two latent classes was measured by three items, then there would
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
12/26
12
be a total of 4*2*3 or 24 conditional probabilities reported. In addition, the proportion of
respondents expected to fall into each latent class was estimated.
To begin, two latent classes were tested for each of the four models estimated (social importance,
political importance, official planning sources, and unofficial planning sources). Models with
additional classes were also tested as the data would allow, and then compared to the simpler models
to see whether there was a significant improvement in model fit. Once a model was chosen for each
construct, MPlus computed the conditional probabilities of each teacher falling into each class, and
then assigned the teacher to the category with the greater membership probability. As with the IRT
analysis, weights were included in analysis which took into account national representation of
students while allowing each of the three countries to contribute equally to the analysis.
Multilevel Modeling
Once scale scores and class memberships were calculated, they were incorporated into an
analysis of students civic engagement. In particular, a series of multilevel models allowed for
student outcomes to be estimated by characteristics of teachers in their school in a way that takes into
account that students were nested within schools and linked to teachers in those schools.
To take into account that students are linked to more than one teacher in their school, the two
units of analysis that were used in the multilevel model are schools and students, not teachers and
students. Scores for all teachers included in the measurement analysis were considered; if data were
available for more than one teacher in a school, then their scores were averaged together. In the case
of the dichotomous latent class variables for importance of teaching topics and for the use of planning
materials, the modal category membership was used. If teachers were equally split between
categories, then the school was randomly assigned to one of the categories. In the United States only
one teacher per school was surveyed, which meant that the teachers score became the score for the
school. In this analysis, teachers can be thought of as informants of the teaching practices that
occur within the school.
Certain schools did not survey a civic-related teacher who taught the tested class. In other cases,
the teacher did teach the tested class but did not answer any questions in a section, making the
computation of a scale score impossible. In these cases, data were imputed by taking the average
value of the schools nearest to it in the data set as ordered by school identification code. Because
school ID codes are ordered by strata (i.e., schools under the same control [public/private] or that are
located in a similar region of the country appear near each other in the data set), this imputation
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
13/26
13
strategy was deemed satisfactory. Less than 10% of schools in England or Australia needed to have
data imputed; however, close to 50% of schools in the United States needed to have data imputed.
Identical analyses were ran in the U.S. with only schools with non-imputed and with the full set of
imputed and non-imputed schools, with no differences found between analyses in terms of significant
effects found. Altogether, students in 142 schools in Australia, 128 schools in England, and 124
schools in the United States were included in the sample (student N = 3331, 3043, and 2811,
respectively.)
Once school scores were created and missing data imputed, multilevel models were tested using
Hierarchical Linear Modeling software (HLM: Raudenbush, Bryk, Cheong, & Congdon, 2005).
Because this is an initial, exploratory analysis of how these characteristics of teachers might influence
students, only one set of teacher variables was tested as predictors at a time. Altogether, four sets of
analyses were tested: one for teachers use of activities, one for teachers confidence, one for teachers
belief in importance of certain topics, and one for teachers use of planning materials. In all analyses,
a series of student variables were included in their model centered on their group mean, which means
that these variables only reduced variability within (not between) groups. The inclusion of these
student-level variables was designed to capture individual differences in civic development and
differences due to home background, which reduced within-school variance (and, by extension,
increased the intraclass correlation, or ICC, of these outcomes) and made the detection of between-
school effects due to differences among teachers easier. The student-level variables included were
gender, home literacy (books in the home), discussion of political topics with parents, reading about
national topics in the newspaper, trust in the government IRT scale (Torney-Purta et al., 2001), and
internal political efficacy IRT scale (Husfeldt et al., 2005)
All student-level IRT scales other than internal political efficacy and trust in government are
considered as outcomes. These scales are described in depth in the main summary of the IEA Civic
Education Study of 14-year-olds (Torney-Purta et al., 2001) and in a summary of additional analyses
conducted through CEDARS (Husfeldt et al., 2005). The outcomes of interest included scales of civic
knowledge (total scale only), concepts of citizenship and government (norms of conventional
citizenship, norms of social movement citizenship, economy-related government responsibilities, and
society-related government responsibilities), political and social attitudes (attitudes toward ethnic
minority, immigrant, and womens rights; attitudes toward anti-democratic groups, positive and
protective attitudes toward the nation; trust in the media), expected civic participation (informed
voting, non-voting political activities, community participation, and illegal protest), and attitudes
toward school (perception of open classroom climate for discussion and confidence in the value of
school participation).
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
14/26
14
Results
Measurement Results
Item response theory analysis. Tables 1-4 report the results of the IRT analyses for the four sets
of items whose responses are thought to fall on a continuous scale (conventional class activities,
interactive class activities, confidence in teaching political topics, and confidence in teaching social
topics, respectively). Each table reports the items discrimination, difficulty, and three category
parameters. A discrimination score of 0 indicates that the item does not differentiate at all among
teachers with different confidence levels (or levels of activity usage); most items are expected to have
a discrimination parameter around 1. Each category parameter is subtracted from the items overall
difficulty to get the difficulty threshold between two categories (e.g., category parameter c1 is the
threshold between the lowest and second-lowest response options). The average scale difficulty is 0.
Additional information about the analyses of model fit and differential item functioning is available in
Barber (2006).
Table 1: Item Parameters for Use of Conventional Activities Scale
Discrimination Difficulty c1 c2 c3
Students Study Textbooks 1.14 -0.24 1.63 -0.34 -1.29
Students Work on Worksheets 0.54 -0.60 2.71 -0.52 -2.18
Teacher Asks Questions/Students Answer 0.83 -1.70 3.50 -0.95 -2.55
Teacher Lectures/Students Take Notes 0.65 0.51 1.98 -0.80 -1.18
Note: c1-c3 are category parameters.
Although five items were thought to indicate teachers use of conventional activities, the item
relating to teachers choosing the issues to be covered displayed poor model fit and was removed from
the analysis. With the exception of the item relating to students use of textbooks, the remaining
items have somewhat low discrimination, or ability to distinguish between teachers with high or low
use of these activities more generally. However, the inclusion of these items was necessary to
maintain adequate model fit, so they were retained in analysis. Among the items leastable to
discriminate between teachers with different preferences were the frequency with which students
work on worksheets, and the frequency with which teachers lecture and students take notes. These
items also varied in their difficulty. It took the least reported use of teacher-centered activities for
teachers to report asking questions to students regularly, and the most use to report regularly lecturing
to students while they take notes.
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
15/26
15
Table 2: Item Parameters for Use of Interactive Classroom Activities Scale
Note: c1-c3 are category parameters.
Although three items were listed as potential indicators of teachers use of interactive classroom
activities, only two were retained after analysis of items. The third, relating to the frequency with
which students work on projects, had considerably lower discrimination, and the model fit did not
change when this less-discriminating item was removed. The items that remained were nearly equal
in the extent to which they discriminate among teachers with different levels of use for interactive
classroom activities. However, it took less use of such activities to report that students regularly work
in groups on projects than it did to report that students regularly participate in role-plays and
simulations, as indicated by these items difficulty.
Table 3: Item Parameters for Confidence in Teaching Political Topics Scale
Note: c1-c3 are category parameters.
The item relating to teachers confidence in covering the National Constitution and political
institutions was the most discriminating, while the item relating to elections was the least
discriminating. Overall, the topic that required the least confidence (as determined by item difficulty)
was teaching citizens rights; the topic that required the most underlying confidence to report
confidence in was the judicial system.
Discrimination Difficulty c1 c2 c3
Students work in groups on different topics 1.68 -0.41 1.75 -0.27 -1.48
Students participate in role-play andsimulations 1.65 0.08 1.71 -0.36 -1.35
Discrimination Difficulty c1 c2 c3
Constitution/ Institutions 2.36 -0.32 1.13 0.08 -1.21
Citizens Rights 1.52 -0.76 1.48 0.10 -1.58
Conceptions of Democracy 1.55 -0.44 1.21 0.07 -1.28
Elections/ Electoral System 1.36 -0.47 1.27 0.20 -1.48
Judicial System 1.42 -0.28 1.34 0.09 -1.43
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
16/26
16
Table 4: Item Parameters for Confidence in Teaching Social Topics Scale
Note: c1-c3 are category parameters.
Items relating to confidence in teaching about equal opportunities for men and women and about
cultural differences were similar in their ability to discriminate among teachers with varying levels of
confidence in teaching social topics; confidence in teaching about the media was less discriminating.
As determined by the items difficulty, teaching about media also required the least underlying
confidence for a teacher to rate it as a subject they are confident in, although expressing confidence in
teaching about cultural differences was nearly as easy.
Latent class analysis. Analysis to determine categories of teachers based on their beliefs of the
importance of civic-related topics and their use of various planning materials yielded mixed results.
In the analyses of the importance of teaching political topics and the use of official planning materials,
not even a simple two-class model was supported by the data. This suggests that there is not enough
variability among teachers in this sample in their views of whether studying political topics is
important or in their use of official planning materials to create multiple categories of teachers based
on these characteristics.
For the analysis of teachers beliefs in the importance of teaching about social topics, the data
were only able to support a two-class model. The inclusion of additional classes resulted in complete
separation, which meant that teachers who gave a particular response to an item had a 0% probability
of falling into one of the classes. This is indicative that there was not enough information to fully
estimate all parts of the model. The conditional probabilities associated with this two-class model are
summarized in Table 5. They suggest that the two classes represent teachers who find teaching about
these topics somewhat more important and somewhat less important. Teachers who responded that
they think that these activities are not important, somewhat important, or important have a
higher probability of falling into class 1 than they do of falling into class 2. To contrast, teachers who
viewed these activities as very important have higher probabilities of falling into class 2. The
bolded proportions in Table 5 indicate which class membership is more likely given each individual
item response.
Discrimination Difficulty c1 c2 c3
Equal Opportunities 1.80 -1.00 1.35 0.19 -1.54
Cultural Differences 1.76 -0.77 1.33 0.15 -1.48
The Media 1.08 -1.10 1.31 0.34 -1.65
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
17/26
17
Table 5: Conditional Probabilities for Two-Class Model of Importance of Teaching Social Topics
Low (#1) High (#2)
Equal Opportunities
Not Important 1% < 1%
Somewhat Important 2% < 1%
Important 82% 23%
Very Important 15% 76%
Cultural Differences
Not Important -- --
Somewhat Important 3% < 1%
Important 94% 6%
Very Important 3% 93%
Media
Not Important
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
18/26
18
Table 6: Conditional Probabilities for Importance of Unofficial Planning Materials
High Low
Your Own Ideas
Not Important 2% 2%
Less Important 8% 20%
Important 54% 74%
Very Important 37% 4%
Original Sources
Not Important 1% 3%
Less Important 13% 17%
Important 35% 64%
Very Important 51% 16%
Outside Materials
Not Important 5% 8%
Less Important 36% 49%
Important 44% 42%
Very Important 15% < 1%
Your Own Materials
Not Important < 1% 2%
Less Important 5% 29%
Important 58% 67%
Very Important 35% 3%
Media
Not Important < 1% < 1%
Less Important < 1% 9%
Important 25% 73%
Very Important 75% 11%
Multilevel Models of Students Civic Engagement
Multilevel analyses revealed many ways in which teachers practices and attitudes can influence
students civic development. All student-level IRT scales were tested against all sets of predictors
(with the exception of internal political efficacy and trust in government, included as within-school
controls in all models). However, there were no significant teacher-level predictors for students
attitudes toward anti-democratic groups or their protectionist attitudes toward their nation. Therefore,
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
19/26
19
these outcomes do not appear in any other analysis. Country-by-country results for each of the six
teacher predictors (scales or categories) are reported in Table 7. A report of this multilevel analysis
follows, organized by teacher predictors.
Table 7: Descriptive Statistics (Mean and SD or percentage) by Country for New Teacher Variables
Australia England United States
Use of Conventional Classroom Activities 9.9 (1.9) 9.4 (2.0) 10.3 (2.0)
Use of Interactive Classroom Activities 10.1 (1.8) 9.7 (1.9) 10.3 (2.2)
Confidence in Teaching Political Topics 10.3 (1.8) 9.1 (1.9) 10.8 (1.8)
Confidence in Teaching Social Topics 10.1 (2.0) 9.4 (2.0) 10.5 (1.8)
High Importance Given to Social Topics 49% 53% 58%
High Use of Unofficial Planning Materials 51% 40% 43%
Teachers use of classroom activities. Results of multilevel analyses revealed that teachers
influenced students the most through their choice of classroom activities. In particular, their use of
interactive activities such as role-playing or group project had an extensive effect on students
knowledge, conceptualizations of citizenship and government responsibility, social attitudes, expected
participation, and their perception of their school. These results are summarized in Table 8.
Table 8: Summary of the Effects of Classroom Activities on Civic Engagement in Three Countries
Australia England United States
Convention Interactive Convention Interactive Convention Interactive
Knowledge n.s. 1.32* (.55) n.s. n.s. n.s. n.s.
Social Citizen n.s. n.s. -0.04+ (.04) n.s. 0.06+ (.04) n.s.
Econ. Gov. n.s. 0.06* (.03) n.s. n.s. n.s. n.s.
Society Gov. n.s. 0.09* (.04) n.s. n.s. n.s. n.s.
Imm. Rights n.s. 0.16* (.05) n.s. -0.19* (.07) n.s. n.s.
Wom. Rights n.s. 0.12* (.04) n.s. n.s. n.s. n.s.
Minor. Rights n.s. 0.14* (.08) n.s. n.s. n.s. n.s.
Inf. Voting n.s. 0.10* (.03) n.s. n.s. n.s. n.s.
Illegal Protest n.s -0.08* (.04) n.s. n.s. n.s. n.s.
Class Climate n.s. 0.14* (.05) n.s. n.s. -0.08+ (.09) -0.09* (.23)
Confidence in
School Part. n.s. 0.11* (.04) n.s. n.s. n.s. -0.08* (.03)
Note: HLM regression coefficients reported. Standard errors are in parentheses. Civic knowledge
student mean = 100, sd = 20; all others student mean = 10, sd=2 +p < .10; *p < .05
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
20/26
20
The impact of teachers choice of classroom activities was most noticeable in Australia. Students
who attended schools in which teachers regularly used interactive activities had higher civic
knowledge than those attending schools in which teachers used these activities less. They also had a
stronger attitude toward government responsibilities, both economic-related (ensuring that citizens
can make a living) and society-related (e.g., ensuring that citizens have access to education and health
care). Students with teachers who regularly engaged them in interactive activities had more positive
attitudes toward the rights of women, immigrants, and ethnic minorities; and were more likely to
expect to vote and less likely to protest illegally. Finally, being exposed to opportunities to
collaborate with one another in the classroom had a positive effect on students individual attitudes
toward school, increasing their perception of an open classroom climate and their confidence that their
participation in school decision-making is valued.
The effects of teacher activities on students civic development are less apparent in England and
the United States. However, unlike Australia, the use of conventional classroom activities such as
working from a textbook and lecturing did seem to significantly impact students. Students who had
teachers who more heavily relied on conventional activities in the classroom had less strong beliefs
about the importance of social-movement citizenship (e.g., the importance of standing up for human
rights) in England, and also less positive attitudes toward immigrants. To contrast, students with
teachers who used conventional activities more hadstrongerbeliefs about this type of citizenship in
the United States. In addition, United States students in schools where teachers relied more upon this
conventional, teacher-centered form of instruction perceive their classrooms as less open to
discussion. However, U.S. students with teachers who relied more heavily on interactive classroom
activities similarly had less positive perceptions of the openness of their classrooms to discussion, and
also had less confidence in the value of their participation (opposite to the effect in Australia).
Teachers confidence in teaching. Teachers confidence in teaching certain civic-related topics
had far less of an impact on students civic development. In fact, there were no significant
relationships between confidence and students civic outcomes in the United States. In Australia and
England, confidence in both political and social areas was tested for their effects on student outcomes;
however, only teachers social confidence was significant. These results are reported in Table 9.
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
21/26
21
Table 9: Summary of the Effects of Confidence in Teaching Social Topics in Australia and England
Australia England
Social Citizen 0.03* (.03) n.s.
Conventional Citizen 0.06* (.03) n.s.
Trust in the Media -0.05* (.03) n.s.
Illegal Protest n.s. 0.11* (.04)
Note: HLM regression coefficients reported. Standard errors are in parentheses. All student mean =
10, sd=2. Analysis controls for teachers political confidence. +p < .10; *p < .05
As with the previous analysis, teachers had the furthest-ranging effects on students in Australia.
Students with teachers who were confident in teaching about social topics had stronger beliefs in the
importance of both conventional citizenship and social-movement citizenship. At the same time, they
also expressed less trust in the news media. In England, students with teachers who had confidence in
teaching about social topics were more likely to expect to participate in illegal protest.
Teachers perception of the importance of teaching social topics. This analysis of teaching
about social topics focuses on the gap in students achievement between those who have teachers who
find teaching about these topics more or less important. Again, no significant results were found in the
United States; significant results for Australia and England are summarized in Table 10.
Table 10: Summary of the Effects of Importance of Teaching Social Topics in Australia and England
Australia England
Knowledge -4.47* (1.64) n.s.
Social Citizen 0.19* (.08) 0.16* (.08)
Conventional Citizen 0.27* (.09) 0.12+ (.07)
Pos. Attitudes toward Nation n.s. 0.29* (.10)
Minority Rights n.s. 0.27* (.14)
Political Activities n.s. 0.19* (.11)
Classroom Climate -0.28* (.12) n.s.
Note: HLM regression coefficients reported. Standard errors are in parentheses. Civic knowledge
student mean = 100, sd = 20; all others student mean = 10, sd=2. +p < .10; *p < .05
In both Australia and England, students with teachers who believed that teaching about social
issues is important had stronger beliefs that both conventional and social-movement activities are
important for citizenship. In England, this view of social topics as important had additional positive
effects on students attitudes toward ethnic minorities, positive attitudes toward their own nation, and
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
22/26
22
on their expectations of participating in conventional political activities not related to voting (e.g.,
joining a political party or writing letters). In Australia, to contrast, students with teachers who found
teaching about these topics important actually viewed their classes as less open to discussion, and also
had significantly lowerscores on the CIVED test of civic knowledge.
Teachers use of unofficial materials. The final analysis, summarized in Table 11, explores
whether differences in teachers preparation lead to differences in students civic development.
Table 11: Summary of the Effects of Using Unofficial Planning Materials in Australia and England
Australia England
Social Government n.s. 0.21* (.10)
Immigrant Rights 0.34* (.15) n.s.
Minority Rights 0.27* (.09) n.s.
Community Participation 0.21* (.10) n.s.
Note: HLM regression coefficients reported. Standard errors are in parentheses. All student mean =
10, sd=2. +p < .10; *p < .05
Australian students with teachers who reported that unofficial materials were more important for
planning civic-related subjects had more positive social attitudes than do students whose teachers find
these less important. In particular, their attitudes toward political rights of immigrants and ethnic
minorities were more positive. These students also had stronger expectations of participating in
community-related civic activities in the near future. To contrast, English students whose teachers
found these unofficial materials important had stronger beliefs that government should take on various
society-building responsibilities.
Discussion
This analysis demonstrates how a combination of IRT and latent class analytic techniques could
be applied to the analysis of the teacher survey data collected as part of the IEA Civic Education
Study. Scales of teachers confidence captured individual differences among teachers as to how
capable they feel in teaching about various civic-related topics, and scales of teachers activity usage
capture similar differences in the frequency with which they use different learning approaches in the
classroom. To contrast, latent class analysis techniques revealed that teachers could be divided into
one of two categories based on the importance that they place on learning about social topics and the
importance that they place on using unofficial planning materials. Although \these categories appear
to discriminate between those who rate these subjects and materials as important from those who
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
23/26
23
rate them as very important, multilevel analyses revealed that students who have teachers in
different groups differed significantly in their knowledge, attitudes, and expected behaviors.
The use of these variables in multilevel analyses also indicates that teachers can have a wide-
reaching influence on students civic development. This speaks to the importance of considering
multiple dimensions of civic engagement. When discussing teacher effects, it is tempting to focus
almost exclusively on how characteristics of teachers influence what students know. While the use of
interactive class activities did positively relate to higher civic knowledge among Australian students,
the majority of other effects in all three countries related more to students concepts of citizenship,
their social attitudes, and their opinions about school. School and teacher effects on students
attitudes can be difficult to explore among students because there is so much variability within
schools. By adding within-school controls to account for some of that variability, however, a clearer
picture of how teachers influence their students can start to be formed. Additionally it demonstrates
the importance of considering teachers attitudes toward social topics, not just those topics most
associated with civics such as government and politics. In particular, teachers beliefs as related to
social topics had a stronger effect than their beliefs about political topics (in line with findings from
cross-national studies by Fouts & Lee, 2005).
The multilevel analyses also illustrate how differently teachers can influence students in Australia,
England, and the United States. The majority of significant teacher effects in these analyses were
found looking at the effects of Australian teachers. Previous research using smaller samples supports
this finding. Prior (1999) found that Australian social studies teachers valued active citizenship, with
a focus on knowledge of current events and community consensus, despite a formal curriculum which
advocated teaching about government structure and history. It is not surprising, then, to see that
Australian teachers who had especially high beliefs that social topics are important had students with
stronger conceptualizations of both conventional citizenship (including the following of current
events) and social-movement citizenship, and that teachers who engaged their students in more
interactive activities increased their students attitudes toward rights of others in their communities.
Additionally, the more traditional focus of the formal curriculum may have led many Australian
students to use other planning materials, which could better help them meet their goals of encouraging
active citizenship and community participation.
In England, results from focus groups found that teachers in this country often focused on the role
of citizens as skeptics of government, or on the role of government in peoples lives (Arnot, Araujo,
Deliyanni-Kouimtzi, Rowe, & Tome, 1996). This is reflected in the positive relationship between
teachers beliefs that a subject is important and active citizenship (either conventional or social-
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
24/26
24
movement oriented, also in active participation in political activities), and in the relationship between
the use of additional planning materials and stronger belief in society-related government
responsibilities. In the most extreme cases of fostering skepticism, teachers who were especially
confident in teaching these subjects had students who planned to protest illegally. To contrast,
teachers who used the most traditional activities appeared to discourage social-movement citizenship
norms. Other results, however, appear to contrast this general finding and are worthy of further study,
including the effects of teachers importance beliefs on increased patriotism, and the negative effects
of interactive classroom activities on immigrant attitudes.
Fewer significant results are found when observing the United States. Those that do exist suggest
that the use of interactive classroom activities takes away opportunities for open classroom discussion
or for building confidence in school participation. Indeed, another teacher survey item capturing the
frequency of political discussion did not fit on the interactive activities scale, perhaps because in the
United States such structured activities leave less opportunity for open discussion (see Schulz &
Sibberns, 2004). Further analysis of teachers use of discussion, and how it relates to other hands-on
activities, is warranted. The lack of significant effects in the United States might also be attributed to
two other factors. First, fewer teachers in the U.S. completed this survey as compared to England or
Australia, and more information from teachers may lead to more powerful analyses in which
additional effects can be detected. Second, it is interesting to note that the United States teachers
reported higher confidence in each type of activity, and report using both sorts of classroom activities
more often, than did teachers in England or Australia. Teachers in the United States may have been
thinking more about social desirability than are teachers in other countries, leading to a less accurate
portrayal of their actual classroom attitudes and behaviors.
In summary, the teacher variables formed by IRT and latent class analyses give a great deal of
information about how teachers can influence students civic development. Additional analyses
should work to follow up on these findings in individual countries in greater depth, and should also be
considered in creating new variables which can be generalized across all countries in the IEA Civic
Education Study. By considering teachers in a wider variety of social and policy contexts, we can
gain a more complete understanding of how teachers can influence students development into active,
engaged citizens.
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
25/26
25
References
Arnot, M. Araujo, H., Deliyanni-Kouimtzi, K., Rowe, G., and Tome, A. (1996) Teachers, Gender andthe Discourses of Citizenship. International Studies in Sociology of Education, 6, 3-35.
Barber, C. (2006). An item response theory analysis of teachers attitudes toward the civic education
of 14-year-olds in three countries. Unpublished Masters seminar paper, Department ofMeasurement, Statistics, and Evaluation, University of Maryland College Park.
Bronfenbrenner, U. (1988) Interacting systems in human development. In N. Bolger, C. Caspi, G.Downey and M. Moorehouse (Eds.),Persons incontext: Developmental processes (pp.25
50). Cambridge, England: Cambridge University Press.
duToit, M. (2003).IRT from SSI: BILOG-MG, MULTILOG, PARSCALE, TESTFACT. Lincolnwood,
IL: Scientific Software International.
Gonzales, M. H., Riedel, E., Williamson, I., Avery, P. G., Sullivan, J. L., & Bos, A. (2004).
Variations of citizenship education: a content analysis of rights, obligations, and participation
concepts in high school civic textbooks. Theory and Research in Social Education, 32(3),
301-325.
Gonzales, M. H., Riedel, E., Avery, P. G., & Sullivan, J. L. (2001). Rights and obligations in civiceducation: a content analysis of theNational Standards for Civics and Government. Theory
and Research in Social Education, 29(1), 109-128.
Fouts, J. and Lee, W. (2005) Education and Social Citizenship: perspectives of teachers in USA,
Australia, England, Russia and China. Hong Kong: Hong Kong University Press.
Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991).Fundamentals of item response theory.
Newbury Park, CA: Sage Publications.
Homana, G., & Barber, C.(2006, November). School climate for citizenship education: acomparative study of England and the United States. Paper to be presented at the Second
IEA International Research Conference, Brookings Institution, Washington, DC.
Husfeldt, V., & Barber, C. (2005, September). Teachers concepts of civic education in relation to
students attitudes and engagement. Paper presented at the Third European Consortium ofPolitical Research Conference, Section on Political Sciences and Citizenship in the
Classroom, Budapest, Hungary.
Husfeldt, V., Barber, C., & Torney-Purta, J. (2005). Students social attitudes and expected political
participation: New scales in the enhanced database of the IEA Civic Education Study.
College Park, MD: Civic Education Data and Researcher Services.
Lave, J. and Wenger, E. (1991) Situated learning: Legitimate peripheral participation. Cambridge:
Cambridge University Press.
Lubke, G. (2006). Discriminating between categorical and continuous latent variables. Paper
presented at the Center for Integrated Latent Variable Research Conference on Mixture
Models in Latent Variable Research, College Park, MD.
Masters, G. N., & Wright, B. D. (1997). The partial credit model. In W. J. van der Linden & R.K.Hambleton (Eds.),Handbook of modern item response theory (pp. 101122). New
York/Berlin/Heidelberg: Springer.
Muraki, E. (1992). A generalized partial credit model: Application of an EM algorithm.Applied
Psychological Measurement, 16, 159176.
-
7/28/2019 Barber. Teachers' Practices Relation to Students' Civic Engagement in Three Countries.
26/26
Muthn, L. K., & Muthn, B. O. (1998-2006). MPlus users guide. (Fourth Edition). Los Angeles,
CA: Muthn & Muthn.
Pajares, F. (1992) Teachers Beliefs and Educational Research: cleaning up a messy construct.Review
of Educational Research, 62, 307-332.
Prior, W. (1999) What it Means to Be a Good Citizen in Australia: perceptions of teachers,
students, and parents. Theory and Research in Social Education, 27, 215-248.
Raudenbush, S. W., Bryk, A. S., Cheong, Y. F., and Congdon, R. (2004) HLM 6: hierarchical linear
and nonlinear modeling. Lincolnwood, IL: Scientific Software International.
Schulz, W., & Sibberns, H. (Eds.) (2004). IEA Civic Education Study Technical Report.
Amsterdam: IEA.
Shulman, L. S. (1986) Those Who Understand: knowledge growth in teaching. Educational
Researcher, 15, 4-14.
Swaminathan, H., & Rogers, H.J. (1990). Detecting differential item functioning using logistic
regression procedures.Journal of Educational Measurement, 27, 361-370.
Torney-Purta, J., Barber, C., & Wilkenfeld, B. (in press). Latino adolescents civic development in
the United States: research results from the IEA Civic Education Study. Journal of Youth and
Adolescence.
Torney-Purta, J., Lehmann, R., Oswald, H., & Schulz, W. (2001). Citizenship and education in twenty-
eight countries: civic knowledge and engagement at age fourteen. Amsterdam: IEA.
Torney-Purta, J., Barber, C., & Richardson, W. (2005). How teachers preparation relates to students
civic knowledge and engagement in the United States: Analysis from the IEA Civic EducationStudy. (Fact Sheet). College Park, MD: Center for Information and Research on Civic
Learning and Engagement, University of Maryland, College Park.
Torney-Purta, J., Richardson, W., & Barber, C. (2005). Teachers experience and sense of confidence
in relation to students civic understanding and engagement across countries .InternationalJournal of Citizenship and Teacher Education, 1(1), 32-57.