promoting learner error provides affectual stimulation ... 2008.doc  · web viewpromoting learner...

67
Promoting learner error facilitates conceptual change Promoting learner error provides affectual stimulation, triggering engagement and conceptual change Abstract Pupils’ expectation-related errors oppose the development of an appropriate scientific attitude towards empirical evidence and the learning of accepted science content, representing a hitherto neglected area of research in science education. In spite of these drawbacks, a pedagogy is described that encourages pupils to allow their biases to improperly influence data collection and interpretation during practical work, in order to provoke emotional responses and subsequent engagement with the science. The usefulness of triggering emotion in order to facilitate learning is borne out quantitatively by findings from a series of three randomised experiments (n=158) which show superior gains using this pedagogy that are still significant two and three years after the initial treatment. In addition, pupils who experienced more intense emotions during treatment demonstrated the most gains in the medium term. This research is one element of a long-term study of expectation-related observation in school science whose findings impact generally on the proper consideration of empirical evidence and the learning of science content. Introduction Professional scientists can be susceptible to personal bias when collecting data (Mahoney, 1979), indeed, an aim of peer assessment 1

Upload: others

Post on 08-Oct-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

Promoting learner error provides affectual stimulation,

triggering engagement and conceptual change

Abstract

Pupils’ expectation-related errors oppose the development of an appropriate scientific

attitude towards empirical evidence and the learning of accepted science content, representing a

hitherto neglected area of research in science education. In spite of these drawbacks, a pedagogy is

described that encourages pupils to allow their biases to improperly influence data collection and

interpretation during practical work, in order to provoke emotional responses and subsequent

engagement with the science. The usefulness of triggering emotion in order to facilitate learning is

borne out quantitatively by findings from a series of three randomised experiments (n=158) which

show superior gains using this pedagogy that are still significant two and three years after the

initial treatment. In addition, pupils who experienced more intense emotions during treatment

demonstrated the most gains in the medium term. This research is one element of a long-term

study of expectation-related observation in school science whose findings impact generally on the

proper consideration of empirical evidence and the learning of science content.

Introduction

Professional scientists can be susceptible to personal bias when collecting

data (Mahoney, 1979), indeed, an aim of peer assessment prior to publication of

findings in scholarly journals is the checking of methods, results and inferences for

predisposed, sometimes unconscious influences towards a foregone conclusion.

Taken to extremes such biases manifest themselves as scientific fraud1 where

researchers deliberately set out to deceive for monetary and other motives, such

1 For example, the infamous twin studies conducted by Sir Cyril Burt on the inheritance of IQ.

1

Page 2: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

as a ‘…blinding commitment to a particular paradigm’ (Nott and Smith, 1995,

p407).

A common assumption associated with school science practical work is that

young experimenters observe and report natural phenomena faithfully. The

possibility that pupils can, as some scientists have done, allow predilection

towards a favoured conclusion to influence their data collection and reporting, is

rarely considered by teachers (Author, 2006), and represents a neglected area of

science education research. Traditionally, the literature has been equivocal

regarding the validity of comparisons of school pupils with professional scientists,

with some workers making direct parallels between the behaviours and attitudes

of the two groups (Brewer & Samarapungavan, 1991; Chinn and Brewer, 1998;

Driver, 1983; Karmiloff-Smith, 1988); conversely, others deny similarities on the

grounds of incomparable maturation of scientific thinking skills and domain-

specific knowledge (Chi, 1978; Kuhn, 1989). The current research focuses on

psychological processes that are fundamentally and universally human, specifically

the wilful or subconscious influences of desirable outcomes on behaviour and

perceptions - forms of ‘wishful thinking’. This psychology develops spontaneously

(Gilovich, 1991) and within limits, is largely independent of experience having

been demonstrated in populations of varied age, and so has relevance to both

school pupils and scientists. This article examines the possibility of using these

often-troublesome qualities in a positive sense to promote engagement during

science lessons.

2

Page 3: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

School pupils, often surreptitiously, though sometimes without being

themselves aware will record observations that do not reflect the reality of physical

phenomena under study. Leanne (12 years old) compared the masses of two

beakers holding equal volumes of a different liquid - one contained saltwater, the

other, distilled water. When asked to use the electronic balance to measure the

masses she declared that this was not necessary, as she already knew the

saltwater beaker was the heavier. Holding each beaker in either hand, she

affirmed,

‘I can tell by the weight’ (Leanne).

The 5g of salt in the saltwater beaker contributed only 3% towards the total mass

of the system, and the mass difference between the two beakers was too small to

be within the limits of human perceptual abilities.2 When challenged about the

certainty of her observation,

‘I’m really sure – I felt my arm starting to drop because of the extra weight’ (Leanne).

Leanne’s anticipation of the (scientifically correct) result of the saltwater beaker

being the heavier had led her to either knowingly submit a false report or

experience an unconscious perceptual modification that made it appear to her that

there was indeed a noticeable difference between the two beakers - a kind of

scientific illusion. This is a well-studied psychological event, though infrequently

cited in the science education literature.

2 The threshold for perceiving mass differences lies at around 10% (Gordon, 1989).

3

Page 4: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

‘Truly ambiguous information is often simply perceived in a way that fits our preconceptions’ (Gilovich, 1991, p52).

It is proposed that such expectation-related observations (EROs) are

commonplace in school science classrooms. Further examples described by Author

(2006) include:

On wrapping wool around a container of water at ambient temperature, a

rise of 5°C is recorded

When two marbles of different size are dropped simultaneously, the heavier

is repeatedly seen to land first

The north pole of a magnet is the more powerful, attracting objects with

greater force

A balloon inflated with air feels far lighter than one that is deflated

Acids with low pH values cause less fizzing when mixed with marble chips

EROs can be viewed as an unwanted aspect of experimentation primarily

because they signal an unscientific method of working. In addition, if observers’

preconceptions are aligned with theories not currently accepted by science, EROs

end up as being apparent empirical confirmations of misconceptions. That said, the

current study examines the possibility that the encouragement of EROs can be

useful for learners’ lasting rejection of the very misconceptions that were the

source of the biases.

Chinn and Brewer (1998) review previous studies (e.g. Chan, Burtis and

Bereiter, 1997; Inagaki, 1981; Johsua and Dupin, 1987) that have utilised

4

Page 5: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

anomalies, in the form of experimenters’ unanticipated results to facilitate learning

in a Piagetian sense, creating cognitive disequilibrium in order that old concepts

are replaced with new, scientifically acceptable variants. Most of this work is

aligned with the conceptual change paradigm. Allied to this approach is the

familiar pedagogic technique of teaching through bluff, a quite instinctive practice

found at grass roots level in the repertoires of teachers who may have little

knowledge of science education research pertaining to anomalies. The teacher

might hold up an inflated and a deflated balloon to show a class, playing devil’s

advocate and incorrectly inferring ‘the inflated balloon is lighter…yes?’ to which

many in the class voice agreement, so revealing their status as misconceivers.

Thereafter, weighing the balloons refutes this erroneous theory, and emotions

such as surprise, awe and puzzlement that are generated enhance engagement

and thus the chance of meaningful learning.

It was realised that this technique could be further empowered if learners could

experience a series of several, successive, hands-on bluff activities during the

course of a single lesson, with each activity relating to the same physical

phenomenon. If the early activities were designed to produce poorly resolved,

difficult-to-read data, experimenters would be more likely to be influenced by

expectations and EROs would ensue. Subsequent activities would offer

increasingly better resolved results, and so the true, scientific phenomenon

becomes progressively more difficult for even the most biased experimenters to

ignore, with the final activity being particularly convincing (Author, 2005). Thus, as

with the simple bluff approach, the emotional responses generated as the learner

eventually comes to realise the surprising ‘right answer’ are thought to develop

5

Page 6: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

engagement with the science, the expected outcome being the facilitation of

learning (figure 1). EROs experienced could further escalate emotion by inducing a

strong, early adherence to preconceptions, since prior concepts initially appear to

be supported by empirical findings (ibid.). Pedagogies that advance participant

interest have immediate relevance - a lack of pupil engagement with regards to

school science is a recalcitrant issue globally (Fensham, 2004), and in England

there is currently a governmentally derived drive to engage learners during

science lessons with a view to countering declining numbers of science students

entering post-compulsory education.

Eighteen different lessons of this type were devised, each dealing with a specific

misconception, and termed Misconception Intervention (MI) lessons.3 The MI used

for the current study was Marble drop, focusing on the incorrect idea that in the

absence of significant air resistance effects, heavier objects fall with a greater

speed than lighter objects – hereafter referred to as the heavy/fast misconception.

MI lessons were devised to encourage engagement with the science through bluff

approaches to experimentation that could elicit emotional responses. Although

anecdotal reports from teachers have suggested that pupils were indeed

particularly engaged during these lessons, the efficacy of the method at correcting

misconceptions was unknown, as were the types/levels of affectual reactions to the

bluff activities. The primary purpose of the current investigation is to address the 3 The precise design and final content of MIs lean heavily on conceptual change theory; further, detailed elucidations of MIs are considered not relevant to the current context, and plan to be presented in subsequent publications.

6

Figure 1.

Page 7: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

first query by evaluating the comparative effectiveness of the MI approach with a

‘typical’ science practical lesson in correcting the heavy/fast misconception. To

operationalise this aim a major research question was formulated: If pupils

experienced a Misconception Intervention lesson, were they more likely to

subsequently recall correct science than if they attended a similar, transmission-

style practical lesson? The study was part of a long-term project that investigated

in a wider sense the nature of EROs in school science classrooms (Author, 2006).

Previous work

Theory-laden observation

Before observation can take place some expectation of what is going to

happen needs to be present in the observer’s mind so that perceptual apparatus

can focus upon relevant aspects of the system. Thus, all observed data are not

pure, unbiased recordings but are tainted by and are only as reliable as the theory4

held by the observer (Hodson, 1986). These theories influence firstly how an

observer goes about collecting data, governing experimental set up, measuring

techniques and observation selection, and secondly may have some bearing on

perception itself, a consequence of which might be illusory experiences. Theory

dependence can make a scientist record erroneous observations if the theoretical

standpoint is incorrect (ibid.). Competing theories can accordingly induce different

observations of the same phenomenon because observation statements use 4 Theory in this sense signifies the idea(s)/conceptual frameworks held by an individual relevant to the phenomenon under investigation, for instance heavier objects will always fall more quickly than lighter ones. Theory can give rise during experimentation to anticipation of a specific result – the heavy marble is going to hit the ground before the light marble.

7

Page 8: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

concepts that are rooted in each particular theory - the Aristotelian and Galilean

theories of falling bodies both focused on the same, easily-reproducible behaviour

of objects in free-fall, though both cited different and contradictory empirical data

(Kuhn, 1996).

Since all observation is theory dependant a scientist is inescapably bound to

some expectation of a particular outcome during an experiment. That said, this

mind-set is by no means automatically a precursor of self-fulfilling prophesy, as the

methods of science promote the negating of these potentially-biasing influences,

providing for objective measurement/examination that will accurately capture the

reality of phenomena to such a degree as the apparatus and methods allow. It is

when these checking mechanisms break down that prejudiced experimenting is

allowed to flourish, and an expectation-related observation (ERO) may be defined

as the biased collection or interpretation of data, influenced by a desire to reach a

predetermined conclusion. Proper science keeps this potentially spoiling

consequence of theory dependence in check; historically, unscientifically strong

allegiances to ‘incorrect’ prior theories have culminated in ‘incorrect’ inferences,

aligned with those theories. Note that theory dependant observation and

expectation-related observation are far from being analogues, the former

representing an inevitable quality of perception, the latter an unwanted effect

arising from failure to temper subjective desires.

‘Observations are theory-dependent. Students' personal theories affect what they see’ (Gunstone, 1991, p71).

8

Page 9: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

The potentially biasing consequences of theory-dependence are a relevant

factor in school science (Author, 2007), though there is a paucity of references to

expectation-related error within the science education literature. The Australian-

derived pedagogy of Predict-Observe-Explain (POE) is self-evident, requiring

learners to anticipate outcomes, carry out a practical activity and then account for

any anomalies, so stimulating cognitive conflict and subsequent conceptual

change. Gunstone (1991) describes a POE task that required students to make

observations using ammeters within a DC circuit (figure 2). Accepted scientific

theory expects both ammeter readings to be equal since current should remain the

same throughout a DC series circuit, however, 40% of pupils incorrectly predicted

a higher reading in one ammeter, analogous with an erroneous diminishing current

model (Shipstone, 1984). During the demonstration some observers saw slightly

higher readings in one of the meters, while others saw equal readings in both, and

there was a high correlation between prediction and observation. Intriguingly,

some students at the back of the room, all predicting a scientifically incorrect

current difference, came forward for a closer look, while others at the back (all

predicting the scientific ‘no change’) remained at their places, ‘...reclined back in

their seats with an air of contented boredom’ (Gunstone, 1991, p69). After

discussion, a consensus was reached that there was indeed a 3% difference

between ammeter readings, though caused by inaccuracies within the ammeters

themselves and not by consumption of current. The fact that different individuals

had made idiosyncratic observations of the same phenomenon may be explained in

light of observation being theory-laden: the students who knew what the ammeters

would show because they understood the scientific theory were perhaps taking

surety in the positivist view that accepted science cannot be challenged, there

9

Page 10: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

being only one ‘true’ answer; this represents a recession of empirical evidence in

the face of scientific dogma. It is probable that these students’ observations were

not done with sufficient care because they had high expectations of a particular

outcome, and a quick, careless glance at the ammeter dials wrongly confirmed

their conclusions - some did not even bother to make any observation at all, so

confident was the faith in their predictions. The long-term ERO study (Author,

2006) has shown that this form of scientific illusion is commonplace in school

science and can be readily generated by teacher-manipulation of practical

procedures, and similarly, it was found that if students had strong expectations of

an experiment, less attention was given to observations.

A different POE study (Gunstone, Mitchell and the Monash Children's Science

Group, 1988) gives an account of observers expecting the combined mass of a

rotting piece of liver plus its sealed jar to decrease due to belief of the

misconceptions that rotting material loses matter and/or gases have no weight.

The discovery of no weight loss brought suggestions that the experiment failed

because air must have leaked in. Chinn and Brewer (1998) correspondingly found

that responses to anomalous data fell into categories such as doubting/disbelieving

the data, proposition of faulty method and criticising the expertise of the

experimenter.

10

Figure 2.

Page 11: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

These two accounts locate the essence of ERO behaviours and are typical of

others in the literature where students have neglected anomalous data, either

failing to notice or ignoring unexpected outcomes, or acknowledging though later

dismissing them as being irrelevant to the overall conclusion (Driver, 1975, 1983;

Gunstone and White, 1981; Hesse, 1987; Zimmerman, Raghavan and Sartoris,

2003).

Three studies report specifically on the heavy/fast misconception that is the

focus of the current research. Champagne, Gunstone and Knopfler (1985) found

when weights of differing mass were dropped and landed simultaneously, some

observers suggested that the blocks must have actually been equal in mass, while

others said the heavier block did land first but the difference was too small to be

perceptible. Gunstone and Watts (1985) describe how when a bright student

predicted that an aluminium cube would hit the floor before a plastic cube, and

although most of the class observed the two arrive at the floor together, swore the

aluminium cube hit first. When asked to give a reason for the phenomenon he said

simply ‘Newton's law’ (ibid., p87) as if to give his observation credibility by

reference to an accepted doctrine. Gunstone (1994) reports that 63% of DipEd

students who predicted a shot put would hit the ground before a rubber ball

dropped from the same height also observed this outcome, when in actuality the

balls landed at the same time, showing that far from being exclusive to younger

learners these qualities prevail with advanced students of science who have proved

through examination their knowledge and understanding. Indeed, a series of

studies have identified the heavy/fast misconception in such diverse populations as

11 year-olds, physics undergraduates, postgraduate teacher-trainees and non-

11

Page 12: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

student adults, and in frequencies of up to 91% (Champagne, Klopfer and

Anderson, 1980; Gunstone, 1994; Gunstone and White, 1980, 1981; Oakes, 1945;

Osborne, 1984).

Conceptual change studies/social influence

There is a long tradition of misconception research carried out under the

aegis of the conceptual change paradigm (Duit and Treagust, 2003, offer an

exceptional exposition of prior work). Misconception Intervention lessons were

devised using conceptual change findings as a source (including Driver, 1983;

Driver, Asoko, Leach, Mortimer and Scott, 1994a; Driver, Guesne and Tiberghien,

1985; Harlen, 1999; Jofili, Geraldo and Watts, 1999; Posner, Strike, Hewson and

Gertzog, 1982; Shakespeare, 2003; Treagust and Tsui, 2004; Watson, Swain and

McRobbie, 2004; Watson and Wood-Robinson, 1998; Watts and Bentley, 1991). The

view that anomalies can arouse cognitive conflict and subsequent rejection of a

misconception theory in favour of the scientific alternative lies at the core of the

system, as do social influences on learning as originally espoused by Vygotsky

(1978) that assume a constructivist epistemology where knowledge can only be

assembled via verbal/written exchanges with other people, thus scientific theories

are not absolute revelations of observed reality, but social constructions. MI lesson

design takes the form of the presentation of anomalies in a social context,

requiring that all participants interact during the declaration and debate of their

theory of choice, and it is proposed that powerful, frequently irresistible social

pressures become evident particularly at the closing stages that force the choosing

of the accepted, scientific theory and rejection of misconceptions. Within the few

12

Page 13: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

references to EROs that exist in the literature, the influence of social factors

during scientific observation hardly merits a mention.

Practical work facilitates theoretical understanding

The utilisation of practical work to augment the teaching of scientific theory

has opponents as well as proponents, with some advocating the usefulness of an

authentic, hands-on experience (Atkinson, 1990; Gott and Duggan, 1995; Millar,

1989) and others challenging whether substantive conceptual entities are

adequately constructed or confronted as a result (Erickson, 1994; Hodson, 1993;

Watson, 2000). Conceptual change studies have utilised practical activities during

attempts to teach accepted science and rectify misconceptions, with mixed success

(Carmichael, Driver, Holding, Phillips, Twigger and Watts, 1990; Driver, Squires,

Rushworth and Wood-Robinson, 1994b), and the current study seeks to investigate

the claim that an MI lesson could realise similar goals of successful rejection of

misconceptions and construction of accepted concepts contextualised in a practical

setting. More specifically, and in line with the format of the current work, there

have been a few prior studies concerned with the presentation of anomalies by

means of practical activities in order to achieve successful learning (Lawson, 1995;

Osborne and Wittrock, 1983; Renner, Abraham and Birnie, 1988).

The affectual factor

The facilitative link between emotion and memory has been well established

(e.g. Davidson and Jergovic, 1996; Hertel and Parks, 2002), and learning activities

designed to access affect have been shown to be successful educational tools.

Jerusalem and Pekrun (1999) state how joy during learning is associated with

13

Page 14: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

performance situations; Nisbett and Ross (1980) report that evidence that is more

vivid or stands out in an individual's memory is likely to be given disproportionate

value – it appears the brain preferentially stores information that is significantly

more emotionally loaded (Bromm and Desmedt, 1995). Both positive and negative

emotions are thought to play a part,

‘Hope of success, pride, taking joy in success, fear of failure, or indifference and low level anxiety in relation to lack of

success are seen as particularly motivating for achievement’ (Laukenmann, Bleicher, Fub, Glaser-Zikuda, Mayring and von

Rhoneck, 2003, p490).

Alternatively, in some contexts affect may have a debilitating or reconstructive

effect on memory as in the case of acute emotional trauma inducing memory

repression; the psychology and psychiatry literatures widely report instances of

psychogenic amnesia in response to distressing life events such as childhood

sexual abuse (discussed by Wessel and Wright, 2004). Of course, these extreme

conditions have little relevance to the formal learning situations applicable to the

current research.

MI lessons employ bluff activities, that were thought to be affectually

arousing, in attempts to excite learners, fostering attachment to personal theory

and provoking them into committing EROs (Author, 2006, 2007). In addition, it was

hypothesised that increasing affect might help make the experience less

forgettable for learners, making the content appear more relevant, interesting and

engaging (Alsop, 2001), allowing memories to be laid down and subsequently

recalled to a greater extent. The current study attempts to quantify the emotional

14

Page 15: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

experience of each learner in the search for associations between affect and other

variables such as achievement and EROs.

Summary

A few prior workers have noted the presence of EROs in school science

settings. The format of Misconception Intervention lessons draws on research from

a variety of disciplines, considering the processes and findings of conceptual

change, practical science, social constructivism and emotion-mediated learning; in

order to firstly test the effectiveness of this approach, and secondly study the

possible influences MI lessons might have on pupil affect, an experimental method

is described hereafter. Educational experiments have been employed as

assessment devices to compare the relative effectiveness of different science

pedagogies in correcting misconceptions (such as Asami, King and Monk, 2000;

Chang and Barufaldi, 1999), and the current research similarly comprises of an

experimental comparison of an MI lesson with a ‘typical’ science practical lesson,

with each approach focusing in its own way on phenomena related to the influence

of mass on gravitational attraction.

Participants and setting

The research took place in two different English state-maintained schools.

School A was a mixed gender non-selective secondary-modern type institution in

the south east of England catering for ages 11-16 years. The mean ability of school

A’s pupils was lower than the national average due to nearby selective grammar

schools drawing off the most able 10-20% of children. School B in contrast was a

mixed gender non-selective middle school also in the south east of England,

15

Page 16: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

responsible for the education of children of ages 9-13 years. Most of the intake

derived from a nearby affluent village and consequently overall achievement was

higher than the national average.

Table 1 give the number and composition of each of the samples accrued for

the research. The three experiments involved a total of 158 pupils.

Method

As stated, the driving force behind the current research was a test of the

efficacy of MI lessons in correcting misconceptions, a hitherto unknown quality,

thus the major research question formally enquired if pupils experienced a

Misconception Intervention lesson, were they more likely to subsequently recall

correct science than if they attended a similar, transmission-style practical lesson?

There were a number of subsidiary questions that focused on affectual differences,

including: would one lesson incite a greater frequency or depth of emotion in

pupils? To realise these, three educational experiments were performed with

treatment and control groups being subjected to two distinct ways of teaching, MI

or transmission lesson, and the effects on pupils’ learning were studied in an effort

to determine if either way was superior to the other. Specifically, the experiments

should determine which approach, if any, is the more effective at dispelling the

heavy/fast misconception. Additionally, associations of the misconception variable

were to be made with other factors, namely pupil ability, individual emotional

intensity and EROs. Strongly EROing pupils were determined using a quantity - the

16

Page 17: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

AE5 variable - that took into account the depth of commitment to one particular

theory.

The experiments were of classical pre-test /post-test control group design, also

known as a 'true' experimental design (Cohen, Manion and Morrison, 2000) or

randomised experiment (Shadish, Cook and Campbell, 2001); a two-group design

negates any interaction effects due to the pre-test influencing participants’

performance in the post-test of a single-group experiment (ibid.). Subjects were

matched by ability6 and assigned to one of two groups using a random process.

Pupils were not matched by age as the sample was drawn from a single year

group, there being potentially a maximum difference of 11 months between the

oldest and youngest pupil, a situation not deemed as representing a significant

threat to validity due to maturation effects. No data were available relating to

socio-economic class. Once created, each group was randomly designated to either

undergo treatment or control, and after matching, the gender makeup of

treatment/control groups was found to be suitably balanced. The aim of such

random assignment is to create two groups that are probabilistically similar, thus

any observed differences after treatment is likely to be due to the treatment itself

and not differences between the groups. The sampling procedure followed the

tenets of purposive sampling by typical instances as described by Shadish et al.

(2001).

Similarities with a recent investigation of ecology concepts can be made with

the current research, as Ozkan, Tekkaya and Geban (2004) used a

5 Absolute EROing.6 Cognitive Ability Test mean SAS score.

17

Page 18: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

treatment/control group experimental design with pre-tests / post-tests and class

sizes of 28 and 30. However, the study utilised unchanged intact classes, a position

avoided in the current research due to the possibility of confounding independent

variables such as the prior experiences of one group giving them an advantage

during testing. Such quasi-experimental designs are more usual in education

research and easier logistically since new groups do not have to be created, but

findings lose validity due to the presence of confounds (Cohen et al., 2000). The

true, randomised design was seen as a strength of the current study, since there is

a dearth of randomised experiments in the science education literature.

Pupils worked in pairs for both treatment and control lessons. Each lesson took

place simultaneously in different classrooms and was taught by different members

of staff.

Experiment hypothesis - The treatment (MI) group will demonstrate a significantly

higher learning gain than the control (transmission) group.

Null hypothesis - The treatment group will not demonstrate a significantly higher

learning gain than the control group.

Data collection

The treatment lessons.

The Misconception Intervention lesson Marble drop was carried out with a

pre-test and a post-test completed at the start and at the end of the lesson,

respectively. Each lesson was one hour in duration. The MI approach begins with

18

Page 19: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

the teacher setting the scene by offering a scenario, which in the case of Marble

drop took the form of a hypothetical question: if a heavy man and a light man jump

off a cliff into the sea at the same time, who will make the first splash?

Simultaneously and as a demonstration, the teacher physically dropped a large and

small marble at the same time. Pupils were then invited to predict what the ‘right

answer’ will be, choosing one of three mutually exclusive theories: big marble,

small marble or the scientifically correct same. In order to purposely elicit

misconception theories and thus subsequent EROs, at this point a red herring was

fed in by the teacher: it may help you to imagine who would make the bigger

splash…

Predictions were then verbally shared with the class as each pair called out

loud their predicted theory, which was recorded by the teacher on an overhead

transparency (OHT) in full view. This important step allows the general consensus

of the class to be made publicly explicit, having influences on the social acceptance

of favoured theories, becoming particularly important later during the lesson.

These social factors are considered vital for the facilitation of misconception

rejection and the acceptance of accepted scientific theory, as reflected by the

phenomenon of free-falling marbles of differing size.

Each group were given a big and small marble and the practical phase

began. Four activities were carried out, the aim of each being to determine which

marble, big or small, falls the faster. The first activity was Which looks faster, and

involved dropping each marble singly in turn (not simultaneously) and making an

assessment as to which one appears to be falling more quickly. The result was

19

Page 20: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

written down by each pair and verbally shared with the class, being recorded on

OHT as was the prediction. The poor resolution of this first activity makes a clear

observation difficult for pupils, who may be encouraged due to a theory-laden

mind-set to revert to their theory choice as elicited during the prediction phase, as

many did. Data from the long term study (Author, 2006) suggest some pupils who

make such EROs can consciously submit a false report, choosing to fall back on

their prediction when in actuality there was no perceived difference between the

speeds of the two marbles. Others merely look to see what everyone else is

getting, and amend their result accordingly. Most interestingly, a minority of

pupils actually believe they see one marble falling significantly faster repeatedly,

and it is postulated this group of illusion-observers are pupils most hooked on

theory-dependence.

The activities continued, though each one progressively provided better-

resolved observations so making the scientific phenomenon as expressed by the

same theory difficult to ignore. The fourth and final activity Card tunnel is

especially lucid, and involves the two marbles being held in apparatus that allows a

reliable simultaneous release and produces a single audible sound that is clearly

suggestive of both marbles landing at the same time. Pupils were then given the

opportunity to make a final choice of theory, examining their own data and those of

other pairs in order to come to a decision. Revelation of the ‘right answer’ was

achieved by teacher demonstration involving datalogger light gates, showing no

discernable differences between the falling speeds of the two marbles.

The control lessons.

20

Page 21: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

These took the form of a ‘typical’ transmission-style lesson that involved a

circus of four practical activities that had ‘speed of falling’ as its central theme,

and were one hour in duration. Similarly, pre and post-tests were administered.

Each control lesson began with the teacher explaining to pupils how to carry out

each of the four activities, thereafter, pupils were allowed to complete the

activities in their own time and in no specified order, in pairs, moving from station

to station throughout the lesson.

Activity one involved timing an series of objects of increasing mass sliding

down an inclined slope to see if mass influenced speed down the slope. The second

activity required pupils to time the descent of three different-sized card ‘skydivers’

from a fixed point, to determine whether surface area had any effect on rate of fall.

The third was a simple exercise where participants recorded the weight as

indicated by a Newtonmeter of an incrementally increasing load of 100g masses,

essentially converting grams into Newtons. The fourth activity was a marble drop,

requiring pupils to simultaneously release a big and small marble and record

which, if any, landed first. It was planned that pupils spend an approximately equal

amount of time on each of the four circus activities, with results being recorded on

worksheets given to each pupil at the start of the lesson.

As is usual with circus lessons, ten minutes from the end of the lesson pupils

were asked to bring their experimenting to a close and gather as a class as the

teacher talked through the practical activities, inviting pairs to comment on their

results, and finally revealing the scientific answer in each case.

21

Page 22: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

The assumption was made that the control lesson represented a typical non-

constructivist transmission-type practical lesson as experienced by pupils in

English secondary schools that alongside other aims attempts to refute the

heavy/light misconception, and the activities contained therein would probably be

familiar to readers who are experienced science teachers. Indeed, school B

employed an almost identical lesson as part of the established scheme of work that

involved a circus where different aspects of physical phenomena centred on

gravity as a theme, including parachutes, inclined slopes and free-falling objects.

Figures 3 and 4 give further details of the lesson structure of treatment and

control lessons.

Instruments

Each pupil completed three written tests, a pre-test, a post-test and a

delayed post-test; the Experiment One and Two participants also underwent a

second delayed post-test. Both treatment and control pupils experienced the same

tests, under examination conditions. The answers to the tests were not

communicated to the pupils after completion, apart from in some instances after

the delayed post-test, as a few pupils had asked what the answer actually was, and

since this had occurred at the end of the research it had no bearing on the results.

22

Figure 3. Figure 4.

Page 23: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

Pre-test.

Carried out at the start of the lesson. This consisted of three questions

concerned with gravity, only one of which tested the heavy/fast misconception that

was being targeted by both the MI and treatment lessons, called the critical

question, and with the remaining two questions acting as filler (see figure 5; Q3 is

the critical question).

A detailed and descriptive study of the heavy/light misconception and the

scientifically correct same theory as constructed by participants was not an aim of

the research; neither were the relationships, albeit interesting, between these

entities and the wider conceptual frameworks in which they might be embedded,

and previous workers (e.g. Champagne et al., 1980) have provided such accounts

using data collected by extended interview methods. In the current research,

examination of pupils’ ideas took a pragmatic stance in the sense that an

immediate concern was how learners holding the heavy/light misconception might

perform in formal testing, such as Key Stage Three National tests7 and General

Certificate in Secondary Education (GCSE).8 Thus, the tests utilised during the

current research took on a style of questioning found in these contexts, essentially

a superficial though valid examination of whether pupils could effectively use this

single concept to successfully address a multiple-choice response question (figure

5).

The single critical question alone in the absence of the two filler questions

was not used during pre-testing. Although this would have sufficed for the

7 Taken by year 9 pupils (ages 13-14) in England.8 Taken by year 11 pupils (ages 15-16) in England.

23

Page 24: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

treatment group, it might have alerted the control pupils to the true focus of the

study which could have made them unnaturally confer more attention towards

their marble drop activity, thus invalidating the control lesson as a typical practical

circus experience, where equal weight should be given to each component activity.

The two filler questions addressed irrelevant phenomena that related to activities

in the control lesson (see figure 5 for the pre-test questions).

Post-test.

Carried out at the end of each lesson, except in one experiment when it was

completed 24 hours after the lesson. Like the pre-test, the post-test consisted of

three questions on gravity, including one question that tested the misconception

under study, the second critical question. The post-test questions were not the

same as those that were in the pre-test, except with one experiment where the

post-test consisted of a repeat of the pre-test, plus the three new questions.

Delayed post-test.

Carried out approximately six weeks after each experiment in order to

examine medium-term learning. The content of the delayed post-tests was varied,

two being a repeat of the original pre-test, the other simply the pre-test critical

question.

24

Figure 5.

Page 25: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

With the first and second experiments, an additional second delayed post-

test was carried out three and two years respectively after the original experiment

to examine long-term learning effects, and consisted of a repeat of the previous six-

week delayed post-test.

Emotion matrix

With experiment 3 only, participants’ emotions were surveyed after

completion of the first post-test by means of a short questionnaire – the emotion

matrix (figure 6) - that enquired about the depth of emotion experienced during

revelation of the scientific answer at the end of the lesson.

Results and analysis

Data are presented in the form of a particulars table that summarises the

context of each experiment, inter-group differences and intra-group gains (table 1).

Ability equivalence – t-tests CAT SAS values of each group to check that one

is not unfairly more able than the other

Gains – shows the progress of each group since the start of the experiment,

using pre-test scores as a baseline and expressed as a percentage

Results – compares the pre, post and delayed post-test results of treatment

versus control groups to show differences in performance. Quantitative

25

Figure 6.

Page 26: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

analysis involved testing for independence of treatment and control groups

using the chi square statistic (DF=1)

With each of the three experiments the abilities of treatment and control

groups were found to be equivalent with relation to both CAT SAS score and pre-

test score, thus any superior gains by a particular group could not have been due

to differences in ability.

If the assumption that all variables bar type of lesson had been controlled is

valid, then the superior gains of the treatment group in all three experiments show

that the MI lesson was more successful than the control lesson in teaching the

correct scientific conception, thus conversely the frequencies of the heavy/fast

misconception were higher with control. This conclusion holds at the time of

administration of post-test (immediately following the lesson, or with Experiment

One, 24 hours later), delayed post-test9 (six weeks later) and second delayed post-

test (Experiments One and Two only, three and two years later, respectively).

Therefore, the null hypothesis may be rejected. Similar results gained in two very

different schools endorse the generalisability of these claims, as does the fact

different teachers achieved comparable success when delivering the same 9 With Experiment Two at the time of the delayed post-test despite the treatment group displaying a numerically superior performance than control this difference was no longer statistically significant.

26

Table 1.

Page 27: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

treatment MI lesson. Throughout analysis there were no significant findings with

regard to the gender variable.

Figure 7 illustrates the average progress of treatment and control groups

over the period of the research, based on attainment during testing.

Analysis of the emotion matrix questions

Individuals were allocated a score - emotion total – which was a sum of

values based on their responses from the emotion matrix questionnaire (figure 6).

The questions selected were based on data collected from the long term ERO study

and intended to capture common emotional responses that had been previously

reported by pupils during/after MI lessons. The higher an individual’s score, the

greater the level of generalised affective stimulation at the time of final revelation

of the scientific answer at the end of the lesson. Table 2 gives some descriptive

statistics of treatment and control groups’ emotion total scores.

Both treatment and control groups were equivalent with respect to individuals’

emotion scores (t= - 0.91, df=48, α=0.37, two tailed).

27

Figure 7.

Table 2.

Page 28: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

There were no affectual differences between correct and incorrect pupils of both

treatment and control groups at post-test (t= 0.44, df=31, α=0.66, two tailed,

unequal variances).

At delayed post-test, the correct pupils from the treatment group had experienced

higher intensity of affect compared with incorrect pupils of the same group (t= -

2.86, df=23, α=0.009, two tailed). There were no differences within the control

group (t= - 0.75, df=21, α=0.46, two tailed, unequal variances).

Affect was not associated with ability (r= 0.0067, v= 48, α = > 0.1).

Affect was not associated with the Absolute EROing (AE) variable (t= - 1.16,

df=23, α=0.26, two tailed).

Discussion

Using anomalous data in an attempt to facilitate conceptual change is not a

novel approach. That said, utilising a series of bluff activities where learners are

encouraged to make their own errors and experience illusions is innovative, and

the literature does not reference the triggering of expectation-related observation

as a pedagogical tool.

As is the case with simple bluff demonstrations, it was intended that MIs

elicit strong attachment to misconception theories and so subsequent revelation of

the acceptable science would be all the more surprising, and so memorable. As an

28

Page 29: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

adjunct, the MI approach was devised to initiate emotional stimulation during all

phases of the lesson, from affection towards the initial prediction, to the pleasure

of collecting evidence that confirm the prediction while committing EROs, and

finally to the thrill experienced while watching the teacher reveal the scientific

answer at the end that verifies the pupil’s status as ‘right’ or ‘wrong’. At the end of

Experiment Three pupils from both treatment and control groups completed the

emotion matrix, a short questionnaire that had been previously utilised in a

separate phase of the long-term ERO study. As experiencing emotion can generally

assist memory, and since the treatment groups had made larger conceptual gains

than the control groups, the former might be expected to report greater affect. In

spite of this anticipation, analysis shows that although the treatment group

reported more intense emotions than control, the difference was not significant.

This was interesting, since the items in the matrix were developed from emotions

reported previously during MI lessons only, the fact the control pupils reported the

same emotions at equivalent levels indicates a commonality of affectual experience

that traverses these two diverse approaches to practical work.

In addition to this, pupils from both treatment and control groups who had

answered the critical question correctly during the post-test did not experience

any more emotion than incorrect pupils, showing that affect was not associated

with more effective learning at the stage immediately following the experiment.

However, by the time of the delayed post-test six weeks later the more emotional

learners from the treatment groups only had fared better, achieving significantly

more correct responses. It appears that for the learners who experienced the most

emotion during the MI lesson conceptual change is more robust compared with

29

Page 30: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

less emotional peers who had achieved well at post-test due to the application of

shorter-term memory mechanisms (post-test took place around 5 minutes after

revelation in two experiments, and 24 hours later in the other), though reverted to

initial misconceptions at some time after the lesson. There were no ability

differences along the emotional continuum, denying the possibility that the more

emotional pupils recalled better because they were also more able. Thus, it is

tentatively proposed that the superior gains of the treatment groups are a

consequence of greater engagement with the science that results from emotional

stimulation triggered during the treatment lessons.

emotion → enhanced learning

The reasons for these boosts in affectual levels however, are less clear. Data from

the previous long-term study linked strong EROing10 during MI lessons with the

belief that it was personally important to get the answer right, and these same

children also reported the most intense emotions (Author, 2006), so supporting the

model,

ERO → emotion

Consequently, a plausible mechanism explaining the comparative success of MI

lessons could be,

ERO → emotion→ enhanced learning

10 Represented by the AE variable.

30

Page 31: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

This model implies that pupils who were committing strong EROs would also

experience the most emotion, however, this was not the case with the three

experiments of the current research, as data indicate that most of the pupils

experienced strong emotions during the lessons, with some managing to control

their feelings and observe without bias, and others failing in this respect and

submitting to EROs. This conflicts with findings from the long-term ERO study

where the ERO variable did correlate with affect, though this might be explained

by the two variables used for each study not representing precisely the same

quantity.

The group of 21 AE (strong EROs) learners from the current study did not

perform better in post-tests or delayed post-tests than the rest of the treatment

learners, so unexpectedly, carrying out EROs did not serve as a superior method

with respect to learning the correct scientific concept when compared with

‘proper’, unbiased experimenting, which puts into doubt the proposed mechanism

of ERO → emotion → enhanced learning. On the other hand, these data might

imply that after teacher revelation of the scientific theory, previously

misconceiving ERO learners have had conceptual barriers removed and so were as

likely to achieve favourable conceptual change as more proper experimenters.

EROs experienced during the control lessons were more likely to have stayed

submerged and thus misconceptions subsequently went uncorrected, accounting

for the control groups’ inferior post/delayed post-test results.

31

Page 32: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

With less time being spent on the heavy/fast misconception in the control

lessons compared with the treatment, it could be argued that it is of no surprise

the latter group would perform better at post-test, and the reasons for success lie

with other pedagogical features of MI lessons, not being related at all to

differences in emotional elicitation. This view of a non-affectual mechanism

appears to be supported by the fact that treatment pupils failed to report generally

greater emotion totals than control. Nevertheless, the most emotional pupils also

demonstrated more learning in the medium term - a finding peculiar to treatment

lessons only – which is compelling, and supported by data from an earlier study

(Author, 2006), so it is argued that at least part of the success of the treatment

lessons is down to the proposed model,

ERO → emotion → enhanced learning

It seems that although both treatment and control participants experienced

intense emotions during the study, with some of the former group, affectual

arousal was utilised to positively influence performance.

Of course, there might well be concurrent or even alternative agents of

causation. It must be remembered that the control lesson was a ‘typical’ science

practical where normally little time would be spent on the heavy/fast

misconception, so findings at least imply the worth of extending the exposure

given to pupils with regard to this incorrect, recalcitrant idea. Further research

may shed more light on this issue, though whatever the reasons for success, it

32

Page 33: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

remains undeniable that since superior gains persisted two and three years after

initial exposure, the MI approach to practical work has demonstrable power.

One might expect the brighter students to fare better in the written pre, post

and delayed post-tests. Ross and Law (2003) assumed that a year 11 class from

their study exhibited less misconceptions partly due to their above average ability;

Lawson and Thompson (1988) on the other hand found factors such as mental

capacity and verbal intelligence had very little or no effect on the frequency of

misconceptions. Findings from the experiment phase of the current research

substantiate the former study, with more able pupils tending to choose the

scientifically acceptable answer during the pre-test. Post-test results however,

show that pupils of all abilities were equally likely to gain the correct answer,

indicating that in the short term at least, conceptual change had occurred with less

able individuals who had initially misconceived during the pre-test. It is postulated

that EROs undertaken during the lesson by this lower ability group facilitated the

process.

Six weeks after the experiments, globally, the delayed post-test results

reverted back to an ability-mediated pattern, with the brighter pupils faring

better;11 this was also the case with the 3-year post-test. It appears that the reason

why short-term gains demonstrated at post-test by less able learners were not

sustained was connected with an inadequate ability to recall distant memories of

the lesson, ensuing in a reversion back to the initial misconception declared in the

pre-test. Analysis revealed that pupils of all abilities choosing a misconception

11 Although within the MI group the less ables were still achieving at the same level as the others.

33

Page 34: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

theory in the post and delayed post-tests tended to fall back on the same theory

they had chosen in the original pre-test. Indeed, Claxton (1986) comments that

generally, retrieval of a concept is more difficult than acquisition, and just because

one learns or understands a new concept that is not the end of the matter, as recall

of long-standing misconceptions is often easier than retrieval of a more recently-

assimilated theory. The link that was established between low ability and EROs

during the long-term study was not verified in the current research, as the AE

(strongly EROing) group was of equivalent ability to others in the sample, possibly

due to low sample size (n=52) since the larger main study collected data from

1023 pupils.

Critics might challenge the validity of the assumption that a single multiple-

choice question fully assesses whether successful conceptual change has occurred,

and that further and detailed examination of pupils’ concepts is necessary in order

to show a definite and lasting rejection of the heavy/light misconception. Although

this cannot be disputed, as discussed previously the measure of achievement

utilised by the current research was pragmatic, taking the form of success in

answering questions during formal examinations such as KS3 testing and GCSE.

Failure in these contexts represents an immediate and damaging effect of this

misconception, contributing against progression in school science thus having

consequences for further access to science education and future career choice.

Since pre and post-test questions undertaken within this study resembled those

encountered during formal exams, it seems fair to assume that pupils who were

successful in pre and post-testing would be likely to similarly achieve well when

answering questions that address this concept at KS3/GCSE.

34

Page 35: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

It is intended that future publications will report other aspects of the long-

term ERO study (Author, 2006), of which the experimental phase reported in the

current article represents a subordinate part. Findings are derived from a detailed

exploration into EROing behaviour, and will focus on multivariate associations of a

plethora of factors, the reasons why learners ERO, individual differences between

EROers and non-EROers, and relating conclusions to the developmental

psychology paradigm in order to generate a causal model. A central aspect that

was not explicitly dealt with in the current experimental study is that of social

influences on learning during MI lessons, particularly how the theory-choices of

other participants influence data collection and inference making.

Summary, conclusions and implications

In all three experiments undertaken, at the time of the post-test significantly

more pupils in the treatment groups were aligned to the scientific concept when

compared with control group pupils, thus, the null hypothesis can be rejected.

Post-experimental gains continued into both the medium and long term, and

findings contribute to the literature debate that considers the success of practical

work in augmenting substantive theory. Since the control lessons corresponded to

a form of ‘traditional’ school science, deficiencies of this contemporary pedagogy

in correcting the heavy-fast misconception were apparent.

The brighter pupils performed better at pre-test, although ability was not a

mediating factor at post-test or delayed post-test with the treatment pupils.

Despite some contradictory data, the tentative claim that committing EROs

35

Page 36: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

triggered affectual responses, enhancing engagement and meaningful learning

was supported by the finding that experiencing emotion during MI lessons was

associated with superior medium-term recall, as indicated by performance at

delayed post-test six weeks after the event. The three MI lessons were consistently

effective in promoting conceptual change across the ability range in the short term

at least, though had mixed results in the medium term. These data add to and

confirm the conclusions of previous workers that infer the presentation of

anomalous data has positive effects on learning (e.g. Adey, 1992), and the issue of

expectation-related observation in school science remains largely unexplored,

representing a fertile area for further research. The human tendency to still

believe one’s original idea is the right choice in the face of increasing doubt will be

familiar to readers on introspection, and findings from this research suggest that

this egocentric and normally obstructive inclination might, if generated with care

and aforethought be put to good use.

These findings, particularly the fact that pupils still did significantly better

two and three years after exposure to a single lesson show what is possible if

attempts are made to trigger learners’ emotions during science lessons. Currently,

data from the developmental and experimental psychology paradigms are largely

ignored in curriculum design, and vital research on cognitive entities and

processes, principally emotion, remain hidden gems to educationalists. Making the

effort to engage by arousing emotion in pupils would surely pay dividends

motivationally as well as attainment-wise. That in the short and medium terms less

able learners performed as well as their higher-ability peers implies the MI

approach is able to inspire students who are traditionally the least engaged.

36

Page 37: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

References

Adey, P. (1992). The CASE results: implications for science teaching. International Journal of Science Education, 14, 137-146.

Author (2005). School Science Review.Author (2006). The phenomenon of expectation-related observation: an

exploration of nature, associations and causes. Unpublished PhD dissertation.Author (2007). School Science Review (in press).Alsop, S. (2001). Seeking emotional involvement in science education: food

chains and webs. School Science Review, 83, 63-68.Asami, N., King, J. and Monk, M. (2000). Tuition and memory: mental models

and cognitive processing in Japanese children's work on D.C. electrical circuits. Research in Science and Technological Education, 18, 141-154.

Atkinson, E. P. (1990). Learning scientific knowledge in the student laboratory. In E. Hegarty-Hazel (Ed.), The Student Laboratory and the Science Curriculum (pp119-131). London: Routledge.

Brewer, W. F., and Samarapungavan, A. (1991). Child theories versus scientific theories: differences in reasoning or differences in knowledge? In R. R. Horfman & D. S. Palermo (Eds.), Cognition and the Symbolic Processes: Applied and Ecological Perspectives (pp209-232) Hillsdale, New Jersey: Lawrence Erlbaum Associates.

Bromm, B. and Desmedt, J. (1995). Pain and the Brain: From Nociception to Cognition. New York: Raven Press Ltd..

Carmichael, P., Driver, R., Holding, B., Phillips, I., Twigger, D. and Watts, D. M. (1990). Research on Students' Conceptions in Science: A Bibliography. Children's Learning in Science Project, CSSME. Leeds, University of Leeds.

Champagne, A. B., Gunstone, R. F. and Knopfler, L. E. (1985). Instructional consequences of students’ knowledge about physical phenomena. In L. H. T. West and A. L. Pines (Eds.), Cognitive Structure and Conceptual Change (pp61-90). Orlando, Florida: Academic.

Champagne, A. B., Klopfer, L. E. and Anderson, J. H. (1980). Factors influencing the learning of classical mechanics. American Journal of Physics, 48, 1074-1079.

Chan, C., Burtis, J. and Bereiter, C. (1997). Knowledge building as a mediator of conflict in conceptual change. Cognition and Instruction, 15, 1- 40.

Chang, C-Y. and Barufaldi, J. P. (1999). The use of a problem-solving- based instructional model in initiating conceptual change in students’ achievement and alternative frameworks. International Journal of Science Education, 21, 373-388.

Chi, M. T. H. (1978). Knowledge structures and memory development. In R. S. Siegler (Ed.), Children's thinking: What develops? Hillsdale, New Jersey: Lawrence Erlbaum Associates.

Chinn, C. A. and Brewer, W. F. (1998). An empirical test of a taxonomy of responses to anomalous data in science. Journal of Research in Science Teaching, 35, 623-654.

Claxton, G. (1986). The alternative conceiver's conceptions. Studies in Science Education, 13, 123-130.

37

Page 38: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

Cohen, L., Manion, L. and Morrison, K. (2000). Research Methods in Education (5th Edition). London: RoutledgeFalmer.

Davidson, D. and Jergovic, D. (1996). Children’s memory for atypical actions in script-based stories: an examination of the disruption effect. Journal of Experimental Child Psychology. 61, 134-152.

Driver, R. (1975). The name of the game. School Science Review, 56, 800-805.

Driver, R. (1983). The Pupil as Scientist? Milton Keynes: The Open University Press.

Driver, R., Asoko, H., Leach, J., Mortimer, E. and Scott, P. (1994a). Constructing scientific knowledge in the classroom. Educational Researcher, 23, 5-12.

Driver, R., Guesne, E. and Tiberghien, A. (Eds.) (1985). Children's Ideas in Science. Milton Keynes: The Open University Press.

Driver, R., Squires, A., Rushworth, P. and Wood-Robinson, V. (1994b). Making Sense of Secondary Science: Research into Children’s Ideas. New York: Routledge.

Duit, R. and Treagust, D. F. (2003). Conceptual change: a powerful framework for improving science teaching and learning. International Journal of Science Education, 25, 671-688.

Erickson, G. (1994). Pupils' understanding of magnetism in a practical assessment context: the relationship between content, process and progression. In P. J. Fensham, R. F. Gunstone and R. White (Eds.), The Content of Science: A Constructivist Approach to its Teaching and Learning (pp 80-97). London: The Falmer Press.

Fensham, P. J. (2004). Engagement with Science: An international issue that goes beyond knowledge. SMEC Conference, September 23/24, Dublin City University.

Gilovich, T. (1991). How We Know What Isn't So: The Fallibility of Human Reason in Everyday Life. New York: The Free Press.

Gordon, I. E. (1989). Theories of Visual Perception. Chichester: John Wiley and Sons.

Gott, R. and Duggan, S. (1995). Investigative Work in the Science Curriculum. Buckingham: The Open University Press.

Gunstone. R. F. (1991). Reconstructing theory from practical experience. In B. Woolnough (Ed.), Practical Science (pp67-77). Milton Keynes: The Open University Press.

Gunstone, R. F. (1994). The importance of specific science content in the enhancement of metacognition. In P. J. Fensham, R. F. Gunstone and R. White (Eds.), The Content of Science: A Constructivist Approach to its Teaching and Learning (pp131-146). London: The Falmer Press.

Gunstone, R. F. and Watts, M. (1985). Force and motion. In R. Driver, E. Guesne and A. Tiberghien (Eds.), Children's Ideas in Science (pp85-104). Milton Keynes: The Open University Press.

Gunstone, R. F. and White, R. T. (1980). A matter of gravity. Research in Science Education, 10, 35-44.

Gunstone, R. F. and White, R. T. (1981). Understanding of gravity. Science Education, 60, 291-9.

Gunstone, R. F., Mitchell, I. J. and the Monash Children's Science Group (1988). Two teaching strategies for considering children's science. In What

38

Page 39: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

Research Says to the Teacher: The Yearbook of the International Council of Associations of Science Education (pp1-12). Monash, Monash University.

Harlen, W. (1999). Effective Teaching of Science: A Review of Research. Edinburgh: Scottish Council for Research in Education.

Hertel, P. T. and Parks, C. (2002). Emotional episodes facilitate word recall. Cognition and Emotion, 16 (5), 685-694.

Hesse, J. J. III. (1987). The costs and benefits of using conceptual change teaching methods: a teacher’s perspective. In J. D. Novak (Ed.), Proceedings of the Second International Seminar on Misconceptions and Educational Strategies in Science and Mathematics (Vol. 2) (pp194-209). Ithaca, New York: Cornell University.

Hodson, D. (1986). The nature of scientific observation. School Science Review, 68, 17-29.

Hodson, D. (1993). Rethinking old ways: towards a more critical approach to practical work in school science. Studies in Science Education, 22, 85-142.

Inagaki, K. (1981). Facilitation of knowledge integration though classroom discussion. Quarterly Newsletter of the Laboratory of Comparative Human Cognition, 3, 26-28.

Jerusalem, M. and Pekrun, R. (Eds.) (1999). Emotion, Motivation and Leistung. Gottingen, Bern, Toronto, Seattle: Hogrefe.

Jofili, Z., Geraldo, A. and Watts, M. (1999). A course for critical constructivism through action research: a case study from biology. Research in Science and Technological Education, 17, 5-17.

Johsua, S. and Dupin, J. J. (1987). Taking into account student conceptions in instructional strategy: an example in physics. Cognition and Instruction, 4, 117-135.

Karmiloff-Smith, A. (1988). A child is a theoretician, not an inductivist. Mind and Language, 3, 183-195.

Kuhn, D. (1989). Children and adults as intuitive scientists. Psychological Review, 96, 674-689.

Kuhn, T. S. (1996). The Structure of Scientific Revolutions (3rd Edition). Chicago: The University of Chicago Press.

Lawson, A. E. (1995). Science Teaching and the Development of Thinking. Belmont, California: Wadsworth.

Lawson, A. E. and Thompson, L. D. (1988). Formal reasoning ability and misconceptions concerning genetics and natural selection. Journal of Research in Science Teaching, 25 (9), 733-746.

Laukenmann, M., Bleicher, M., Fub, S., Glaser-Zikuda, M., Mayring, P. and von Rhoneck, C. (2003). An investigation of the influence of emotional factors on learning in physics instruction. International Journal of Science Education, 25 (4), 489-507.

Mahoney, M. J. (1979). Psychology of the scientist. Social Studies in Science, 9, 349-375.

Millar, R. (1989). Bending the evidence: the relationship between theory and experiment in science education, In R. Millar (Ed.), Doing Science: Images of Science in Science Education (pp38-61). London: The Falmer Press.

Nisbett, R. and Ross, L. (1980). Human Inference: Strategies and Shortcomings of Social Judgement. Englewood Cliffs, New Jersey: Prentice Hall.

39

Page 40: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

Nott, M. and Smith, R. (1995). Talking your way out of it, “rigging” and “conjuring”: what science teachers do when practicals go wrong. International Journal of Science Education, 17, 399-410.

Oakes, M. E. (1945). Explanations of natural phenomena by adults. Science Education, 29, 137-42.

Osborne, R. J. and Wittrock, M. C. (1983). Learning science: a generative process. Science Education, 67, 489-508.

Osborne, R. (1984). Children’s dynamics. The Physics Teacher, 22 (8), 504-8. Ozkan, O., Tekkaya, C. and Geban, O. (2004). Facilitating conceptual change

in students' understanding of ecological concepts. Journal of Science Education and Technology, 13, 95-105.

Posner, G., Strike, K., Hewson, P. and Gertzog, W. (1982). Accommodation of a scientific conception: towards a theory of conceptual change. Science Education, 66, 211-227.

Renner, J. W., Abraham, R. M. and Birnie, H. H. (1988). The necessity of each phase of the learning cycle in teaching high school. Journal of Research in Science Teaching, 28, 437-454.

Ross, K. and Law, E. (2003). Children’s ideas about melting and freezing. School Science Review, 85, 99-102.

Shadish, W. R., Cook, T. D. and Campbell, D. T. (2001). Experimental and Quasi-experimental Designs for Generalised Causal Inferences. Boston, Massachusetts: Houghton Mifflin.

Shakespeare, D. (2003). Starting an argument in science lessons. School Science Review, 85, 103-108.

Shipstone, D. M. (1984). A study of children’s understanding of electricity in simple D.C. circuits. European Journal of Science Education, 6, 185-198.

Treagust, D. F. and Tsui, C. Y. (2004). Conceptual change in learning genetics: an ontological perspective. Research in Science and Technological Education, 22, 185-202.

Vygotsky, L. (1978). Mind in Society: The Development of Higher Psychological Processes. Cambridge, Massachusetts: Harvard University Press.

Watson, J. R. (2000). The role of practical work. In M. Monk, and J. Osborne (Eds.), Good Practice in Science Teaching: What Research has to Say (pp57-71). Buckingham: The Open University Press.

Watson, J. R. and Wood-Robinson, V. (1998). Learning to investigate. In M. Ratcliffe (Ed.), ASE Guide to Secondary Science Education. 84-91. Cheltenham: Stanley Thornes.

Watson, J. R., Swain, J. R. L. and McRobbie, C. (2004). Students' discussions in practical scientific inquiries. International Journal of Science Education, 26, 25-45.

Watts, D. M. and Bentley, D. (1991). Constructivism in the curriculum: can we close the gap between a strong theoretical version and the weak version of theory-in-practice? The Curriculum Journal, 2, 171-182.

Wessel, I. and Wright, D. B. (2004). Emotional memory failures: on forgetting and reconstructing emotional experiences. Cognition and Emotion, 18, 449-455.

Zimmerman, C., Raghavan, K. and Sartoris, M. L. (2003). The impact of the MARS curriculum on students' ability to coordinate theory and evidence. International Journal of Science Education, 25, 1247-1271.

40

Page 41: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

Figure 1: Rationale behind Misconception Interventions.

41

Pupils make predictions.

Early practical activities are poorly resolved. EROs ensue, with recorded

observations tending to confirm predictions; many observations contradict

the reality of the phenomenon.

Later practical activities are better resolved. Less EROs, with recorded

observations tending increasingly to be more aligned with the reality of the

phenomenon.

Teacher demonstration confirms reality of phenomenon; emotional responses

triggered by this revelation and by other phases of the lesson may promote

engagement with the science.

Page 42: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

Figure 2: DC circuit described by Gunstone (1991).

42

Page 43: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

Figure 3: Treatment lesson format.

.

43

Treatment lesson

Pre-test

Learners make predictions

Practical activities 1-4

Learners look at data and make a final choice

Scientific answer is revealed during teacher

demonstration

Page 44: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

Figure 4: Control lesson format

44

Control lesson

Pre-test

Learners carry out four mini-experiments arranged as a circus that

use gravity as a theme

Teacher reveals the scientific answer to each of the mini-experiments

Post-test

Page 45: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

Figure 5: Pre-test questions.

45

2. A skydiver jumps from an aeroplane.

She will fall faster if she spreads her arms and legs as far out as possible.

She will fall faster if she curls into a ball.

She will fall faster if she takes up a head-down, dive position.

She will fall faster if she opens her parachute

3. Signor Galileo decides to drop two cannon-balls from the top of a tall building, at exactly the same time. One of the balls is twice as heavy as the other.

He finds that both balls hit the ground at the same time.

He finds that the heavier ball lands first.

He finds that the lighter ball lands first.

You do not know which ball will land first.

Pre-test.

Think about each of the following statements and tick only one of the four boxes under each question.

1. A trolley freewheels down a slope.

Adding more weight will make the trolley go further.

Adding more weight will make the trolley go faster.

Adding more weight will have no ef-fect.

You do not know what effects adding more weight will have.

Page 46: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

Think about how you felt when you were told the correct answer, and tick the appropriate box next to each statement:

I felt this strongly

I felt this slightly

I did not feel this at all

I felt proud of myself when I was right

I felt embarrassed when I was wrong

I felt disappointed when I was wrong

I was pleased to be right

It did not bother me that I was wrong.

I felt excited when I was waiting to be told about the answer.

I was surprised to be wrong, because I thought I was right

I really wanted to be right

I was afraid of getting the answer wrong in case I looked foolish.

Figure 6: Emotion matrix.

46

Page 47: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

Figure 7: Temporal progress of treatment and control groups.

*Upper line represents treatment groups, lower line control groups.

Temporal progress of treatment and control groups

0102030405060708090

100

Pre-test Post-test Delayedpost-test

2 year post-test

3 year post-test

Test

Mea

n %

cor

rect

Mea

n %

cor

rect

47

Page 48: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

Particulars Experiment 1 Experiment 2 Experiment 3

Year group Year 7 Year 6 Year 6

Number of participants in treatment class 27 27 25

Number of participants in control class 26 28 25

Raw

resu

lts (c

orre

ct/in

corr

ect) Treatment pre-test

Control pre-test0/273/23

0/271/27

8/173/22

Treatment post-testControl post-test

19/67/18

25/21/27

23/27/18

Treatment delayed post-testControl delayed post-test

18/96/15

19/514/9

18/66/19

Treatment 2nd delayed post-testControl 2nd delayed post-test

13/1011/12

14/0911/13

XX

Pre/

post

-test

co

mpa

rison

s

Treatment group pre/post-test gains +76%**** +93%*** +60%***

Control group pre/post-test gains +16% 0% +16%

Treatment/control group post-test results difference

x2= 9.70** x2= 40.20**** x2= 18.75****

Pre/

dela

yed

post

-test

com

paris

ons

Treatment group pre/delayed post-test gains

+67%**** +79%*** +44%*

Control group pre/delayed post-test gains

+29% +58%*** +12%

Treatment/control group delayed post-test results difference

x2= 5.42* x2= 1.11 x2= 11.52***

Treatment group pre/second delayed post-test gains

+57%**** +61%**** X

Control group pre/second delayed post-test gains

+36%* +42%** X

Treatment/control group second delayed post-test results difference

x2= 1.23 x2=0.548 X

Table 1: Data and statistics from the three experiments. 12

12 Note that * = α < 0.05; ** = α < 0.01; *** = α < 0.001; **** = α < 0.0001.

48

Page 49: Promoting learner error provides affectual stimulation ... 2008.doc  · Web viewPromoting learner error provides affectual stimulation, triggering engagement and conceptual change

Promoting learner error facilitates conceptual change

Statistic Treatment group Control group

n 25 25

Mean 6.68 5.56

Standard deviation 2.63 2.96

Range 3-12 2-11

Table 2: Descriptive statistics of emotion total.

49