precision teaching and direct instruction: measurably superior...

23
Precision Teaching and Direct Instruction: Measurably Superior Instructional Technology in Schools Carl Binder Precision Teaching and Management Systems, Inc. Cathy L. Watkins California State University ABSTRACT Although educators, policy-makers, business leaders, and the general pub- lic have become increasingly concerned about the "basic skills" crisis in Ameri- can schools, research-based solutions have existed for over two decades in the form of measurably superior teaching methodologies: Precision Teaching and Direct Instruction. In federally vali- dated research, each of these instruc- tional technologies has been shown to produce r greater achievement and self-esteem among students than more traditional teaching practices, with fa- vorable cost-benefit ratios when imple- mented in schools. These results have been obtained despite adverse socio- economic influences on students so of- Introduction Although systematic, empirically derived instructional technology in many forms has existed for decades, mainstream educators have, by and large, resisted it. Such criterion- referenced approaches as the "Per- sonalized System of Instruction" (PSI) or "Kel ler Pan" (Sherman, Ruskin, & Semb, 1982) have been rejected in many university settings, despite measurable improvements in students' learning, because many 74 ten blamed for failure in the classroom. These methods have not been widely adopted, partly due to political and philosophical resistance to measurably superior instructional technology among educators. This article provides overviews of Precision Teaching and Direct In- struction, discusses their origins and research backgrounds, cites effec- tiveness data, and describes how they can complement one another when used together. It provides sufficient references to the literature and pointers to existing programs to en- able interested readers to learn more about each of these measurably su- perior educational solutions. educators and administrators can- not accommodate systems that dis- turb the normal distribution of grades in the student population. An analy- sis of the contingenc ies that affect adoption of instructional methods in the educational establishment reveals forces that oppose change at all levels and which must be overcome in order f or measurably effective instructional technology to take hold (Watkins, 1988). PERFORMANCE IMPROVEMENT QUARTERLY

Upload: others

Post on 28-Jul-2020

17 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

..... -----

Precision Teaching and Direct Instruction:

Measurably Superior Instructional Technology in

Schools

Carl Binder Precision Teaching and Management Systems, Inc.

Cathy L. Watkins

California State University

ABSTRACT

Although educators, policy-makers,

business leaders, and the general pub­

lic have become increasingly concerned

about the "basic skills" crisis in Ameri­

can schools, research-based solutions

have existed for over two decades in the form of measurably superior teaching

methodologies: Precision Teaching and Direct Instruction. In federally vali­

dated research, each of these instruc­

tional technologies has been shown to

produce far greater achievement and

self-esteem among students than more

traditional teaching practices, with fa­vorable cost-benefit ratios when imple­

mented in schools. These results have

been obtained despite adverse socio­

economic influences on students so of-

Introduction Although systematic, empirically

derived instructional technology in many forms has existed for decades, mainstream educators have, by and large, resisted it. Such criterion­referenced approaches as the "Per­sonalized System of Instruction" (PSI) or "Keller Pan" (Sherman, Ruskin, & Semb, 1982) have been rejected in many university settings, despite measurable improvements in students' learning, because many

74

ten blamed for failure in the classroom. These methods have not been widely

adopted, partly due to political and

philosophical resistance to measurably

superior instructional technology

among educators.

This article provides overviews of Precision Teaching and Direct In­

struction, discusses their origins and

research backgrounds, cites effec­

tiveness data, and describes how they can complement one another when

used together. It provides sufficient

references to the literature and

pointers to existing programs to en­able interested readers to learn more

about each of these measurably su­

perior educational solutions.

educators and administrators can­not accommodate systems that dis­turb the normal distribution of grades in the student population. An analy­sis of the contingencies that affect adoption of instructional methods in the educational establishment reveals forces that oppose change at all levels and which must be overcome in order for measurably effective instructional technology to take hold (Watkins, 1988).

PERFORMANCE IMPROVEMENT QUARTERLY

In elementary and schools, and in the uni e grams thatprepare teache schools, educational fad con go. To an observer it often een "new" methods are valued bea their newness, and mature me including measurably effec are rejected simply becau e -no longer new. U nfortunatel of the most mature and effect structional methods fall int.o -· h a v i o r a l "

category-a school of thought that is now very much out of vogue in mainstream education . Among the measurably effective in­structional technologies that have been imple­mented in

Decade

applict

Precisi

Dire,c

regu

clas

capab

Arm "basii

br([_

schools over thelast twenty fiveyear areP Teaching and Direct In tru fact, these two approache to tion may be the most thoro dated and consisten ly e methods yet developed in 1 speaking schools (Binder

Watkins, 1988). Decade of1

and application suggest tha I Teaching and Direct regular and special cla roo be capable of eliminating -current "basic skills cri · i: adopted. However, mo e and policy-makers are no

these methods. And hen

aware of them, there i o

VOLUME 3, NUMBER 4/1990

Page 2: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

nction: ,echnology in

C.

:nrfailure in the classroom.,., have not been widelydue to political and

r istance to measurablyuctional technology

lc.::O ·�.

provides overviews of� �ching and Direct In­• .;;c ses their origins and.. e.,.grounds, cites effec-

and describes how theyen one another when

�r. I provides sufficient:o he literature and

· ring programs to en­readers to learn more

_ ese measurably su­

onal solutions.

d administrators can­date systems that dis­tal distribution of grades?°pulation. An analy-

-lilgencies that affect· tructional methods·onal establishment

hat oppose changeand which must beor�er for measurablyc onal technology to. s, 1988).

�JPROVEMENT QUARTERL y

In elementary and secondary schools, and in the university pro­grams that prepare teachers for those schools, educational fads come and go. To an observer it often seems that "new" methods are valued because of their newness, and mature methods, including measurably effective ones, are rejected simply because they are no longer new. Unfortunately, some of the most mature and effective in­structional methods fall into the "be­h a v i o r a l "

sophical and political resistance to their use (Binder & Watkins, 1989).

An important message that perfor­mance technologists and systematic instructional developers can deliver to those concerned about America's educational failures is that the keys to

a solution lie in better instructional

methods, not in the socio-economic

and cultural factors that are so often blamed for the problem. Results of effectiveness research demonstrate

that with the category-a school of thought that is now very much out of vogue in mainstream educat ion . Among the measurably effective in­structional technologies that have been imple­mented in

Decades of research and

application suggest that

Precision Teaching and

implemen­tation of su­p e r i o ri n s t r u c ­tional meth­ods it is possible to o v e r c o m ethe effects ofsuch vari­ables as in­n e r - c i t yp o v e r t y,single-par­ent families,

Direct Instruction in

regular and special

classrooms may be

capable of eliminating

America's current

"basic skills crisis," if

broadly adopted.

schools over the last twenty five years are Precision Teaching and Direct Instruction. In fact, these two approaches to instruc­tion may be the most thoroughly vali­dated and consistently effective methods yet developed in English­speaking schools (Binder, 1988; Watkins, 1988). Decades of research and application suggest that Precision Teaching and Direct Instruction in regular and special classrooms may be capable of eliminating America's current "basic skills crisis," if broadly adopted. However, most educators and policy-makers are not aware of these methods. And when they are aware of them, there is often philo-

VOLUME 3, NUMBER 4/1990

t e l e v i s i o no v e r d o s e,

and other influences outside the classroom (e.g., Watkins, 1988). Nonetheless, most educators and policy-makers continue to blame fac­tors beyond teachers' control for fail­ure in the classroom.

This article provides overviews of Precision Teaching and Direct In­struction, discusses their origins and research backgrounds, and describes how they can complement one an­other when used together. It provides sufficient references to the literature and pointers to existing programs to enable interested readers to learn more about each of these measurably superior instructional technologies.

75

Page 3: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

The fact is that America now has the

best basic skills instructional technol­

ogy in the world, yet it is not being

used. We hope that this article will help to inform educators, policy mak­ers, and increasingly concerned busi­ness leaders that there are now mature, cost-effective solutions to America's educational crisis, ready to be implemented in a broad variety of educational settings, and able to pro­duce results that are orders of magni­tude greater

into the classroom, most behaviorists discarded the measurement frame­work that had proven so useful in basic research laboratories (rate or frequency of response) in favor of the scale used in virtually all traditional educational evaluation-percentage correct (Lindsley, 1990). Despite Skinner's ( 1950) conclusion that "rate of responding appears to be the only datum which varies signifi­cantly and in the expected direction

under condi­than the re­sults of mainstream educational practice.

Precision Teaching

Origins

During the 1960s, many of the stu-dents and

By using daily charts,

teachers and students

were able to make timely

decisions about the

effectiveness of methods

and materials in helping

students to achieve

defined performance

goals.

tions which are relevant to the learn­ing process," most behav­

iorally ori­

e n t e d

instructional

t e c h n o l o ­

gists opted

to measure

a c c u r a cy

o n ly , a n d

ge n e r a l lycolleagues of B.F. Skinner moved from basic re­search laboratories into applied set­tings. In fact, NSPI (originally the National Society for Programmed

Instruction) was a part of this move­ment. Most of those who began to apply what had been learned in the laboratory to educational problems created processes and programs based on the findings of basic re­search. Using reinforcement sched­ules, behavior shaping, discrimination learning paradigms, stimulus fading, and other prin­ciples and procedures derived from laboratory research, these pioneers created teaching programs and re­vised them based on measured ef­fects. However, when they moved

76

ignored the

temporal dimensions of behavior,

except in particular cases (e.g., typ­ing speed and reading rate).

0. R. Lindsley, the founder of Pre­cision Teaching(Lindsley, 1964, 1972, 1990), who with Skinner had first applied the method of free operant conditioning to humans (Lindsley & Skinner, 1954), had coined the term "behavior therapy" in his work with psychotics, and had made major methodological contributions in ar­eas such as sleep research (Lindsley, 1957), behavioral pharmacology (Lindsley, 1962), and geriatric behav­ior prosthesis (Lindsley, 1964b), took a different approach. Instead of cre­ating programs and "recipes" based on laboratory findings, he emphasized

PERFORMANCE IMPROVEMENT QUARTERLY

"' ... ::, z

... z

CA

DEPOSITOR AGEN

.,,

the measurement frameu

proven so powerful for : his associates in the lali created the "Standar Chart" (a.k.a. Stand.an Chart), a 6-cycle emi

graph for charting beha\l (or rate) against calen he taught teachers and

to count and time behm complishments in the cl: Figure 1). He reasoned· ting science in the han and students" it would b them to discover, in the

individual learner ha

and materials produced provements in learning mance. In effect, Lin leJ

VOLUME 3, NUMBER 4/199(

Page 4: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

· to the classroom, most behaviorists· ded the measurement frame-work hat had proven so useful in

·c research laboratories (rate orfrequency of response) in favor of the;cale u ed in virtually all traditionalucational evaluation-percentage:orrect (Lindsley, 1990). Despite· er's (1950) conclusion that "ratere ponding appears to be theinly datum which varies signifi-an l and in the expected direction

v charts, students

ake timely wut the ('methods in helping 'Jl-ehieve t.rmance

under con di. tions which are relevant to the learn­ing process," most behav­iorally ori­e n t e d instructional t ech n o l o ­gists opted to measure acc u r acy o n ly, and ge n e r a l ly ignored the

nporal dimensions of behavior c:ep in particular cases (e.g., typ�� peed and reading rate). ). R. Lindsley, the founder of Pre­ion Teaching(Lindsley, 1964, 1972,}O) who with Skinner had firstJlied the method of free operant· · oning to humans (Lindsley &.nner, 1954), had coined the termhavior therapy" in his work with·cho ics, and had made majorr:hodological contributions in ar­ch as sleep research (Lindsley,) behavioral pharmacologyle , 1962), and geriatric behav-J hesis (Lindsley, 1964b), tookerent approach. Instead of cre­" programs and "recipes" basedtboratory findings, he emphasized

L"UR\4ANCE IMPROVEMENT QUARTERLY

Figure 1. Standard Behavior Chart

500

100

50

10 "'

5

z

z

0 10 20 30

10

20 -v.

_,.

so -·

,

100 -2

200

-5

500 -8

1000-16

-24

SUCCESSIVE CALENDAR DAYS

SUPERVISOR ADVISER

DEPOSITOR

MANAOU

AGENCY TIMER

the measurement framework that had proven so powerful for Skinner and his associates in the laboratory. He created the "Standard Behavior Chart" (a.k.a. Standard Celeration Chart), a 6-cycle semi-logarithmic graph for charting behavior frequency (or rate) against calendar days, and he taught teachers and their students to count and time behaviors and ac­complishments in the classroom (see Figure 1). He reasoned that by "put­ting science in the hands of teachers and students" it would be possible for them to discover, in the case of each individual learner, what procedures and materials produced greatest im­provements in learning and perfor­mance. In effect, Lindsley emphasized

VOLUME 3, NUMBER 4/1990

BEHAVER

COUNTER CH,1,RTER

the evaluation and revision compo­nents of systematic instruction by en­couraging teachers and students to

pinpoint behaviors, count, time and chart them every day, and "try, try again" when initial procedures did not produce the desired results (Lindsley, 1972).

The Standard Behavior Chart itself (Pennypacker, Koenig, & Lindsley, 1972; Kazdin, 1976; West, Young, & Spooner, 1990) proved to be an impor­tant contribution to the study of learning and performance. Its loga­rithmic or "multiply-divide" count per minute scale along the left axis en­abled students and teachers to chart and directly assess ratios of correct and error frequencies, and to view

77

Page 5: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

and quantify progress in the form of straight-line trends rather than "learning curves" (since the logarith­mic scale straightens out the tradi­tional learning curve) formed by sequences of daily frequency mea­sures on the chart. By using daily charts, teachers and students were able to make timely decisions about the effectiveness of methods and ma­terials in helping students to achieve defined performance goals (White & Haring, 1976). By creating linear representations of learning ( trends in performance) on the semi-logarith­mic chart, and quantifying them as multiplicative factors per week (e.g., correct responding multiplying x 2.0 per week, errors dividing by /1.5 per week), Lindsley defined the first simple measure of learning in the literature: celeration (either a multi­plicative acceleration of behavior fre­quency; or a dividing deceleration of behavior frequency per celeration pe­

riod, e.g., per week). The chart en­abled users to measure learning against standard angles on the chart (resembling those on a protractor) to obtain direct read-outs of learning, independent of performance level. The chart's standard dimensions and pro­portions would enable users (includ­ing non-educational performance technologists) to avoid the distortion inherent in conventional non-stan­dard "stretch-to-fill" graphs and to directly compare trends and magni­tudes of effect and variability.

Precision Teaching Philosophy and Strategies

At the beginning of the paper that represents his initial contribution to the educational literature, Lindsley (1964a) wrote: "Children are not re­tarded. Only their behavior in aver-

78

age environments is sometimes re­tarded. In fact, it is modern science's ability to design suitable environ­ments for these children that is re­tarded" (p. 62).

A key element of Precision Teach­ing is the dictum that "the child knows

best" (Lindsley, 1972). Based on Skinner's famous statement that "the

organism is always right," Lindsley taught Precision Teachers to assume that learners respond in lawful ways to environmental variables and that if learners behave in an undesirable way it is the responsibility of teachers to alter those variables until they produce the desired result. This as­sumption, perhaps obvious to most current-day performance technolo­gists, flies in the face of traditional psycho-educational practice which tends to label and to blame students

for failure, not instructional meth­ods.

Daily measurement of performance was another important element of Precision Teaching from the begin­ning. As in the basic operant condi­

tioning laboratory, where continuous cumulative response graphs allowed researchers to observe ongoing vari­ability of performance, daily record­ing of students' performance enabled Precision Teachers and their students to identify and to take advantage of variables that cause changes in per­formance dur:ing the learning pro­cess.

Self-recording by students and sharing of results among teachers and students was another component of Precision Teaching that came from the methods practiced by laboratory behavior analysts who met frequently to share cumulative response records (Lindsley, 1990). The standard chart became a primary communication tool

PERFORMANCE IMPROVEMENT QUARTERLY

among thousands of Pre1 Teachers and their studen ai of sharing discoveries and tively solving problems. operant conditioning labo

Precision Teachers anal zt: sults and designed interven individuals while collec in comparing individual reco hope of identifying general

ciples of learning and perfo The Standard Celeration Chm like conven-t i o n a l "stretch-to­fill" charts), b e c a u s e i t allowed for

d i r e c t graphic com-p a r i s o n

Precis

the te

refer i

speed

among individuals and inter serves as an efficient tool 101

purpose. Early Precision Teacher

categories of functional be analysis when analyzing and

ing interventions. Theydis · � between operational or descr definitions of events (an events, movement cycles an " quent events) and functional ti tions (stimuli, respon e consequences), which could o� determined by changing eve continuing to measure beha quencies (Lindsley, 1964a) to« mine functional relation behavioral and environmen ables. Thus, for example, o el only call a subsequent even a r quence" if measuremen strated that changing tha e an effect on the frequenc of -havior it was arranged to follo

An extension of this fun approach, derived originall

VOLUME 3, NUMBER 4/1990

Page 6: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

:vironments is sometimes re­. In fact, it is modern science's

de ign suitable environ-

o hese children that is re­p. 62). element of Precision Teach­

edictum that "the child knows · d ley, 1972). Based on

-r' famous statement that "the · always right," Lindsley

Preci ion Teachers to assume rrners respond in lawful ways ronmental variables and that e behave in an undesirable

e responsibility of teachers r those variables until they � e desired result. This as­:m, perhaps obvious to most ·,lay performance technolo-

in the face of traditional ed cational practice which , label and to blame students

rre not instructional meth-

ea urementofperformance other important element of n Teaching from the begin-

in he basic operant condi­taboratory, where continuous ·ve response graphs allowede o observe ongoing vari­

performance, daily record­ents' performance enabled

!l eachers and their students t:fy and to take advantage of

at cause changes in per­e dm'.ing the learning pro-

�rding by students and o results among teachersen was another componention eaching that came from

practiced by laboratory analysts who met frequently :umulative response records r 1990). The standard chart primary communication tool

A:. 'CE IMPROVEMENT QUARTERLY

among thousands of Precision Teachers and their students, a means of sharing discoveries and coopera­tively solving problems. As in the operant conditioning laboratory, Precision Teachers analyzed re­sults and designed interventions for individuals while collecting and comparing individual records in the hope of identifying general prin­

ciples of learning and performance. The Standard Celeration Chart (un­like conven-

operant conditioning laboratory, was an emphasis on definition of behav­ior as active, and measurement of its products whenever possible. Preci­sion Teachers applied the "dead man's test" to descriptions of behavior. "If a dead man can do it, then don't try to teach it." This rule helped teachers avoid setting teaching objectives such as "keeps eyes on paper" or "sits qui­etly in chair" which are not countable behaviors. Likewise, early Precision

T e a c h e r s t i o n a l "stretch-to­fill" charts), b e c a u s e i t allowed for d i r e c tgraphic com-

Precision Teachers use t r i e d t om e a s u r e" b e h a v i o r tracks"-the r e s u l t s o f b e h a v i o r rather than

the term "fiuency" to

refer to accuracy plus

speed of performance.

p a r i s o namong individuals and interventions, serves as an efficient tool for this purpose.

Early Precision Teachers used the categories of functional behavior analysis when analyzing and chang­ing interventions. They distinguished between operational or descriptive

definitions of events (antecedent events, movement cycles, and subse­quent events) and functional defini­

tions (stimuli, responses, and consequences), which could only be determined by changing events and continuing to measure behavior fre­quencies (Lindsley, 1964a) to deter­mine functional relations among behavioral and environmental vari­ables. Thus, for example, one would only call a subsequent event a "conse­quence" if measurement demon­strated that changing that event had an effect on the frequency of the be­havior it was arranged to follow.

An extension of this functionalist approach, derived originally from the

VOLUME 3, NUMBER 4/1990

the behavior itself-whenever possible. This principle was related to the recogni­tion that automatic laboratory apparatus actually counted switch­closures caused by sufficiently robust movements on the part oflaboratory subjects, and did not necessarily measure each of the subject's bar­presses. Precision Teachers, for ex­ample, could neither measure nor change the frequency of"feeling good." But they could certainly help stu­dents to increase their frequency of tallying "good feelings" during the day, a kind ofbehavior track. Gilbert (1978) expressed the same idea, per­haps more elegantly, by stressing ac­complishments rather than behaviors as the proper subject of performance engineering.

Combining these principles and practices, Precision Teachers and their students have treated each project as an individual experiment, and for more than 25 years have continued to make discoveries about how to improve

79

Page 7: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

learning and performance in a broad range of student populations.

Research and Development of

Precision Teaching Early practitioners discovered that

brief timed samples of academic per­formance (e.g., 1 minute per day) were sufficient for monitoring progress and making decisions, and that it is often unnecessary to record performance for longer periods, as had been the practice at the very beginning of the movement. Subse­quently, most Precision Teachers be­gan using daily one-minute timed samples of performance for charting and decision-making (Kunzelmann, Cohen, Hulten, Martin, & Mingo, 1970; White and Haring, 1976).

One of the most significant contri­butions of Precision Teaching research was the use of frequency aims

(Haughton, 1972; Wood, Burke, Kunzelmann, & Koenig, 1978; Koorland, Keel, & Ueberhorst, 1990). Because early practitioners were strongly influenced by operant condi­tioning and its applied offshoot known as "behavior modification," they ini­tially viewed behavior frequency (re­sponse rate) as a "performance variable" able to be arbitrarily in­creased or decreased through the use of consequences. However, when teachers began measuring behavior frequencies of academic skills (e.g., writing answers to simple arithmetic problems), they noticed that conse­quences were often not sufficient for increasing performance. For example, while most students could achieve performances of 40 to 50 correctly written answers to addition problems per minute by engaging in daily prac­tice, some seemed unable to move beyond 20 per minute. No matter

80

what consequences teachers arranged for improving performance (e.g., to­kens, praise, notes home, etc.), these low-rate performances remained be­low the desired levels. After discover­ing that these students' rates of writing and reading digits were con­siderably lower than the levels exhib­ited by successful students, Haughton and his associates found that by prac­ticing the more elementary or "tool" skills (writing and reading digits) until they reached higher levels, students were able to attain higher rates of writing answers to problems.

The discovery that rate of correct responding in prerequisite skills, not merely the successful performance of prerequisites at any rate, is a limiting factor in the development of subse­quent skills, became the driving force in curriculum-based decision-making among Precision Teachers. Later, Precision Teachers began using the term fluency to refer to accuracy pl us speed of performance, a goal of Pre­cision Teaching efforts at every level in a student's progress through any curriculum sequence (Binder, 1988). Precision Teachers have developed curriculum guides, assessment in­ventories, and decision-making strategies based on objectively deter­mined aims or fluency standards es­tablished in many different curriculum areas (Starlin, 1972; White & Haring, 1976; Barrett, 1979). In discovering the importance of flu­ency, not mere accuracy, as a defini­tion of true mastery, Precision Teachers confirmed findings from a broad array of other fields about the relationship between automaticity or "second nature" responding and im­proved retention, transfer of training, and "endurance" or resistance to dis­traction (Binder, 1987, 1988; Binder,

PERFORMANCE IMPROVEMENT QUARTERLY

Haughton, & Van Eyk 199 beyond mere confirmatio research about "overlearn 100% correct, Precision been able to accuratel quired performance le e

per minute frequencie an itly plan for their differen · on key outcome variabl

Another key developme sion Teaching was the use

ing screening" proce 1

independently assessing per levels and celeration (me

learning as change in per

over repeated daily sampl cific tasks to identify tude of failure in academic devE A massive project in Was� ( Child Service Demo 1 grams, 197 4) collected app:n:

150,000 daily performance cies ofnearly 3,000 skill fro students in three school Teachers charted 7 to 10 da: per student per skill (3 tostudent) to determine me

quencies and celera tio of learning). Project problem learners as tu e

less than half the median 1

quency or weekly celera tion«

skill. This procedure iden · than 70% of the studen costly and time-consuming subsequently diagno ed a learning problems. In a Ia1 with pre-school children ' Rinaldi, Crew, & Kunzelmm single "snapshot" mea ur � mance on a set of five e E

skills enabled teachers to ide: of the students who were referred for special servi and Kunzelmann (1981) htJ celeration, a direct mea ure ing, is not racially di cm:

VOLUME 3, NUMBER 4/1990

Page 8: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

•ha consequencesteachersarrangedimproving performance (e.g., to­

praise, notes home, etc.), these -rnte performances remained be­the desired levels. After discover­

ta hat these students' rates of ·· · g and reading digits were con­erably lower than the levels exhib­

ed b successful students, Haughton o.d hi associates found that by prac­cing the more elementary or "tool"

(writing and reading digits) until e reached higher levels, students ere able to attain higher rates of riting answers to problems. The discovery that rate of correct sponding in prerequisite skills, not erely the successful performance of �requisites at any rate, is a limiting clor in the development of subse-ent skills, became the driving force

1cu1Ticulum-based decision-making ong Precision Teachers. Later,

recision Teachers began using the fluency to refer to accuracy plus

reed of perform�nce, a goal of Pre­cion Teaching efforts at every level a tudent's progress through any · · cul um sequence (Binder, 1988).

· ion Teachers have developedrrriculum guides, assessment in­m ories, and decision-making rategies based on objectively deter­ined aims or fluency standards es­.bli hed in many different mculum areas (Starlin, 1972; hite & Haring, 1976; Barrett, 1979).

· covering the importance of flu-not mere accuracy, as a defini­

m of true mastery, Precision �chers confirmed findings from a oad array of other fields about the La · onship between automaticity or �nd nature" responding and im­o ed retention, transfer of training,

d endurance" or resistance to dis­u:tion (Binder, 1987, 1988; Binder,

'ERFoRMANCE IMPROVEMENT QUARTERLY

Haughton, & Van Eyk, 1990). Going beyond mere confirmation of prior research about "overlearning" past 100% correct, Precision Teachers have been able to accurately measure re­quired performance levels as count per minute frequencies and to explic­itly plan for their differential effects on key outcome variables.

Another key development in Preci­sion Teaching was the use of "learn­ing screening" procedures for independently assessing performance levels and celerations (measures of learning as change in performance over repeated daily samples) on spe­cific tasks to identify students at risk of failure in academic development. A massive project in Washington State (Child Service Demonstration Pro­grams, 197 4) collected approximately 150,000 daily performance frequen­cies of nearly 3,000 skills from 17,996 students in three school districts. Teachers charted 7 to 10 days of data per student per skill (3 to 5 skills per student) to determine median fre­quencies and celerations (measures of learning). Project staff defined problem learners as students with less than half the median class fre­quency or weekly celeration on a given skill. This procedure identified more than 70% of the students whom more costly and time-consuming procedures subsequently diagnosed as having learning problems. In a later study with pre-school children (Magliocca, Rinaldi, Crew, & Kunzelmann, 1977), single "snapshot" measures of perfor­mance on a set of five elementary skills enabled teachers to identify 90% of the students who were subsequently referred for special services. Koenig and Kunzelmann (1981) showed that celeration, a direct measure of learn­ing, is not racially discriminatory,

VOLUME 3, NlJMBER 4/1990

while isolated performance frequency samples may correlate with racial or socio-economic factors since they rep­resent levels of current achievement . Thus celeration may be the first truly unbiased measure of aptitude in the educational literature. A combina­tion of performance frequency mea­sures and celerations (change in performance per week of daily mea­sures) may offer the most sensitive, cost-effective and culturally unbiased assessment framework for defining performance standards and monitor­ing progress in schools-a subject of considerable debate among educators and policy-makers in recent years.

Precision Teachers have conducted extensive research on the process of instructional decision-making. In early practice (e.g, Freschi, 1974), teachers and students simply in­spected charted data and made changes when frequencies of correct and/or incorrect performance were not changing in the desired direction. Liberty and her associates have con­ducted extensive research on the use of decision rules based on both levels and trends (celerations) of perfor­mance (Liberty & Haring, 1990). The use of projected trends on the stan­dard chart (called dynamic aims) as guides for decision-making substan­tially increased the frequency with which teachers made instructionally effective program changes. The use of"learningpictures," named patterns formed by data on the chart used by students to decide if and how to change procedures, has been among the most powerful and effective strategies for decision-making in Precision Teach­ing classrooms (All, 1977; McGreevy, 1983; Lindsley, 1990).

Finally, Precision Teaching re­search and practice have revealed that

81

Page 9: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

the suppression of errors can often retard learning and that encouraging students to respond at very high rates from the beginning of their work on a given skill, even when most responses are incorrect, can significantly in­crease learning rates (Bower & Orgel, 1981; Lindsley, 1990). Thus, Precision Teachers call errors "learning oppor­tunities" and often encourage students to take large "leap-ups" through curriculum sequences, making many errors and

ing to attain breakthroughs that im­prove on already impressive results. Lindsley (1990), for example, suggests that learning at the rate of doubling performance per week (a x 2.0 celeration on the daily chart) is a good benchmark for Precision Teachers. Steady progress at a x 2.0 celeration produces orders of magnitude greater net performance improvement than is typical in schools.

To confirm Precision Teaching ef­f ecti vene s s

c o r r e c t i n g the errors as an integral part of the l e a r n i n gp r o c e s s .M cG r e e v y (1978) sum­marized this

The improvements themselves are dramatic;

but when cost/benefit is considered, they are

staggering.

on measures t h a t a r ec o m m o n l y used and ac­cepted in educational evaluation studies, the

strategy with the slogan "Easy to do, hard to learn; hard to do, easy to learn." Substantial published re­search supports the conclusion that placement on more difficult tasks can result in faster learning rates

(Johnson, 1971; Neufeld & Lindsley, 1980; Scott, Wolking, Stoutimore, & Harris, 1990).

Effectiveness of Precision Teaching

Because data collection and analy­sis-the evaluation and revision cycle of systematic instruction-are inher­ent in the practice of Precision Teaching, every successful interven­tion adds to the Precision Teaching effectiveness database. Literally hundreds of thousands of charted in­structional projects have demon­strated the effectiveness of this approach. Rather than attempting to demonstrate effectiveness per se, Precision Teachers are always striv-

82

most widely cited demonstrations were conducted in Great Falls, Montana, during the early 1970s(Beck, 1979). Over a four­year period students and teachers in the Sacajawea Elementary School engaged in 20 to 30 minutes per day of Precision Teaching, with curriculum and instruction that were otherwise similar to what was practiced else­where in the school district. Students advanced an average of 19 to 40 per­centile points (depending on the sub­test) on the Iowa Test of Basic Skills higher than comparable students elsewhere in the school district. These results were confirmed by the Joint Dissemination Review Panel of the U.S. Office of Education, and led to the Precision Teaching Project, a fed­erally funded dissemination effort operated from Great Falls over a number of ensuing years. The im­provements themselves are dramatic; but when cost/benefit is considered, they are staggering, since the time

PERFORMANCE IMPROVEMENT QUARTERLY

allocated to Precision Teac relatively small and the ma used (primarily standard chart' mimeographed practice shee quite inexpensive. Impro emei

two or more grade-levels per YE instruction are common in Pref Teaching classrooms (e. Young, & Spooner, 1990).

Current Efforts and Futu.r Trends

Precision Teaching as a' mo, is still quite small in the con

mainstream education. One that may have prevented wid � adoption is that it has been de,el primarily by practitioner academics. Consequently, there been relatively few publicatio Precision Teaching becau e teac unlike academics, have neith interest nor tangible incen · .e publication. On the other ham cause it has been driven by cl � practice rather than by gran­ported or tenure-motivated r Precision Teaching ha adv� technically by leaps and ho based on daily practice and m mentation by thousands of ew and their students. The re ula quarter of a century, is a re mature and extremely poten 1

discoveries and practices tha widely acknowledged or acce the academic community.

Some states, districts and lJ.ill1 ties are Precision Teaching holds (e.g., Utah, Grea Montana, the Universitie of and Washington). A number o mercially available compu :er programs for instruction (e. Tutor marketed by Schol authoring and delivering· (Exemplar from BehaviorTec±

VOLUME 3, NUMBER 4/1990

Page 10: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

to a ain breakthroughs that im­rove on already impressive results. · dsle (1990), for example, suggests

learning at the rate of doublingerformance per week (a x 2.0 tleration on the daily chart) is a good

chmark for Precision Teachers. tead progress at a x 2.0 celeration roduce orders of magnitude greater .- performance improvement than

ical in schools. o confirm Precision Teaching ef­

fe cti vene s s

�m,ents dramatic; 'benefit is ihey are

ug.

on measures t h a t a r ec o m m o n l y used and ac­cepted in educational evaluation studies, the most widely

:ed demonstrations were conducted Great Falls, Montana, during the ly 1970s (Beck, 1979). Over a four-

ar period students and teachers in e acajawea Elementary School sci-ged in 20 to 30 minutes per day of ec· ion Teaching, with curriculum

instruction that were otherwise rrilar to what was practiced else­tere in the school district. Students anced an average of 19 to 40 per­

tile points (depending on the sub­) on the Iowa Test of Basic Skills

�er than comparable students ewhere in the school district. These ml were confirmed by the Joint "'emination Review Panel of the -._ Office of Education, and led to i Precision Teaching Project, a fed­Lil funded dissemination effort ,ra ed from Great Falls over a rn.ber of ensuing years. The im­• ements themselves are dramatic·

hen cost/benefit is considered' '

y are staggering, since the time

:RR'.)RMANCE IMPROVEMENT QUARTERLY

allocated to Precision Teaching was relatively small and the materials used (primarily standard charts and mimeographed practice sheets) were quite inexpensive. Improvements of two or more grade-levels per year of instruction are common in Precision Teaching classrooms (e.g., West, Young, & Spooner, 1990).

Current Efforts and Future

Trends

Precision Teaching as a "movement" is still quite small in the context of mainstream education. One factor that may have prevented widespread adoption is that it has been developed primarily by practitioners, not by academics. Consequently, there have been relatively few publications about Precision Teaching because teachers, unlike academics, have neither the interest nor tangible incentives for publication. On the other hand, be­cause it has been driven by classroom practice rather than by grant-sup­ported or tenure-motivated research, Precision Teaching has advanced technically by leaps and bounds­based on daily practice and experi­mentation by thousands of teachers and their students. The result, after a quarter of a century, is a relatively mature and extremely potent set of discoveries and practices that are not widely acknowledged or accepted in the academic community.

Some states, districts and universi­ties are Precision Teaching strong­holds (e.g., Utah, Great Falls, Montana, the Universities of Florida and Washington). A number of com­mercially available computer-based programs for instruction (e.g., Math Tutor marketed by Scholastic), for authoring and delivering instruction (Exemplar from BehaviorTech, Inc.

VOLUME 3, NUMBER 4/1990

in Irving, Texas), and for charting and decision-making (e.g., AC-CEL, developed at Utah State University and marketed by Precision Teaching Materials and Associates, Sarasota, FL) have been based on Precision Teaching principles and procedures. A small but active network of private schools and tutoring agencies (e.g., Morningside Academy in Seattle, Quinte Learning Centre in Ontario, Children's Workshop in San Diego, Ben Bronz Academy in West Hart­ford, Evergreen Center in Milford, Massachusetts, Haughton Learning Center in Napa, California) exists for various student populations. The National Diffusion Network contin­ues to support Precision Teaching, based on the Great Falls Precision Teaching Project. And a number of companies supply Precision Teaching materials and training (Precision Teaching Materials and Associates, Inc., in Sarasota, Florida; Behavior Research Company in Kansas City, Kansas). Precision Teachers gather annually for an international confer­ence (most recently in Boston, No­vember, 1990). And an increasing number of Precision Teachers are making an effort to communicate with a broader audience of educa­tors, policy-makers, and business leaders. However, until there is greater demand for measurably effec­tive methods in the public schools, this approach may continue to be a minority movement within the edu­cational mainstream.

From the perspective of perfor­mance technology, Precision Teach­ing offers a critical set of tools for instructional planning, implementa­tion, evaluation, and decision-mak­ing. Precision Teachers do not hesitate to experiment with a variety

83

Page 11: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

of different teaching methods and practice strategies, as long they can continue to measure and chart the

effectiveness of such new approaches. Fluency aims represent a universal,

objective standard for educational

planning and evaluation. The prac­tice of Precision Teaching is compat­ible with any other educational

approach, given measurable objec­

tives. There is reason to believe, therefore, that as educators and oth­

ers become more desperate in the

current mood of educational crisis, there may yet be an opening for greater use of this powerful, adapt­

able, and measurably effective in­

structional technology.

Direct Instruction

Direct Instruction (DI) is a research­based approach to instructional de­

sign and implementation based on over 25 years of development. In is an

educational philosophy and a set of

teaching procedures and program­ming principles derived from that

philosophy. DI is best represented by

over 50 commercially available teaching programs ( the majority pub­lished by Science Research Associ­

ates) each of which has been field tested to ensure its effectiveness. In

recent years some teachers and in­structional designers have combined

DI methods and materials with Pre­cision Teaching. Like Precision

Teaching, Direct Instruction encoun­ters resistance among mainstream

educators, often because of its de­tailed scripting of teacher's behavior.

However, Direct Instruction has been

consistently shown to support greater

academic achievement, self-esteem and problem-solving abilities in chil­

dren than any mainstream approach

to teaching (Watkins, 1988).

84

Origins

With a background in philosophy,

Siegfried Engelmann originally derived his approach to teaching basic aca­

demic skills to children from a logical

analysis of concepts and operations

followed by testing of teaching materi­

als and procedures. The forerunner of Direct Instruction was the Bereiter­

Engelmann preschool program funded

by the Carnegie Foundation during the 1960s at the University of Illinois

at Urbana (Bereiter & Engelmann,

1966). This program produced dra­matic effects with disadvantaged chil­

dren (Engelmann, 1970) and a request for Engelmann and his associates to participate in Project Follow Through.

Project Follow Through was a feder­ally funded effort to identify effective teaching programs for students who

are at high risk for failure. The ap­proach to instruction developed in the Bereiter-Engelmann preschool was

combined with the principles of be­havior analysis to form Direct In­

struction through Engelmann's collaboration with Wesley Becker at the Universityoflllinois. Engelmann

and Becker later moved to the Uni­

versity of Oregon.

Strategies for Teaching More in

Less Time

The Bereiter-Engelmann program was based on the assumption that

disadvantaged children can "catch up" with their more affluent peers if

they are provided with effective and

efficient instruction. This "more in less time" notion is critical to the mission of Direct Instruction because even if students with academic defi­cits are taught with effective pro­

grams that result in their gaining at the same rate as more affluent peers,

they will al ways remain behind. Only

PERFORMANCE IMPROVEMENT QUARTERLY

by teaching at a faster than a e1 rate can the gap be closed.

Direct Instruction realize the l

of teaching more in less time b

teaching procedures that m

the time students spend in · tion and by developing ma teri

seek (whenever possible) to tea< "general case." A general case

egy is one that uses the maJ

possible number of example t;o J duce the largest possible amo

l e a r n i n g .

For example, by teaching

40 s o u n d s

and blending skills, Direct

Instruction

gives stu­

dents a gen­e r a l i ze d

d e c o d i n g skill that is

Agenen .

is one

smallest of exam_

the la amou1

relevant to one-half of the more c

mon English words ( Gersten , 1983). Animportantpartofthe

phase of developing a Direct tion program is identification of s

general case strategies.

Direct Instruction Design

Principles According to Engelmann

Carnine(1982), designing ins e for cognitive learning requir

analyses: the analysis of beha,

the analysis of communicatio the analysis of knowledge s

The analysis of behavior ee

pirically-basedlawsorprincipl how the environment influen havior. This analysis conce1

factors as how to motivate how to present examples as part o struction, how to prompt and rei:m

responses and how to correc e

VOLUME 3, NUMBER 4/1990

Page 12: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

}rigins

· i h a background in philosophy,· egfried Engelmann originally derived· approach to teaching basic aca­lemic skills to children from a logicalnal is of concepts and operations>Ilowed by testing of teaching materi-

and procedures. The forerunner of>irect Instruction was the Bereiter­,

elmann preschool program funded the Carnegie Foundation during

ne 1960s at the University of Illinois rbana (Bereiter & Engelmann,

9 6). This program produced dra-1atic effects with disadvantaged chil­ren (Engelmann, 1970) and a request >r Engelmann and his associates toarticipate in Project Follow Through.'roject Follow Through was a feder­Oy funded effort to identify effective�ching programs for students whore a high risk for failure. The ap­roach to instruction developed in theereiter-Engelmann preschool was

bined with the principles of be-1vior analysis �o form Direct In­;ruction through Engelmann's illaboration with Wesley Becker at ie · mversity ofillinois. Engelmann 1d Becker later moved to the Uni­. · ty of Oregon.

ategies for Teaching More in

"' s Time

e Bereiter-Engelmann program based on the assumption that

:;advantaged children can "catch 1 with their more affluent peers if e are provided with effective and 1cient instruction. This "more in

time" notion is critical to the ion of Direct Instruction because

�n if students with academic defi­are taught with effective pro­

that result in their gaining at ame rate as more affluent peers, will always remain behind. Only

ERroRMANCE IMPROVEMENT QUARTERLY

by teaching at a faster than average rate can the gap be closed.

Direct Instruction realizes the goal of teaching more in less time by using teaching procedures that maximize the time students spend in instruc­tion and by developing materials that seek (whenever possible) to teach a "general case." A general case strat­egy is one that uses the smallest possible number of examples to pro­duce the largest possible amount of l e a r n i n g .

The analysis of communications seeks principles for the logical design of effective teaching sequences. These principles allow the designer to de­scribe the range of generalization ex­pected to occur when the learner receives specific sets of examples. The analysis of communications examines the samenesses and differences among sets of stimuli. It supports design of instructional sequences that prevent misrules, restricted generalization

(failure to re­

For example, by teaching 40 s o u n d s and blending skills, Direct Instruction gives stu­dents a gen­e r a l i z e dd e c o d i n gskill that is

A general case strategy

is one that uses the

spond to ap­p r o p r i a t e examples), or overgeneral­ization (re­sponding to inappropriate examples).

smallest possible number

of examples to produce

the largest possible

amount of learning. The analy­sis of knowl-

relevant to one-half of the more com­mon English words ( Gersten & Maggs, 1983). Animportantpartoftheanalysis phase of developing a Direct Instruc­tion program is identification of such general case strategies.

Direct Instruction Design

Principles

According to Engelmann and Carnine (1982), designing instruction for cognitive learning requires three analyses: the analysis of behavior, the analysis of communications, and the analysis of knowledge systems.

The analysis of behavior seeks em­pirically-based laws or principles about how the environment influences be­havior. This analysis concerns such factors as how to motivate students, how to present examples as part of in­struction, how to prompt and reinforce responses and how to correct errors.

VOLUME 3, NUMBER 4/1990

edge systems seeks to logically organize or classify know ledge. In order for a classification system to have maximum utility for the instructional designer it must pro­vide information about how to commu­nicate skills to a learner. Because concepts that are structurally similar can be taught similarly, this analysis looks for similarities across seemingly different types of learning outcomes. The logical analysis of the structure of knowledge forms underlies En­gelmann and Carnine's theory of in­struction (1982). They identify three major categories of cognitive knowl­edge which are presented in order from simple to complex: Basic Forms, Join­ing Forms, and Complex Forms.

Classifying knowledge forms pro­vides Direct Instruction programmers with a basis for designing instructional strategies that can be used repeatedly with similar forms of knowledge. In

85

Page 13: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

other words, it results in rules for teaching skills in each category. The specific program design principles are described in detail by Engelmann and Carnine (1982).

tion and sequencing of examples and nonexamples. The five juxtaposition principles for sequencing and pre­senting examples and nonexamples illustrate the precision with which Direct Instruction programming principles guide the design and implementation of instruction (En­gelmann & Carnine, 1982). Table 2 contains a script reflecting applica-

Juxtaposition Principles for

Teaching Basic Concepts

An important consideration in teaching basic concepts is the selec-

Table 1

A Logical Classification of Knowledge Forms*

Knowledge Category Type Examples

Basic Forms (sensory-feature Comparatives (one dimension) louder, darker, longer concepts)

Non-comparatives •red, dark (object properties) (one dimension) •on, between (obiect relations)

Nouns (multi-dimension) truck,shoe,boy,pony

Joining Forms (logical or Response transformations • changing any adjective to anempirical relations between adverb by adding "ly"sensory-feature concepts) •add 1 to any number to get the

next number

Correlated features relationships (facts):

• Concrete example -- give • Hot air rises. This air is hot.feature Will it rise? Why? (It's hot.)

• Label a set - give feature •Mammals are hairy, warm-blooded, etc. Are these mammals? Why? (Name identifying features.)

•Name substitution (synonym) •When it's sunny I feel lazy? Say it with another word for "lazy." (When it's sunny I feel indolent.)

• Given a class, tie to higher- • All cars are vehicles. Is thisorder class. [car] a vehicle?

Complex Forms Communications about events • Describing the workings of (fact systems) the heart

• Describing a baseball game

Cognitive problem-solving • Long division routines (behavior chains) • Applying any algorithm

* (from Engelmann & Carnine, 1982)

86 PERFORMANCE IMPROVEMENT QUARTERLY

tion of these principles. This step instructional sequence signed for initial teaching and of the concept "voiced sound. -­lar sequence can be applied : initial teaching and testin o ally any single-dimension no

parative concept or opera ·on.

We can summarize the fi e · position principles as follow

1. The wording principlethe teacher's wording shoul similar as possible aero and nonexamples. This hel

students' attention on the de the examples by reducing or confusion that may be ca " variations in the teacher' lam

Note in Table 2 the cons· what the teacher says.

2. The setup principle · bruthe logical assumption tha an. that is the same across examp nonexamples rules out a po correct interpretation. Thei examples and nonexampl ., for the initial teaching of a a should share the grea te p« number of irrelevant fea Table 2 all examples and non� are words of similar length ilia the same first two sounds. This nates the length of the ord initial sounds as possible inte

tions of "voiced sound." Engelmann and Carnine

maintain that using the e principles in the initial eqru most efficient. Later sequence duce systematic changes in and setup to promote maxim eralization.

3. The difference principle

that in order to show the limi concept, we should juxtapo amples and nonexampl similar to one another, and·

VOLUME 3, NUMBER 4/1990

Page 14: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

o and vequencing of examples andexamples. The five juxtaposition

� ciple for sequencing and pre­tin examples and nonexamples

a e the precision with which ec Instruction programming ciples guide the design and

_ lementation of instruction CEn­'1mann & Carnine, 1982). Table 2

]

· a script reflecting applica-

f Knowledge Forms*

Examples

. - n) louder, darker, longer

•red, dark (object properties)

•on, between (obiect relations)

truck, shoe, boy, pony

• changing any adjective to an

adverb by adding "ly"

•add 1 to any number to get the

next number

e • Hot air rises. This air is hot.

Will it rise? Why? (It's hot.)

e •Mammals are hairy, warm-

blooded, etc. Are these

mammals? Why? (Name

identifying features.)

oym) • When it's sunny I feel lazy?

Say it with another word for

"lazy." (When it's sunny

I feel indolent.)

er- • All cars are vehicles. Is this

[car] a vehicle?

en • Describing the workings of

the heart

• Describing a baseball game

•Long division

• Applying any algorithm

FOR.MANCE IMPROVEMENT QUARTERLY

tion of these principles. This twelve­step instructional sequence is de­signed for initial teaching and testing of the concept "voiced sound." A simi­lar sequence can be applied in the initial teaching and testing of virtu­ally any single-dimension non-com­parative concept or operation.

We can summarize the five juxta­position principles as follows.

1. The wording principle states thatthe teacher's wording should be as similar as possible across examples and nonexamples. This helps focus students' attention on the details of the examples by reducing distraction or confusion that may be caused by variations in the teacher's language. Note in Table 2 the consistency in what the teacher says.

2. The setup principle is based onthe logical assumption that anything that is the same across examples and nonexamples rules out a possible in­correct interpretation. Therefore, examples and nonexamples selected for the initial teaching of a concept should share the greatest possible number of irrelevant features. In Table 2 all examples and nonexamples are words of similar length that have the same first two sounds. This elimi­nates the length of the word or the initial sounds as possible interpreta­tions of "voiced sound."

Engelmann and Carnine (1982) maintain that using these first two principles in the initial sequence is most efficient. Later sequences intro­duce systematic changes in wording and setup to promote maximum gen­eralization.

3. The difference principle statesthat in order to show the limits of a concept, we should juxtapose ex­amples and nonexamples that are similar to one another, and indicate

VOLUME 3, NUMBER 4/1990

that they are different. This sequence facilitates discrimination of concept examples and nonexamples. Steps 5 and 6 in Table 2 illustrate the differ­ence principle.

4. The sameness principle statesthat to show the range of the concept, we should juxtapose examples of the concept that differ from one another as much as possible and indicate that they are the same. This sequence is intended to foster generalization to unfamiliar concept examples. Steps 3, 4, and 5 illustrate the sameness principle.

5. The testing principle calls forrandom presentation of new examples and nonexamples to see if the concept has been learned. Steps 6 through 12 illustrate this principle and would in practice be followed by appropriate re­inforcement or correction procedures, depending on students' responses.

Direct Instruction principles include similar principles for programming sequences to teach other types of knowledge and for teaching sets of related concepts (e.g., geometric shapes).

Direct Instruction Teaching

Procedures

Certain features of the practice of Direct Instruction distinguish it from more traditional approaches. Some of the more salient features are de­scribed next.

1. Scripted presentations. Lessonscripts specify what the teacher says and does for each task. Scripted pre­sentations support quality control of instruction. The particular examples and sequences in Direct Instruction programs have been pre-tested and empirically established as effective, ensuring the success of students who have mastered essential prerequisite

87

Page 15: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

skills. Most teachers lack training in instructional design and therefore are not likely to select and sequence teaching examples effectively with­out explicit directions. Without guid­ance, teachers may use language that students do not understand or that

distracts students' attention from ex­amples. Like Precision Teaching, Di­

rect Instruction assumes that students learn or fail to learn because of effec­tive or ineffective instruction. Direct Instruction places responsibility for learning in the hands of teachers and instructional developers, and does not

"blame" students for failure-as is so

common in mainstream psycho-edu-

cational practice. Teachers are more likely to use effective instructional sequences when given explicit scripts for using field-tested procedures.

An additional advantage of scripted presentations is that they make it possible for supervisors to readily

evaluate instruction and to provide immediate assistance to teachers, when needed. Scripts allow aides, parents, and other para-profession­als to assume teaching responsibili­

ties, resulting in increased quality instructional time.

2. Small groups. Direct Instruc­tion lessons are typically taught with

groups of 5 to 10 students. Small

88

Table 2

A Script for Teaching the Concept ''Voiced Sound"

Step Word Type What the Teacher Says

1 Mack Non-example "I'll say some words. Then I'll tell you if each word

ends in a voiced sound. Mack. It doesn't end in a

voiced sound."

2 Mass Non-example "Mass. It doesn't end in a voiced sound."

3 Maz Example "Maz. It ends in a voiced sound."

4 Mag Example "Mag. It ends in a voiced sound."

5 Mad Example "Mad. It ends in a voiced sound."

6 Mat Non-example "Mat. Does it end in a voiced sound?"

(student responds)

7 Mass Non-example "Mass. Does it end in a voiced sound?"

(student responds)

8 Mab Example "Mab. Does it end in a voiced sound?"

(student responds)

9 Maff Non-example "Maff. Does it end in a voiced sound?"

(student responds)

10 Mal Example "Mal. Does it end in a voiced sound?

(student responds)

11 Mat Non-example "Mat. Does it end in a voiced sound?"

(student responds)

12 Mav Example "Mav. Does it end in a voiced sound?"

(student responds)

Note: This table does not include procedures for reinforcing or correcting

student responses.

PERFORMANCE IMPROVEMENT QUARTERLY

group instruction is more effici than one-to-one instruction and vides the opportunity for more ai direction, attention, feedback aml dividualization than large gro struction.

3. Unison responding. One or

goals of Direct Instruction i t.o

erate high rates of responding bJ students. If individual studen asked to respond to the each

questions, problems can ari�e. Fi while the

teacher is in-t e r a c t i n g

with one stu­dent, other s t u d e n t s

may not be paying at­

t e n t i o n . Thus, stu­dents might o n l y b el e a r n i n g

Scripte,

make

supe1

evaluate to pron

assista

h

some fraction of the time tha 1 are actually in the learnin tion. This is a waste of time could be spent acquiring aca e skills. A second problem is ha" students respond in sequence raJ than in unison, one student m.a c

the response of the precedi.ru! dent. The teacher has no

knowing whether the second has actually learned the an wer

merely imitating another cl These problems disappear hei

students respond at the same ·.,,.

each question posed by the Unison responding penni'"

greatest amount of practice for•

student and provides the teacher the maximum amount of info:nru;

about each student's perfor

4. Signals. Teachers ensuretaneous responding from all

VOLUME 3, NUMBER 4/1990

Page 16: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

·onal practice. Teachers are morecely to use effective instructional(!llences when given explicit scripts

· g field-tested procedures.additional advantage of scripted

esentations is that they make it · le for supervisors to readily

alnate instruction and to provide edia te assistance to teachers

te needed. Scripts allow aides: ren , and other para-profession­: ro a sume teaching responsibili­

re ulting in increased quality ctional time. mall groups. Direct Instruc­

ons are typically taught with 111p of 5 to 10 students. Small

ra., ept ''Voiced Sound"

at the Teacher Says

re words. Then I'll tell you if each word

lired ound. Mack. It doesn't end in a

d."

leS!l't end in a voiced sound."

- in a voiced sound."

- in a voiced sound."

fs in a voiced sound."

end in a voiced sound?"

ponds)

, it end in a voiced sound?"

ponds)

it end in a voiced sound?"

ponds)

end in a voiced sound?"

!)Onds)

end in a voiced sound?

,ionds)

• end in a voiced sound?"

!)Onds)

end in a voiced sound?"

JOnds)

forcing or correcting

troRMANCE IMPROVEMENT QUARTERLY

group instruction is more efficient than one-to-one instruction and pro­vides the opportunity for more adult direction, attention, feedback, and in­dividualization than large group in­struction.

3. Unison responding. One of thegoals of Direct Instruction is to gen­erate high rates of responding by all

students. If individual students are asked to respond to the teacher's questions, problems can arise. First, while the teacher is in-

by pre-teaching the entire group to answer on a particular cue or signal and then managing signalled unison responding throughout lessons. Some signals are visual (hand movements) while others are auditory (e.g., hand claps). The teacher's manual specifies how and when to signal for a given task. The signal is an evaluation tool: By having students respond in unison while listening to the responses of all students, the teacher can determine

whether or not each stu­

t e r a c t i n gwith one stu­dent, other s t u d e n t smay not be paying at­t e n t i o n .Thus, stu­dents might o n l y b el e a r n i n g

Scripted presentations make it possible for

supervisors to readily

evaluate instruction and

dent in the small group h a s t r u l y mastered a part icular skill. Sig­nals make it possible to combine the benefits of

to provide immediate assistance to teachers

when needed.

some fraction of the time that they are actually in the learning situa­tion. This is a waste of time that could be spent acquiring academic skills. A second problem is that when students respond in sequence rather than in unison, one student may copy the response of the preceding stu­dent. The teacher has no way of knowing whether the second student has actually learned the answer or is merely imitating another student. These problems disappear when all students respond at the same time to each question posed by the teacher. Unison responding permits the greatest amount of practice for each student and provides the teacher with the maximum amount of information about each student's performance.

4. Signals. Teachers ensure simul­taneous responding from all students

VOLUME 3, NUMBER 4/1990

one-to-one teaching with the efficiency of group instruction.

5. Pacing. Rapid pacing of instruc­tion is important because it allows the teacher to present more material during each instructional period. This results in increased opportunity to learn, a variable that is clearly re­lated to student achievement (Brophy & Good, 1986). In addition, brisk pacing helps to maintain students' attention to the task which may re­sult in increased learning and fewer behavior management problems. In the process, it is also a way of encour­aging fluent performance.

6. Correction procedures. WhileDirect Instruction materials are pro­grammed to minimize student errors, some errors are inevitable. Errors provide the teacher with valuable in­formation about the difficulties stu-

89

Page 17: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

dents are having. Errors tell the teacher that students need more practice applying certain skills, and corrections provide those additional teaching trials. Effective instruction includes effective correction proce­dures. Different types of errors call for different types of corrections. The procedures specified in the Direct In­struction teacher's script provide ef­fective correction for each type of mistake. An important part of the analysis, design, field-testing, and revision of Direct Instruction is the identification of error types and of appropriate correction procedures.

Shifting Aspects of Task Design

Because of its specificity and teacher

scripting, some critics fault Direct Instruction as too rote, too artificial, or too teacher-directed, and, there­fore, unlikely to produce generalized conceptual and problem-solving skills able to be applied by students without teacher prompting in novel situations. In fact, students taught with Direct

Instruction exhibit superior problem­

solving abilities (Watkins, 1988). De­sign principles used by Direct Instruction developers for systemati­cally shifting the characteristics of instructional tasks in the course of complete teaching programs prevent the problems anticipated by critics. Becker and Carnine (1981) describe six "shifts" that should occur in any well-designed teaching program.

The first shift is from ouertized to

covertized problem-solving strategies.

Initially, teachers require overt re­sponding at each step in the instruc­tional sequence so that they can identify particular skills with which students have difficulty and apply appropriate reinforcement and cor­rection procedures. Later, teachers

90

may only require overt responding in some of the steps in a problem-solving sequence, perhaps only the last step. This shift facilitates transition from teacher-directed to independent problem-solving.

The second shift is from simplified

contexts to complex contexts. In sim­plified contexts the teacher empha­

sizes the relevant features of a task, while in complex contexts students must apply knowledge under condi­tions that vary in irrelevant detail, thereby mimicking everyday problem­solving situations.

The third shift is from providing

prompts to removing prompts. Early in instruction supplemental stimuli,

which are later removed, may be added to focus the learner's attention to rel­evant details of the presentation.

The fourth shift is from massed

practice (to encourage acquisition) to distributed practice (to facilitate re­

tention).

The fifth shift is from immediate

feedback to delayed feedback, an­other condition that mimics every­day situations.

The sixth shift is from an emphasis

on the teacher's role as a source of

information to an emphasis on the

learner's role as a source of informa­

tion. Like the other shifts, this one enhances independent performance.

Taken together, these instructional strategies help move students from fixed lessons to more generalized, in­dependent, and real-world applica­tion of strategies and skills.

Direct Instruction Research

Background

Direct Instruction principles and procedures are supported by general principles derived from basic behav­ioral research as well as by the li tera -

PERFORMANCE IMPROVEMENT QUARTERLY

ture of effective teaching pracri1 In addition, a multitude of controi research studies provide empir support for the specific desiQ"Il p1 ciples and teaching practice Direct Instruction. These tudies summarized by Engelmann 1 Carnine (1982), and are also reviei

by Becker ( 1984), Becker and an

(1980) and Weisberg, Packer Weisberg (1981).

However, the most impo search basis for Direct Instru o field testing of programs and an sis of errors. Logical anal what is to be taught and ho to it guide the developmen of le,; scripts, which are then tested on' dents to see if they are effec · e. fectiveness is measured in tewhether the procedures produce intended learning. Progr systematically revised ba ed on c from field tests. Most of the co

cially available programs ha e g through three revision cycle Direct Instruction teacher manuals have been revamped : times (Becker & Carnine 19 n.

Effectiveness of Direct

Instruction

Perhaps the most compe dence for the effectivenes of Di Instruction is the evaluation ofPI, Follow Through (Watkins 19

national evaluation compared performance of children in o different instructional mode represented the broad range o rent educational practice. the evaluation has been con

sial (see for example, Ho e G McLean, & Walker's (197 ) of the method of data anal

generally acknowledged tha rect Instruction model w

VOLUME 3, NUMBER 4/1990

Page 18: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

o.a only require overt responding in = me of the steps in a problem-solving requence, perhaps only the last step.

· hift facilitates transition from

eacher-directed to independent 11:roblem-solving.

The second shift is from simplified ':Clntexts to complex contexts. In sim­' · ed contexts the teacher empha­rize he relevant features of a task, drile in complex contexts students

apply knowledge under condi­;io that vary in irrelevant detail,

ereby mimicking everyday problem­;olving situations.

The third shift is from providing Jrompts to removing prompts. Early in

·uction supplemental stimuli,drich are later removed, may be added o focus the learner's attention to rel­. an details of the presentation.The fourth shift is from massed

,roctice (to encourage acquisition) to fistributed practice (to facilitate re­mtion).

e fifth shift is from immediate �dback to delayed feedback, an­dier condition that mimics every­a ituations.

e sixth shift is from an emphasis n. the teacher's role as a source ofiformation to an emphasis on the>arner's role as a source of informa­on. Like the other shifts, this onenhances independent performance.

aken together, these instructional trategies help move students from xed lessons to more generalized, in -ependent, and real-world applica­on of strategies and skills.

ii.rect Instruction Research

ackground

Direct Instruction principles and rocedures are supported by general wciples derived from basic behav­ral research as well as by the li tera-

f'ERFOR1v1ANCE IMPROVEMENT QUARTERLY

ture of effective teaching practices. In addition, a multitude of controlled research studies provide empirical support for the specific design prin­ciples and teaching practices used in Direct Instruction. These studies are summarized by Engelmann and Carnine ( 1982), and are also reviewed by Becker ( 1984), Becker and Carnine (1980) and Weisberg, Packer, and Weisberg (1981).

However, the most important re­search basis for Direct Instruction is field testing of programs and analy­sis of errors. Logical analyses of what is to be taught and how to teach it guide the development of lesson scripts, which are then tested on stu­dents to see if they are effective. Ef­fectiveness is measured in terms of whether the procedures produce the intended learning. Programs are systematically revised based on data from field tests. Most of the commer­cially available programs have gone through three revision cycles. Most Direct Instruction teacher training manuals have been revamped four times (Becker & Carnine, 1981).

Effectivenes s of Direct

Instruction

Perhaps the most compelling evi­dence for the effectiveness of Direct Instruction is the evaluation of Project Follow Through (Watkins, 1988). A national evaluation compared the performance of children in over 20 different instructional models which represented the broad range of cur­rent educational practice. Although the evaluation has been controver­sial (see for example, House, Glass, McLean, & Walker's (1978) critique of the method of data analysis), it is generally acknowledged that the Di­rect Instruction model was clearly

VOLUME 3, NUMBER 4/1990

the most effective of all programs on measures ofbasic skills achievement, cognitive skills, and self-concept. (Many of the non-DI programs tested were actually less effective than typical public school programs used with control groups, yet some of these ineffective programs continue to receive funding at higher levels than Direct Instruction.) Other publications provide detailed de­scriptions of the findings for all of the Follow Through models (e.g., Stebbins, St. Pierre, Proper, Ander­son, & Cerva, 1977), as well as for the Direct Instruction model in particu­lar (e.g., Becker, 1977; Becker & Carnine, 1980).

Some researchers have tried to as­sess the stability of the effects of the Follow Through Direct Instruction model. For example, Becker and Gersten (1982) compared the scores of fifth and sixth grade students who had participated in Direct Instruc­tion programs during earlier grades with the performance of similar non­Follow Through children. Direct In­struction students scored significantly higher on measures of reading and math in 50% of the comparisons made. In other studies, students who had participated in Direct Instruction programs during their first three grades were compared with similar students who did not participate. Results indicate that Direct Instruc­tion students are more likely to re­ceive high school diplomas, less likely to be retained in any grade, and less likely to drop out (Gersten, 1982; Gersten & Carnine, 1983; Gersten & Keating, 1983).

More than any other commercially available instructional programs, Direct Instruction is supported by controlled research studies. While it

91

Page 19: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

is not possible to summarize all of the research demonstrating the effec­tiveness of Direct Instruction, inter­ested readers are ref erred to Becker's ( 1984) review ofresearch with broadly divergent populations, in a variety of settings, in numerous content areas. The approach is also supported by studies conducted in Australia. Lockery and Maggs (1982) reviewed more than 30 studies conducted in Australia over a ten year period. The impressive r e s u l t s

learning with Direct Instruction pro­grams. In addition, Direct Instruc­tion has been introduced in seven African countries and there are ad­aptations of the programs operating in other non-English speaking coun­tries. The Association for Direct In­struction (P.O. Box 10252, Eugene, OR 97440) publishes a newsletter, offers training on DI programs, and operates a state-funded pre-school. Engelmann-Becker Corporation

c o n t i n u e s t o develop

o f t h e s estudies pro­vided theb a s i s fo rchanges inthe way bothnormal andr e t a r d e dchildren aret a u g h t i nAustralia.

Students routinely

improve by two full

grade levels on two

commercial Direct In­s t r u c t i o np r o g r a m s and publish books, and r e s e a r c h continues at the Univer­sity of Or­egon and

skills per month using

a combination of

Precision Teaching

and Direct Instruction.

Current

Status and Future Directions

Advances in Direct Instruction program development continue to occur. Englemann-Becker Corpora­tion (Eugene, OR) has developed DIAL (Direct Instruction Authoring Language), a computer-based train­ing authoring system that incorpo­rates DI design principles. Vachon and Carnine (1984) published crite­ria based on Direct Instruction for evaluating computer-based training programs. Programs are being de­signed that will apply Direct Instruc­tion to math and science for high school and college students using videodisc technology.

Becker (1984) estimated that at least 5 million children in the En­glish speaking world are currently

92

elsewhere. In spite of

these advances and evidence sug­gesting the superior effectiveness of DI, educators continue to resist adopting Direct Instruction programs. Recently, Engelmann won a suit in the state of California directing the state curriculum board to base text­book adoptions on "learner valida­tion"-a policy that had been legally mandated but not enforced (Binder & Watkins, 1989). Engelmann filed the suit when Direct Instruction pro­grams, perhaps the most thoroughly tested of any commercially published teaching materials, were rejected for inclusion on the state approved text­book list. Engelmann plans further efforts in the courts while continuing to develop and refine Direct Instruc­tion programs.

PERFORMANCE IMPROVEMENT QUARTERLY

Combining Precisio,1

Teaching with Direc

Instruction More and more practitione

combining the two technologi �. Direct Instruction is a power and knowledge acquisition :eel ogy, Precision Tea�hing offerior tools for practice to the po fluency, criterion-referenced "' ment, and decision-makin . strengths of these methods COD

ment one another. Teacher­rect Instruction for initial teachl skills and concepts, then u e Pree Teaching materials and prooeo to help students achieve high lefluency, beyond the acqui i ·on« ria specified in Direct I programs. Educators in publir private settings in Florida ' a nia, Ontario, Seattle, and n E

other locations have used he

ciples and procedures of technologies to produce un.J edented academic achie, e ru their students. The or · Academy in Seattle, for exam 1 ports that students who had ously progressed by only t o 001 months of academic achie em year of public school instTu · o measured on standard tests ro " improve by two full grade le E

two skills per month using a co tion of Precision Teaching and I Instruction methods and ma:­(Johnson, 1989).

Conclusion Precision Teaching and Dire

struction are mature and powerful instructional techno that are fully capable of e:r America's "basic skills cri i if1 adopted. Based on systema · c ·

VOLUME 3, NUMBER 4/1990

Page 20: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

learning with Direct Instruction pro­ams. In addition, Direct Instruc­

·on has been introduced in seven· can countries and there are ad­

aptations of the programs operating in other non-English speaking coun­. e . The Association for Direct In-truction (P.O. Box 10252, Eugene,

OR 97440) publishes a newsletter offers training on DI programs, and operates a state-funded pre-school.

ngelmann-Becker Corporation c o n t i n u e s t o develop

·outinely

two full

�son two

"Jtnth using

ri-tion of

reaching

istruction.

commercial Direct In­s tr u c t i o n p r o g r a m s and publish books, and r e s e a r c h continues at the Univer­sity of Or­egon and elsewhere.· In spite of

hese advances and evidence sug-ting the superior effectiveness of

)I educators continue to resist tdopting Direct Instruction programs. teGently, Engelmann won a suit in he tate of California directing the -ate curriculum board to base text­ook adoptions on "learner valida­ion -a policy that had been legallyl.a.Ildated but not enforced (Binder &a kins, 1989). Engelmann filed the· when Direct Instruction pro­

rams, perhaps the most thoroughly d of any commercially published

iaching materials, were rejected for tdusion on the state approved text­>0k list. Engelmann plans further forts in the courts while continuing , develop and refine Direct Instruc->n programs.

�ORMANCE IMPROVEMENT QUARTERLY

Combining Precision Teaching with Direct

Instruction More and more practitioners are

combining the two technologies. While Direct Instruction is a powerful skill and knowledge acquisition technol­ogy, Precision Teaching offers supe­rior tools for practice to the point of fluency, criterion-referenced assess­ment, and decision-making. The strengths of these methods comple­ment one another. Teachers use Di­rect Instruction for initial teaching of skills and concepts, then use Precision Teaching materials and procedures to help students achieve high levels of fluency, beyond the acquisition crite­ria specified in Direct Instruction programs. Educators in public and private settings in Florida, Califor­nia, Ontario, Seattle, and numerous other locations have used the prin­ciples and procedures of these two technologies to produce unprec­edented academic achievement in their students. The Morningside Academy in Seattle, for example, re­ports that students who had previ­ously progressed by only two to three months of academic achievement per year of public school instruction, as measured on standard tests, routinely improve by two full grade levels on two skills per month using a combina­tion of Precision Teaching and Direct Instruction methods and materials (Johnson, 1989).

Conclusion Precision Teaching and Direct In­

struction are mature and extremely powerful instructional technologies that are fully capable of erasing America's "basic skills crisis" if widely adopted. Based on systematic meth-

VOLUME 3, NUMBER 4/1990

ods and extensive research, these tech­nologies are perhaps the most fully validated teaching tools ever imple­mented in American schools. At this time, very few educators or policy­makers are aware of these methods, or of their measured effectiveness. Those who know about them often resist adoption for philosophical or political reasons. We believe that policy-makers, corporate and cultural leaders, and the general public will opt for measurably effective instructional methods, if they know of their existence. Hopefully, this article will help to make a wider audience aware of these cost-effective educational solutions.

References All, P. (1977). From get truckin' to Jaws,

students improve their learning pic­tures. Unpublished master's thesis, University of Kansas, Lawrence.

Barrett, B. H. (1979). Communitization and the measured message of normal behavior. In R. York & E. Edgar (Eds.), Teaching the severely handicapped (Vol. 4). Columbus, OH: Special Press.

Beck, R. (1979). Report for the Office of Education Joint Dissemination Review

Panel. Great Falls Montana: Preci­sion Teaching Project.

Becker, W. C. (1977). Teaching reading and language to the disadvantaged what we have learned from field re­search. Harvard Educational Review,

47, 518-543. Becker, W. C. (1984, March). Direct In­

struction: A twenty year review. Paper presented at the XVI annual Banff International Conference on Behav­ioral Science.

Becker, W. C., & Carnine, D. W. (1980). Direct Instruction: An effective ap­proach to educational intervention with the disadvantaged and low per­formers. In B. B. Lahey & A K. Kazdin (Eds.), Advances in clinical and child psychology. New York: Plenum.

93

Page 21: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

�======-====----�-----=====�-------------------

Becker, W. C., & Carnine, D. W. (1981). Direct Instruction: A behavior theory model for comprehensive educational intervention with the disadvantaged. In S. W. Bijou & R. Ruiz (Eds.),Behavior modification: Contributions to educa­tion. Hillsdale,NJ: LawrenceErlbaum Associates.

Becker, W. C., & Gersten, R. (1982) A follow-up of follow through: Meta­analysis of the later effects of the Direct Instruction Model. American Educational Research Journal, 19,

75-93.Bereiter, C., & Engelmann, S. (1966).

Teaching disadvantaged children in the preschool. Englewood Cliffs, NJ: Prentice-Hall.

Binder, C. (1987). Fluency-building™

research background. N onantum, MA: Precision Teaching and Man­agement Systems, Inc. (P.O. Box 169, Nonantum, MA 02195).

Binder, C. (1988). Precision Teaching: Measuring and attaining exemplary academic achievement. Youth Policy, 10(7), 12-15.

Binder, C., Haughton, E. & Van Eyk, D. (1990). Increasing endurance by building fluency: Precision Teaching attention span. Teaching Exceptional Children, 22(3), 24-27.

Binder, C., & Watkins, C. L. (1989). Promoting effective instructional methods: Solutions to America's edu­cational crisis. Future Choices, 1(3),

33-39.Bower, B. & Orgel, R. (1981). To err is

divine. Journal of Precision Teaching, 2(1), 3-12.

Brophy, J., & Good, T. (1986). Teacher behavior and student achievement. In M. Wittrock (Ed.), Third handbook of research on teaching (pp. 328-375). New York: MacMillan.

Child Service Demonstration Programs Progress Report N. (1974). Tacoma, WA: Intermediate School District N. 111.

Engelmann, S. (1970). The effective­ness of Direct Instruction on IQ performance and achievement in

94

reading and arithmetic. In J. Hellmuth (Ed.), Disadvantaged child. Vol. 3, Compensatory edu­cation: A national debate. New York: Brunner/Mazel.

Engelmann, S., & Carnine, D. W. (1982). Theory of instruction: Principles and applications. New York: Irvington.

Freschi, D. F. (1974). Where we are. Where we are going. How we're getting there. Teaching Exceptional Children, 6, 89-97.

Gersten, R. M. (1982). High school follow­up of DI Follow Through. Direct In­struction News, 2, 3.

Gersten, R. M., & Carnine, D. W. (1983). The later effects of Direct Instruction Follow Through. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Canada.

Gersten, R. M., & Keating, T. (1983). DI Follow Through students show fewer dropouts, fewer retentions, and more high school graduates. Direct In­struction News, 2, 14-15.

Gersten, R. M., & Maggs, A (1982). Five year longitudinal study of cognitive development of moderately retarded children in a Direct Instruction pro­gram. Analysis and Intervention in Developmental Disabilities, 2, 329-343.

Gilbert, T. F. (1978). Human Compe­tence: Engineering worthy perfor­mance. New York: McGraw Hill.

Haughton, E. (1972). Aims: Growing and sharing. In J.B. Jordan & L. S. Robbins (Eds.), Let's try doing some­thing else kind of thing. Arlington, VA: Council on Exceptional Children, 20-39.

House, E. R., Glass, G. V., McLean, L. D., & Walker, D. F. (1978). No simple answer: Critique of the Follow Through evaluation. Harvard Edu­cational Review, 48(2), 128-159.

Johnson, K. (1989). Executive summary. Seattle, WA: Morningside Corpora­tion. (810 18th Ave., Seattle, WA 98122).

Johnson, N. J. (1971). Acceleration of

PERFORMANCE IMPROVEMENT QUARTERLY

inner-city elementary school preading performance. npubru doctoral dissertation, Uni e -­Kansas, Lawrence.

Kazdin, A E. (1976). Statistical a:c ses for single-case experimenra:i signs. In M. Hersen & D. H. Ba: (Eds.), Single-case experimental signs: Strategies for studying oo ior change. New York: Pe Press, 265-316.

Koenig, C.H., & Kunzelma (1981). Classroom learning scr ing. Columbus: Charles E. er

Koorland, M. A., Keel, f. C Ueberhorst, P. (1990). Setting f

for precision learning. Teach -ceptional Children, 22(3), 64-66_

Kunzelmann, H. P., Cohen, ' L H W., Martin, G. & Mingo, A. (l!l Precision Teaching: An initialing sequence. Seattle: Special C Publications.

Liberty, K. A & Haring, r. G. (Ul

Introduction to decision rule u Remedial and ·special Educai 11(1), 32-41.

Lindsley, 0. R. (1957). Operan ior during sleep: A measw-e oof sleep. Science, 126, 1290-

Lindsley, 0. R. (1962). Operan· oo tioning techniques in the mea.5: ment of psychopharmacolc response. First Hahnemann sium on Psychosomatic Medicine : 383.

Lindsley, 0. R. (1964a). Direct meas ment and prosthesis of retard havior. Journal of Education, . 62-81.

Lindsley, O.R. (1964b). Geriatric be] ior prosthesis. In R. Ka tenhl (Ed.), New thoughts on old age __ York: Springer.

Lindsley, O.R. (1972). From Precision Teaching. In J. B. J and L. S. Robbins (Eds.), Let ing something else kind of thing 1-12). Arlington, VA: Councilceptional Children.

Lindsley, O.R. (1990). Precision ing: By children for teachers. Te

VOLUME 3, NUMBER 4/1990

Page 22: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

o and arithmetic. In J.m h (Ed.), Disadvantaged

ol. 3, Compensatory edu-1: A national debate. New Br nner/Mazel.

� ., & Carnine, D. W. (1982). , of instruction: Principles and otions. New York: Irvington. D. F. (1974). Where we are.: e are going. How we're gettingTooching Exceptional Children,

lL :'.\iI. (1982). High school follow-I Follow Through. Direct In­

on ews, 2, 3. R. .1I., & Carnine, D. W. (1983).rter effects of Direct Instruction, Through. Paper presented atmual meeting of the American·ona1 Research Association,

eal, Canada.. 1., & Keating, T. (1983). DI

,Thrnugh students show fewer fewer retentions, and more

- ool graduates. Direct In­ion ews, 2, 14-15.R. M. & Maggs, A. (1982). Fiveo ·tudinal study of cognitive1pment of moderately retardeden in a Direct Instruction pro-

Analysis and Intervention in 1pmental Disabilities, 2, 329-

�- F. (1978). Human Compe­Engineering worthy perfor­

!'.. ew York: McGraw Hill. E. (1972). Aims: Growing

oaring. In J. B. Jordan & L. S. (Eds.), Let's try doing some­

� kind of thing. Arlington, VA::il on Exceptional Children, 20-

. R. Glass, G. V., McLean, L. D., er, D. F. (1978). No simple

er: Critique of the Follow evaluation. Harvard Edu­

ial Review, 48(2), 128-159. (1989). Executive summary.

!e WA: Morningside Corpora­( 10 18th Ave., Seattle, WA

n.

N. J. ( 1971). Acceleration of

IJA'\lCE IMPROVEMENT QUARTERLY

inner-city elementary school pupils' reading performance. Unpublished doctoral dissertation, University of Kansas, Lawrence.

Kazdin, A. E. (1976). Statistical analy­ses for single-case experimental de­signs. In M. Hersen & D. H. Barlow (Eds.), Single-case experimental de­signs: Strategies for studying behav­ior change. New York: Pergamon Press, 265-316.

Koenig, C.H., & Kunzelmann, H.P. (1981). Classroom learning screen­ing. Columbus: Charles E. Merrill.

Koorland, M. A., Keel, M. C. & Ueberhorst, P. (1990). Setting aims for precision learning. Teaching Ex­ceptional Children, 22(3), 64-66.

Kunzelmann, H. P., Cohen, M., Hulten, W., Martin, G. & Mingo, A. (1970). Precision Teaching: An initial train­ing sequence. Seattle: Special Child Publications.

Liberty, K. A. & Haring, N. G. (1990). Introduction to decision rule systems. Remedial and Special Education, 11(1), 32-41.

Lindsley, 0. R. (1957). Operant behav­ior during sleep: A measure of depth of sleep. Science, 126, 1290-1291.

Lindsley, 0. R. (1962). Operant condi­tioning techniques in the measure­ment of psychopharmacologic response. First Hahnemann Sympo­sium on Psychosomatic Medicine, 373-383.

Lindsley, 0. R. (1964a). Direct measure­ment and prosthesis of retarded be­havior. Journal of Education, 147, 62-81.

Lindsley, O.R. (1964b). Geriatric behav­ior prosthesis. In R. Kastenbaum (Ed.), New thoughts on old age. New York: Springer.

Lindsley, O.R. (1972). From Skinner to Precision Teaching. In J. B. Jordan and L. S. Robbins (Eds.), Let's try do­ing something else kind of thing (pp. 1-12). Arlington, VA: Council on Ex­ceptional Children.

Lindsley, O.R. (1990). Precision Teach­ing: By children for teachers. Teach-

VOLUME 3, NUMBER 4/1990

ing Exceptional Children, 22(3), 10-15. Lindsley, O.R. & Skinner, B.F. (1954). A

method for the experimental analysis of the behavior of psychotic patients. American Psychologist, 9, 419-420.

Lockery, M., & Maggs, A. (1982). Direct Instruction research in Australia: A ten-year analysis. Educational Psy­chology, 2, 263-288.

Magliocca, L. A., Rinaldi, R. T., Crew, J. L. & Kunzelmann, H.P. (1977, May).Early identification of handicappedchildren through a frequency sam­pling technique. Exceptional Chil­dren.

McGreevy, P. (1978). Hard to do be­comes easy to learn. Journal of Pre­cision Teaching, 1(2), 27-29.

McGreevy, P. (1983). Teaching and learning in plain English (2nd Ed.). Kansas City, MO: Plain English Pub­lications .

Neufeld, K. A. & Lindsley, 0. R. (1980). Charting to compare children's learn­ing at four different reading perfor­mance levels. Journal of Precision Teaching, 1 (1), 9-17.

Pennypacker, H. S., Koenig, C. H. & Lindsley, 0. R. (1972). Handbook of the Standard Behavior Chart. Kan­sas City, KS: Precision Media.

Scott, J., Wolking, B., Stoutimore, J. & Harris, C. (1990). Challenging read­ing for students with mild handicaps. Teaching Exceptional Children, 22(3), 32-35.

Sherman, J. G., Ruskin, G., & Semb, G. B. (Eds.) (1982). The Personalized Sys­tem of Instruction: 48 Seminal Papers. Lawrence,KS: TRIPublications. (P.O. Box 844, Lawrence, KS 66044).

Skinner, B. F. (1950). Are theories of learning necessary? Psychological Re­view, 57, 193-216.

Starlin, A. (1972). Sharing a message about curriculum with my teacher friends. JnJ. B. Jordan & L. S. Robbins (Eds.), Let's try doing something else kind of thing (pp.13-18). Arlington, VA: Council on Exceptional Children.

Stebbins, L.B., St. Pierre, R. G., Proper, E. C., Anderson, R. B., & Cerva, T. R.

95

Page 23: Precision Teaching and Direct Instruction: Measurably Superior ...binde1.verio.com/wb_fluency.org/Publications/BinderWatkins1990a.pdf · Precision Teaching and Direct Instruction:

(1977). Education as experimenta­tion: A planned variation model (Volume IV-A: An evaluation of Fol­low Through). Cambridge, MA: Abt Associates.

Vachon, V. & Carnine, D. W. (1984). Evaluation of computer software. As­

sociation for Direct Instruction News, 3(2), 11-15.

Watkins, C. L. (1988). Project Follow Through: A story of the identification and neglect of effective instruction. Youth Policy, 10(7), 7-11.

Weisberg, P., Packer, R. A., & Weisberg, R. S. (1981). Academic training. In J. L. Matson &J. R. McCartney(Eds.),Handbook of behavior modificationwith the mentally retarded. New York:Plenum.

West, R. P., Young, R. & Spooner, F. (1990). Precision Teaching: An intro­duction. Teaching Exceptional Chil­

dren, 22(3), 4-9. White, 0. R. & Haring, N. G. (1976).

Exceptional teaching. Columbus, Ohio: Charles E. Merrill.

Wood, S., Burke, L., Kunzelmann, H. & Koenig, C. (1978). Functional criteria in basic math skill proficiency. Jour­nal of Special Education Technology,

2, 29-36.

96

CARL BINDER is Chair of the NSPI

Emerging Technology Committee, Chair of the 9th International Preci­

sion Teaching Conference, and

President of Precision Teaching and Management Systems, Inc., a Bos­

ton area performance technology

consulting firm. Mailing Address: PT/M S, Inc., P .O. Box 169 ,

Nonantum, MA 02195, (617) 332-2656, or Compuserve electronic mail 73240,1134.

CATHYL. WATKINS is a psycholo­

gist who trains teachers, conducts

research, and advocates measur­

ably effective instruction. She is

Assistant Professor in the Depart­

ment of Advanced Studies. Mailing

Address: Department of Advanced

Studies, California State Univer­

sity, Stanislaus, Turlock, CA 95380.

Authors' Note: Copies of the Stan-

dard Behavior Chart can be obtained

from: Precision Teaching Materials and Associates (PTMA), 15 Cross­

roads, Suite 230, Sarasota, FL 34239

PERFORMANCE IMPROVEMENT QUARTERLY

ERIC Research Abstra

Nancy R. Preston

Syracuse University

A Nation At Risk: The Irr

tive For Educational Refor

Open Letter to the Ame

People. A Report to the

and the Secretary of Edu

Gardner, David P., and o Washington, DC: National Co sion on Excellence in Ed ucatio

1983. 72pp.

This report: (a) inve ti a

declining state of the educa

system in America, as me high school student perfo1

the United States and o her

tries; (b) identifies specific r

areas; and (c) offers multiple

mendations for improvemen­

five major recommendations

at appear, respectively, un

headings: content, standar

pectations, time, teaching lea

and fiscal support. Reco tions pertaining to conten ·­

the strengthening of high •

graduation requirements b

lishing minimum require e each student of: (a) 4 year o

(b) 3 years of mathematic (c)3

of science, (d) 3 years of sociaJ

ies, and (e) one-half year of co

science. With regard to

and expectations, schoo

and universities are enco

adopt more rigorous and measstandards and higher exp

for academic performance

dent conduct. Four-year coll -universities, in particular �

vised to raise their ad.mis · o

quirements. In order to im ro

VOLUME 3, NUMBER 4/1990