The Role of Instruction in Learning To Read: Preventing Reading Failure in At-Risk Children
The Role of Instruction in Learning To Read: Preventing Reading Failure in At-Risk Children
0022-0663/98/$3.00
David J. Francis
University of Houston
Jack M. Fletcher
Christopher Schatschneider
University of Houston
Paras Mehta
Arizona State University
First and 2nd graders (N = 28?) receiving Title I services received 1 of 3 kinds of classroom
reading programs: direct instruction in letter-sound correspondences practiced in decodable
text (direct code); less direct instruction in systematic sound-spelling patterns embedded in
connected text (embedded code); and implicit instruction in the alphabetic code while reading
connected text (implicit code). Children receiving direct code instruction improved in word
reading at a faster rate and had higher word-recognition skills than those receiving implicit
code instruction. Effects of instructional group on word recognition were moderated by initial
levels of phonological processing and were most apparent in children with poorer initial
phonological processing skills. Group differences in reading comprehension paralleled those
for word recognition but were less robust. Groups did not differ in spelling achievement or in
vocabulary growth. Results show advantages for reading instructional programs that
emphasize explicit instruction in the alphabetic principle for at-risk children.
37
38
reading problems with activities and tasks involving phonological awareness skills. Both studies showed clearly that
the supplementation of standard kindergarten curriculums
with activities involving phonological awareness skills resulted in growth in phonological awareness skills relative to
children who received the standard curriculum without
phonological awareness skills. The studies also showed that
these gains continued and were also manifested in areas
involving word reading in the first and second grades (see
Foorman, Francis, Beeler, Winikates, & Fletcher, 1997).
Vellutino et al. (1996) provided either one or two semesters (depending on progress) of 30 min daily, one-on-one
tutoring to poor readers in Grade 1. The tutoring in letter
identification, phoneme awareness, word-reading skills, and
practice in connected text helped the majority of these
children become average readers. Torgesen (1997) found
that 20 min a day for 80 hr of one-on-one tutoring in
phonological decoding strategies (with or without training in
articulatory gestures) and practice in reading and writing
enabled approximately 75% of first graders who had been in
the bottom 10th percentile in phonological skills in kindergarten to move to national averages in timed and untimed
decoding. Similar results were achieved with older, severely
disabled readers (age 10 years on average); however, the
one-on-one tutoring was much more intensive2 hr daily
for 80 hrand decoding accuracy but not speed reached
national averages. Olson, Wise, Ring, and Johnson (1997)
had similar results with third to sixth graders below the 10th
percentile in word recognition who were tutored individually in phonological decoding strategies (with or without
training in articulatory gestures).
The efficacy of the interventions in these studies, which
emphasized tutorial interventions, is interesting in relation to
older studies that also focus on early intervention. In
summarizing these programs, Slavin and his colleagues
(Slavin, Karweit, & Madden, 1989; Slavin et al., 1994)
noted that the most widely used supplementary-remedial
programs, diagnostic-prescriptive pullout programs provided under Title 1 programs for economically disadvantaged children, showed little evidence of effectiveness
unless they involved one-on-one tutoring. Moreover, the
attempt to mainstream at-risk children by having Title 1 or
special education aides work in the regular classroom has
been no more effective than the pullout model (Archambault, 1989; Puma, Jones, Rock, & Fernandez, 1993).
In contrast, kindergarten or first-grade prevention programs and classroom change models have proved effective.
The only prevention programs for which data are available
on long-term effects of intensive reading instruction in the
early grades are Reading Recovery (Pinnell, Lyons, DeFord,
Bryk, & Seltzer, 1994; Shanahan & Barr, 1995) and Success
for All (Slavin, Madden, Dolan & Wasik, 1996). In evaluations of Reading Recovery, first graders tutored daily for 30
min by a trained Reading Recovery tutor exceeded matched
control children's reading performance with an effect size of
.87. This effect size fell to .45 and .29 one and two years
later, respectively, without additional intervention. More
recent analysis of the effects of Reading Recovery continue
to show large effect sizes that diminish over time. Reading
Instructional Methods
During the 90-min daily language arts period, the children were
instructed in one of three classroom reading methods, all of which
existed within a literature-rich environment in the classroom: direct
39
Table 1
Study Design and School Characteristics
Federal
lunch
program
No.
School Enrollment
Grade classrooms Curriculum
(%)
1
71.4
1
1,208
5
IC-S
2
5
IC-S
2
1,009
1
6
49.5
IC-R
2
4
IC-R
3
1,232
64.2
1
6
EC
2
6
IC-R
908
4
43.2
1
3
DC
887
2
5
41.8
1
DC
1,137
6
39.9
1
2
IC-R
1
2
DC
2
2
DC
2
2
IC-R
2
3
IC-S
853
7
64.5
1
2
EC
1
2
DC
2
2
EC
2
2
DC
8
839
1
32.3
3
IC-R
1
3
EC
2
2
IC-R
2
1
EC
Note. IC-S = implicit code-standard; IC-R = implicit coderesearch; EC = embedded code; DC = direct code.
40
41
Analysis
We used individual growth curves methodology to analyze
changes in phonological processing, word reading, and vocabulary.
These methods permit the estimation of (a) the mean rate of change
and an estimate of the extent to which the individual's growth
differs from this mean rate, and (b) correlates of change, which in
this investigation focused on effects resulting from the four
instructional groups but also included covariates of verbal IQ, age,
and ethnicity. In the analysis of growth in word reading, we also
examined the effects of initial level of phonological processing as a
correlate of growth and a moderator of instructional effects.
Individual growth parameters and correlates of change were
estimated using Hierarchical Linear Models-3 (HLM-3; Bryk &
Raudenbush, 1987, 1992; see Francis, Fletcher, Stuebing, Davidson, & Thompson, 1991; Francis et al., 1996; Rogosa, Brandt, &
Zimowski, 1982, for information on the application of individual
growth models in psychology and education). In addition to time
being nested within individuals, students were nested within
teacher, providing for a three-level model (time, student, teacher).
Although teachers are also nested within school, there was an
insufficient number of schools to model school-level variability, so
this factor was ignored in the analyses.
In analyzing instructional effects, we were first interested in
knowing whether IC-R (representing research-trained and monitored instruction) differed from the district's standard (representing
district-trained and supervised instruction), tested atp < .05. Then,
to control for Type I error, we conducted Bonferroni-adjusted
pairwise comparisons among the three experimental approaches to
instruction with an alpha level of .0167 (or .05/3). In modeling
academic outcomes, we have ignored differences between IC-S and
DC and between IC-S and EC, because these curricula differ from
IC-S both in the explicitness of code instruction and in the training
of teachers to deliver the instruction. Comparison of IC-S to IC-R
provides information about the importance of the teacher-training
42
Results
Tutoring Effects
We examined the size of the tutoring unit (one-to-one or
small group, i.e., 3-5 students with one teacher) and the
nature of the content of the tutorial (whether it matched or
did not match classroom instruction). The mismatch condition was available only for the two code-emphasis groups
because the district's standard tutorialReading Empowerment based on Clay's (1991) methodwas matched with
the IC approach. Unfortunately, it was impossible to retain
the initial assignment to ratios of one-to-one or one-to-many
because the teachers needed to rearrange groupings to deal
with behavioral and learning problems. Thus, we calculated
the average number of days a student was in a 1:1 or 1 :many
ratio condition. This variable did not significantly predict
reading growth or outcomes. There was also no significant
effect of matched or mismatched tutorial content. Because of
the lack of tutoring effects, tutoring was ignored in subsequent analyses.
Table 2
Frequency Distributions for Teacher Attitude
Survey Data (%)
Frequency distributions
Definitely Endorse Definitely
yes
no
1
2 3 4
5
Question
1. Recommend to district
DC
EC
IC-R
2. Recommend to colleague
DC
EC
IC-R
3. Recommend for all children
DC
EC
IC-R
4. Recommend for special needs
DC
EC
tC-R
64
22
44
36
50 17 11
39 17
73
22
28
27
50 11 17
50 17
55
28
33
27 18
39 17 11
39 28
45
50
17
27 27
28 11 11
44 28 11
22
82
61
50
9
39
28
0
0
0
43
Table 3
Factor Score Means, Standard Deviations, and Sample Sizes for Phonological Processing
at Each Wave of Data Collection
Instructional
group
Direct code
Grade 1
Grade2
Embedded code
Grade 1
Grade 2
Implicit code-research
Grade 1
Grade 2
Implicit code-standard
Grade 1
Grade 2
December
October
M
SD
0.68
1.74
0.54
0.80
0.37
1.38
February
April
SD
42 1.87
14 2.25
0.74
0.69
46
35
1.07
1.89
0.74
0.72
57
28
0.84
0.79
24
24
SD
44 1.34
14 2.06
0.69
0.47
0.36
0.74
49
36
0/72
1.61
0.60
0.62
0.51
1.58
0.55
0.62
57
28
0.93
1.89
0.43
1.48
0.50
0.70
24
24
0.90
1.76
SD
39 2.16
14 2.51
0.83
0.60
41
14
0.69
0.71
41
29
1.59
2.18
0.77
0.71
39
28
1.23
2.17
0.87
0.79
55
27
1.53
2.21
0.88
0.73
53
25
1.02
1.72
0.75
0.63
23
23
1.22
1.90
0.86
0.64
23
22
44
Table 4
Raw Score Means, Standard Deviation, and Sample Sizes for Word Reading at Each Wave
of Data Collection
Instructional
group
Direct code
Grade 1
Grade 2
Embedded code
Grade 1
Grade 2
Implicit code-research
Grade 1
Grade 2
Implicit code-standard
Grade 1
Grade 2
October
M
SD
December
n
SD
February
n
SD
April
n
SD
1.59 23 1.91
7.87 23 14.27
0.57
9.13
2.81 23
9.35 22
45
4 j
3.5--
-*-*-a-
3 -
2.52 1.5 -
1
0.5 +
0
October
December
April
October
February
December
February
School Year
Figure 1. Growth in phonological processing raw scores by curriculum (panel a) and predicted
growth in phonological processing by curriculum (panel b).
HLM-2 (Bryk & Raudenbush, 1992). We included covariates of age, verbal IQ, ethnicity, and October word-reading
scores. This analysis revealed that the DC group outperformed the IC-R group, F(l, 165) = 10.06, p = .002,/ =
1.53, as well as the EC group, F(l, 165) = 5.34, p = .022,
f - 1.12, with no differences between the IC-R and EC
groups (p = .37,/ =0.41).
The practical significance of the slope and intercept
differences is clearly apparent when examining individual
cases. A relatively large percentage of children in the IC-R,
IC-S, and EC curricula did not exhibit growth. As can be
46
16
T
--*-s-m-
I
s
E
z
December
February
School Year
16
14 --
12 10
JS
E
z
October
December
February
School Year
Figure 2. Growth in word reading raw scores by curriculum (panel a) and predicted growth in
word-reading scores by curriculum (panel b).
given that in October they read zero words. Included in the
analysis were covariates of age and ethnicity. The results
showed that DC children were 3.6 times more likely to be
reading more than one word at the end of the year than IC-R
children, XHh N = 182) - 6.48,p = .011 (95% confidence
interval [CI] = 1.34, 9.49), and 5.2 times more likely than
EC children, X20> # = 182) = 10.79, p = .001 (95%
CI 1.94, 13.80). If the criterion was two words read
accurately at the end of the year, then DC children were 5.6
47
u
3
ode
_c
CO
DC
S
5
CD
"S
s
8
o
c
sz
.3
I
o2
n
N
p
Si
in
I-
o
i-
io
dnaig |o weojvd
CL
o
CO
,g
-
35
O
1*1
aCD
"3
uency
tCode- Res
00
LL
dnaig io iiKawd
48
en
o
o
en
CD
0.0
0.5
1.0
1.5
2.0
2.5
3.0
49
72 +
70
68 66 --
64 4
62
60
58
56
54 +
52
October
December
February
April
School Year
B
82
80
78
76
74
October
December
February
School Year
50
Table 5
Standard Score Means, Standard Deviation, and Sample
Sizes on May Achievement Tests of Reading and Spelling
for Four Instructional Groups
WJ-R Reading
Instructional group
Basic
Passage
comprehension
KTEA
spelling
FRI
comprehension
96.1
14.6
58
96.7
15.9
58
85.7
12.2
58
81.8
9.4
50
88.6
11.2
82
91.4
12.7
82
82.0
8.2
82
80.8
8.3
62
89.6
12.7
78
92.0
14.8
78
81.6
81.5
8.7
61
84.5
9.7
45
89.0
12.1
45
Direct code
M
SD
n
Embedded code
M
SD
n
Implicit code-research
M
SD
n
Implicit code-standard
M
SD
n
9.1
77
81.7
83.1
7.6
6.9
45
34
Note. WJ-R - Woodcock-Johnson Psychoeducational BatteryRevised (Woodcock & Johnson, 1989); KTEA - Kaufman Test of
Educational Achievement (Kaufinan & Kaufman, 1985); FRI Formal Reading Inventory (WIederholt, 1986). The FRI was not
administered to children who scored less than 5 points on the WJ-R
Passage Comprehension.
Reading cluster is the average of the Letter-Word Identification and Word Attack (pseudoword) subtests and represents
a measure of decoding. Passage Comprehension is a cloze
test at the sentence level, and the FRI is a multiple-choice
test based on silent narrative and expository text reading. On
the basis of our previous research (Foorman et al., 1996), we
did not administer the FRI to children who scored less than 5
raw score points on the WJ-R Passage Comprehension to
avoid frustrating the children on the more difficult FRI.
A two-level hierarchical linear models approach using
SAS PROC MIXED (SAS Institute, 1997), nesting student
within teacher, was utilized to investigate instructional
group differences in the May achievement scores. Significant effects of instructional group were followed up with the
three post hoc contrasts of interest, using Bonferroni corrections to control the alpha level at p < .0167. Significant
instructional group effects were found for the WJ-R Basic
Reading cluster, F(3, 197) * 6.03, p = .008, / = 0.67,
M 2 = .48 and the WJ-R Passage Comprehension subtest,
F(3, 197) = 2.15, p = .044,/= 0.40, AR2 = .64. Post hoc
tests of the instructional effect revealed that the DC group
had higher mean decoding scores than either the EC group,
F(h 197) = 9.41, p = .003,/ = 1.17, or the IC-R group,
F(l, 197) = 7.00,/? = . 0 0 9 , / " 1.22, respectively. Likewise,
the DC group had higher mean Passage Comprehension
scores than the EC group, F(l, 197) - 4.76, p = .030,/ =
0.72, but this difference was not significant at the Bonfeironiadjusted criterion. The difference between the DC and IC-R
groups was not significant, F(l, 197) = 3.68,/? = .056,/ =
51
Table 6
Means, Standard Deviations, andp Values for the Six Scales of the Multi-Grade
Inventory for Teachers for Four Instructional Groups
Direct code
Scales
SD
SD
SD
Academic
Activity
Adaptability
Attention
Language
Social
3.26
2.96
2,89
3.58
2.86
3.27
0.41
1.51
0.77
0.85
0.78
0.47
60
60
60
60
60
60
3.11
3.14
2.82
3.59
2.85
3.25
0.41
1.48
0.93
0.79
0.72
0.54
86
86
86
86
86
86
3.26
2.97
2.70
3.38
2.68
3.14
0.42
1.47
0.80
0.84
0.67
0.59
n
85
85
85
85
85
85
SD
3.39
3.77
3.28
3.65
3.09
3.47
0.33
1.42
0.89
0.77
0.56
0.56
47
47
47
47
47
47
P
.002
.020
.003
.189
.020
.010
52
References
Adams, M. J. (1990). Beginning to read. Cambridge, MA: MIT
Press.
Agronin, M. E., Holahan, J. M., Shaywitz, B. A., & Shaywitz, S. E.
(1992). The Multi-Grade Inventory for Teachers. In S. E.
Shaywitz & B. A. Shaywitz (Eds.), Attention deficit disorder
comes of age (pp. 29-67). Austin, TX: PRO-ED.
Allington, R. L. (1991). Children who find learning to read
difficult: School responses to diversity. In E. H. Hiebert (Ed.),
Literacy for a diverse society (pp. 237-252). New York:
Teachers College Press.
Archambault, R. X. (1989). Instructional setting and other design
features of compensatory education programs. In R. E. Slavin,
N. L. Karweit, & N. A. Madden (Eds.), Effective programs for
students at risk (pp. 220-263). Needham Heights, MA: Allyn &
Bacon.
53
54
Appendix A
Spelling Patterns for Embedded Code Instruction (Sequenced From Left to Right)
Sequence for Grade 2
-*g
_ug
_en
_ait
_ate
_me
_ean
_csl
_each
_ive
_ome
Jght
_oad
_ad
-op
Jt
_at
-ep
_ay
_ale
_my
ease
eel
_aU
_ice
_oke
_oat
_an
_ot
_in
_ad
_go, no
_ame
_ave
_ee
_eet
_een
Jte
_jme
ose
_old
_ie
_ap
_og
_ap
_et
_ain
_ake
_ane
_eed
_ea
^p
ile
_ike
_ope
_ue
_ow
ath
Jd
JU
_an
-ed
_aint
_ade
-.ace
_eam
_ead
-.cat
_and
_ang
Jne
Jde
Jgh
_oa
_own
_oft
oot
Jft
Jst
_ump
_uag
_ench
_ent
_arm
Jc
uff
_ell
_amp
_ank
_ond
_oom
_ink
_isp
-OSS
_BSt
_imt
_ept
-.elp
~.eive
_orm
_urn
_unk
est
_oil
_arn
_ird
_ax
_anf
_ask
~ong
_ood
^int
Jng
_ess
_act
_ast
_atch
_onk
oon
_ilt
_irst
_ulp
end
eft
_idf
_orn
-all
_alt
_anch
_ox
_ook
ix
Jlk
_itch
unch
_elt
_elf
_ar
_ern
55
Appendix B
Instructional Components Used as Criteria for Compliance
Direct code components
1.
2.
3.
4.
Phonemic awareness
Use of anthology
Phonics, phonics review
Guided and independent exploration
5.
6.
7.
8.
Writing
Spelling dictation
Workshop
Use of workbook materials
Shared reading
Guided reading
Responses to and extensions of literature
Phonics instruction in context
5.
6.
7.
8.
Appendix C
Teacher Attitude Survey
1. If you were responsible for curriculum decisions in your district, would 5. How close is the match between the intervention you are delivering and
you recommend that resources (materials, staff development, etc.) be
your own beliefs about how to teach children to read?
provided for this intervention in the future?
a. An exact match. This is the way I already teach.
2. Would you recommend the intervention you are using to a colleague?
b. Very similar. I agree with most aspects of the intervention.
3. Would you recommend the intervention for use with all age-appropriate
c. Somewhat similar. I agree with some aspects of the intervention.
children?
d. Not similar at all. My beliefs about the teaching of reading are con4. Would you recommend die intervention for children with special needs?
tradictory to those of the intervention.
Note.
Responses to the first four questions were based on a scale ranging from 1 {definitely yes) to 5 (definitely no).