The Effects of Instruction in An Inference Strategy On The Reading Comprehension Skills of Adolescents With Disabilities
The Effects of Instruction in An Inference Strategy On The Reading Comprehension Skills of Adolescents With Disabilities
Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at .
http://www.jstor.org/page/info/about/policies/terms.jsp
.
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of
content in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms
of scholarship. For more information about JSTOR, please contact [email protected].
Sage Publications, Inc. and Hammill Institute on Disabilities are collaborating with JSTOR to digitize,
preserve and extend access to Learning Disability Quarterly.
http://www.jstor.org
The current educational climate and its calls for national standardized assessment exams. For example,
increased skill acquisition and rising performance the proposed 2009 National Assessment of Educational
demands are requiring students to learn higher-order framework reflects
Progress (NAEP) reading expansion
reading skills, like inference skills (e.g., American from its current 1992-2007 framework, to include the
Institute for Research, 2005; Partnership for 21st assessment of broader reading content and deeper cog
Century Skills, 2006). With few exceptions, all second nitive processes (American Institute for Research,
ary students, including students with disabilities 2005). This framework represents a shift from assessing
(SWD), are required to take rigorous state reading com skills at the literal/word level of reading comprehen
petency exams, most of which involve the use of infer sion to assessing higher-order skills within reading
ence skills. At present, 26 states administer exit exams, that emphasize and inte
comprehension "interpreting
and 19 of them withhold diplomas based on poor per matter, the very skills required to
grating" reading
formance on the exit exams (Center on Education make inferences.
quate reading skills contributes to poor academic out which poor comprehenders have been explicitly taught
comes for students with LD (Leach, Scarborough, & how to make inferences have focused on teaching stu
Rescorla, 2003; Mastropieri, Scruggs, & Graetz, 2003; dents to attend to integrative factors similar to those
Wagner et al., 2003). specified by Kintsch. In each study, students were
Further complicating matters is the fact that higher taught one or some combination of the following skills:
order skills, such as those involved in reading compre activating their background knowledge, making predic
hension, in general, and making inferences, in tions, asking and answering questions, looking for clues
particular, can be much more difficult to teach students in the text, making connections between prior knowl
with LD to a point of proficiency than lower-order edge and information in the passage, and attending to
processes (Fisher, Schumaker, & Deshler, 2002; text structure.
Swanson, Hoskyns, & Lee, 1999). Making inferences has Although the results of the studies in this area are
been defined as the ability to "construct the text base somewhat mixed, three studies show positive treatment
and the mental models that go beyond the information effects for poor comprehenders (e.g., Dewitz, Carr, &
articulated in the text" (Snow, 2002, p. 108). Patberg, 1987; Hansen & Pearson, 1983; Yuill &
directly
The ability to generate inferences is typically tested by Jocelyne, 1988). However, none of these studies focused
on students with disabilities or on secondary students.
asking questions like, "Why did the boy take action like
he did?" or "What is the main message of this passage?" The poor comprehenders' average posttest scores on
The answers to such do not appear directly in some of the criterion-based tests hovered below the
question
none of these studies used
the text. Instead, the reader is expected to integrate clues passing range. Furthermore,
in the text with prior knowledge to create an answer. standardized measures of reading comprehension.
Thus, although the ability to generate inferences may be With regard to secondary students, researchers focus
critical to text comprehension, the generation of an ing on the use of conscious strategic reading compre
inference in is the result of the in hension processes have reported that students with LD
reading essentially
dividual reader's response to the ideas presented in the can learn to use comprehension strategies that conceiv
contribute to inference
text; this is somewhat dependent on his/her ability to ably could generation (Gersten
some et al., 2001; Swanson et al., 1999). Examples of such
connect or bridge those ideas with prior knowl
in text (Pressley, 2000). include summarization
edge and with clues provided comprehension strategies
To provide a theoretical framework for what happens & Salvia, 1992), activating background knowl
(Gajria
inference Kintsch (1998) suggested edge and prediction (Afflerbach, 1990), and clarifying
during generation,
that during the comprehension process, mental repre (Simmonds, 1992). Other research has shown that sec
sentations are constructed or formed about the infor ondary students with LD can learn complex reading
mation read in text. When the reader thinks, strategies and that their scores on criterion-based read
being
these measures can increase as a result of
talks, or writes about representations, they ing comprehension
Standard
Grade
Age.
59.75
76.0
Means
15.46
1.38
2.9
Student
Sex
Y-M
SES
Race
Disability
IQ
Score
Percentile
Equivalent
2.5
N
15-08
1M
SLD
67
Multi-racial
<1
<55
I N=neither
free
nor
reduced-cost
lunch;
F=free
lunch
orreduced-cost
lunch;learning
SLD= disability;
MR=Mentally
retarded;
LEP=Limite
Englis
pro
Specific
15-10 N 6F 15-05
N African-American SLD SLD 59<55<12.7 7
8 F 3F 15-02
15-01
F N/A MR
African-American 40<55<1
2.3 SLD
2M 16-05
F LEP/SLD 88744 3.9
Hispanic
3.3
115-01
66
105
SLD
White
M
F
7 SLD
5M F American-Indian
15-02 86661 3.3
White
African-American
Student
Information
. N/A=Not
.' '
available.
1
Table
U\
Oo
| bo ISO
Purpose Questions:
1. What is the author's reason for writing this passage?
Predicting Questions:
1. What is the next most likely event to happen after the end of this passage?
2. What would likely happen if the Olympics were held in Germany again?
3. Based on this in the future, Joe will ...
passage, probably
Clarifying Questions:
1. The man at the newsstand told Darren a dollar was a lot of money because ...
depending on the type of think-and-seek question. (See student behavior, describe a step of the strategy or how
the Procedures section for a description.) to use the strategy, model the strategy, provide practice
The mnemonic device "INFER" was created from the opportunities with feedback, and provide a post organ
first letters of the steps to help students to remember the izer.
during baselineand after instruction, respectively. With ding to one of the four types of think-and-seek ques
to the Use Test, the scorers agreed on tions) were written by a researcher.
regard Strategy
949 out of 969 possible agreements, for a total percent These long passages and accompanying questions
were used after all the question types had been intro
age of agreement of 98% (range = 93% to 100.0%). On
duced to the students so that they could practice using
the criterion-based comprehension tests, the scorers
on the strategy with a mixture of questions. Student per
agreed 100% of the 255 items scored. Finally, on the
formance on these activities was scored using an answer
Strategy Knowledge Test, the scorers agreed on 28 items
out of a possible 30, for a total percentage of agreement key and the guidelines described under the Measures
section for the Strategy Use Test and the criterion-based
of 93% (range = 80% to 100%).
comprehension test.
Reliability for teacher and student instructional time
Pretest procedures. Students completed a Reading
was determined for three of the instructional sessions
Satisfaction a
Survey and minimum of three probe tests
during which two scorers recorded the times separately.
containing a total of nine Strategy Use Tests and nine
Agreement was registered each time the two scorers'
corresponding five-item criterion-based comprehension
times agreed on a start or stop time to the minute. The
tests over a one-week period. For each probe test, a
total percentage of agreement on teacher time was
Strategy Use Score and a Comprehension Test Score
100%, and on student time it was 93%. The scorers'
were determined. When the third baseline probe was
times agreed on 10 out of 10 possible agreements for
completed, four students whose baselines were stable
teacher times and on 15 out of 16 possible agreements
for student times. (hereafter referred to as Cohort A) began instruction in
the Inference Strategy. Once the Cohort A students
Procedures showed an increase in their use of the strategy, the four
Instructor. The instruction was completed by the first other students at least one addi
(Cohort B) completed
author, who is a certified special education teacher with tional baseline probe until their baselines were stable.
five years' experience teaching students with disabili Then they began the instruction.
ties. She also is a certified strategic instruction model Intervention The students received
procedures.
professional developer with the University of Kansas instruction in the Inference Strategy in sessions ranging
Center for Research on Learning. in length from 60 to 75 minutes, on the
depending
Instructional materials. An instructional protocol school schedule. Instruction was based on a validated
(Fritschmann et al., in prep.) was written to ensure that instructional methodology for teaching learning strate
instruction was standardized across the two classes. It
gies to students with disabilities (Schumaker & Deshler,
was comprised of scripted step-by-step instructions for 2006).
each lesson plus visual devices to be used during the In the first instructional the students were
session,
instruction. asked to make a commitment to actively learn and use
Two types of practice materials were constructed. For the Inference Strategy. Also, in the first class session, the
the first type, nine short, one-paragraph passages were instructor explained and described in detail the steps of
compare the standardized reading test scores earned by each of the eight participants on each Strategy Use
before and after instruction on the GRADE. Test (diamond symbols) as well as the percentage
Figure 2. Percentage of points earned for strategy use and percentage of comprehension questions
answered correctly by Students 1 and 2.
STUDENT 1
Baseline
100n Instruction Generalization
90
#^^^
t> sen -^
xB..^irrrrt
- ''
<? 60n P
& 50 n /
jS 40- /
'*
fe 20n ^^^
?" *^
10-
-
0-- -!? ?'-;-1-1-1-j-1-1
9 9 9 4446899
Reading Passage Grade Level
STUDENT2 I I
100-
j
^^
3 40-i
son "
? .B_
" m
"
201
*fe
101
o-h-*?? ?!? ?!? ?I-!-1-1-1-1-1-1
999946899
Reading Passage Grade Level
? - Use - - -- -
Strategy Comprehension
STUDENT3
Baseline 100 Instruction Generalization
90
?- "
? 70-J
60- m^~~m^^ ^^
$
50- Jtr ^^*
&
o> x^
S 40- /
JU x *
o 0
fe 20- x' /~
?"
10
0^-
y -1- -1- -*?\-1-!-1-1-1-1
9994446899
Reading Passage Grade Level
STUDENT4 I
90- *''
m^*^ S^^a
?? 7o^/
o
eo^
50-
^^"^^""
"' /
O)
JS 40
8 30"
fc 20
?"
10
oH? ?i? ?i? -1-1-1-1-1-1-1-1
999 46899
Reading Passage Grade Level
STUDENT5 I
100
^m%%
5 som/ x* w/
S 60- m
o 50
S 40
30 ''
3 ** ~B^.
o 20-
?-
10
- '
oH? ?i? ?i? ?i? ?I-1-1-1-1-1-1-1
*'*
999446899
?#?
.^; Strategy Use --*-- Comprehension
y.jr#-^te-^toJg>.-.:. .- .
._..^^_ _
Figure 4. Percentage of points earned for strategy use and percentage of comprehension questions
answered correctly by Students 1 and 2.
STUDENT6
Baseline
100 I I
Instruction Generalization
& 50^ /
2 40i B^ /
8 30" ^.
" ^^*
fe 20 n
a
io-|
Oi ?i? ?i? i i i i i i i
9994446899
Reading Passage Grade Level
STUDENT7 I
100
'
o 601 - /
& 5o / ^/
S 40- i y / \
8 301 ^S*
a> 20H ?r
? - Use - - -- -
Strategy Comprehension
, ;,. ,.: iM,,?,..,.,?,..M ;i ' 7"" '-'
^-1J............MU-...
Y-^'v-'
<?^?^>?y<<^.? ,;,^-',r;
T?- -;-; -""t111"1" '",-;""'"?.&? '-'"-'""
r1"1"-"." :"'**>>rr,rwfm^^*"?XW~.
of comprehension questions answered correctly (square The figures show that the percentage of comprehen
symbols) on each criterion-based comprehension test. sion questions answered correctly increased with the
(Each symbol represents performance on three passages onset of instruction and maintained a positive trend
and three sets of questions.) The grade level at which through the remainder of instruction and posttesting.
each reading passage was written is shown along the During baseline, the students answered an average of
x-axis of each graph. Student 3's data were graphed 31.74% of the
comprehension questions correctly.
with those of Students 4 and 5 because his graph part During instruction, they answered an average of
ner moved from the school and could not continue 77.39% of the questions correctly; during the posttest
with the study. Likewise, Student 6's data were graphed condition, they answered an average of 82% of the
with those of Students 7 and 8 because his graph part questions correctly. Similar results were evidenced with
ner was excluded midway from the study due to a high regard to the Strategy Use Test. During baseline, the
absentee rate. students earned an average of 0% of the points on the
Table 2
Percentage Scores on the Maintenance Tests
1 40 0 60 79
2 n/a n/a 67 84
3 26 15 53 77
4 60 22 n/a n/a
5 47 40 n/a n/a
6 33 29 n/a n/a
7 40 10 n/a n/a
8 n/a n/a 80 88
Pretest
Student Posttest
j
0 1 100 j
I 0 2 96 | j
3 0 80
0 4 100
5 0 96
6 0 92
7 0 80
8 0 90
median score for the Strategy Use posttests was signifi cantly higher than the median score for the baseline
than the median score for the baseline = and it was also signifi
cantly higher comprehension tests, p .012,
= was also significantly than the median score for the mainte
tests, p .012, and it higher than cantly higher
score for the maintenance without-review nance = score was
the median test, p .028. The median maintenance
= .028. The median score for the maintenance than the median baseline score,
tests, p significantly higher
=
without-review test was significantly higher than the p .027.
Table 4
The GRADE Comprehension Standard Scores and Grade-Level Equivalents
58
7 89 2.9 5.9
Mean (SD) 61.25 (8.17) 88.63* (3.16) 2.99 (0.52) 5.81 (0.73)
Table 5
Overall Mean Ratings for All Students on the Reading Satisfaction Questionnaire
Student
Pretest Posttest
1 1.1 5.8
2 1.6 4.9
3 1.5 5.1
42.3 5.5
5 1.5 4.4
6 1.8 6.4
7 1.3 6.5
8 1.3 6.6
change in the students' ability to respond to inference knowledge at the end of the study.
type questions on criterion-based tests. Increases in In addition, the results of the Student Satisfaction
strategy use and ability to answer inferential questions Questionnaire suggest that students who participated
were found only after students participated in the in the Inference Strategy instruction were more satis
Inference Strategy instruction as demonstrated through fied at the end of the study than at the beginning of the
the multiple-baseline design. Third, students' posttest study with how they felt about reading and different
scores on the GRADE were significantly higher than comprehension processes. On the one question related
their pretest scores following instruction in the to their reaction to the instruction, the students indi
Inference the GRADE scores indi cated that they enjoyed the instruction = 6.62 on a
Strategy. Moreover, (M
cated that, on average, the students made a 2.8 grade 7-point scale). Finally, instruction of the Inference
level gain in reading comprehension within 15 hours Strategy required five hours of initial instructional
of instruction. The effect sizes related to the gains asso delivery and then another 10 hours of supervising prac
ciated with all three of these major outcome measures tice activities and providing feedback.
Fill in the box that best describes how you feel ... Pretest Posttest
I know what steps I can take to make meaning Mean 2.06 4.56*
fromwhat I read. 0.64
SD 1.92
Range 1-3 2-7
I feel that I can use the Inference Strategy to help Mean 1.00 6.37*
me understand what I read in class. 0 SD 0.52
Range 1 6-7
I enjoyed the exercises and passages that were Mean 1.00 6.62*
used while learning the Inference Strategy. 0 SD 0.52
Range 1 6-7
*
Represents amean gain of at least one point.
might be made by students exhibiting lesser deficits sustained use of complex strategies such as the
still need to be determined. Another limitation is that Inference Strategy require considerably more study.
test scores on the students' decoding skills were not Research is needed to determine the effects of
available. Thus, it is unknown whether they had higher Inference Strategy instruction with larger, more di
levels of decoding skills than comprehension skills, verse, and more carefully described groups of students,
which enabled them to tackle the higher reading-level and with teachers, as opposed to researchers, providing
passages.
the instruction. Maintenance procedures need to be
An additional concern is that the instruction was explored in more depth and detail. In addition, further
provided by a researcher. Whether other teachers can analysis of the data focusing on student performance
the same types of reading gains is unknown. on each of the question types may provide helpful
produce
Further, expository passages were not included in the information. Last, research is needed that focuses on
instructional materials or the criterion-based tests. use of the strategy with expository as well as narrative