The Effect of Discourse Markers On The Comprehension of Lecture
The Effect of Discourse Markers On The Comprehension of Lecture
Comprehension ofLectures*
CRAIG CHAUDRON AND JACK C. RICHARDS
University of Hawaii at Manoa
INTRODUCTION
With greater numbers of non-native speakers of English entering English-
medium institutions of higher education around the world, the provision of
appropriate English-language training as a preparation for academic study
becomes increasingly important. In the United States, all major universities now
2. LISTENING TO LECTURES
The function of lectures is to instruct, by presenting information in such a way
that a coherent body of information is presented, readily understood, and
remembered. Several distinct modes of lectures have been distinguished in
research on the nature of academic discourse. Dudley-Evans and Johns (1981)
establish three categories of lectures: a reading style, a more informal con-
versational style, and a rhetorical style:
Style A—'Reading Style'. The lecturer reads from notes, or speaks as if he was reading
from notes. Characterised by short tone groups, and narrowness of intonational range.
Falling tone predominates: level tone (in Brazil's terms, signal of withdrawal from inter-
action) may also occur.
Style B—'Conversational Style'. The lecturer speaks informally, with or without notes.
Characterised by longer tone groups and key-sequences from high to low. When the
lecturer is in 'low key1 at the end of a key sequence, the speaker may markedly increase
tempo and vowel reduction, and reduce intensity.
Style C—"Rhetorical Style'. The lecturer as performer. Characterised by wide into-
national range. The lecturer often exploiting high key, and a 'boosted high key'.
Frequent asides and digressions marked by key and tempo shift—sometimes also by
voice-quantity shift (1981:34)
The present study deals primarily with lectures in the reading style.
In view of the didactic focus of lectures, the structuring and organization of
information within a lecture has been assumed to be an essential aspect of its
comprehensibility. Within applied linguistics, researchers interested in identi-
fying those aspects of lecture structure which might be relevant focuses in train-
ing non-native listeners have examined how the organization of information
within a lecture is signalled. Cook (1975) describes the macro-structure of a
lecture as being composed of a number of 'expositions'. These consist of an
optional episode of expectation, an obligatory focal episode, an obligatory
developmental episode together with optional developmental episodes, and an
obligatory closing episode. At the level of micro-structure, episodes are
described in terms of moves. For example, a concluding move is a justificatory
statement, a focal episode with a concluding function, or a summary statement;
CRAIG CHAUDRON AND JACK RICHARDS 115
Four different versions of the lecture were recorded, each version including a
different combination of macro and micro discourse markers. These lectures
were then played to second-language learners of different ability levels, and
measures were taken of their comprehension.
4. HYPOTHESES
It was hypothesized that learners would comprehend the information in the
lecture better when more discourse markers were included, in particular
H I : L2 learners would comprehend the lecture better when micro-markers
were added than when no markers were added.
H2: L2 learners would comprehend the lecture with macro-markers better
than the lecture with only micro-markers.
5.1 Materials
A video tape and transcript of a natural lecture presented to ESL university
students was used as source material. This lecture, which dealt with the
expansion of the United States from thirteen colonies to an imperial nation, was
condensed to a seven-page written passage. This passage, the 'Baseline' version,
did not include any special signals of discourse organization or linking between
sentences, other than what was absolutely necessary to convey the meaning of
the lecture.
A second version of the lecture, the 'Micro' version, was then constructed, in
which various markers of intersentential relations, framing of segments, and
pause fillers were inserted. No other changes in the content of the lecture were
made. Examples of these markers are (see Appendix A for a complete listing of
the markers used):
temporal links—then, and, now, after this, at that time
causal links—because, so
contrastive relationships—but, actually
relative emphasis—you see, unbelievably, of course
framing/segmentation— well, OK, all right?
Every attempt was made to keep any of these markers from adding semantic
information to the lecture. The relationships encoded by the markers were,
typically, already evident in the content of the text
A third version was also constructed, called the 'Macro' version, containing
signals or metastatements about the major propositions within the lecture, or
the important transition points in the lecture. For example (see Appendix A for
a complete listing):
what I'm going to talk about today...
let's go back to the beginning...
this brought about new problems...
118 DISCOURSE MARKERS AND THE COMPREHENSION OF LECTURES
5.3 Subjects
Two groups of subjects were tested using these materials. These will be referred
to as the 'pre-university' and the 'university' groups. The pre-university group
were 71 ESL students enrolled in sections of two listening courses in an inten-
sive English language program at a private college in Hawaii. The university
5.5 Analysis
All the subjects' responses were scored either right or wrong. An exact-word
scoring method was used for the cloze items, with only minor errors in spelling
or grammatical form being considered acceptable.5
Pearson product-moment correlations were calculated between the depen-
dent cloze and comprehension measures and the various standardized and
placement test scores for the subjects.6 The dependent measures were analysed
separately in an analysis of covariance (SPSSX MANOVA procedure, SPSS
Inc., release 1.1), with lecture version the independent factor (four levels), and
different standardized and placement tests as covariates.7
Unexpectedly, the placement scores for the pre-university group consisted of
three test administrations, separated by six-month intervals. As a result, the
analysis was conducted on two separate sub-groups, each representing a test
administration. This left an N of 33 in the one group and 32 in the second. The
third group was too small for further analysis.
120 DISCOURSE MARKERS AND THE COMPREHENSION OF LECTURES
6. RESULTS
The results will be reported separately for the two groups.
Pre-university group
The cloze measure for this group as a whole was very low (X •** 19.6, out of 79
possible). Table 2 reports the means for the group as a whole and separately by
1984, test date 2—TD2—was late spring of 1984). Whereas the cloze had a KR-
21 of .87, considered adequately high, the multiple-choice and true-false tests
were so low in reliability (.2 and 0.16, respectively), that they will not be con-
sidered in the analysis of the lecture versions here.
Table 3 shows the results of the Analysis of Covariance on this cloze measure,
as differentially affected by the lecture versions, for TD1 and TD2. The version
means as adjusted by the covariates are also displayed here for TD1.
It is evident in Table 3 that there was a significant effect for version on cloze
responses with TD1 (F(3/27) - 4.99, p < 0.01), but not TD2. The a priori
comparison of differences between means snowed that there were, no
differences between the adjusted means for the Micro version and the Baseline.
Supporting the hypothesis, the Macro version was significantly superior to the
Micro version (p < .01), but in conflict with the hypothesized effect, it was also
superior to the combination Micro-Macro version. Post hoc comparisons
revealed no differences between the Micro-Macro and the Micro or Baseline
versions.
It was therefore of some interest to determine what difference there might be
between the two test groups. Based on the cloze recall outcome and all other
CRAIG CHAUDRON AND JACK RICHARDS 121
Source SS df MS F
a. Test date 1
Constant .78 1 78 .01
Regression (co-variates) 473.41 2 236.71 4.3 •
Version 822.71 3 274.24 4.99**
Within 1484.14 27 54.97
b. Test date 2
Constant 173.10 1 173.10 2.49
•p<.05
«p<.01
*~p<.00l
placement test scores, the later test group (TD2, summer 1984) performed
significantly better than the earlier one (t-tests, p < .005). The relevance of this
difference will be discussed below.
University group
The mean cloze score for the university group was 35.8 (n = 81), considerably
higher than the pre-university group. Table 4 reports the means for the group as
a whole and separately by version condition. The cloze in this case also had a
high reliability (KR-21 r =• .89) and the multiple-choice and true-false tests
improved in reliability (.32 and .39, respectively), but not enough to warrant
their being included in further analyses.
Table 5 shows the results of the Analysis of Covariance on this cloze measure,
as differentially affected by the lecture versions. The version means as adjusted
by the covariates are also displayed here.
Just as with the TD1 pre-university group, Table 5 shows that there was a
significant effect for version on cloze responses (F(3/76) — 3.10, p < .05),
adjusting for the listening placement scores as covariate. The a priori com-
parison of means showed in this case that there were no differences between the
adjusted means for the Micro version and the Baseline, nor between the Micro-
Macro and Macro versions, but that the Macro version was again significantly
superior to the Micro version (p < .01). Post hoc comparisons revealed no
differences between the Micro-Macro and the Micro or Baseline versions,
although in this case the Micro-Macro version appeared to produce better
Source df MS F
University group
Constant 64.14 1 64.14 .49
Regression (co-variates) 1592.84 1 1592^4 12.14—
Version 1218.40 3 406.13 3.10*
Within 9967.43 76 131.15
• p<.05
•** p<.001
7. DISCUSSION
In the light of the theory of information processing and top-down compre-
hension of discourse, the finding that macro-markers led to better recall of the
text material than micro-markers should not be surprising. The learners are
evidently aided in organizing the major ideas in the lecture from the guidance of
the lecturer's signals of major segments and emphasis. These help them
construct appropriate schematic models of the major portions of the lecture,
even if they lack sophisticated understanding of the content or the rhetorical
structure of expository speech.
Why do the micro-markers not aid the learners' retention of the lecture
content? For one thing, these markers probably do not add enough content to
make the subsequent information more salient or meaningful. For another, the
devote some attention to the particular phrasing and placement of the expres-
sion. The anticipation and processing by the listener follows accordingly: one
leams to disregard all the minor pause fillers and redundant intersentential
connectors, perhaps making use of the time to process the significant parts of
the text. But on the other hand, the listener knows that paying attention to
markers of the overall organization of the text is a critical skill for the compre-
hension of the information conveyed by the lecture.
A final comment is warranted concerning why the TD2 group did not show a
significant effect like the TD 1 pre-university students and the university group.
One explanation is that these subjects may have been a more homogeneous
group, since most of them were recent arrivals in the USA, just enrolling in the
summer session of the intensive program, and relatively homogeneous in ethnic
and language backgrounds (mainly East Asians). In these respects they were
NOTES
• An earlier version of this article was presented at the 19th Annual Convention of Teachers of
English to Speakers of Other Languages, 10 April 1985, in New York City. The authors would like
to thank all those who kindly gave their time, and made their classes available for this research. They
also are grateful to the students who co-operated in doing the lecture comprehension task. In
particular, we would like to thank Janet Leister, Ann Chun, Steve Taylor, and Bruce Horton, of
Hawaii Pacific College, and Rodger Snow, Tom Grigg, Kathy Rulon. Patricia Card, Philip Pinsent,
and Chas Mason, of the English Language Institute, University of Hawaii at Manoa.
1
The total duration of the lectures varied between 23 and 27 minutes because of the added
material in each of the versions from Micro to Micro-Macro. These times include eight minutes of
pauses, because there were 13 pauses of 40 seconds inserted at systematic intervals, as described in
the next section.
2
REFERENCES
Adams, M. J. and A. Collins. 1979. 'A schema-theoretic view of reading' in R. Freedle
(ed.): Advances in Discourse Processes, VoL II: New Directions in Discourse Process-
ing. Norwood, N. Jj Ablex.
126 DISCOURSE MARKERS AND THE COMPREHENSION OF LECTURES
APPENDDCA
Macro-Markers
What I'm going to talk about today is something Another interesting development was
you probably know something about already— You probably know that
What [had] happened (then/after that] was [that] The surprising thing is
We'll see that As you may have heard
That/this is why Now where are we
To begin with This is how it came about
The problem [herej was that You can imagine what happened next
This/that was how In this way
The next thing was It's really very interesting that
This meant that This is not the end of the story
One of the problems was Our story doesn 't finish there
Here was a big problem And that's all we 'II talk about today
What we've come to by now was that