Communicative Syllabus Design and Testing: Dr. Ambreen Shahriar Dr. Ayesha Sohail Dr. Habibullah Pathan
Communicative Syllabus Design and Testing: Dr. Ambreen Shahriar Dr. Ayesha Sohail Dr. Habibullah Pathan
Key words
Communicative syllabus
Communicative testing
Backwash effect
Notional syllabus
1. INTRODUTION
Teaching and testing have an unbreakable relationship. Neville (1988) notes that
teaching and testing are closely related but in testing the same sort of material is to be
administered and marked in such a way that the results could be reliable when
individuals and groups are compared. The following triangle presents the relation
between the trio; communicative needs, language programs and testing systems.
Figure: 1 Communicative
The Curriculum Triangle
needs
Carroll (1980:05)
Language Testing
programmes systems
Madsen (1983) starts his book with the statement, “Testing is an important part of
every teaching and learning experience”. Effective testing is important for a better
effect on the teaching and learning process. Morrow (1981a) points that the written
and spoken tests (not reading and listening tests) are taken to assess the overall
performance on a task and the skills or strategies used to perform it.
Carroll (1980) points that communicative teaching as well as testing varies according
to learner needs. A communicative syllabus considers the purposes of language
learning as foremost. Besides, the mode and medium of communication and the target
level are also taken into account. Keeping a close concern of the academic and social
requirements from the target language, the communicative syllabus designer reflects
on the social hindrances also.
Communicative tests assess the ability of a learner to use the language generally and
universally without restricting its use to particular settings only. The performance
tests which check the learners’ abilities to use the language in specific settings are not
communicative in nature. Though a communicative test also assesses the learners
communicative ability in the given setting, yet that setting will act as a sample of any
setting that the learner may come across with, not a specific setting.
By now I have explained what I meant by syllabus and testing. I have also tried to
make myself clear on the communicative syllabus and communicative testing. In the
next section, I will discuss the theoretical issues related to communicative syllabus
2. LITERATURE REVIEW
Now I am turning towards the theoretical issues. This section comprises the review of
the literature on the Communicative Syllabus and testing. The first sub-section covers
the communicative syllabus design. The next section under this heading highlights the
theoretical issues related to the communicative testing and assessment.
Ellis (1993) favours communicative syllabus over the other types of syllabus because
it teaches the language in the way it is naturally acquired (i.e. through
communication). Yet the concept of communicative syllabus strongly suffers at the
hands of different scholars. One of the commonly held beliefs is that communicative
syllabus includes learning through communication, at the cost of neglecting the
structures (grammar), a definition not complete in itself. Larsen-Freeman (1986)
explains communicative syllabus in that way. She says, many other methods also have
similar goal as the communicative method to syllabus design, but communicative
approach has a broader notion of communicative competence. She says, here, the
teacher creates and promotes situations for communication. Negotiating meaning is
the task to be achieved even when the form is incorrect. Learning to communicate is
done through communication.
Now, this concept of ‘negotiating meaning even when form is incorrect’, above, gives
rise to the misunderstanding for a communicative syllabus. Swan (1981), therefore,
does not favour the all-purpose use of a communicative syllabus. He is rather of the
view that all syllabus types should be integrated (not giving equal importance to all of
course, but following the learners needs) to form a course. Likewise, Morrow
Figure: 2
Linguistic Competence against
Communicative competence CC
Allwright (1979:168)
LC
LC =Linguistic competence
CC= Communicative competence
Johnson (1982) also agrees with Allwright (1979) on the mentioned point. Besides,
Johnson says that a language teacher has to make sure that the learners are acquiring
both the knowledge of language structures and language use. Therefore, acquiring
linguistic competence becomes a part of communicative syllabus.
But this was not the only misunderstanding towards a communicative syllabus. There
are more disagreements on the question of what comprises communicative syllabus.
Johnson (1982) defines Communicative syllabus as a syllabus that ‘links structures to
meaning categories’. But Harmer (1982) writes that syllabus or its content cannot be
communicative, but the activities in the syllabus and methodology make it
communicative. Melrose (1991) considers only that type of syllabus to be
communicative, which does not follow a well-developed plan and is, rather,
negotiable and grants maximum learner autonomy. Yalden (1983) seems the most
convincing in her explanation of a communicative syllabus, its types and its
components. She presents six types of communicative syllabus as follows:
Type 4 Functional
Of all these syllabus types, Yalden mentions that type 5 is the strongest input syllabus
and type 6 is the most minimal input syllabus (type 6 is the one mentioned by
Melrose).
Besides, Yalden (1983) lists ten essential components of any communicative syllabus
to comprise detailed consideration of:
8. The target level and the variety of the target language required.
1. Purposive domain.
2. Setting.
3. Interaction.
4. Instrumentality
5. Dialect.
6. Target level.
7. Communicative event.
8. Communicative key.
Thus, these only seem to have been reshuffled by Yalden. And again reshuffled by
Savignon (2002). Savignon’s components of a communicative curriculum also
support the idea that applying the communicative approach does not mean putting
language structures aside. It is only another approach to the syllabus design. Her five
components are as follows:
Activities: translation, dictation, rote memorization, synonyms and antonyms, true and
false cognates, spelling tests, pronunciation exercises and patterned repetition of verb
paradigms or arts games.
4. Theater Arts: The focus on the tools they need to act, that is, to interpret, express,
and negotiate meaning in a new language.
Activities: The occasions for language use, role-playing (both scripted and unscripted)
simulations, and even pantomime, ensemble building, and the many related activities.
1. Beyond the Classroom: The focus on the after the class activity.
Activities: English language radio and television programs, videos, and feature-length
films, newspapers and magazines, World Wide Web sites, computer-mediated
communication.
She notes that the cultural expectations, language goals and learning styles vary from
context to context. Therefore the language teachers should arrange the mentioned
components in the syllabus according to the learner needs.
Breen and Candlin (1980) also present similar views when they say that the purpose
of language learning is ‘to communicate as a member of a particular socio-cultural
group’. Thus according to them, as according to Munby and Yalden, besides the
analysis of sociolinguistic requirements and uses of the target language, the syllabus
designer has to be sure of the required the target level, at the time of designing the
syllabus.
Weir (1990) mentions that communicative testing is intended to assess the knowledge
of the language as well as the ability to implement that knowledge in use. Weir
(1981) marks ‘communicative competence’ and ‘communicative performance, to be
tested through communicative testing. But here (1990), Weir clarifies that the
communicative performance is the ability to use language in an isolated situation; in
contrast to that, communicative language testing tests the ability to use language in all
and any situation. Therefore, he mentions that communicative competence and
The nature of the communicative tests is not fully agreed upon. Savignon (2002)
mentions that essay writing, in-class presentations, and other more holistic
assessments of learner competence are currently favoured methods for communicative
testing. Morrow (1981b) points that a communicative language test is essentially
qualitative in nature but it can be marked numerically. Morrow (1981b) mentions that
a communicative test determines whether a learner can perform a type of language
activity. And he makes it clear to the test designer to assess and evaluate what a
communicative test is intended to assess and evaluate. And as I clarified in the last
stanza, Weir (1990) elucidates what the communicative tests are expected to assess.
Weir (1990) considers reliability and validity as the fundamental criterion against
which any test may be judged. He adds that reliability can be sacrificed for the
purpose of increased validity but validity cannot be sacrificed at any cost. He,
therefore, lays greater importance to validity without which, according to him, a test
will not test what it is intended to test. Kelly (1978; cited in Weir, 1981) notes that the
objectives on test needs should be made clear to construct a valid test. Madsen (1983),
however, proclaims that good tests are not only valid and reliable; they also improve
class attitude, motivation and student performance. Hughes (1989) writes that due to
the invalid test content or unreliable test scoring, backwash effect can become
harmful. He finds content and criterion related validity and reliability to be essential
for an accurate test. While Heaton (1975) also mentions face validity.
Carroll (1980) expects a test to possess Relevance (of the test content to the
communicative needs), Acceptability (of the testee on the test content and format),
Comparability (of the test scores regardless of the space and time) and Economy (of
time, effort and resources against information provided) (commonly called RACE).
The next section of the assignment brings forward the practical implications drawn on
the historical overview presented.
3. IMPLICATIONS
This part of the assignment covers the solutions to the problems in my target situation.
I reached these solutions only after applying the existing theories to my target
situation. This section consists of few sub-sections. In the succeeding sub-section, I
will talk about the present conditions in my target situation with respect to the target
language, learners and the society.
SOCIAL CONSTRAINTS: Learners share the same language (either L1 or L2). They
do not find any purpose, other than academic, to communicate in the target language.
teacher to learner
learner to learner
adult to adult
INSTRUMENTALITY:
TARGET LEVEL: Intelligible (can understand others and make oneself understood)
After noticing the present in class situation it is now essential to know where exactly
the target language is required, besides the required proficiency level. To find out this,
needs analysis has to be conducted.
Educational setting
In the target situation, needs analysis of has to be conducted from three different
perspectives which are going to influence the target level. The learner needs,
requirements and motivation seem foremost. Therefore, a needs analysis will be
conducted from the learner about their expectations from the course, the resources and
the learning environment. The suggestions can be acquired on whether to develop a
completely new syllabus or modify the existing syllabus.
After that, the needs analysis of the academic requirements, from the course, will be
conducted. The teachers and the administration can comment on the present level of
command of the students generally. Besides, they can describe the target level and are
in a better position to comment on the social constraints involved in the acquisition of
the target language.
The needs analysis of the market requirements seems essential too, because the
learners are at the tertiary level and after this they have to find jobs and face the
market. So the syllabus must prepare them for the needs and requirements of the
market. This is a lengthy process since the requirements of the market vary in various
fields and the learners belong to different fields. For this, the requirements in the
market of the common jobs that our learners prefer can be looked for.
The learners can be taught same syllabus initially (for the first year) and specific to
their market requirement at the later stage (during the second year).
The previous two sections highlighted the conditions in my target situation. I also
mentioned the present state of the learners and their target requirement, followed by
the process of conducting needs analyses. I would now like to give practical
suggestions on the syllabus.
Of all the types of the communicative syllabus presented by Yalden (1983), I prefer
Type 5 the Fully Notional syllabus for my target situation. I do not prefer any of the
other type because, as in type 1 ‘Structural-Functional’ so in type 2 ‘Structures and
Functions’, grammatical forms are the core of the syllabus. In type 1, the functions are
As type 6 ‘Fully Communicative’ syllabus is the most minimal input syllabus and that
is why unsuitable. The target learners need a well-developed plan of action in the
form of a syllabus. Besides, they also require complete teacher support, self-direction
does not seem possible for them at the initial level. Yalden (1983) also says that this
type is not suitable for elementary learners. Therefore the target learners can be
granted some liberty to choose and decide at times, later in the course but they cannot
be granted complete autonomy.
Type 4 Functional syllabus can be seen as a possibility but type 5 Notional Syllabus
seems more appropriate to me because it has developed from a sociolinguistic
viewpoint. The main purpose of type 5 syllabus is to identify and cover those
elements of the target language which are suitable to the needs of particular social and
occupational group. A fully notional syllabus, as described by Wilkins (1976) focuses
on what will be communicated through language, instead of how, when and where the
language is used. Besides, Yalden (1983) writes that a notional syllabus is learner-
I would prefer notions as the units of organization for the syllabus from the following
list of inventory:
Situations
Topics
Functions
Notions
Roles/activities
Structures
Wilkins (1976) compares the notional syllabus with grammatical and situational
syllabuses and mentions that the notional syllabus starts from the point of the desired
‘communicative capacity’.
As far as the unit ordering is concerned, I will do that on the basis of:
i) Simplicity criteria
ii) Priority of needs
iii) Sequencing potential.
In order to develop the language program, the steps suggested by Yalden (1983) will
be followed. (see Appendix A)
3.3 Testing
In a test during the term time, testees will be given tasks/problems/activities related to
their academic field along with “source material” in the form of files, booklets, tapes,
etc. (idea taken from Carroll, 1980).
Before starting with the process of test construction, the test devisers have to discuss
the contents under the heading Learners versus Target language in section 3.1 (or see
Test Construction:
1. Before writing
Communicative testing demands that before writing the tests, the deviser must be
clear about:
Total time allocated for the test (time per component also).
Scoring procedure.
Apart from all this, it is also essential that the communicative language testers must
be provided with a set of blueprints to devise tests. Fulcher and Davidson (2007) mark
that in order to keep the validity and reliability, it is important to provide the test
devisers with a range of blueprints.
Since the notional syllabus is taught to the students, therefore, tests will be
constructed keeping in mind, the sociolinguistic perspective. The tests will assess the
learners on their expected encounters with the language. As the syllabus is learner-
centred, so should the tests be. They should test the learners on their competence and
ability to use the linguistic knowledge, focusing their limitations and resources. For
writing up the tests following steps need to be taken:
Be sure about the appropriate ratio between task and the time allocated.
Pretest if possible.
A good test always results in a beneficial backwash effect. As Heaton (1975) writes
that test are conducted so that teaching could be adjusted for better learning.
Therefore:
Test will be valid, reliable and efficient (these affect all aspects of test design
regardless of the paradigm, says Weir, 1990).
Test content will be based on course objectives rather than course content.
Direct testing will be preferred over indirect testing (agreeing with Hughes,
1989).
Integrative testing will be preferred over discrete point testing (suiting the
learners’ level).
The learners will be made familiar with the format and testing techniques.
Madsen (1983:180) and Heaton (1975:172) help language teachers to prepare “Item
Analysis” of the difficulty level and discrimination level which can also be used for
setting a test.
Not just the test construction but also the assessment on the tests is a very important
issue. According to Fulcher and Davidson (2007), “the models and frameworks
describes the what of language testing…the tasks tell us about the how of language
testing… scoring is concerned with the how much or how good of language testing.
For marking a language test, Morrow (1981a) presents two schemes: first, which he
calls quantitative analytic tradition, the marker marks the performance on each of the
criteria already decided and then adds the marks to find out total score. Whereas,
following the second, i.e. qualitative synthetic approach, which he prefers, the marker
marks on the overall impression of the performance on the basis of the mentioned
criteria. Larsen-Freeman (1986) notes that in assessment through communicative
approach, the errors of form can be avoided as natural outcome of the language
learning process. And Brown et al. (2004) give tips on fair assessment out of which
validity, reliability, fairness, equitability and efficient. They also suggest on the timely
assessment and ask to give feedback to the students. Brown, et al. (2004) also suggest
that assessments should be taken throughout the semester or year.
4. CONCLUSION
REFERENCES:
Alderson, J.C. and Hughes, A. (Eds.) (1981). ELT Documents 111- Issues in
Language Testing. London: The British Council.
Allwright, R. (1979). ‘Language learning through communication practice.’ In
Brumfit, C. and Johnson, K. (Eds.). (1979). Pp- 167-82.
Bachman, L.F. (1989). Fundamental Considerations in Testing. London: OUP.
Bourke, J.M. (2006). ‘Designing a topic-based syllabus’. ELT Journal 60/3:
279-86
Breen, M. and Candlin, C. (1980). ‘The essentials of communicative
curriculum in language teaching’. Applied Linguistics 1/2:89-112.
Brumfit, C. and Johnson, K. (Eds.). (1979). The Communicative Approach to
Language Teaching. Oxford: Oxford University Press.
Carroll, B.J. (1980). Testing Communicative Performance: an Interim Study.
Oxford: Pergamon.
Ellis, R. (1993). ‘The structural syllabus and second language acquisition’.
TESOL Quarterly 27/1:91-113.
Fulcher, G. and Davidson, F. (2007). Language Testing and Assessment: An
Advanced Resource Book. London: Routledge.
Harmer, J. (1982). ‘What is communicative?’ ELT Journal 36/3: 164-8.
Harrison, A. (1983). ‘Communicative testing: jam tomorrow?’ In Hughes, A.
and Porter, D. (eds.) (1983). Pp-77-85.
Heaton, J.B. (1975). Writing English Language Tests. Harlow: Longman
Group Limited.
Hughes, A. (1989). Testing for Language Teachers. Cambridge: Cambridge
University Press.
1 Needs Survey.
2 Description of purpose to be prepared in terms of
Student characteristics
Student skill on entry to and on exit from the program
3 Selection or development of syllabus type in terms of 4 and physical
constraints on the program.
4 The proto-syllabus: description of language and language use to be
covered in the program.
5 The pedagogical syllabus: development of teaching, learning and
testing approached.
Development of teaching materials (as far as possible)
Development of testing sequence and decisions on testing
instruments.
6 a) Development of classroom procedures
selection of exercise types and teaching techniques
preparation of lesson plans
preparation of weekly schedules
b) Teacher training: briefings and workshops on
principles
desired outcome
exploitation/creation of teaching material
7 Evaluation
Of students
Of program
Of teaching
8 Recycling stages
Congruence or ‘fit’ between goals set and student
performance is determined
Content is reassessed
Materials and methodological procedures are revised.
Figures
1. The curriculum triangle.
2. Linguistic Competence against Communicative competence
Tables
1. The characteristics of communicative and non-communicative activities.
2. Test construction phases
3. Time table class VIII
4. Parameters and procedures for test design
Achievement test: the test conducted to find the success of individuals, groups or the
course in achieving the objectives.
Backwash effect: the effect of testing on teaching and learning.
Communicative competence: knowledge of the rules of grammar and discourse and
of communicative strategies.
Communicative performance: the ability to produce/use language in a
communicative setting.
Content validity: a test with representative sample of relevant language skills,
structures etc.
Cost-effective: practical i.e. easy and cheap to construct, administer, score and
interpret.
Criterion-referenced testing: a test that classifies a person according to whether or
not he can perform a task. (Compare with Norm-referenced testing)
Criterion related validity: the results of the test agree with the candidate’s
performance on another dependent or independent test.
Diagnostic test: the test taken to find students’ strength and weaknesses.
Direct testing: the test that requires the candidate to perform those skills precisely
which are to be measured. (Compare with indirect testing)
Discrete point testing: testing of a single item at a time. (Compare with Integrative
testing).
Grammatical competence: knowledge of the rules of grammar/language.
Face validity: a language test designed, for one part of the world, has a specific
relative vocabulary, which, if used in another part, lacks face validity.
Focused communicative task: a task which results in the prominence of some
linguistic feature (not by paying more attention to form than meaning).
Indirect testing: the test that attempts to measure the skills through the underlying
abilities. (Compare with direct testing)
Integrative testing: the test that require many language items to be combined to
complete a task. (Compare with discrete point testing)
Language Arts: focus on forms of English, including syntax, morphology, and
phonology.