Delta Module Three Principal Examiner S Report 2010
Delta Module Three Principal Examiner S Report 2010
2010
Version 1
Contents
1. Introduction.......................................................................................................................................... 3
2. Purpose of Report ............................................................................................................................... 4
3. Examiners comments ......................................................................................................................... 4
3.1 Overall comments on the work of candidates ............................................................................... 4
3.2 Specific strengths.......................................................................................................................... 5
3.3 Specific weaknesses..................................................................................................................... 5
3.3.1 Grasp of Topic ....................................................................................................................... 6
3.3.2 Needs Analysis ...................................................................................................................... 6
3.3.3 Course Proposal .................................................................................................................... 7
3.3.4 Assessment ........................................................................................................................... 7
3.3.5 Presentation and Organisation .............................................................................................. 7
4. Advice for centres and candidates ...................................................................................................... 7
5. Examples of Part 1 .............................................................................................................................. 9
5.1 Examples from Teaching Exam Classes assignments................................................................. 9
5.2 Examples from Teaching Young Learners assignments ............................................................ 11
5.3 Example from an EAP Reading Assignment .............................................................................. 13
6. Examples of priorities and objectives ................................................................................................ 14
6.1 Example from an EAP assignment ............................................................................................. 14
6.2 Example from a YL assignment .................................................................................................. 15
6.3 Example from a Teaching Exam Classes assignment ............................................................... 16
review the relevant literature of their chosen topic area and identify key issues
explain how they identified the needs of a chosen group of learners, and how they used
diagnostic tests to establish learning priorities
design a course of at least 20 hours, providing a rationale for its design, goals and teaching
approach
explain how the course will be assessed and evaluated
outline how the proposed course design relates to the issues identified in the introduction.
In doing so, candidates are expected to demonstrate an informed understanding of: their chosen topic
area; key principles of needs analysis and diagnostic testing; key principles of and types of course and
syllabus design; as well as key principles and roles of assessment.
The EA is assessed according to a detailed Mark Scheme which allocates marks for each of the five
assessment categories each of which is divided into three sub-categories.
Grasp of topic
Course proposal
Assessment
These categories are marked in line with the grade descriptions as outlined in the Delta Modules
Handbook 2010 (page 70). Marks are awarded for each category using a band system and then
totalled to form an overall grade (Distinction, Merit, Pass or Fail). The weighting for the assessment
categories is as follows:
2. Purpose of Report
This Module Three Report is based on Extended Assignments submitted in December 2009 and June
2010. These assignments are independent research projects owned by candidates, so it is not
appropriate to provide model sample assignments. However, this report highlights areas considered
by examiners to be particularly strong or weak so as to give clearer guidance to candidates and
centres. It also provides specific comments to help candidates and centres.
3. Examiners comments
The topic areas focused on (and the percentage of candidates who chose these) were as follows:
EAP (13%)
ESP (3%)
CLIL (1%)
LDT (1%)
Others (0.5%)
As predicted in the previous PE report, there was a greater range of chosen topics this time.
Nevertheless EX, EAP, YL, BE and 1-1 remain the three most popular topics and were chosen by over
75% of candidates. It is hoped that there will continue to be a wide range of chosen topics in future
submissions.
researched the chosen specialism in insightful ways and critiqued the relevant literature
designed innovative and comprehensive course plans which were well justified
were well-written and clearly organised with plentiful reference to key sources.
Most kept to the word limit. Those that did not were penalised or returned unmarked.
Some specific strengths were as follows:
Stronger candidates made good use of suggested headings outlined in the Handbook.
Some had done some extensive reading/research, and were often able to juxtapose writers
views and provide justified criticality/draw conclusions of their own.
Some used very detailed breakdowns/summary charts of when NA/DTs and assessments
would be carried out.
Some presented very comprehensive course plans, with explicit links visually and in writing to
stated course objectives. There was some good use of colour-coding and arrows to highlight
different strands, sequencing and links to course objectives.
Occasional bursts of creativity and insights in some papers were refreshing to read.
Part 4
justification for and design of the assessment procedures needs to be much clearer
lack of clarity as to what is to be tested, when and how.
Writing
Many areas of weakness identified in the previous Examiners Report (October 2009) were again valid
for this session, so readers are advised to consult this report, especially sections 3.2.1, 3.2.2, 3.2.3
and 3.2.4.
The following comments made by examiners in the last two sessions (December 2009, June 2010)
reflect specific weaknesses according to the five main assessment categories:
3.3.1 Grasp of Topic
Lack of clarity as to the specialism. Some candidates began with a course in mind and just
used the specialism as a kind of title. Some candidates chose a specialism which was
contained in the title and file name, but then proceeded to discuss a separate topic, such as
Project Work with Young Learners for example. The focus here was on project work which is
not a specialism and is not specific to YL teaching.
Some candidates narrowed the scope of their assignment, for example by focusing on one
exam or one part of one exam. With some weaker candidates, the discussion of the topic as a
whole then tended to be weak, with the result that they neglected the bigger picture or the
general principles of the specialism. A problem quite specific to those who chose teaching
exam classes was that some candidates described the exam itself in too much detail and
failed to discuss the specialism.
Some candidates chose a title which could easily be related to multiple specialisms, for
example Business English for 1-1. or Preparing Chinese YLs for Reading and Writing Flyers
Exams. In such cases it is important that one specialism is clearly chosen and focused on in
Part 1.
Lack of reference to literature in discussing the specialism. In some cases ideas were drawn
only from generic books, such as Harmer, Scrivener or Thornbury, which do not have the
necessary depth for the chosen specialism.
Some candidates took up a lot of Part 1 to explore their reasons for doing the specialism at
the expense of the content of that section, while others used this section to discuss needs
analysis and course design in detail.
3.3.2 Needs Analysis and Commentary
Lack of reference to literature on needs analysis and diagnostic testing. Some candidates
failed to consider the theory, while others mentioned it without direct reference to key sources.
Weaker candidates tended to use NA tools without explaining why, did not analyse thoroughly
enough, and subsequently failed to justify learning priorities adequately with reference to the
analysis. Some candidates seemed to have already decided on their course focus and
seemed to go through the motions of doing a needs analysis.
Rather uncritical application of learner styles questionnaires, which in some cases produced
little more than a colour-coded table showing that students had a mix of styles.
Lack of critical selection or prioritisation of data collected from the NA and DT a tendency
sometimes just to turn the data into an unfeasibly long list of course objectives without linking
back to the purposes of the students and the very short time available.
The analysis of the tests given has tended to focus too heavily on the detail with not enough
drawing together of the different strands that have come out of these.
In particular the justification of the choice of priorities was often weak or non-existent.
The advice given in the last Examiners Report (October 2009) remains valid, so centres and
candidates are advised to consult section 4 of this report in addition to the comments below.
Centres should give clear guidance to candidates on how to approach the assignment, in particular:
choosing a specialism as the starting point for the assignment and ensuring it underpins all
sections
ensuring the specialism is discussed in theoretical and practical terms
ensuring background reading is referred to explicitly in all sections
ensuring the NA tools are analysed adequately and that the results are synthesised to
establish learning priorities some candidates may require training in this
ensuring the course plan is developed out of the needs analysis, and justified explicitly in
terms of the results and priorities identified (it is important that the EA is not seen as a course
planning assignment but that designing a course plan is one aspect of the assignment)
ensuring the assessment procedures are justified in terms of the course, and that sample tests
are appendixed
ensuring that plenty of time is allowed for proof-reading before submitting their final version
ensuring all candidates are familiar with the advice on pages 71-76 of the handbook
reminding candidates that the word count limits for sections are important to achieve
appropriate balance and weighting.
Candidates are advised to make use of the following checklist as a final check before submitting their
assignment.
Have I
clearly chosen a specialism from the list provided, and indicated this on the cover
page?
outlined key features of the specialism and indicated what distinguishes it from
other forms of teaching?
referred to and commented on background reading and key sources throughout?
discussed principles underlying NA/DT, CSD, assessment, etc?
clearly justified my choice of needs analysis tools?
included completed samples of diagnostic tests used in the appendix?
analysed the results of the diagnostic tests adequately?
justified the learning priorities I have identified clearly in relation to my needs
analysis?
justified my course objectives in terms of learner needs?
added my course plan as an appendix to the main body of the text?
included sufficient detail in my course plan?
made it clear what I will assess and how, with samples in the appendix?
outlined how the course will be evaluated?
respected the word-limit and indicated the word count on the cover page?
linked all parts of the assignment coherently to one another?
signposted all the appendices clearly in the main body of the text?
Yes/no
Centres are advised to continue to monitor candidates progress in this assignment, through individual
tutorials and by commenting on drafts, in order to ensure that they are meeting the criteria before they
complete the whole assignment. Some candidates might require additional advice, such as how to
include quotes within the text.
Centres should also continue to advise candidates that assignments are checked electronically for
plagiarism and that plagiarism has already been and will be penalised. Plagiarism checks include
checks against previously submitted assignments as well as assignments or parts of assignments
which include passages copied from online resources or books.
Centres should inform candidates that submission of assignments which have been
plagiarised will lead to the candidates disqualification and a ban on re-entry of up to three
years.
5. Examples of Part 1
A common problem faced by many candidates who have chosen to narrow down their topic area is
how to maintain a balance between the broader specialism (such as teaching exam classes) and the
narrower topic (such as IELTS) and how to then use the latter as an example of the former. The
following four examples illustrate ways in which both weaker and stronger candidates tackled Part 1 of
the assignment.
Examiner comments:
Candidate A tended to focus too much on describing the IELTS exam and did not devote
enough time to discussing general issues relating to teaching exam classes.
Example B
Preparing students for an examination is a special responsibility (Burgess & Head 2005:1).
Many learners take IELTS or TOEFL in order to gain entry into a university in an English speaking
country, or to open up employment opportunities. As a result, expectations for positive outcomes are
great (May, 1996; Burgess & Head, 2005).
The aim of an exam class is to maximise the students score. The main way they differ from
General English (GE) classes is that there is a clear goal that is often missing from GE classes. The
shared goal helps develop a strong class dynamic promoting hard work in and out of the classroom
(May, 1996; Burgess & Head, 2005). This hard work is rewarded with progress. In exam classes the
learners consider this progress more valuable as it takes them closer to passing the exam. This cycle
has a positive effect on the learners as well as the teacher. When students are succeeding the teacher
is encouraged to further challenge them.
In order for the learners to pass the exam they need to cover the subject matter that is likely
to arise and practice the skills required. As a result, teachers often teach to the exam (Hughes, 1989;
Baxter, 1997). This relationship between the test and the teaching is called Backwash and is a
symptom of exam classes (Prodromou, 1995). If an exam requires the learner to complete lots of
multiple choice activities the class preceding this may consist of little else. Here the impact the exam
has on the teaching is negative as the class will be dull and predictable. Prodromou (1995) believes
that exams in general simplify language down to word and sentence level removing context, content,
interest and humour. For positive backwash to occur an exam class should be engaging and fun much
like a GE class. In fact, increasingly exam boards have made the decisions to mimic real life and have
created activities that the learners will be familiar with from GE coursebooks (Burgess & Head, 2005).
However, with an exam such as IELTS where the content is more serious, the teacher may have to
draw on their personal resources to make the lessons engaging for the learners.
Furthermore, learners (especially those preparing for a high stakes exam like IELTS) can be
intolerant of being taught anything that 'isn't in the exam', even though it may be good for their
learning, which means communication is really important and that the syllabus needs to be negotiated
at least partly with the students. If it is non-negotiable from the teachers point of view, then a rationale
for activities should be provided. Otherwise students can become mistrustful of the teacher and start
to doubt their abilities.
The students must feel that the teacher is knowledgeable about the English language and
about the exam. Preparing learners for exams is as much about teaching the strategies and skills
needed in order to meet the criteria as it is about the language (Thornbury, 2006). The learners need
to know what type of tasks to expect and how to complete them. Therefore, learner training is
essential (Thornbury, 2006). Exam strategies such as using learner dictionaries, applying self
correction techniques or receptive skill training are often incorporated into a course (May, 1996;
Burgess & Head, 2005). It is useful if the teacher can pass on tips that are less commonly known.
Prodromou (1995) believes if testing dominates teaching it can result in: errorphobia, fear,
anxiety, mistrust, and boredom. Therefore exam classes work best if teachers and students like, trust
and respect each other. As the exam approaches most students need a lot of reassurance that they
can/will pass. Dealing with anxious learners means that the teacher may have to assume the role of
counsellor which can be draining (Burgess & Head, 2005).
In addition, sometimes the level of the exam is out of reach of the learners despite all their
efforts (May, 1996). This is particualry true of IELTS where many candidates are aiming at a level
which will give them access to higher education. This can be demotivating particularly in mixed-ability
classes when weaker students may be seen as holding the class back. Furthermore, exam classes
produce a lot of marking and the syllabus can be seen as restrictive which teachers may feel limits
their creativity and impinges on their free time (May, 1996; Burgess & Head, 2005).
Examiner comments:
Candidate B also chose to design an IELTS course, but successfully managed to discuss
general issues related to the specialism itself (namely Teaching Exam Classes) and highlighted
these issues with reference to preparing students for IELTS as an exam.
10
11
Examiner comments:
Candidate C describes Project Work in detail without discussing Young Learners as a
specialism or describing issues related to teaching teenagers, which is the focus of the course
designed. Much of the discussion of Project Work might be beneficial in lots of contexts. The
candidate needed to outline key issues related to the chosen specialism (teaching teenagers)
and discuss Project Work as a possible way to address these issues.
Example D
One main problem reported by teenage learners (TLs) is that course book materials are not
interesting. This is because most materials available today are not suitable/relevant for TLs and are
aimed towards young learners (511), or adults (18+), using cartoon stories or topics such as
pregnancy/retirement. The few aimed at teenagers become out-dated quickly and tend to be aimed at
American/European students. Due to this, I want to devise a course that benefits and reflects my TLs,
and improve my activity planning for future TL classes. This in turn will make my students more
motivated and benefit more from their English studies. Key factors to be considered when planning
this course and teaching my students are:
Independence/Autonomy
TLs are starting to break away from parents and find independence, which means they want to start
taking ownership and authority over their studies. This is different to adults, who already have a sense
of independence/ownership over their studies, and children, whose courses are normally controlled
completely by the teacher. Similarly to Harmers findings (2003), I have found that utilising surveys
and discussions on work to be undertaken, and debating class/teacher rules, helps achieve this sense
of autonomy. This also concurs with Lewis who mentions that giving TLs responsibility, and making
them accountable for their actions, allows autonomy over what they are doing and how they should do
it (2007:7).
Materials
Thomson raises the point that TLs need materials to have connections to their lives and evolve around
their own personal being, rather than something they are unlikely to know about or want to know about
(2006). By selecting materials involving their personal lives I have noticed that TLs are more interested
in the language presented. Materials and activities that have been received well by my students are
the use of songs, computers and videos.
Lesson Variety
Due to low concentration spans in teenagers, it is important that lessons have a variety of different
stages and activities from skills to language, movement and games. Lindstromberg puts this down to
TLs becoming restless easily; making them switch off from the activities given (2004:16). This is
something that I have found common with TLs and that back up activities are often needed if
concentration weakens.
Classroom Management
Teenagers are sensitive to issues of fairness (Lindstromberg 2004:19). As the teacher I must ensure
positive feedback/attention is spread evenly so students feel respected and not disregarded. In
classes where I have focused on particular TLs the others became detached from the lesson and were
harder to re-engage later on.
Conclusion
Overall, this implies that when designing my course I need to not only assess previous work/tests for
learning needs, but also include my TLs in the decision making of the courses content, find topics
relevant to them and ensure that activities are varied and suit their learning styles. When teaching I
should also provide a balance of attention and note inter-student relationships.
Examiner comments:
Candidate D narrows the focus to discussing issues related to teenagers. The candidate
demonstrates good understanding of the specialism and key issues related to it and
successfully integrates generic issues with reference to his own context.
12
Bottom-up processing pays close attention to the language itself (Nuttall 2005, p.78) and
centres on word-level meaning, sentence structure, and textual details (Plakans 2009,
p.253).
EAP readers will have limited schemata and knowledge of the language in a text compared with
that of the author (Spector-Cohen et al., 2001), so any EAP reading course must aim to fill such
gaps. Developing formal schemata can help learners to strike an equal and necessary balance
between top-down and bottom-up text-processing strategies, thus enabling more efficient reading
and encouraging the acquisition of content schemata that can be acquired from textbooks,
journals, and articles of educational content Griva (2005).
13
Many writers argue that metacognitive strategies are also required to self-regulate thoughts that
monitor cognition (Plakans, 2009). I always encourage EAP students to consider and reflect upon
the use of particular strategies because it helps them understand their suitability and encourages
their conscious selection.
Errey (2005) argues that both cognitive and metacognitive reading strategies be explicitly taught in
order for EAP students to cope with readings that are composed of discourse in discipline-specific
fields, and under time constraints. All the reading suggests that more proficient and skilled readers
have a wider repertoire of skills and are better able to select between appropriate strategies.
Examiner comments:
Candidate E successfully managed to discuss general issues related to the specialism itself
(Teaching EAP) before exploring specific issues related to the narrower focus (Teaching EAP
Reading). Links between the narrower focus and the overall specialism are maintained
throughout and logically discussed.
14
Strengths:
Identifying or label pictures.
Reading
Writing
Speaking
Phonology
15
Weaknesses
Listening to and understanding longer
texts and answering comprehension
questions about it.
Confuse answering true/false when
sentences contain negation.
E.g. There isnt a picture on the wall.
True/False.
Problems with filling-gaps was mainly due
to not reading the rubric carefully.
Spelling e.g. *hous, *settember, *brawn.
Forming questions.
Communicating in English is difficult for
them even though their comprehension is
generally good.
Their spoken English lacks fluency and
accuracy.
Longer speech sounds stilted.
Wrong intonation which effects
intelligibility.
Principal Examiners Report 2010
The childrens linguistic needs that I identified based on these results and my observations are:
Skill
Listening
Reading
Writing
Speaking
Phonology
These needs are the basis for the course objectives (see 3.3). Although the children need to improve
the four skills, speaking will be given priority as it is their weakest skill.
2.6 Non-linguistic needs
During the lessons, I constantly observed the children as I believe that observation is a very useful
source of information about performance, attitudes and motivation. I recorded my observations in a
table (Appendix 6) from which I drew up the class profile and identified some of the childrens nonlinguistic needs, namely, the need for:
A variety of activities.
An environment where they can feel confident to experiment with the language.
Praise and encouragement.
My observations were also entered in another table (Appendix 7) which will also be used to monitor the
childrens progress throughout the course.
3.3 Course objectives
Although there are no imposed objectives for this course, it is important to state them as it brings into
focus what one wishes to achieve in a course. (Graves, 2000). Below are the objectives of the course,
based on the need analysis outcome (see 2.5):
Objectives*:
By the end of the course learners will:
be better able to understand more challenging and authentic recordings such as the LRRH
story and a videoclip about wolves.
be better able to understand more challenging reading texts other than those in their
course books such as the LRRH story and fact files about animals.
have practised writing short descriptions of characters and short stories.
be better at spelling lexis related to the story, family, food, appearance, animals and the
forest.
have practised oral skills such as repeating stories, talking about animals, describing a
forest scene and telling their own stories.
have improved intonation.
have practised pronouncing new lexis.
(*The colours used in the table reflect those used for the needs (see 2.4) and the aims in the course
plan (Appendix 1)).
These objectives will also be communicated to the parents at the beginning of the course.
Examiner comments:
The candidate makes explicit links between the learning priorities and the diagnostic test
results, although both the linguistic needs and non-linguistic needs could have been
grouped under the same sub-section as learning priorities. The course objectives are also
clearly linked to the priorities, and use of colour highlights this link. The objectives themselves
could, however, be more specific.
6.3 Example from a Teaching Exam Classes assignment
16
2.5) Priorities
I would like to consider students opinions regarding the skill areas they want to focus on because if
students can have some choice in this learning matter, the higher the chances of the language focus
to be uptaken (Nunan,1995:135). It will also give them satisfaction to clear their own predicted
learning hurdles (Hutchinson and Waters,1987:60). However, because of students weaker scores in
the reading diagnostic test and some students inexperience with learner centred approaches like self
directed studying strategies, the teacher with their expertise needs to overrule some of the learner
centred course suggestions, and make appropriate decisions. (Widdowson,1987:86).
In light of this discussion I will devote time to practising and raising awareness of the relevant subskills needed for all parts of the test. However, due to students self cited weaknesses, more space
will be allocated to the productive skills. In addition, there will be a focus on self directed learning
techniques to reflect some students apparent lack of knowledge of independent study skills.
3.2) Objectives
The objectives show the various stages on the journey towards the destination, expressing the
specific ways the goal will be achieved (Graves,2001). However, the objectives of this course need to
accommodate students identified needs or personal agendas and those of the teachers (Dubin and
Olshtain,1986). So, referring back to the needs analysis and diagnostic test, we see students
identified needs are to improve elements of their productive skills, but because their reading scores
were lower than other self cited weakness the teacher needs to intervene and act on behalf of the
students by focusing an objective on reading. E.g. Student 1 scored 20/40 for the reading but scored
6 for her speaking, which was her cited area for improvement (appendix 1.2/5.1). Moreover, some
students demonstrated an apparent lack of knowledge of the exam structure and autonomous
learning attributes.
Based on students needs analysis, diagnostic scores and the teachers intuition the objectives will
enable students to:
i) know about the test format and how to address each part effectively. This involves awareness of
marking criteria.
ii) be exposed to independent learning strategies useful for test preparation.
iii) be aware of the different facets of writing discourse needed to write an effective discursive essay
(writing, part 2) and to describe a graph or chart (writing, part 1). i.e. organisational awareness,
cohesive devices, specific language/phrases to describe trends.
iv) be aware of the different facets of spoken discourse needed to do well in the speaking test i.e.
awareness of over-hesitating, and extension of discourse.
v) be aware of the different sub-skills needed to answer questions on the reading sections of the
exam. i.e. skimming, scanning and understanding main ideas of paragraphs.
vi) be aware of the different listening sub-skills needed to answer questions in the exam. i.e. detailed
listening, gist listening, sound discrimination and other skills involved in communicative discourse.
vii) adapt some of the course material to describe their own personal situations or topics that interest
them. This is to combat negative backwash.
Examiner comments:
The candidate summarises the learning priorities but these are a little vague and would benefit
from greater detail. The course objectives are referred back to the needs analysis and learning
priorities, although some of the detail in the first paragraph of 3.2 might work better in section
2.5. It is clear however how the course objectives have emerged from the needs analysis.
17