Schillings Et Al 2018 A Review of Educational Dialogue Strategies To Improve Academic Writing Skills
Schillings Et Al 2018 A Review of Educational Dialogue Strategies To Improve Academic Writing Skills
research-article2018
ALH0010.1177/1469787418810663Active Learning in Higher EducationSchillings et al.
Article
Active Learning in Higher Education
2023, Vol. 24(2) 95–108
A review of educational dialogue © The Author(s) 2018
Marlies Schillings
Maastricht University, The Netherlands
Herma Roebertsen
Maastricht University, The Netherlands
Hans Savelberg
Maastricht University, The Netherlands
Diana Dolmans
Maastricht University, The Netherlands
Abstract
Written feedback plays a key role in the acquisition of academic writing skills. Ideally, this feedback should
include feed up, feed back and feed forward. However, written feedback alone is not enough to improve
writing skills; students often struggle to interpret the feedback received and enhance their writing skills
accordingly. Several studies have suggested that dialogue about written feedback is essential to promote the
development of these skills. Yet, evidence of the effectiveness of face-to-face dialogue remains inconclusive.
To bring this evidence into focus, we conducted a literature review of face-to-face dialogue intervention
studies. The emphasis was on key elements of the interventions and outcomes in terms of student
perceptions and other indicators, and the methodological characteristics of the studies. Subsequently, we
analysed each selected intervention for the presence of feed-up, feed-back and feed-forward information.
Most interventions used all three feedback elements – notably assessment criteria, student feedback, and
revision, respectively – and combined lecturer–student as well as student–student dialogue. Students
generally perceived the interventions as beneficial; they appreciated criteria and exemplars because they
clarified what was expected of them and how they would be assessed. With regard to student outcomes,
most interventions positively affected performance. The literature review suggests that feedback dialogue
shows promise as an intervention to improve academic writing skills, but also call for future research into
why and under which specific conditions face-to-face dialogue is effective.
Corresponding author:
Marlies Schillings, Department of Nutrition and Movement Sciences and School of Health Professions Education (SHE),
Maastricht University, P.O. Box 616, 6200 MD Maastricht, The Netherlands.
Email: [email protected]
96 Active Learning in Higher Education 24(2)
Keywords
Feed back, feed forward, feed up, higher education, student learning
academic writing, at least in contemporary Western society, is a distinct style of writing used by those in
academia and research communities that is noted for its detached objectivity, its use of critical analysis and
its presentation of well-structured, clear arguments based on evidence and reason. (p. 139)
Hence, academic writing is an essential means of communication (Lillis and Turner, 2001;
Murray, 2001; Sultan, 2013; Zhu, 2004). Examples of academic writing products can range from
essays, bibliographies and theses up to scientific papers (Ganobcsik-Williams, 2004). However,
acquiring academic writing skills is complicated for students in higher education (Carless, 2006;
Elander et al., 2006).
The literature describes various approaches to academic writing instruction (Lea and Street,
2006; Wingate and Tribble, 2012). Many approaches address teaching academic writing skills
outside the specific subject content, in extracurricular ‘study skills’ courses. These generic or
bolt-on approaches assume that common features in academic writing can be taught separately
(Etherington, 2008). However, other studies on effective academic writing methods show that
enhancing student learning in this manner is ineffective (Ganobcsik-Williams, 2004; Tribble and
Wingate, 2013; Wingate, 2006, 2012). The main argument is that learning to study well at uni-
versity cannot be separated from subject content and the process of learning. In addition, many
students begin their studies with little or no knowledge of the principles underpinning discipline-
dependent academic discourse regarding academic writing. These principles are rarely explicitly
documented by subject lecturers who often assume students understand what is required of them
(Elton, 2010; Hunter and Tse, 2013). Knowing that learning to write well is difficult is convinc-
ing to realize that university students need support with academic writing (Wingate, 2006, 2012,
2014). Developing disciplinary writing requires an understanding of a distinct discourse on sub-
ject knowledge and tacit writing (Elton, 2010; Hunter and Tse, 2013; Wingate, 2006). Another
argument against separate writing courses is that rising numbers of student are accessing higher
education and their heterogeneous educational backgrounds require other ways to teach complex
academic writing skills (Boscolo et al., 2007; Lillis and Turner, 2001; Tribble and Wingate,
2013; Wingate, 2006). Therefore, researchers are considering effective approaches that will
enhance learning academic writing skills and also serve lifelong development. There is need to
introduce student input into embedded subject-specific discourse and instruction, known as the
built-in approach, in contrast to generic and often extracurricular teaching (Hunter and Tse,
2013; Lillis, 2001; Wingate, 2006; Wingate et al., 2011).
Academic writing support has already been studied extensively. Research on academic writ-
ing support ranges across, for example, the use of exemplars or worked examples (Carless and
Chan, 2017; To and Carless, 2016; Yucel et al., 2014), the use of assessment criteria (Elander,
2002; Elander et al., 2006), the implementation of training or instruction (Taras, 2001, 2003), the
Schillings et al. 97
use of different modes of feedback provision (McCarthy, 2017; Morris and Chikwa, 2016), the
role of feedback in revision of writing products (Jonsson, 2012), the role of self and/or peer
assessment (Taras, 2001, 2003), and the importance of the writing process itself (Cloutier, 2016).
Each research direction contributes to improved insight into academic writing skills develop-
ment. However, one of the most powerful single influences on achievement is feedback (Hattie
and Timperley, 2007).
improve the students’ understanding of the feedback and help them move forward (Black and
Wiliam, 2009; Hattie and Timperley, 2007). Peer-to-peer dialogue is considered particularly
helpful because peers speak each other’s language, and they can motivate and help each other to
move forward (Bloxham and Campbell, 2010; Bloxham and West, 2007; Cloutier, 2016; Elton,
2010; Nicol, 2010; Rae and Cochrane, 2008; Zhu and Carless, 2018).
What remains unclear, however, is whether students actually find face-to-face dialogue useful
in improving their academic writing skills and, if so, why. Neither is it clear whether other out-
comes, such as the quality of academic writing products, improve with the introduction of dia-
logue. There is therefore a need to further explore the following:
1. Which feedback elements (feed up, feed back and feed forward) do face-to-face dialogue
interventions use and who are the participants in such interventions?
2. What are the outcomes of interventions in terms of student perceptions and other indicators
and how can these be explained?
3. What are the main methodological characteristics of studies analysing the effectiveness of
face-to-face dialogue interventions?
Methods
Search strategy
In April 2017, we searched the following online databases: Web of Science, EMBASE, ERIC,
CINAHL, PsycINFO and Google Scholar. At first, we searched on ‘feed up’, ‘feed back’ and ‘feed
forward’, but this strategy did not produce enough suitable articles so we added the term ‘feed-
back’. To minimize the chance of missing relevant articles, the scope was broad and included the
following string of keywords and Boolean operators: ‘dialogue OR discussion OR conversation’
AND ‘feedback’ AND ‘writing’.
Data extraction
The first author performed the search, yielding 1508 records. After removal of duplicates, the
titles and abstracts of the remaining records (N = 1182) were screened on the inclusion and
exclusion criteria. The resulting records (N = 304) contained the topics ‘dialogue’, ‘feedback’
and ‘writing’. Further eligibility was subsequently assessed by reading the full articles on this
list. After this phase, 102 articles remained for consideration. Of those, only articles that dis-
cussed a feedback intervention involving ‘face-to-face dialogue’ before submission of an aca-
demic writing assignment were included. As a result, the final review was based on 19 studies
(Figure 1).
Schillings et al. 99
Identification
database search
(N = 1508)
Duplicates removed
Records remaining after
(N = 326)
Identification
removal of duplicates
(N = 1182)
Records excluded
Records (i.e. their titles and
abstracts) screened based on
Screening
(N = 878)
inclusion and exclusion criteria
(N = 304)
Non-eligible records
excluded
Records further assessed for
Eligibility
eligibility (N = 202)
(N = 102)
Records excluded
analysis
(N = 19)
Data analysis
We scrutinized each intervention for the presence of feed-up, feed-back and feed-forward informa-
tion (Black and Wiliam, 2009; Hattie and Timperley, 2007; Jonsson, 2012; Nicol and Macfarlane-
Dick, 2006; Price et al., 2010; Rae and Cochrane, 2008). For the purpose of this review, we
considered educational strategies such as assessment criteria, exemplars, worked examples and
training (e.g. instructions or workshops) as expressions of feed-up information, written lecturer
feedback and written peer review/assessments as feed-back information, and instructions to revise
draft products as feed-forward information. In the next step, we checked which and how many
100 Active Learning in Higher Education 24(2)
Results
Feedback elements used in the interventions and the participants in the dialogue
All the interventions focused on improving students’ writing products, such as an essay, paper or
bibliography (see Table 1). In nine of the studies, the feedback students received contained all three
feedback elements: feed up, feed back and feed forward. As regards feed-up information, assess-
ment criteria were the tools most often used (N = 12), followed by training/instruction (N = 9) and
exemplars or worked examples (N = 8). Written feed-back information was most often provided by
peers during peer review or peer assessment (N = 13) and in eight interventions by lecturers; five
interventions combined both strategies. All the interventions that provided feed-forward informa-
tion instructed students to revise their drafts (N = 13).
Finally, with respect to the participants in the dialogue, most interventions used the student–
lecturer format (N = 17), although the peer-to-peer dialogue was also used frequently (N = 15); the
majority of the studies applied both formats (N = 13). Of the nine studies that provided students
with all three feedback elements, seven used both the lecturer–student and the peer-to-peer dia-
logue format.
Criteria Exemplars Training or Written Written Revision Student – Lecturer – Combined + - 0 Mab TAb DAb
or worked instruction feedback from feedback of draft Student Students
examples lecturer from peers
Other notes: = present; n = number of participants. N = number of elements; ? = information not available. + = positive outcomes; - = negative outcomes; 0 = no effect.
aOrdered from most to least feedback elements used (per feed-up, feed-back and feed-forward).
101
Table 2. Overview of the data collection methods used to capture student perceptions and other
student outcomes (N = 19).
Study design
Single group, post-test-only 58% (N = 11)
Two groups, post-test-only 26% (N = 5)
Single group, pre- and post-test 11% (N = 2)
Two groups, pre- and post-test 5% (N = 1)
Data sources
Students 100% (N = 19)
Lecturers 11% (N = 2)
this review were predominantly post-test designs, using a single group, possibly because most stud-
ies investigated the intervention in the course of a running educational programme. Potential ethical
issues, such as offering the same programme or the same quality of education to each student, could
have prevented the use of pre-test/post-test designs. Post-test designs, however, make it hard to
determine the effectiveness of the intervention, because it is not clear what the pre-test conditions
were (Creswell, 2014). Although the review shows predominantly positive self-perception, one
needs to be careful in interpreting this finding. The positive perceptions might not be related to con-
crete improved academic writing skills.
This review has two major limitations. The first is the inadequate provision of relevant informa-
tion in the included articles. Although this review provides improved insight into interventions
containing face-to-face dialogue, it could not establish the effectiveness of the separate feed-up,
feed-back and feed-forward features of the interventions and more exclusively the content and
effectiveness of the face-to-face dialogue. While this review shows that interventions specifically
including face-to-face dialogues mostly work well, the investigated studies provide very little
insight into why and under what conditions this may be the case. Second, categorizing various
educational strategies as feed-up, feed-back or feed-forward information is to some extent arbi-
trary. For example, criteria and exemplars were categorized as feed up, but criteria and exemplars
could also give students suggestions on how to revise their text or move forward (feed-forward
information). Furthermore, revision was categorized as feed forward, however, in practice revision
can also be seen as the way or the result of how to proceed or improve. So, there might be some
overlap between the various feed-up, feed-back and feed-forward strategies.
For future research, we recommend specifically investigating the content and effectiveness of
face-to-face dialogue in the process of improving academic writing skills. More experimental
study designs, for example, two group, pre-test/post-test designs including qualitative methods
could establish why and under what conditions these dialogues work best. Besides measuring stu-
dent perceptions, other outcome measurements such as marks or dialogue content analysis should
be considered. An interesting aspect for future study could be the long-term impact of face-to-face
dialogue on students’ writing skills. Finally, to determine the instructiveness of face-to-face dia-
logue, it is necessary to investigate the related instruction or facilitation method.
The implications of our findings for educational practice in higher education, especially for
course designers, are twofold. First, from the student’s perspective, face-to-face dialogue in an
intervention that includes feed up, feed back and/or feed forward seems to help the process of
learning to write academic material. Second, this review provides concrete examples of feed-up,
feed-back and feed-forward strategies including face-to-face dialogue that can be helpful when
designing educational interventions to enhance student learning of academic writing skills, particu-
larly the use of criteria and/or worked examples.
To conclude, our review has demonstrated that feedback dialogue interventions in the context of
academic writing are helpful in most cases according to student perceptions and other outcome meas-
urements such as marks or text analysis. Although face-to-face dialogue appears to support this pro-
cess, the question of why and under which specific conditions it is effective needs further research.
Acknowledgements
The authors would like to acknowledge the thoughtful critique offered by the reviewers and editor of this
article. Furthermore, we thank Angelique van den Heuvel and Ragini Werner for editing this manuscript.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Schillings et al. 105
References
Baker KM (2016) Peer review as a strategy for improving students’ writing process. Active Learning in
Higher Education 17(3): 179–92.
Black P and Wiliam D (2009) Developing the theory of formative assessment. Educational Assessment
Evaluation and Accountability 21(1): 5–31.
Bloxham S and Campbell L (2010) Generating dialogue in assessment feedback: Exploring the use of interactive
cover sheets. Assessment & Evaluation in Higher Education 35(3): 291–300.
Bloxham S and West A (2007) Learning to write in higher education: Students’ perceptions of an intervention
in developing understanding of assessment criteria. Teaching in Higher Education 12(1): 77–89.
Boscolo P, Arfé B and Quarisa M (2007) Improving the quality of students’ academic writing: An intervention
study. Studies in Higher Education 32(4): 419–38.
Boud D and Molloy E (2013) Rethinking models of feedback for learning: The challenge of design. Assessment
& Evaluation in Higher Education 38(6): 698–712.
Boud D, Lawson R and Thompson D (2013) Does student engagement in self-assessment calibrate their
judgement over time? Assessment & Evaluation in Higher Education 38(8): 941–56.
Boud D, Lawson R and Thompson D (2015) The calibration of student judgement through self-assessment:
Disruptive effects of assessment patterns. Higher Education Research & Development 34(1): 45–59.
Bunce L, Baird A and Jones S (2017) The student-as-consumer approach in higher education and its effects
on academic performance. Studies in Higher Education 42(11): 1958–78.
Caffarella RS and Barnett BG (2000) Teaching doctoral students to become scholarly writers: The importance
of giving and receiving critiques. Studies in Higher Education 25(1): 39–52.
Carless D (2006) Differing perceptions in the feedback process. Studies in Higher Education 31(2): 219–33.
Carless D and Boud D (2018) The development of student feedback literacy: Enabling uptake of feedback.
Assessment & Evaluation in Higher Education 43: 1315–25.
Carless D and Chan KKH (2017) Managing dialogic use of exemplars. Assessment & Evaluation in Higher
Education 42(6): 930–41.
Carless D, Salter D, Yang M, et al. (2011) Developing sustainable feedback practices. Studies in Higher
Education 36(4): 395–407.
Cartney P (2010) Exploring the use of peer assessment as a vehicle for closing the gap between feedback
given and feedback used. Assessment & Evaluation in Higher Education 35(5): 551–64.
Carver M (2017) Limitations of corrective feedforward: A call for resubmission practices to become learning-
oriented. Journal of Academic Writing 7(10): 1–15.
Chalmers C, Mowat E and Chapman M (2017) Marking and providing feedback face-to-face: Staff and stu-
dent perspectives. Active Learning in Higher Education 19(1): 35–45.
Cloutier C (2016) How I write: An inquiry into the writing practices of academics. Journal of Management
Inquiry 25(1): 69–84.
Connor U and Asenavage K (1994) Peer response groups in ESL writing classes: How much impact on
revision? Journal of Second Language Writing 3(3): 257–76.
Creswell JW (2014) Educational Research: Planning, Conducting, and Evaluating Quantitative and
Qualitative Research. Harlow: Pearson Education.
Crossman JM and Kite SL (2012) Facilitating improved writing among students through directed peer review.
Active Learning in Higher Education 13(3): 219–29.
Duncan N (2007) ‘Feed-forward’: Improving students’ use of tutors’ comments. Assessment & Evaluation in
Higher Education 32(3): 271–83.
Elander J (2002) Developing aspect-specific assessment criteria for examination answers and coursework
essays in psychology. Psychology Teaching Review 10: 31–51.
Elander J, Harrington K, Norton L, et al. (2006) Complex skills and academic writing: A review of evidence
about the types of learning required to meet core assessment criteria. Assessment & Evaluation in Higher
Education 31(1): 71–90.
Elton L (2010) Academic writing and tacit knowledge. Teaching in Higher Education 15(2): 151–60.
Etherington S (2008) Academic writing and the disciplines. In: Friedrich P (ed.) Teaching Academic Writing.
London: Continuum, pp. 26–58.
106 Active Learning in Higher Education 24(2)
Price M, Handley K, Millar J, et al. (2010) Feedback: All that effort, but what is the effect? Assessment &
Evaluation in Higher Education 35(3): 277–89.
Qualifications and Curriculum Authority (QCA) (2000) Available at: www.qca.org.uk/qualifications
/types/603.html (accessed 30 August 2018).
Rae AM and Cochrane DK (2008) Listening to students: How to make written assessment feedback useful.
Active Learning in Higher Education 9(3): 217–30.
Reese-Durham N (2005) Peer evaluation as an active learning technique. Journal of Instructional Psychology
32(4): 338–45.
Robinson S, Pope D and Holyoak L (2013) Can we meet their expectations? Experiences and perceptions of
feedback in first year undergraduate students. Assessment & Evaluation in Higher Education 38(3): 260–72.
Ruegg R (2015) Differences in the uptake of peer and teacher feedback. RELC Journal 46(2): 131–45.
Schartel SA (2012) Giving feedback – An integral part of education. Best Practice & Research Clinical
Anaesthesiology 26: 77–87.
Shute V (2008) Focus on formative feedback. Review of Educational Research 38(6): 631–45.
Sritrakarn N (2018) A comparison of teacher’s and senior students’ feedback: Student attitudes and their
writing improvement. The Journal of Asia TEFL 15(2): 329–48.
Sultan N (2013) British students’ academic writing. Industry & Higher Education 27(2): 139–47.
Tai J, Ajjawi R, Boud D, et al. (2017) Developing evaluative judgement: Enabling students to make decisions
about the quality of work. Higher Education 76: 467–81.
Taras M (2001) The use of tutor feedback and student self-assessment in summative assessment tasks: Towards
transparency for students and for tutors. Assessment & Evaluation in Higher Education 26(6): 605–14.
Taras M (2003) To feedback or not to feedback in student self-assessment. Assessment & Evaluation in
Higher Education 28(5): 549–65.
Thurlings M, Vermeulen M, Bastiaens T, et al. (2013) Understanding feedback: A learning theory perspec-
tive. Educational Research Review 9: 1–15.
To J (2016) ‘This is not what I need’: Conflicting assessment feedback beliefs in a post-secondary institution
in Hong-Kong. Research in Post-Compulsory Education 21(4): 447–67.
To J and Carless D (2016) Making productive use of exemplars: Peer discussion and teacher guidance for
positive transfer of strategies. Journal of Further and Higher Education 40(6): 746–64.
Tribble C and Wingate U (2013) From text to corpus – A genre-based approach to academic literacy instruc-
tion. System 41: 307–21.
Tsui ABM and Ng M (2000) Do secondary L2 writers benefit from peer comments? Journal of Second
Language Writing 9(2): 147–70.
Van den Berg I, Admiraal W and Pilot A (2006) Designing student peer assessment in higher education:
Analysis of written and oral peer feedback. Teaching in Higher Education 11(2): 135–47.
Van der Schaaf M, Baartman L, Prins F, et al. (2013) Feedback dialogues that stimulate students’ reflective
thinking. Scandinavian Journal of Educational Research 5(3): 227–45.
Vickerman P (2009) Student perspectives on formative peer assessment: An attempt to deepen learning?
Assessment & Evaluation in Higher Education 34(2): 221–30.
Wingate U (2006) Doing away with ‘study skills’. Teaching in Higher Education 11(4): 457–69.
Wingate U (2012) Using academic literacies and genre-based models for academic writing instruction: A
‘literacy’ journey. Journal of English for Academic Purposes 11: 26–37.
Wingate U (2014) Approaches to acculturating novice writers into academic literacy. In: Lyda A and Warchl
K (eds) Occupying Niches: Interculturality, Cross-Culturality and Aculturality in Academic Research.
Cham: Springer International Publishing, pp. 104–18.
Wingate U and Tribble C (2012) The best of both worlds? Towards an English for academic purposes
/academic literacies writing pedagogy. Studies in Higher Education 37(4): 481–95.
Wingate U, Andon N and Cogo A (2011) Embedding academic writing instruction into subject teaching: A
case study. Active Learning in Higher Education 12(1): 69–81.
Yucel R, Bird FL, Young J, et al. (2014) The road to self-assessment: Exemplar marking before peer review
develops first-year students’ capacity to judge the quality of a scientific report. Assessment & Evaluation
in Higher Education 39(8): 971–86.
108 Active Learning in Higher Education 24(2)
Zhang F, Schunn CD and Baikadi A (2017) Charting the routes to revision: An interplay of writing goals, peer
comments, and self-reflections from peer reviews. Instructional Science 45(5): 679–707.
Zhu Q and Carless D (2018) Dialogue within peer feedback processes: Clarification and negotiation of
meaning. Higher Education Research & Development 37(4): 883–97.
Zhu W (2004) Faculty views on the importance of writing, the nature of academic writing, and teaching and
responding to writing in the disciplines. Journal of Second Language Writing 13(1): 29–48.
Author biographies
Marlies Schillings is a Lecturer who is currently undertaking a PhD in the School of Health Professions
Education at Maastricht University, The Netherlands. Her educational and research interests involve writing
curricula in the Faculty of Health, Medicine and Life Sciences. Address: Department of Nutrition and
Movement Sciences and School of Health Professions Education (SHE), Maastricht University, P.O. Box
616, 6200 MD Maastricht, The Netherlands. [email: [email protected]]
Herma Roebertsen is a Senior Lecturer and Educational Adviser at Maastricht University, in the Faculty of
Health, Medicine and Life Sciences. Address: Department of Nutrition and Movement Sciences and School
of Health Professions Education (SHE), Maastricht University, P.O. Box 616, 6200 MD Maastricht, The
Netherlands. [email: [email protected]]
Hans Savelberg is a Professor of Evolving Academic Education at Maastricht University. He is director of
Education for Biomedical Sciences in the Faculty of Health, Medicine and Life Sciences at Maastricht
University. Address: Department of Nutrition and Movement Sciences and School of Health Professions
Education (SHE), Maastricht University, P.O. Box 616, 6200 MD Maastricht, The Netherlands. [email:
[email protected]]
Diana Dolmans is a Professor of Innovative Learning Arrangements at Maastricht University. She has published
on problem-based learning, faculty development and quality assurance in higher education. Address: Department
of Nutrition and Movement Sciences and School of Health Professions Education (SHE), Maastricht University,
P.O. Box 616, 6200 MD Maastricht, The Netherlands. [email: [email protected]]