WOORKBOOK For Guide
WOORKBOOK For Guide
Disclaimer
While care has been taken in the preparation of this material, DIISRTE and the original developer do not warrant that
any licensing or registration requirements specified here are either complete or up-to-date for your State or Territory.
DIISRTE and the original developer do not accept any liability for any damage or loss (including indirect and
consequential loss) incurred by any person as aresult of relying on the information contained in this material.
The Commonwealth, through the Department of Industry, Innovation, Science, Research and Tertiary Education, does
not accept any liability to any person for the information or advice (or the use of such information or advice) which is
provided in this material or incorporated into it by reference. The information is provided on the basis that all persons
accessing this material undertake responsibility for assessing the relevance and accuracy of its content. No liability is
accepted for any information or services which may appear in any other format. No responsibility is taken for any
information or services which may appear on any linked websites.
Published by: Innovation and Business Industry First published: July 2012
Skills Council Ltd
1st edition version: 1
Level 11
176 Wellington Pde Release date: July 2012
East Melbourne VIC 3002 Printed by: Fineline Printing
Phone: +61 3 9815 7000 130 Browns Road
Fax: +61 3 9815 7001 Noble Park VIC 3174
Email: [email protected]
www.ibsa.org.au
ISBN: 978-1-922115-42-3
Table of contents
Welcome
Introduction......................................................................................................................1
Knowledge Bank.........................................................................................................1
Sections in this workbook ..........................................................................................2
Using this workbook ...................................................................................................3
Recommended resources ..........................................................................................4
Your assessment for this unit ....................................................................................5
Application
Resources ..................................................................................................................... 71
Introduction
This Participant Workbook supportsBSBRES801AAInitiate and lead applied research.The
unit is a core unit inTAE80110Vocational Graduate Diploma of Adult Language, Literacy
and Numeracy Leadership. It can also be delivered and assessed as a stand-alone unit. It
has been imported from the Business Services Training Package.
This unit describes the performance outcomes, skills and knowledge required to plan,
conduct and report on applied research to influence strategic practices and outcomes
within an organisational context.
The unit also covers constructing an applied research strategy, using a range of applied
research techniques, and analysing and presenting findings.
In this workbook the activities and assessment materials for the unitBSBRES801AInitiate
and lead applied researchare contextualised for the TAE80110Vocational Graduate
Diploma of Adult Language, Literacy and Numeracy Leadership.
Depending on the organisation in which they work, and their role in that organisation,
leaders and managers in the field of language,literacy and numeracy (LLN) will have
varied purposes for applied research activities and will also have different approaches.
Applied research in LLN can be used to improve outcomes in both LLN and broader
vocational education and training (VET) programs. Research may focus on workplace
practice, learner outcomes, orteacher practice.The activities and resources in this
workbook are designed to be applied to a range of LLN contexts in the VET sector and
include a range of methods.
Knowledge Bank
This Knowledge Bank contains a number of topic areas that have been identified as
common across the core and elective units of TAE80110 Vocational Graduate Diploma of
LLN Leadershipand the TAE70110 Vocational Graduate Certificate of Adult Language,
Literacy and Numeracy Practice.
The five topic areas are:
The national VET system
Learner characteristics
Adult language, literacy and numeracy teaching theories
The English language system and the ACSF
Monitoring and evaluation
Each topic area has information, research activities and readings to support you in
building or validating your existing knowledge about aspects of delivery of LLN in the VET
sector.
The information in the Knowledge Bank is directly connected to the practical application
of the knowledge outlined in each of the Participant Workbooks for each unit. A fine line
exists between information and knowledge. It is not intended that you memorise the
various pieces of information in each topic area for its own sake. Rather, the intention of
the Knowledge Bank is to provide you with an opportunity to build a powerful set of
perspectives and practical knowledge that you can apply in your particular practice
environment, and to enhance your capacity to deliver quality teaching and assessment
services.
The research activities can be used as formative assessments and to provide evidence
for the portfolios in some of the Assessment Tasks for this unit.
Application
This section provides activities to help you apply what you have learnt. Your facilitator may
also provide extra activities to support your learning as you are working through the unit.
Your facilitator will also provide advice on which activities contribute towards assessment.
Readings
This section provides reading material linked to the learning topics. Your facilitator may
lead discussions around some of these readings, or you may want to discuss them with
colleagues or other learners, or reflect on them in relation to your own training
organisation.
References
Throughout the workbook you will be directed to websites for additional information.
Given that web addresses can change you may need to check the link and use search
tools to find updated links.
Glossary
The National Centre for Vocational Education Research (NCVER) maintains an extensive
glossary of VET terms. You can access it online to clarify the meaning of terms used in
this workbook. <http://www.ncver.edu.au/resources/glossary.html>.
Context
To complete this unit you need a learning and assessment environment where you can
access information and apply your skills. This environment is called the practice
environment.
If you are already employed in an organisation that delivers training or assessment, your
workplace will most likely be your practice environment. If not, your facilitator can help to
find you a suitable practice environment.
If you do not have direct access to a practice environment your facilitator may need to
help you by providing simulations or case studies that meet the assessment requirements
for this unit. Throughout this workbook these environments will be referred to as your
practice environment.
Recommended resources
Essential resources
Education Resources Information Center(ERIC), viewed April 2012,
<http://www.eric.ed.gov>. Database of education literature.
National Centre for Vocational Education Research (NCVER), viewed April 2012,
<http://www.ncver.edu.au/>.
National Research and Development Centre for Adult Literacy and Numeracy
(NRDC), viewed April 2012,<http://www.nrdc.org.uk>.
Australian Government, National Health and Medical Research Council, 2007,
Australian code for the responsible conduct of research (summary), viewed April
2012, <http://www.nhmrc.gov.au/research/research-integrity/summary-
australian-code-responsible-conduct-research>.
Further reading
Bell, J.,2005, Doing your research project: A guide for first-time researchers in
education, health and social science, 4th edn, McGraw Hill International (UK) Ltd,
Maidenhead.
Cohen, L., Manion, L., and Morrison, K., 2000, Research methods in education, 5th
edn, Routledge Farmer, London.
Denscombe, M., 2010,The good research guide for small scale social research
projects, (4thedn.), Open University Press, Buckingham.
McKay, S., 2007, Researching second language classrooms, Laurence Erlbaum
Associates Inc., Mahwah, New Jersey.
Richards, J. C. and Lockart, C., 1994, Reflective teaching in second language
classrooms, Cambridge University Press, NY.
Patton, M. Q., 2002, Qualitative research and evaluation methods, 3rd edn, Sage
London.
This unit might be assessed on its ownor together with other units in the
TAE80110Vocational Graduate Diploma of Adult Language, Literacy and Numeracy
Leadership.
The context of a research project will influence the size and nature of the
investigation. Investigation of a research question may have a classroom
focusand involve teachers and learners,for example, looking at aspects of
effective teaching and learning. It may be an individual pursuit or a
Note
collaborative one involving a number of people in an educational
As you work through
the activities in Topic organisation.It may extend across organisations to a system-wide
1, you should consider investigation. It could be practitioner-led, or the result of a requirement for a
potential research funding body. It may involve a small sample or snapshot of practice or be a
within your large-scale undertaking over a period of time.
organisation. Discuss
this with others, Context does not just refer to the site and the subjects of the research but
considering the needs also to the policy framework within which it is conducted. The policy
of the organisation
environment of an organisation will influence the framing of the research
and available
resources. project and the questions being investigated. A researcher‘s individual views
will also influence this.
Some of the key resources you will use in this unit are the research reports
available from NCVER. Consider the following statements from the NCVER
Call for papers for its No frillsconference
(<http://www.nofrills.ncver.edu.au/>):
Research can help influence policy and practice and ensure a better
education and training system for all people living in Australia.
NCVER invites practitioners and researchers to share their research and
knowledge at the 21st National Vocational Education and Training
Research Conference.
NCVER seeks presentations that rely on sound evidence-based research
rather than descriptive or opinion-based work.
Consider the following statement on practitioner ‗intuition‘:
Though no one would question the value of intuition based on practical
experience, complete reliance on anecdotal evidence and personal
impressions in language pedagogy has serious drawbacks. In particular,
these sources cannot resolve many of the crucial questions that face
classroom instructors nor do they always lead to valid, productive
classroom activities.1
1. Discuss with colleagues the underlying assumptions about the role of
research.
2. What is evidence-based research?
3. What do you consider constitutes ‗rich data‘?
Think about these questions as you work through the activities in the
workbook. Keep a journal or other record of the kinds of research and data
you might need to use in your work setting. Keep a list of terms and concepts
which you come across from policy environment and theoretical
underpinnings of LLN research.Keep a diary or notebook of your beliefs about
teaching and learning LLN, noting why you have developed these beliefs. Try
to find links in what you read to ideas and viewpoints similar to your own.
Policy is covered in the unit TAELLN801AAnalyse policy and formulate
strategic language, literacy and numeracy response. It may be useful to refer
to the participant workbook for this unit when completing some of the
research tasks and activities below.
1T. Derwing, and M. J. Munro, 2005, ‘Second language accent and pronunciation teaching: A research-
based approach’, TESOL Quarterly, 39, p.379.
1. During the course of preparing for assessment in this unit you will
access research on the following websites:
a. National Centre for Vocational Education Research (NCVER),
<http://www.ncver.edu.au/>.
b. NCVER, ‗Adult literacy resource‘,
<http://www.adultliteracyresource.edu.au/>.
c. National Research and Development Centre for Adult Literacy
and Numeracy (NRDC), <http://www.nrdc.org.uk/>.
d. Research and Practice in Adult Literacy (RaPAL),
<http://www.literacy.lancs.ac.uk/rapal/index.htm>.
Spend some time examining the websites and research papers available.
Select some research reports which are relevant to your work setting or
research interests, download and add them to your research folder.
How do these accord with your aims as a researcher and, if relevant, those
of your organisation?
Refer also to the RaPAL research aims:
RaPAL encourages a broad range of collaborative and reflective research
involving all participants in literacy work as partners ...
... We critically examine the assumptions on which ABE practice is based,
through encouraging and publicising a broad range of reflective research.
Such research helps us to articulate the theory behind our practice; to
keep asking questions about the significance of literacy in people’s lives;
to challenge the political uses of common myths about literacy ...
3. Discuss with colleagues the research reports you have accessed and
the purpose behind them.
4. Read and record notes on the key messages, preface and/or the
introductions from the following seven research reports. Use the
links provided or access them in the IBSA online readings folder
where this indicated:
a. Nechvoglod, L. and Beddie,F., 2010, Hard to reach learners:
What works in reaching them and keeping them, Adult,
Community and Further Education Board, Melbourne, viewed
April 2012,
<http://www.skills.vic.gov.au/__data/assets/pdf_file/0003/
350085/DOC-CENTRAL_n1530129_v1_Capacity_
35_RHL_Attachment_1_Hard_to_Reach_Learners__what_
works_in_reaching_and_keeping_them.pdf>.
b. Barton, D., Appleby, R., Hodge, R., Tusting, K., and Ivanic, R.,
2006, Relating adults lives and learning: participation and
engagement in different settings, National Research and
Development Centre for Adult Literacy and Numeracy (NRDC),
London, viewed April 2012,
<http://www.nrdc.org.uk/publications_details.asp?ID=48>.Thi
s is included in the IBSA online readings folder.
c. Clarkson, C. and Scurfield, V., 2007, Practitioners leading
research: Learner-centred action research at Dewsbury College
National Research and Development Centre for Adult Literacy
and Numeracy (NRDC), London, viewed April 2012
<http://www.nrdc.org.uk/publications_details.asp?ID=94#>.
This is included in the IBSA online readings folder.
d. Condelli, L., Wrigley, H. S., Yoon, K., Seburn, M., and Cronen,
S., 2003, What works study for adult ESL literacy students, US
Department of Education Washington, DC. This is included in
the IBSA online readings folder.
e. Leith, M., 2012, How learning English facilitates integration for
adult migrants: the Jarrah Language Centre experience,
NCVER, viewed April 2012,
<http://www.ncver.edu.au/publications/2461.html>. This is
included in the IBSA online readings folder.
f. Misko, J. and Priest, S., 2009, Students‘ suggestions for
improving their vocational education and training experience,
NCVER, viewed April 2012,
<http://www.ncver.edu.au/publications/2202.html>. This is
included in the IBSA online readings folder.
g. Roach, K., 2008, ‗Teaching literacy to deaf adults: Maxims for
mapping unchartered territory‘, in A. Burns, and J. Burton,
(eds), 2008, Language teacher research in Australia and New
Zealand, TESOL Inc., Alexandria, VA.
Research traditions
Before developing your own research strategy or proposal and selecting
research methods which are suited to your context, it is also relevant to
understand educational research traditions, in particular those used in LLN
research. It is important to have an understanding of the influence of theories
and standpoints and approaches to research. It is also important to
understand your role as a researcher: the beliefs of the researcher are
influential in the framing of research questions(McKay 2005).
2B. P. Norton, 1995, ‘The theory of methodology in qualitative research’, in TESOL Quarterly, vol. 29,
no. 3, p.575.
3D. Nunan, 1992, Research methods in language learning, Cambridge University Press, Cambridge,
p. 213.
(<http://www.ncver.edu.au/research/research2/five_priorities.html>)
Review these priorities and make notes on how they could impact on
4J. McDonough, and S. McDonough, 1997, Research methods for English language teachers, Arnold,
London, p. 60..
Using each of the four reports you have selected for the Research task on
page 13 in the research task, Fundamentals — purpose, audience,
question, answer the following questions:
1. Is there an identifiable or stated theoretical view or belief which has
helped to frame the question or problem?
2. Identify the terms or concepts explored by the authors in their review
of the literature on their chosen topic.
3. How did the researchers approach finding out what has already been
written on the subject?
Applied research (in education and in LNN) has its own terminology. Start a
glossary of terms by identifying the key ‗research‘ terms used in each of
the reports. Collect others as you read more widely on your research topics.
Do some further reading on some of the specific terms and discuss them
with colleagues.
5L. Cohen, L. Manion, L., and K. Morrison, 2000, Research methods in education, 5th edn, Routledge
Farmer, London, p.73.
6M. Cooke, 2006, ‘When I wake up I dream of electricity’: the lives, aspirations and ‘needs’ of Adult ESOL
learners, Linguistics and Education, vol. 17, no. 1, pp. 56–73.
7H.Beder and P. Medina, 2001, Classroom dynamics in adult literacy education,
NCSALL,<http://ncsall.net/fileadmin/resources/research/report18.pdf>.
Available in IBSA online reading folder
Condelli and Wigley, whose literacy research investigated ‗what works for
learners‘,argue that it is important to make research accessible to
practitioners. They describe good evidence-based research as a combination
of scientific methods and professional wisdom of those in the field:
In our view, the best research design is a mixed method design that
integrates qualitative and quantitative research. This type of design
begins with a strong research methodology with quantitative methods that
are enhanced with qualitative measures... Qualitative methods, such as
interviews and case studies, improve the design by providing data that
can give insights into how findings work and how findings can be
translated into practice.8
1. Read:
a. Condelli, L., Wrigley, H. S., Yoon, K., Seburn, M., and Cronen,
S., 2003, What works study for adult ESL literacy students,US
Department of Education Washington, DC.
2. Note their use of both research traditions. What do you consider are
the strengths and weaknesses of each approach?Look at this
question from the point of view of the LNN practitioner as reader.
8L.Condelli, and H. S. Wrigley, 2004, Real world research: Combining qualitative and quantitative
research for adult ESL, paper presented to NRDC Second International Conference for Adult Literacy and
Numeracy, Loughborough, March 2004, viewed April 2012,
<http://www.leslla.org/files/resources/RealWorldResearch.doc>, p. 2.
Action research
There are a number of reflective practice studies from the adult LLN field
which illustratehow to conduct action research:
The National Research and Development Centre for Adult Literacy and
Numeracy (NRDC) in the UK,
<http://www.nrdc.org.uk/publications_details.asp?ID=94#>
the Adult Migrant English Program (AMEP) in Australia:
<http://www.ameprc.mq.edu.au/resources/prospect>
Prospect journal/volume16no3 December 2001 and Prospect
journal/volume15, no 3December2000 have some excellent examples.
Professor Anne Burns‘ website,
<http://www.professoranneburns.com/>, is a repository of
presentations and publications on how to do action research.
Allwright, R. L., andBailey, K. M., 1991, Focus on the language
classroom: an introduction to classroom research for language
teachers, Cambridge University Press, Cambridge. The authors
describe several principles for exploratory teaching practice and action
research.
Clarkson, C. andScurfield, V., 2007, Practitioners leading research:
Learner-centred action research at Dewsbury College National
Research and Development Centre for Adult Literacy and Numeracy
(NRDC), London, viewed April 2012
<http://www.nrdc.org.uk/publications_details.asp?ID=94#>.This
report describes an action research project.
Ethnographic research
Research task: Ethnographic research guidelines
Research design
Nunan (1992)9suggests the following guide to developing and refining a
research project.
General area
Research question(s)
Key constructs
Justification
Subjects
Procedure
Methods
Type of data
Type of analysis
Outcomes
Anticipated problems
Possible solutions
Resources required.
10S.
McKay, 2007, Researching second language classrooms, Laurence Erlbaum Associates Inc.,
Mahwah, New Jersey.
11 ibid.
12L.
Cohen, L. Manion, and K. Morrison, 2000, Research methods in education, 5th edn, Routledge
Farmer, London.
Ethical considerations
Whether your research is your own personal work, or is being conducted in an
organisational context, you will need to ensure you have a sound working
knowledge of privacy and confidentialityas they apply to research:
Privacy: There are specific requirements regarding privacy of personal
information. Before starting any research you need to identify and
access the requirements. You will need,for example, to let research
participants know and agree to your proposed record-keeping. To what
extent will records be kept confidential?Who else may have access to
research records?
Codes of conduct/c odes of practice: These include the Australian
Activity 1:Part 1 B to D Code for the Responsible Conduct of Research, plus other codes
and Part 2 developed by organisations of researchers such as the Australian
You are ready to Vocational Education and Training Research Association (AVETRA).
complete the rest of
the activity ‘Research They ensure that research is conducted with honesty and
Design’ in the integrity.Guidelines cover such things as respect for research
Application section of
the Workbook.
participants, for example, informing participants that participation is
voluntary, and respect for other researchers, by accurately
acknowledging others‘ research.
If your organisation already has its own research policy and procedures you
will need to access these and follow requirements in collecting and preparing
evidence for your assessment tasks.
A thorough understanding of privacy and ethical research considerations will
help to develop sound research policy and procedures. It will influence how
the research question is framed, data collection methods, your processes in
relation to research subjects, through to the production and presentation of
research.
Scenario
You are conducting a small research project for your organisation on learner
attendance patterns. The purpose is to improve attendance by increasing
flexibility in your organisation in relation to the timetable and attendance
requirements. You need to establish what the barriers to attendance are at
the moment and elicit information from learners on what would make
attendance easier for them. You plan to access recent attendance records
for all of the LLN classes, and then to conduct a survey and record interviews
with a representative sample of students. Some of the students are recently-
arrived learners with limited English communication skills. Most of the
students have school-age children.
Part 1: Privacy
1. Refer to the following documents:
Australian Government, Office of the Australian Information
Commissioner, ‗10 steps guide to protecting your personal
information‘,
<http://www.privacy.gov.au/materials/types/guidelines/view/
6850>.
a. Applied Linguistics Association of Australia (ALAA),
1998,Recommendations on good practice in applied
linguistics,ALAA,<http://alaaorgau.admin.melbourneitwebsites.c
om/
files/alaas_statement_of_good_practice.pdf>. Available in IBSA
online reading folder.
b. Australian Vocational Education and Training Research
Association (AVETRA)Code of
practice,<http://www.avetra.org.au/documents/CodeofPractice.
pdf>.
2. Discuss the scenarioabove with colleagues: how would you implement
the ten steps to protecting other peoples‘ privacy in such a research
activity? Outline the procedures you would put in place to ensure you
meet these requirements. For example, what arrangements will you
make for storage of data? You should also refer to specific privacy
policies required in your workplace.
You will examine the techniques and analysis methods through detailed study
of LLN research examples. As you find techniques you wish to use, record
details of how they are constructed and analysed.
This topic covers:
literature reviews
research methods and data collection
using technology and the Internet.
17M. Q. Patton, 2002, Qualitative research and evaluation methods, 3rd edn, Sage, London, p. 10.
18J.D. Carpentieri, J. Litster, J., and L. Frumkin, 2010, Adult numeracy: A review of research, NRDC,
<http://www.nrdc.org.uk/publications_details.asp?ID=170#>. p. 114.
Literature reviews
A literature review is about writing the history (briefly, of course) of
approaches to a subject and to the methodology of previous investigations to
establish the crucial questions lurking under the surface. It is there to
establish the ancestry and the originality of the new work.19
Reading what others have written on your topic is essential to research.It not
only provides the necessary background to your topic, acknowledging what
others have already contributed, but will inform the next steps in any
research project. Once you have completed a review of the literature you will
be in a position to refine your research question. It is at this point where
seeking feedback from others is useful in helping you decide how you will
proceed. Your research question or methodologies may need to be re-
thought. A literature review can also be used strategically to involve critical
thinkers in your research project by referencing or re-examining their work, or
by seeking their advice and feedback on your conclusions.
One of your assessment tasks for this unit is the development of a literature
review. Careful planning and setting up good record-keeping is an essential
first step.
Referencing
Before starting a review, you need to check you have the fundamental skills
to compile a list of references.The ability to use referencing effectively is key
to keeping your material in order. Referencing is also important when
presenting research to others so that they can find the material you are
referring to, and can follow your thinking. This is especially important so that
anyone who uses your research can contribute to further investigations.As a
starting point it is necessary to find out which reference system you should
use in your given circumstance, for example Harvard, or American
Psychological Association (APA).
You may be required to a meet specific referencing requirements. If not, a
possible starting point is:
Angeli, E., et al., 2010, General format, Purdue Online Writing
Laboratory, viewed April 2012,
<http://owl.english.purdue.edu/owl/resource/560/01/>. This
resource covers all the technical skills required to present your
references in an accurate way and uses the APA style.
This section covers a range of methods and techniques. The following table
lists the data-collection techniques covered in this workbook and notes some
of the restrictions associated with them. As you read about the techniques
you may add notes under the list of restrictions and also list some of the
advantages of the techniques. As noted above, the combining of techniques
can mitigate some of these issues.
Think about the data they collected. From your point of view as a researcher,
how do-able would each of these be within your setting?
You will review a number of research reports throughout this section to
determine what research methods and techniques are used in LLN. You
should also note additional examples as you read more widely.
Beder and Medina (2001)23 describe their sampling processes for learner
case studies which would describe the diversity of literacy education. Once
they had decided on the categories above, they were able to select examples
of each class type. In designing and administering interviews, surveys,
conducting focus groups and case studies, you will need to think about who
to involve and how many participants you will need. Should you use a sample
or the whole population? How will you decide on selection of a sample?
Purposive sampling is one technique where participants are selected as
typical or representative. Adequate description and explanation of any
selection process is essential and should include details about what
restrictions influenced the process.
For further information on sampling, read:
Denscombe, M., 2010,The good research guide for small scale social
research projects, (4thedn), Open University Press, Buckingham.
25ibid., p. 138.
Case studies
A ‗case‘ in LLN research can refer to a person or group of people (learners,
teachers), or it can refer to a classroom, a program or an organisation. In
larger research projects countries can be used for case studies.The data
collected for case studies can be from one source such as an interview or
journal or from a number of sources.
1. Access:
a. Waterhouse, P. and Virgona, C., 2005, Contradicting the
stereotype:
Case studies of success despite literacy difficulties, viewed
April 2012,
<http://www.ncver.edu.au/publications/1590.html>.
Read through the guidelines for this workplace language case study project
and consider how this differs from the Waterhouse andVirgona project.
3. How practicable is case study research to your work setting?
Access:
Teachers of English to Speakers of Other Languages, Inc (TESOL),
‗Qualitative research: Case study guidelines‘, viewed April 2012,
<http://www.tesol.org/s_tesol/sec_document.asp?cid=476
&did=2153>.
Consider these guidelines and some of the case study reports used in
other research you have read.
Summarise the difficulties which can be encountered in analysing the data
and drawing inference. How did Waterhouse andVirgona present their case
studies in their report?
What measures need to be put in place to ensure an ethical approach
when developing case studies?
26M.Denscombe, 2010, The good research guide for small scale social research projects, (4th edn), Open
University Press, Buckingham, p. 323.
27 ibid., p. 181.
You may have experienced focus groups and interviews with your LLN
learners or with LLN colleagues. You will be aware of the obvious difficulties
in conducting these and in recording the responses. It is important to set up a
structure and protocols before conducting focus groups and interviews.
Read some of the literature on interviews from the reference list. Refer also
to some of the research samples used in Topic 1 which used interviews and
focus groups. Make sure you have a good overview of the essentials for
conducting interviews and focus groups as well as the advantages and
disadvantages of the techniques from the point of view of administering,
recording and analysing data.
Observation
Observation is a very direct and powerful but imperfect form of data
collection. It enabled us to see classroom behavior directly, rather than rely
on secondhand accounts given in interviews. However, it is filtered through
the eyes of the observer, and different backgrounds and interests cause
observers to emphasize slightly different behaviors in their data collection.
Although observation can depict what is happening in a classroom, it cannot
reveal what is going on in the minds of the participants. Thus, in some cases,
we witnessed clearly important behaviors but could not infer motivation. For
example, in several instances, we observed learners sleeping. Were they
exhausted? Were they bored? Was the lesson too easy or difficult?
Observation alone could not answer these questions. Finally, it is always
possible that the presence of the observer influenced the behavior observed.
Because both the learners and our observers were adults, and because close
scrutiny of our field notes did not indicate cases of obvious distortion, we do
not believe that this was a significant problem.
(Beder, H., and Medina, P., 2001, Classroom dynamics in adult literacy
education, NCSALL, viewed April 2012,
<http://ncsall.net/fileadmin/resources/research/report18.pdf>, p.6.)
Internet skills
If you need to brush up on basic research skills, a good starting point is:
Angeli, E., et al., 2010, General format, Purdue Online Writing
Laboratory, viewed April 2012,
<http://owl.english.purdue.edu/owl/resource/560/01/>.
28Bogdan R.C., and Biklen, S. K 1992, Qualitative Research in Education: An Introduction to theory and
methods, New York, Pearson Education, p.153.
29NCVER, ‘Research: NCVER author’s and reference guides’ ,viewed April 2012,
<http://www.ncver.edu.au/research/information/authorguides.html>.
30Le Compte, M.D 2000, ‘Analysing Qualitative Data’, Theory into Practice, Vol. 39, pp146-154,
p. 147.
For example, in a possible research exercise in your workplace, you may have
gathered information from your NESB learners in an effort to find out whether
their learning outcomes are affected by the RTO‘s timetabling decisions. You
may have quantitative data on attainment and non-completion and
qualitative data on student satisfaction but the data may conflict. One
question you will need to consider carefully is whether your interpretation of
‗learning outcomes‘ is the same as that understood by your learners. You
might like to think about how you can verify your interpretation. How have
others, such as Barton et al.(2006)(see IBSA online readings
folder),described similar issues in their research reports?
Triangulation
If you have used several of the data collection techniques covered in Topic 2,
you will be in a position to verify your findings through triangulation.This
means that you should:
… [p]rovide sufficient evidence for your claims or interpretations to make
them clear, credible, and convincing to others. Consider alternate
explanations, and account for results that run contrary to the themes that
emerge or for differences among triangulated sources.32
1. Look at:
2. Clarkson, C. andScurfield, V., 2007, Practitioners leading research:
Learner-centred action research at Dewsbury College National
Research and Development Centre for Adult Literacy and Numeracy
(NRDC), London, viewed April 2012
http://www.nrdc.org.uk/publications_details.asp?ID=94#.In IBSA
online reading folder.
How did they go about drawing themes? What were the themes they
identified? How did these link to their research aims?
31ibid., p. 152.
32Teachers of English to Speakers of Other Languages, Inc (TESOL), ‘TESOL Quarterly research guidelines:
Qualitative research: Case study guidelines’, viewed April 2012,
<http://www.tesol.org/s_tesol/sec_document.asp?cid=476&did=2153>.
3. Access:
Barton, D., 2009, ‗Researching adults‘ lives to understand
engagement and progression‘, in Literacy and Numeracy Studies,
vol. 16, no. 2 and vol. 17, no. 1. This is in the IBSA online readings
folder.
Barton‘s research into adult learners‘ lives drew up ‗Key findings‘.
How are these documented? How does Barton deal with validity in
his account of the key findings? How does he demonstrate that the
research findings accurately reflect people‘s lives?
1. Refer to:
a. Davies, A., 2006, ‗What do learners really want from their EFL
course?‘ELT Journal, vol. 60, no. 1.
b. Prodromou, L., 1992,‗What culture? Which culture? Cross-
cultural factors in language learning‘, ELT Journal, vol. 46, no.
1,pp. 39–50.
Discuss the results of the research. How did they analyse data and draw
valid and reliable conclusions about the learners they surveyed?
2. Review other research reports you have examined and note any
common approaches writers have used when explaining how their
research is valid and reliable.
Reviewing your role as researcher and acknowledging your beliefs and biases
is also an important consideration when it comes to analysis of the data.
Analysis of your research findings may need to refer back to the policy
context, or explain the ‗ideological lens‘ you have used.
Refer to:
Leith, M., 2012, How learning English facilitates integration for adult
migrants: the Jarrah Language Centre experience, NCVER, viewed April
2012, <http://www.ncver.edu.au/publications/2461.html>, pp. 8–10.
This is included in the IBSA online reading folder.
Note how the authorplaces herself and her views in the context of
the research.
34A.Jenkins, R. Ackerman, L. Frumkin, E. Salter, and J. Vorhaus, 2011, Literacy, numeracy and
disadvantage among older adults in England, NRDC, p. 2.
Using the four reportsselected and examined from the seven on pages
12-13, look at how each report was structured.
1. Compare the contents pages of each report. How do they organise
content? What are the similarities and differences?How much is this
due to the audience and purpose of the report?
2. Collect a number of samples.
The NCVER research report checklists are a useful guide when putting a
report together:
<http://www.ncver.edu.au/research/information/templates.html#
Checklists>.
A. Orienting decisions
1. What are the general aims of the research? Identify an organisational or
educational problem or innovation for examination.
2. Who is involved in initiating the research? It may include a specific request by or
contract with a funding body or department in your organisation.
3. Who is the audience for the research?Demonstrate the value of what you are
proposing to your proposed e.g. audience colleagues and your organisation. Does it
have value for the wider VET LLN field?
4. Outline why the research is worth doing including some of the expected outcomes.
5. What research has already been done in this area? Describe this briefly. (Literature
reviews are dealt within Activity 3.)
6. What are the constraints of the research?
7. What is the timeframe for the research?
8. What ethical issues need to be dealt with in conducting the research?
9. What resources are required for the research? Include human and physical
resources such as technology and literature.
35L.
Cohen, L. Manion, and K. Morrison, 2000, Research methods in education, 5th edn, Routledge Farmer,
London, p.74.
C. Data analysis
1. Give an overview of expected analysis activities.
Ethicalissues checklist
Explaining purpose:
How will you explain the purpose of the evaluation and methods? What language
will make sense to participants in the study? What details are critical to share?
What‘s the expected value of your research to the participants?
Promises and reciprocity:
Why should the interviewee participate in the interview? What have you agreed to
do with the research (for example, provide the participant with a copy)? How will
you keep track of this?
Risk assessment:
In what ways, if any, will conducting the interview put people at risk? How will you
describe these potential risks to interviewees? How will you handle them if they
arise? Can you ensure the cultural appropriacy of research tools? How will you
manage this?
Confidentiality:
What are reasonable confidentiality and anonymity considerations? Will names,
locations, and other details be changed? Where will data be stored? How long
will data be maintained? How much will you explain of this to the candidates?
Informed consent:
What kind of informed consent, if any, is necessary for mutual protection? What
are your local organisational guidelines and requirements? What has to be
submitted, under what time lines, for approval, if applicable?
Ask colleagues for feedback on your documents and procedures.Make any adjustments
as a result of consultations.
36 For example, McKay (2005) lists ‘respecting participants’ as an important ethical consideration in
language education research, e.g. using research to benefit learners, and sharing knowledge that comes
from the research with participants.
How would you design the questionnaire, cover letter and instructions for
administrators and respondents?
How much information should you collect?
What timeframe are you working in?
What attendance records will you need if you are looking for patterns? Will this
information guide your questions?
How many students should be involved in the survey? Using Zemke and Kramlinger
1986,on page 20 in the document
at:<http://ohioline.osu.edu/b868/pdf/b868.pdf>, calculate an appropriate
sample size.
Should you use an online survey or paper-based survey? What are the advantages
and disadvantages of both in terms of administering, collecting information and
recording and classifying data?
What questions will you include on your survey? Open-ended or closed, or a
combination of both?
Is each question necessary?Is each question unambiguous (that is, not a double
question or a leading question)? Is each question inoffensive? Can all of the
respondents be expected to understand it? Field test the questions.
How will the questionnaire be analysed? This should be considered before the
questionnaire is administered.
How will you describe the research to the respondents in a cover letter or similar?
How much information is necessary on the purpose and context of the project?
What instructions will be necessary on the questionnaire or survey regarding
returning responses, timeline?
What demographic information is required (and necessary), such as age, country of
origin, language, gender?
What privacy considerations need to be made?
What cultural considerations have to be made?
What processes will need to be put in place to keep data secure?
What will you give back to the respondents once the research is completed?
Resources
The following resources are recommendedfor this unit.
It is recommended that you also select relevant research reports from the readings listed
in other units from the TAE80110Vocational Graduate Diploma of Adult Language,
Literacy and Numeracy Leadership and the TAE70110 Vocational Graduate Certificate of
Adult Language, Literacy and Numeracy Practice.
Introduction to research
Bell, J.,2005, Doing your research project: A guide for first-time researchers in
education, health and social science, 5th edn, McGraw Hill International (UK) Ltd.,
Maidenhead. Provides a practical guide to research and a good overview of various
methods used in social and education research within a language education
context.
Boeije, H., 2010, Analysis in qualitative research, Sage, London.
Burns, A., 2006, ‗Surveying landscapes in adult ESOL research‘, in Linguistics and
Education, vol. 17, no. 1, pp.97–105.Provides a summary of current research in
adult ESOL with detail ofAustralian research.Viewed April 2012
<http://www.sciencedirect.com/science/article/pii/S0898589806000416>
Carpentieri, J. D., Litster, J., and Frumkin, L., 2010, Adult numeracy: A review of
research, NRDC, London,
<http://www.nrdc.org.uk/publications_details.asp?ID=170#>. This report provides
an overview of existing research on adult numeracy, with a strong focus on the
United Kingdom but also including other countries. Available in IBSA online reading
folder
Cohen, L., Manion, L.,and Morrison, K., 2000, Research methods in education, 5th
edn, Routledge Farmer, London. A good general text.
McKay, S., 2007, Researching second language classrooms, Laurence Erlbaum
Associates Inc., Mahwah, New Jersey. A very practical and accessible text.
Norton, B. P., 1995, ‗The theory of methodology in qualitative research‘, inTESOL
Quarterly, Vol 29, no. 3, pp.569–576.
Critical research
Nunan, D., 1992, Research methods in language learning, Cambridge University
Press, Cambridge. Includes experimental method, ethnography, case studies,
classroom observation, introspection, elicitation techniques, interaction analysis,
and program evaluation. Also contains a number of useful checklists.
Nunan, D. and Bailey, K. M., 2009. Exploring second language classroom research:
A comprehensive guide. Heinle Cengage Learning, Boston. Focuses on language
classroom research and research design. It includes chapters on the experimental
method, surveys, case study research, ethnography, and action research. Also
covers data collection, including classroom observations, introspective methods
and elicitation procedures. Then covers data analysis strategies: analysing
classroom interaction, quantitative analyses, and qualitative analyses. Chapter on
ethical concerns and mixed methods research. Each chapter contains practical
tasks and highlights a sample study.
Patton, M. Q., 2002, Qualitative research and evaluation methods, 3rd edn, Sage,
London. Accessible and comprehensive text — a good introduction to research.
Richards, J. C. and Lockart, C., 1994, Reflective teaching in second language
classrooms, Cambridge University Press, NY. Both this and McKay (see above)
include chapters giving an overview of methods plus some practical activities. While
referring to second language learning, they are relevant to adult literacy, numeracy
and language context.
Presentation of research
Angeli, E., et al., 2010, General format, Purdue Online Writing Laboratory, viewed
April 2012, <http://owl.english.purdue.edu/owl/resource/560/01/>. Excellent
introduction to all aspects of APA style research presentation.
Mixed methods
Barton, D., Appleby, R., Hodge, R., Tusting, K., and Ivanic, K., 2006, Relating adults‘
lives and learning: participation and engagement in different settings,
NRDC,London, viewed April 2012,
<http://www.nrdc.org.uk/publications_details.asp?ID=48>.Available in IBSA online
reading folder
Lee, A., Chapman, A., and Roe, P., 1996, Pedagogical relationships between adult
literacyand numeracy, UTS, Sydney, viewed April 2012,
<http://hdl.voced.edu.au/10707/111314>.
Leith, M., 2012,How learning English facilitates integration for adult migrants: the
Jarrah Language Centre experience, NCVER, Adelaide, viewed April 2012,
<http://www.ncver.edu.au/publications/2461.html>.Available in IBSA online
reading folder
Prodromou, L., 1992,‗What culture? Which culture? Cross-cultural factors in
language learning‘, ELT Journal, vol. 46, no. 1,pp. 39–50.
Interviews
Cooke, M., 2006, ‗When I wake up I dream of electricity‘: the lives, aspirations and
‗needs‘ of Adult ESOL learners, Linguistics and Education, vol 17, no. 1, pp. 56–73.
Viewed April 2012
<http://www.sciencedirect.com/science/article/pii/S0898589806000878>
The study provides unique and statistically significant information from an initial
sample of over 3000 learners. The benefits to learners from their participation in
Learn Local have become clear showing patterns of participation and identifying
pathways over three years to further study, employment and community
participation. The three stages of the study were:
Stage 1: A community-studies approach to researching strategic issues in ACE
Stage 2: ACE connects!
Stage 3: ACE makes a difference: building pathways, providing opportunities and
creating outcomes.
Nechvoglod, L. and Beddie,F.,2010, Hard to reach learners: What works in reaching
them and keeping them, Adult, Community and Further Education Board,
Melbourne, viewed April 2012,
<http://www.skills.vic.gov.au/__data/assets/pdf_file/0003/350085/DOC-
CENTRAL_n1530129_v1_Capacity_35_RHL_Attachment_1_Hard_to_Reach_Lear
ners__what_works_in_reaching_and_keeping_them.pdf>.
Newcombe, J., and Achren, L.,, 2010, CALDsettlement and possibilities(Regional
reports), Adult, Community and Further Education Board, Melbourne, viewed April
2012, <http://www.skills.vic.gov.au/learnlocal-acfe/acfe-publications-and-
research/acfe-publications-and-research/cald-settlement-and-possibilities>.
Department of Education and Early Childhood Development, 2010, ESL report
2009,Department of Education and Early Childhood Development, Victoria, viewed
April 2012,
<http://www.eduweb.vic.gov.au/edulibrary/public/teachlearn/student/lem/eslrep
ort2009.pdf>. Demographic data for Victoria related to school ESL learners and
their families.
Shomos, A., 2010,Links between literacy and numeracy skills and labour market
outcomes, Australian Government, Productivity Commission, viewed April 2012,
<http://www.pc.gov.au/research/staff-working/literacy-numeracy-labour-
outcomesWELL>.
Workplace English Language and Literacy (WELL) Program, 2010, Resource and
strategic projects guidelines, 2010, Department of Education, Employment and
Workplace Relations, Canberra,viewed April 2012,
<http://www.deewr.gov.au/Skills/Programs/LitandNum/WorkplaceEnglishLangua
geandLiteracy/StratProjects/Documents/RSGuidelines2010.pdf>.
Action research
Burns, A., 1995, ‗Teacher-researchers: Perspectives on teacher action research
and curriculum renewal‘, in A. Burns and S. Hood (eds.), Teachers’ voices: Exploring
course design in a changing curriculum (pp. 3–19).NCELTR, Macquarie University,
Sydney.
Burns, A. 2009,Becoming a holistic teacher: Discovering our practices through
action research, slides of presentation at 26th International ROC-TEFL
Conference,Hsinchu, viewed April 2012,
<http://www.professoranneburns.com/downloads/rocteflplenary09.pdf>.
Methodology issues
Carpentieri, J. D., Litster, J., and Frumkin, L.,2010,Adult numeracy: A review of
research, NRDC,London, viewed April 2012,
<http://www.nrdc.org.uk/publications_details.asp?ID=170#>. An excellent chapter
on the methodological issues in adult numeracy research is part of this
publication:Available in IBSA online reading folder
Gemici, S., Bednarz, A., and Lim, P., 2011, Getting tough on missing data: a boot
camp for social science researchers, NCVER, Adelaide, viewed April 2012,
<www.ncver.edu.au/publications/2421.html>.
Semo, R., 2011, Social capital and young people, NCVER, viewed April 2012,
<www.ncver.edu.au/publications/2400.html>.
OECD and Statistics Canada, 2011, Literacy for life: Further results from the adult
literacy and life skills survey,Second International ALL Report
It says in the report Please cite this publication as: OECD, Statistics Canada (2011),
Literacy for Life: Further Results from the Adult Literacy and Life Skills Survey,
OECD Publishing. http://dx.doi.org/9789264091269-en>.
Trend analysis
OECD, ‗Trend analysis asa method‘, viewed April 2012,
<http://www.oecd.org/document/11/0,3746,en_36702145_36702273_372149
87_1_1_1_1,00.html>.
Useful links
Meethan , K., and Anderson, A., 2011, ‗Validity and reliability‘, Learning from
WOeRK project, University of Plymouth, YouTube video, viewed April 2012,
<http://www.youtube.com/watch?v=izaIWCWA5Rc>. Useful presentation on
qualitative research — validity and reliability.
Learning from WOeRK project, 2011, ‗Qualitative research methods‘, University of
Plymouth, viewed April 2012,<http://cpdoer.net/collections/research-methods/>.
Open learning resources on research.
Graham Gibbs‘ 26 videos on research, for example,
Gibbs, G.,‗Coding‘,2010,YouTube video,viewed April
2012,<http://www.youtube.com/watch?v=7X7VuQxPfpk&feature=related>.
Burns, A., 2012, The website of Professor Anne Burns, viewed April 2012,
<http://www.professoranneburns.com/>. Professor Anne Burns is author of a
number of useful reports on action research in ESOL. This site contains a number of
resources on how to do action research.
Education Resources Information Center(ERIC), viewed April 2012,
<http://www.eric.ed.gov>. Database of education literature.
National Center for the Study of Adult Learning and Literacy, (NCSALL), ‗Research‘,
viewed April 2012, <http://ncsall.net/index.php?id=16>.
Through its research, NCSALL addresses questions that concern educators,
policymakers, and scholars. Such questions include: Why do some adult learners
persist in their studies but others do not? What constitutes effective teaching and
learning? What kinds of professional development activities are best for teachers?
And how can a program's impact on adult learners be measured? NCSALL’s
research provides a structured way for those involved in adult literacy education to
look at practice and learn from evidence, reducing reliance on trial and error.
The National Research and Development Centre for Adult Literacy and Numeracy
(NRDC),‗Generating knowledge and transforming it into practice‘, viewed April
2012, <http://www.nrdc.org.uk/uploads/>.This is anational LLN research centre in
UK.
OECD, ‗Education‘, viewed April 2012,
<http://www.oecd.org/topic/0,3699,en_2649_37455_1_1_1_1_37455,
00.html>.
The Open University, ‗Open Research Online‘,viewed April 2012,
<http://oro.open.ac.uk/>.
Macquarie University, ‘Prospect Journal‘,viewed April 2012,
<http://www.ameprc.mq.edu.au/resources/prospect>.
This is the archive ofProspect, the journal of The National Centre for English
Language Teaching and Research (NCELTR), a national research centre at
Macquarie University, which published research on adult ESL, including Adult
Migrant English Program (AMEP) research.