10.4324_9781003346166_previewpdf
10.4324_9781003346166_previewpdf
CHANGING WORLD
This timely book takes stock of the wide range of developments in society,
education and assessment and offers conclusions and strategies that are
necessary for the future of educational assessment.
Drawing on examples from the UK, Europe and USA, the book will
dissect cultural, political, psychological and ideological ideas on society,
education and assessment and foreground pressing issues relating to
artificial intelligence, social justice and climate change. Acknowledging its
predominantly Western perspective and providing context on the evolution
of educational assessment, the book will bridge the gap between theory and
practice to progress debate and discourse on creating a culture of assessment
fit for the future and rethinking strategies for the path ahead.
Ultimately, the book will provide insights and key takeaways for the
field of educational assessment along with an evidence-based agenda that
will be relevant for education professionals, the assessment industry and
policymakers interested in higher education, international and comparative
education and testing.
Isabel Nisbet has held senior roles in the regulation of qualifications and
assessment in the UK.
Typeset in Sabon
by Apex CoVantage, LLC
CONTENTS
1 Introduction 1
Afterword 208
Index 210
ABOUT THE AUTHORS
Isabel Nisbet’s academic training was in philosophy, with her tutors includ-
ing R.S. Downie in Glasgow and R.M. Hare in Oxford. Her professional
career has been in government and regulation in the UK, including posts in
government departments in Scotland and England and senior roles in the
regulation of medicine and postgraduate medical education. These led to a
Director role in the Qualifications and Curriculum Authority in England.
Isabel was the founding CEO of Ofqual, the statutory regulator of quali-
fications and assessments in England. From 2011 to 2014, she worked for
Cambridge Assessment in South East Asia, based in Singapore. Isabel has
served on the Board of Qualifications Wales and has been governor of four
universities in England. She is currently Vice-Chair of the Board of Gover-
nors of the University of Bedfordshire. In 2021, Isabel was appointed to a
panel carrying out an Independent Review of Education in Northern Ireland,
and their report was published in December 2023. She is a member of the
National Statistician’s Data Ethics Group, and she contributes regularly to
national and international conferences and seminars.
We are very grateful to the following people for comments on draft chapters:
Eleanor Andressen
Ben Colburn
James Conroy
Catarina F. Correia
Martin Johnson
Nick Hillman
Paul Newton
Elisa de Padua
Mick Walker
Lesley Wiseman
The content of the book has benefited from the comments of participants
who attended the 2023 conferences of the Association of Educational As-
sessment, Europe, and the British Educational Research Association; and
events held by the Chartered Institute of Educational Assessors; the Institute
of Education, University College London; and Cambridge University Press &
Assessment.
AUTHORS’ PREFACE
This book has been prompted by our shared awareness of the need for the
rather specialised world of educational assessment to look outside its fa-
miliar spheres of reference to changes in the world and in education and
re-assess where it should go next. We came to this conclusion from different
backgrounds – one from detailed participation in research on educational
assessment in theory and practice; the other bringing an academic training in
philosophy to a professional career in policy and regulation covering educa-
tion and assessment in a wide range of contexts.
We had collaborated before, particularly on fairness in assessment (Nisbet &
Shaw, 2020), and contributed to conferences and seminars for assessment
researchers. During the Covid-19 pandemic, many of these events had to be
held remotely, and this gave us the opportunity to participate in discussions
in the USA, as well as in Europe and in the different constituent parts of the
UK. We were particularly struck by the contrast between the preoccupations
of conference delegates on the two sides of the Atlantic. Our US colleagues
used their coffee breaks and plenary discussions to talk animatedly about
difficult and controversial issues – notably race – which dominated their per-
ception of the context in which they had to work. Some of them were very
worried by the bitterness of the public debate around areas of their work and
about the use being made of the assessments that they had helped to produce.
In European events, there was certainly the feel of a community of practice
meeting each other and producing – and critiquing – high-quality detailed
work. There was an awareness of the national policy contexts in which they
practised, but not the same preoccupation with challenges from the world
beyond assessment.
x Authors’ preface
We came increasingly to the view that, as we approach the end of the first
quarter of the 21st century, it is time to stand back and survey educational
assessment in context. That context includes developments in society and
education, as well as developments in thinking about society and education.
We have attempted to cast our net widely and bring together source material
from different disciplines and very different subject matter. Synthesising such
a wide range of material can be uncomfortable for assessment researchers
used to detailed analytic work, but it reflects the intertwining of different
factors in the real world where assessment is situated.
The wide scope of the material that we have sought to include in our syn-
thesis has made this project very challenging for us. It also means that we
have had to be selective. Some readers may find that issues of particular inter-
est to them have not been covered. But we hope that the questions we have
asked and the approach we have taken will be relevant and helpful. We are
also limited in that almost all of the source material we have used has been
in the English language.
We hope that this book will be of interest not only to assessment research-
ers and academics but also to newcomers to work in educational assessment,
to policymakers and to workers in government and regulation affecting edu-
cational assessment. We also hope that students who are seeking to deepen
their understanding of assessment in context will use the many references
that we have provided to follow up topics of particular interest to them.
We have expressed our own views throughout the book, particularly in
the final chapter. We expect that some readers will disagree with us. Indeed,
we would be disappointed if that were not so. For us, the importance of this
exercise is to use its wide scope to raise important questions for assessment
as we move into the second quarter of the century. Twenty-five years later, it
will be time to take stock again.
Isabel Nisbet and Stuart Shaw
May 2024
Reference
Nisbet, I., & Shaw, S. D. (2020). Is assessment fair? SAGE Publications Ltd.
FOREWORD
but to use deep thinking, genuine reflection, and a range of examples to inter-
rogate the breadth and reach of assessment issues we currently face.
Assessment is a frequent feature in global news media, and this reflects a
sustained public interest where grades and other assessment outcomes claim
to characterise the success (or otherwise) of education systems. The Covid-19
pandemic revealed the limitations of national testing systems based on ancient
and embedded beliefs that require students to sit in examination halls for fi-
nite periods of time in order to “show their learning”. For example, in Eng-
land, Norway and the Netherlands, examinations were cancelled completely
during the height of the pandemic; in China, Hong Kong and Spain, national
tests were postponed; and in the USA, entire test systems were rewritten at
speed to create something that worked in a socially distanced world. Along-
side these cancellations were hasty enactments of assessments that relied on
incomplete sets of data and school-level reporting. What followed from this
was a global wringing of hands about whether national test results (and simi-
lar assessments) were fair or even accurate. This in turn revealed anger and
fear on the part of students who felt their very futures were in peril. The fall-
out from the pandemic is unknown in terms of its impact on education and
it will be perhaps decades before we have anything approximating a good
understanding of what has unfolded as a result of school closures, lost learn-
ing and, in the case of assessment, lost experience of test taking. But what
we have learned is that students are taught from a young age that assessment
outcomes, particularly examination results, really matter and this message
means that they become a part of a learner’s identity. In turn, teachers know
that assessment outcomes will reflect on their practice, both in the classroom
and as leaders of educational institutions. What this book ponders is how
it is time to consider the value of inculcating such beliefs in our education
systems. It is very rare to see philosophical considerations of the moral and
ethical implications of assessment and their inclusion here is to be welcomed.
For many of us in the assessment “world”, such writing may not make for
comfortable reading, but it is necessary reading. Well-being is now a common
part of public discourse, and here its links to education (and assessment) are
laid bare, in terms not simply of the mental stress resulting from testing but
of a global notion of well-being. This holistic view can be seen in terms of
creating sustainable societies that are able to understand and manage the hu-
man and artificial challenges unfolding in the 21st century; education has a
vital role to play if we wish to assure our future. There are no absolute solu-
tions to the issues presented in this book, but this is not the point because the
authors are not attempting to do this. Rather, they are shining a light on what
has happened and presenting some thoughts about what might be.
Assessment requires an open mind to afford continuous engagement in
reflective practice. It is this openness that allows us to spot the potential to
learn from experience and perhaps to improve the human condition. This is
Foreword xiii
not easy as it challenges that very human wish to take the well-trodden path,
but we stop being curious and attempting to tackle the thorniest of problems
in education at our peril and, importantly, at the peril of those who follow us.
Many of the recent debates around education are highly polarised and critics
often take the easy route and present just two sides to each story. This book
presents ways we might move beyond a binary argument towards more nu-
anced ways of talking about education and assessment; let the debate begin.
Mary Richardson
Professor of Educational Assessment
IOE, Faculty of Education and Society,
University College London
1
INTRODUCTION
Never before have we known as much about each other. Never before
have we depended so much on each other. Never before have we had such
an opportunity to move toward what the generations have prayed for,
peace on Earth and a better life for all. We must both imagine a brighter
future and dedicate ourselves to building it, and I ask you all here today to
reaffirm the clear understanding that we must do it together.1
DOI:10.4324/9781003346166-1
2 Introduction
There was also reflection on where matters stood in the world of educa-
tional assessment. As the 20th century began to draw to a close, Professor
Caroline Gipps wrote Beyond Testing: Towards a Theory of Educational
Assessment, in which she reflected on developments in assessment during
the 1990s. She examined technical issues about the effect of assessment
on curriculum and teaching, the relationship between performance as-
sessment and assessment by teachers, and she began the book with these
words:
In our book, written some thirty years later, we are seeking to take up the
baton offered by Gipps. We believe it is now time for a rethink about educa-
tional assessment, taking into account recent developments affecting assess-
ment practice and developments in thinking about education and assessment,
and looking forward towards the mid-21st century.
In this introductory chapter, we set out the approach taken by the book,
and we briefly describe the content of the subsequent chapters. In conclusion,
we offer a scene-setting account of some of the dominant themes in educa-
tion and educational assessment at this time. These themes will be explored
in greater depth throughout the book.
Our approach
The size of the challenge that we have taken up has required us to bring
together a wide range of sources and academic disciplines – including, in ad-
dition to education and assessment, psychology, public policy, information
technology, law, science and moral philosophy. Such synthesis is required,
we suggest, as the issues we discuss are essentially interdisciplinary (requir-
ing an integration of contributions from several disciplines),2 as is the real
world in which they are situated. However, it does have the drawback that,
by necessity, we have had to be selective in the examples we discuss. Readers
may have particular interests that are not covered. We hope that they will be
encouraged to explore these further themselves and apply some of the ques-
tions we have posed here.
Introduction 3
Both authors are based in England, though they have worked elsewhere.
The book draws on examples from throughout the UK, but also from the
USA and Europe. Our adoption of an interdisciplinary approach may be of
particular interest in the USA, where academic thinking on assessment is now
much more influenced by other academic disciplines than it was previously.
The book also draws on publications by international organisations such as
the Organisation for Economic Co-operation and Development (OECD) and
the World Economic Forum (WEF). Almost all our source material is in the
English language.
In Chapters 2–6, we explore developments and changes to thinking about
education and assessment. Many of the examples we have cited merit much
longer and more detailed discussion than has been possible for a book of
this scope. Our purpose has been to rise above the details and draw lessons
about the implications for assessment. However, we have offered references
at the end of each of these chapters, which should enable readers to follow
up in more detail particular issues that interest them. That has resulted in
a contrast of styles between different parts of the book. Chapters 2 and 3
are grounded more in the literature, while Chapters 4, 5 and 6 emphasise
more theoretical issues, examining developments in thinking about society
and education and debating the issues that they raise.
invite readers to address the questions we have posed and decide what their
own view is.
Before proceeding to give an introductory overview of these discussions,
we would like to mention three examples of areas of assessment that we
have not had space to discuss in detail in this book, but which we hope will
continue to be taken up by others in the years ahead. The first is the role of
assessment in the development of infants and very young children. There are
two overlapping reasons why assessment in the early years is important. The
first is to provide information as early as possible about children who are not
progressing as might be hoped/expected in areas identified as important for
their development. Common sense and research (e.g. Research in Practice,
2022; OECD, 2018) concur in advocating supportive early intervention. The
second reason is that assessment in the early years can look forward to formal
education (preschool, school and beyond) and can denote aspects of learn-
ing, health and well-being which most accurately predict future educational
achievement. Information from longitudinal sample surveys is typically used
for this purpose. With increasing recognition of the importance of motivation
to learn and its interrelationship with mental health and well-being, the two
purposes increasingly intersect.
The second area of assessment that deserves wider study than has been
possible in this book is its role in relation to the education of learners with
special educational needs and disabilities (SEND). The numbers of children
and young people of school age who have been categorised by governments
as having SEND can fluctuate because of definitions or changes in govern-
ment policy, but in many countries, the trend in the 2020s has been steeply
upwards,7 with the highest numbers diagnosed as having autism, followed
by speech and language difficulties (e.g. Lindsay et al., 2016). The questions
raised for assessment are at least twofold: How can and should incidences
of SEND be assessed? And how can educational assessments be made more
equitable and accessible for learners with SEND?
A third area, which we mention here but do not cover in detail elsewhere,
is the link between assessment and eugenics. Early eugenics, in the 1900s and
before, sought to study ways in which the physical and mental characteristics
of the human race might be improved. The most troublesome link with as-
sessment was the use of testing to identify people with “inferior” genes (as
evidenced, e.g., by their IQ test scores), with consequences including national
measures to prevent or discourage them from having children. The horren-
dous implementation by Nazi Germany in the 1930s and 1940s of practices
based on eugenic ideology is well documented. At this time in the 21st cen-
tury, attention focuses mainly on the elimination of genetic disease. However,
two questions remain pertinent for assessment: Is there any defensible and
unbiased form of assessment that can be used to identify inherited attrib-
utes, knowledge, or skills? And second, should qualifications or evidence
Introduction 7
and increasingly faster cellular technologies like the internet. The United
States elected its first African American President; the UK departed from the
European Union; and culturally many countries saw rises in nationalism, in
contrast to the internationalism of communications available, and increas-
ingly polarised differences of view (“culture wars”). And all of these develop-
ments are over and above those we have selected for more detailed discussion
in Chapter 3, such as Covid-19 and the rapid increase in evidence – and
awareness – of the threats posed by climate change.
Shifting horizons have been a prevailing feature dominating the first
quarter of the 21st century: shifts in technology, resources, migration and
demographics – from leveraging assets to accessing ecosystems; from the
knowledge economy to the collaboration economy; and shifts in power from
corporations to technology platforms.
As the 21st century began to unfurl, it was becoming increasingly evident
that technological “connectedness” was not only beginning to pave the way
for transformative changes in the way society and individuals functioned
but also starting to disrupt almost every area of life. At the time of writ-
ing, generative AI is the world’s fastest-growing “deep” technology,8 and is
demonstrating enormous potential to reform the rules of industries and or-
ganisations; drive significant economic growth; and transform all sectors of
life, including education (HM Government, 2021).
In these changing contexts, educational assessment has itself been chang-
ing (e.g. Pellegrino, 1999; Bennett, 2002). A backcloth of growing diver-
sity, increased migration, globalisation, the emergence of new players in the
world economy and the explosion of information technology has meant that
citizens of most countries need to upgrade their skills throughout their adult
lives in order to keep abreast of changes in the requirements of modern liv-
ing, both in the workplace and in their personal lives. “Lifelong learning”9
has become the new mantra for all citizens in the modern world.
Education is expected to prepare learners for a fast-changing world in
which technological, demographic, social, environmental, economic and po-
litical transformation are proving to be seismic. Assessment is increasingly
expected to take account of the need to support all the developments de-
scribed here, including increased participation in schooling and in university
education (particularly in preparation for the increase in careers requiring a
degree); “credentialism” (increased demand for formal qualifications); and
the need for so-called 21st century-competencies (OECD, 2018).
Ethical concerns touched upon emotive issues: social exclusion, trust, indi-
vidual autonomy, new forms of digital dividedness14 and privacy as well as
the increasing risks associated with “big” data and the rise of learning analyt-
ics.15 We discuss this in more detail in Chapter 5.
The impact of advances in the cognitive sciences on educational assessment
had already been a cause of some optimism in the second half of the 20th
century. It was predicted that the potential of cognitive psychology would
be “fully realized through item design” (Embretson & Gorin, 2001, p. 343).
Aspects of cognitive psychology appeared particularly well-suited to psycho-
metric traditions of theory and practice, where measurement and cognitive
issues intersected. Any means of observing test-taker behaviours and the
mental processes they employed in responding to and solving test questions
were perceived as fundamental to construct validity (Snow & Lohman, 1989;
Messick, 1995, p. 742; Knight & Silverstein, 2001).
Throughout the first decade of the new century, there was growing de-
mand to make assessments more transparent about the cognitive processes
they sought to measure (US. Department of Education, 2004). It was evident,
Introduction 11
Notes
1 Bill Clinton at the “Millennium Around the World” Celebration, 2000 www.
presidency.ucsb.edu/documents/remarks-the-millennium-around-the-world-
celebration
2 See Manolakelli (2022) – Inter, Multi, Cross, Trans, & Intra-disciplinary:
What is the difference, and why is it important? www.archpsych.co.uk/post/
disciplinarities-definitions
3 As, for example, by R.S. Peters in the first chapter of his Ethics and Education
(1966). Aspects of Peters’s account were disputed then and remain so.
Introduction 13
4 See Johnson and Majewska (2022) for a review of the literature outlining the
characteristics, benefits and disadvantages of formal, non-formal and informal
learning.
5 We have discussed this definition at greater length in Nisbet and Shaw (2020,
pp. 7–10).
6 Mary James defines educational assessment as “all those activities that involve
eliciting evidence of student learning and drawing inferences as the basis for deci-
sions” (James, 2010, p. 163).
7 For a discussion of trends in the UK, including among young children, see
www.educationalneuroscience.org.uk/2022/04/01/why-has-there-been-a-rise-
in-number-of-sen-children-especially-in-the-early-years/
8 “Deep” technologies are grounded in important scientific advances and engineer-
ing innovations but which require a longer period of gestation and/or extensive
capital investment prior to commercial application. Transformative technologies
are technologies that have the potential to impact across many sectors of the econ-
omy (as opposed to a single sector).
9 “Lifelong learning” was a term coined by Leslie Watkins and popularised by Pro-
fessor Clint Taylor of City Unified School in 1993. While not a new concept, it is
one that has assumed a greater and new emphasis in the 21st century.
10 See the United Nations 2030 Agenda for Sustainable Development Goals – Goal
4: “Ensure inclusive and equitable quality education and promote lifelong learn-
ing opportunities for all”. https://sdgs.un.org/goals
11 There also exists an ongoing tension in assessment around the conceptualisation
of 21st century skills, that is, how knowledge is embedded in competence and how
this can be recognised.
12 OECD (2016) was a background report to the second Global Education Industry
Summit, held in Jerusalem on 26–27 September 2016, and covered the available
evidence on innovation in education, the impact of digital technologies on teach-
ing and learning, and the role of digital skills and the education industries in the
process of innovation, using data from OECD surveys.
13 See, for example, Lowman (2013) for a discussion of the use of unproctored or
proctored internet testing, p. 107.
14 See Coleman (2021) for a discussion of the digital divide in the UK post-pandemic.
15 See Timmis et al. (2016) for a discussion of the potential, the challenges, and the
risks associated with technology-enhanced assessment.
16 Introduced to illustrate how the evaluation of scientific and ethical questions
could be integrated within a common validity framework.
17 Chronicled by Newton and Shaw (2014).
References
American Educational Research Association, American Psychological Association,
and National Council on Measurement in Education. (2014). Standards for edu-
cational and psychological testing. American Educational Research Association.
Baird, J. A., Hopfenbeck, T. N., Newton, P. E., Stobart, G., & Steen-Utheim,
A. T. (2014). State of the field review: Assessment and learning. Oxford University
Centre for Educational Assessment Report OUCEA/14/2. Norwegian Knowledge
Centre for Education (case number 13/4697).
Bennett, R. E. (2002). Inexorable and inevitable: The continuing story of technology
and assessment. Journal of Technology, Learning, and Assessment, 1(1). www.
jtla.org
Bennett, R. E. (2011). Formative assessment: A critical review. Assessment in Edu-
cation: Principles, Policy & Practice, 18(1), 5–25. https://doi.org/10.1080/09695
94X.2010.513678
14 Introduction
Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in
Education: Principles, Policy & Practice, 5(1), 7–74.
Bollington, A. (2015). Business brief: Why isn’t everyone lifelong learning? OECD
Yearbook. www.oecd.org/education/lifelong-learning.ht
Borsboom, D., Cramer, A. O. J., Kievit, R. A., Zand Scholten, A., & Franić, S. (2009).
The end of construct validity. In R. W. Lissitz (Ed.), The concept of validity. Revi-
sions, new directions, and applications (pp. 135–170). Information Age Publishing.
Boston, K. (2005). Assessment, reporting and technology: System-wide assessment
and reporting in the 21st century. In Tenth Annual Roundtable Conference: Strat-
egy, Technology and Assessment. Qualifications and Curriculum Authority.
Boston, K. (2007, September 25). Ken Boston: Big brother is testing you. The Guard-
ian. Higher Education Profile. Higher Education. www.theguardian.com/educa-
tion/2007/sep/25/highereducation.schools
Brown, G. T. L. (2019). Is assessment for learning really assessment? Frontiers in
Education, 4, Article 64. http://doi.org/10.3389/feduc.2019.00064
Campbell, B., & Manning, J. (2018). The rise of victimhood culture. Palgrave Macmillan.
Coleman, V. (2021). Digital divide in UK education during COVID-19 pandemic: Lit-
erature review. Cambridge Assessment Research Report. Cambridge Assessment.
Dhawan, V. (2014). Education and neuroscience. Research Matters: A Cambridge
Assessment Publication, 17, 46–55.
Didau, D. (2014, March 12). Why AFL might be wrong, and what to do about it.
David Didau Website. https://learningspy.co.uk/myths/afl-might-wrong/
Embretson, S., & Gorin, J. (2001). Improving construct validity with cognitive psy-
chology principles. Journal of Educational Measurement, 38(4), 343–368. https://
doi.org/10.1111/j.1745-3984.2001.tb01131.x
European Commission. (2019). Key competences for lifelong learning. European Union.
European Commission Education & Culture. (2007). Key competencies for lifelong
learning – A European framework. European Communities. https://op.europa.eu/
en/publication-detail/-/publication/5719a044-b659-46de-b58b-606bc5b084c1
Fletcher-Wood, H. (2017, March 26). Is formative assessment fatally flawed? Con-
fusing learning & performance. Improving Teaching. https://improvingteaching.
co.uk/2017/03/26/formative-assessment-flawed-confusing-learning-performace
Gipps, C. C. (1994). Beyond testing: Towards a theory of educational assessment.
The Falmer Press.
Goswami, U. (2006). Neuroscience and education: From research to practice? Na-
tional Review of Neuroscience, 7(5), 406–411.
HM Government. (2021, September). National AI strategy. Presented to Parliament
by the Secretary of State for Digital, Culture, Media and Sport by Command of
Her Majesty. Command Paper 525. Published by the Office for Artificial Intel-
ligence. ISBN 978-1-5286-2894-5.
James, M. (2010). Educational assessment: Overview. In P. Peterson, E. Baker &
B. McGaw (Eds.), International encyclopaedia of education (3rd ed., Vol. 3, pp.
161–171). Elsevier. www.sciencedirect.com/science/article/pii/B978008044894701
7139
Johnson, M., & Majewska, D. (2022). Formal, non-formal, and informal learn-
ing: What are they, and how can we research them? Cambridge University
Press & Assessment Research Report. www.cambridgeassessment.org.uk/Imag
es/665425-formal-non-formal-and-informal-learning-what-are-they-and-how-
can-we-research-them-.pdf
Kane, M. T. (2001). Current concerns in validity theory. Journal of Educational
Measurement, 38(4), 319–342.
Knight, R. A., & Silverstein, S. M. (2001). A process-oriented approach for avert-
ing confounds resulting from general performance deficiencies in schizophre-
nia. Journal of Abnormal Psychology, 110(1), 15–30. https://doi.org/10.103
7/0021-843X.110.1.15
Introduction 15
Lindsay, G., Ricketts, J., Peacey, L. V., Dockrell, J. E., & Charman, T. (2016).
Meeting the educational and social needs of children with language impair-
ment or autism spectrum disorder: The parents’ perspectives. International
Journal of Language & Communication Disorders, 51(5), 495–507. http://doi.
org/10.1111/1460-6984.12226
Linn, R. L. (1997). Evaluating the validity of assessments: The consequences of use.
Educational Measurement: Issues and Practice, 16(2), 14–16.
Lowman, R. (2013). Ethical issues related to personnel assessment and selection.
Chapter 6. In New directions in assessing performance potential of individuals and
groups: Workshop summary. National Academies of Sciences, Engineering, and Med-
icine (pp. 101–107). The National Academies Press. https://doi.org/10.17226/18427
Manolakelli, A. (2022, September 5). Inter, multi, cross, trans, & intra-disciplinary:
What is the difference and why is it important? ArchPsych. www.archpsych.co.uk/
post/disciplinarities-definitions
Mehrens, W. A. (1997). The consequences of consequential validity. Educational
Measurement: Issues and Practice, 16(2), 16–18.
Messick, S. (1989). Validity. In R. Linn (Ed.), Educational measurement (3rd ed.,
pp. 13–100). American Council on Education.
Messick, S. (1995). Validity of psychological assessment: Validation of inferences
from persons’ responses and performances as scientific inquiry into score mean-
ing. American Psychologist, 50(9), 741–749. https://doi.org/10.1037/0003-066X.
50.9.741
NCEE. (1983). National Commission on Excellence in Education (NCEE) A nation
at risk: The imperative for educational reform. NCEE.
Newton, P. E., & Baird, J.-A. (2016). Editorial: The great validity debate. Assessment
in Education: Principles, Policy & Practice, 23(2), 173–177. https://doi.org/10.10
80/0969594X.2016.1172871
Newton, P. E., & Shaw, S. D. (2014). Validity in educational & psychological assess-
ment. SAGE Publications Ltd. https://doi.org/10.4135/9781446288856
Nisbet, I., & Shaw, S. D. (2020). Is assessment fair? SAGE Publications Ltd.
OECD. (2004). Learning for tomorrow’s world: First results from PISA 2003. OECD.
OECD. (2016). Innovating education and educating for innovation: The power of
digital technologies and skills. OECD Publishing. http://doi.org/10.1787/9789
264265097-en
OECD. (2018). The future of education and skills: Education 2030. www.oecd.org/
education/2030-project
Pellegrino, J. W. (1999). The evolution of educational assessment: Considering the
past and imagining the future (William H. Angoff Memorial Lecture Service, Ed.).
The Educational Testing Service.
Peters, R. S. (1966). Ethics and education. George Allen and Unwin.
Popham, W. J. (1997). Consequential validity: Right concern-wrong concept. Educa-
tional Measurement: Issues and Practice, 16(2), 9–13.
Putnam, R. D., & Garrett, S. R. (2020). The Upswing: How we came together a cen-
tury ago and how we can do it again. Swift Press.
Research in Practice (RiP). (2022). What is early help?: Concepts, policy directions
and multi-agency perspectives. Ofsted.
Richardson, M., & Clesham, R. (2021). Rise of the machines? The evolving role of
AI technologies in high-stakes assessment. London Review of Education, 19(1), 9,
1–13. https://doi.org/10.14324/LRE.19.1.09
Shepard, L. A. (1993). Evaluating test validity. Review of Research in Education, 19,
405–450.
Shepard, L. A. (1997). The centrality of test use and consequences for test validity.
Educational Measurement: Issues and Practice, 16(5–8), 13.
Smith, R., Egglestone, C., Jones, E., & Aldridge, F. (2019, December). Adult
participation in learning survey 2019. Learning & Work Institute. https://
16 Introduction
learningandwork.org.uk/wp-content/uploads/2020/04/Adult-Participation-in-Learning-
Survey-2019.pdf
Snow, R. E., & Lohman, D. F. (1989). Implications of cognitive psychology for educa-
tional measurement. In R. L. Linn (Ed.), Educational measurement (pp. 263–331).
Macmillan Publishing Co, Inc; American Council on Education.
Swaffield, S. (2009). The misrepresentation of Assessment for Learning – and the woeful
waste of a wonderful opportunity [Online]. In AAIA national conference, Bourne-
mouth, 16–18 September 2009. Retrieved August 29, 2018, from www.aaia.org.uk/
content/uploads/2010/07/The-Misrepresentation-of-Assessment-for-Learning.pdf
Timmis, S., Broadfoot, P., Sutherland, R., & Oldfield, A. (2016). Rethinking assess-
ment in a digital age: Opportunities, challenges and risks. British Educational Re-
search Journal, 42(3), 454–476.
Trilling, B., & Fadel, C. (2009). 21st century skills – Learning for life in our times.
Jossey-Bass.
UNESCO. (2000). The right to education: Towards education for all throughout
life. World education report 2000. United Nations (UNESCO Publishing). https://
unesdoc.unesco.org/ark:/48223/pf0000119720
UNESCO. (2019). 4th global report on adult learning and education. Leave no one
behind: Participation, equity and inclusion. UNESCO Institute for Lifelong Learn-
ing. https://uil.unesco.org/system/files/grale_4_final.pdf
United Nations. (2015). Transforming our world. The 2030 agenda for sustain-
able development [Online]. UN. https://sustainabledevelopment.un.org/post2015/
transformingourworld
U.S. Department of Education, National Center for Education Statistics. (2004).
Stronger accountability: Testing for results: Helping families, schools, and commu-
nities understand and improve student achievement. www.ed.gov/nclb/account-
ability/ayp/testingforresults.html
Vitello, S., Greatorex, J., & Shaw, S. D. (2021). What is competence? A shared inter-
pretation of competence to support teaching, learning and assessment. Cambridge
University Press & Assessment.
World Education Forum. (2015). New vision for education: Unlocking the potential
of technology. www3.weforum.org/docs/WEFUSA_NewVisionforEducation_Re-
port2015.pdf
World Education Report. (2000). The right to education: Towards education for all
throughout life. UNESCO Publishing.
Introduction
American Educational Research Association, American Psychological Association, and National
Council on Measurement in Education . (2014). Standards for educational and psychological
testing. American Educational Research Association.
Baird, J. A. , Hopfenbeck, T. N. , Newton, P. E. , Stobart, G. , & Steen-Utheim, A. T. (2014).
State of the field review: Assessment and learning. Oxford University Centre for Educational
Assessment Report OUCEA/14/2. Norwegian Knowledge Centre for Education (case number
13/4697).
Bennett, R. E. (2002). Inexorable and inevitable: The continuing story of technology and
assessment. Journal of Technology, Learning, and Assessment, 1(1). www.jtla.org
Bennett, R. E. (2011). Formative assessment: A critical review. Assessment in Education:
Principles, Policy & Practice, 18(1), 5–25. https://doi.org/10.1080/0969594X.2010.513678
Black, P. , & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education:
Principles, Policy & Practice, 5(1), 7–74.
Bollington, A. (2015). Business brief: Why isn’t everyone lifelong learning? OECD Yearbook.
www.oecd.org/education/lifelong-learning.ht
Borsboom, D. , Cramer, A. O. J. , Kievit, R. A. , Zand Scholten, A. , & Franić, S. (2009). The end
of construct validity. In R. W. Lissitz (Ed.), The concept of validity. Revisions, new directions,
and applications (pp. 135–170). Information Age Publishing.
Boston, K. (2005). Assessment, reporting and technology: System-wide assessment and
reporting in the 21st century. In Tenth Annual Roundtable Conference: Strategy, Technology
and Assessment. Qualifications and Curriculum Authority.
Boston, K. (2007, September 25). Ken Boston: Big brother is testing you. The Guardian. Higher
Education Profile. Higher Education.
www.theguardian.com/education/2007/sep/25/highereducation.schools
Brown, G. T. L. (2019). Is assessment for learning really assessment? Frontiers in Education, 4,
Article 64. http://doi.org/10.3389/feduc.2019.00064
Campbell, B. , & Manning, J. (2018). The rise of victimhood culture. Palgrave Macmillan.
Coleman, V. (2021). Digital divide in UK education during COVID-19 pandemic: Literature
review. Cambridge Assessment Research Report. Cambridge Assessment.
Dhawan, V. (2014). Education and neuroscience. Research Matters: A Cambridge Assessment
Publication, 17, 46–55.
Didau, D. (2014, March 12). Why AFL might be wrong, and what to do about it. David Didau
Website. https://learningspy.co.uk/myths/afl-might-wrong/
Embretson, S. , & Gorin, J. (2001). Improving construct validity with cognitive psychology
principles. Journal of Educational Measurement, 38(4), 343–368. https://doi.org/10.1111/j.1745-
3984.2001.tb01131.x
European Commission . (2019). Key competences for lifelong learning. European Union.
European Commission Education & Culture . (2007). Key competencies for lifelong learning – A
European framework. European Communities. https://op.europa.eu/en/publication-detail/-
/publication/5719a044-b659-46de-b58b-606bc5b084c1
Fletcher-Wood, H. (2017, March 26). Is formative assessment fatally flawed? Confusing
learning & performance. Improving Teaching.
https://improvingteaching.co.uk/2017/03/26/formative-assessment-flawed-confusing-learning-
performace
Gipps, C. C. (1994). Beyond testing: Towards a theory of educational assessment. The Falmer
Press.
Goswami, U. (2006). Neuroscience and education: From research to practice? National Review
of Neuroscience, 7(5), 406–411.
HM Government . (2021, September). National AI strategy. Presented to Parliament by the
Secretary of State for Digital, Culture, Media and Sport by Command of Her Majesty. Command
Paper 525. Published by the Office for Artificial Intelligence. ISBN 978-1-5286-2894-5.
James, M. (2010). Educational assessment: Overview. In P. Peterson , E. Baker & B. McGaw
(Eds.), International encyclopaedia of education (3rd ed., Vol. 3, pp. 161–171). Elsevier.
www.sciencedirect.com/science/article/pii/B9780080448947017139
Johnson, M. , & Majewska, D. (2022). Formal, non-formal, and informal learning: What are they,
and how can we research them? Cambridge University Press & Assessment Research Report.
www.cambridgeassessment.org.uk/Images/665425-formal-non-formal-and-informal-learning-
what-are-they-and-how-can-we-research-them-.pdf
Kane, M. T. (2001). Current concerns in validity theory. Journal of Educational Measurement,
38(4), 319–342.
Knight, R. A. , & Silverstein, S. M. (2001). A process-oriented approach for averting confounds
resulting from general performance deficiencies in schizophrenia. Journal of Abnormal
Psychology, 110(1), 15–30. https://doi.org/10.1037/0021-843X.110.1.15
Lindsay, G. , Ricketts, J. , Peacey, L. V. , Dockrell, J. E. , & Charman, T. (2016). Meeting the
educational and social needs of children with language impairment or autism spectrum disorder:
The parents’ perspectives. International Journal of Language & Communication Disorders,
51(5), 495–507. http://doi.org/10.1111/1460-6984.12226
Linn, R. L. (1997). Evaluating the validity of assessments: The consequences of use.
Educational Measurement: Issues and Practice, 16(2), 14–16.
Lowman, R. (2013). Ethical issues related to personnel assessment and selection. Chapter 6. In
New directions in assessing performance potential of individuals and groups: Workshop
summary. National Academies of Sciences, Engineering, and Medicine (pp. 101–107). The
National Academies Press. https://doi.org/10.17226/18427
Manolakelli, A. (2022, September 5). Inter, multi, cross, trans, & intra-disciplinary: What is the
difference and why is it important? ArchPsych. www.archpsych.co.uk/post/disciplinarities-
definitions
Mehrens, W. A. (1997). The consequences of consequential validity. Educational Measurement:
Issues and Practice, 16(2), 16–18.
Messick, S. (1989). Validity. In R. Linn (Ed.), Educational measurement (3rd ed., pp. 13–100).
American Council on Education.
Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’
responses and performances as scientific inquiry into score meaning. American Psychologist,
50(9), 741–749. https://doi.org/10.1037/0003-066X.50.9.741
NCEE . (1983). National Commission on Excellence in Education (NCEE) A nation at risk: The
imperative for educational reform. NCEE.
Newton, P. E. , & Baird, J.-A. (2016). Editorial: The great validity debate. Assessment in
Education: Principles, Policy & Practice, 23(2), 173–177.
https://doi.org/10.1080/0969594X.2016.1172871
Newton, P. E. , & Shaw, S. D. (2014). Validity in educational & psychological assessment.
SAGE Publications Ltd. https://doi.org/10.4135/9781446288856
Nisbet, I. , & Shaw, S. D. (2020). Is assessment fair? SAGE Publications Ltd.
OECD . (2004). Learning for tomorrow’s world: First results from PISA 2003. OECD.
OECD . (2016). Innovating education and educating for innovation: The power of digital
technologies and skills. OECD Publishing. http://doi.org/10.1787/9789264265097-en
OECD . (2018). The future of education and skills: Education 2030.
www.oecd.org/education/2030-project
Pellegrino, J. W. (1999). The evolution of educational assessment: Considering the past and
imagining the future ( William H . Angoff Memorial Lecture Service , Ed.). The Educational
Testing Service.
Peters, R. S. (1966). Ethics and education. George Allen and Unwin.
Popham, W. J. (1997). Consequential validity: Right concern-wrong concept. Educational
Measurement: Issues and Practice, 16(2), 9–13.
Putnam, R. D. , & Garrett, S. R. (2020). The Upswing: How we came together a century ago
and how we can do it again. Swift Press.
Research in Practice (RiP) . (2022). What is early help?: Concepts, policy directions and multi-
agency perspectives. Ofsted.
Richardson, M. , & Clesham, R. (2021). Rise of the machines? The evolving role of AI
technologies in high-stakes assessment. London Review of Education, 19(1), 9, 1–13.
https://doi.org/10.14324/LRE.19.1.09
Shepard, L. A. (1993). Evaluating test validity. Review of Research in Education, 19, 405–450.
Shepard, L. A. (1997). The centrality of test use and consequences for test validity. Educational
Measurement: Issues and Practice, 16(5–8), 13.
Smith, R. , Egglestone, C. , Jones, E. , & Aldridge, F. (2019, December). Adult participation in
learning survey 2019. Learning & Work Institute. https://learningandwork.org.uk/wp-
content/uploads/2020/04/Adult-Participation-in-Learning-Survey-2019.pdf
Snow, R. E. , & Lohman, D. F. (1989). Implications of cognitive psychology for educational
measurement. In R. L. Linn (Ed.), Educational measurement (pp. 263–331). Macmillan
Publishing Co, Inc; American Council on Education.
Swaffield, S. (2009). The misrepresentation of Assessment for Learning – and the woeful waste
of a wonderful opportunity [Online]. In AAIA national conference, Bournemouth, 16–18
September 2009. Retrieved August 29, 2018, from
www.aaia.org.uk/content/uploads/2010/07/The-Misrepresentation-of-Assessment-for-
Learning.pdf
Timmis, S. , Broadfoot, P. , Sutherland, R. , & Oldfield, A. (2016). Rethinking assessment in a
digital age: Opportunities, challenges and risks. British Educational Research Journal, 42(3),
454–476.
Trilling, B. , & Fadel, C. (2009). 21st century skills – Learning for life in our times. Jossey-Bass.
UNESCO . (2000). The right to education: Towards education for all throughout life. World
education report 2000. United Nations (UNESCO Publishing).
https://unesdoc.unesco.org/ark:/48223/pf0000119720
UNESCO . (2019). 4th global report on adult learning and education. Leave no one behind:
Participation, equity and inclusion. UNESCO Institute for Lifelong Learning.
https://uil.unesco.org/system/files/grale_4_final.pdf
United Nations . (2015). Transforming our world. The 2030 agenda for sustainable development
[Online]. UN. https://sustainabledevelopment.un.org/post2015/transformingourworld
U.S. Department of Education, National Center for Education Statistics . (2004). Stronger
accountability: Testing for results: Helping families, schools, and communities understand and
improve student achievement. www.ed.gov/nclb/accountability/ayp/testingforresults.html
Vitello, S. , Greatorex, J. , & Shaw, S. D. (2021). What is competence? A shared interpretation
of competence to support teaching, learning and assessment. Cambridge University Press &
Assessment.
World Education Forum . (2015). New vision for education: Unlocking the potential of
technology. www3.weforum.org/docs/WEFUSA_NewVisionforEducation_Report2015.pdf
World Education Report . (2000). The right to education: Towards education for all throughout
life. UNESCO Publishing.