0% found this document useful (0 votes)
51 views62 pages

10.4324_9781003346166_previewpdf

Uploaded by

Waleed Waley
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
51 views62 pages

10.4324_9781003346166_previewpdf

Uploaded by

Waleed Waley
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 62

EDUCATIONAL ASSESSMENT IN A

CHANGING WORLD

This timely book takes stock of the wide range of developments in society,
education and assessment and offers conclusions and strategies that are
necessary for the future of educational assessment.
Drawing on examples from the UK, Europe and USA, the book will
dissect cultural, political, psychological and ideological ideas on society,
education and assessment and foreground pressing issues relating to
artificial intelligence, social justice and climate change. Acknowledging its
predominantly Western perspective and providing context on the evolution
of educational assessment, the book will bridge the gap between theory and
practice to progress debate and discourse on creating a culture of assessment
fit for the future and rethinking strategies for the path ahead.
Ultimately, the book will provide insights and key takeaways for the
field of educational assessment along with an evidence-based agenda that
will be relevant for education professionals, the assessment industry and
policymakers interested in higher education, international and comparative
education and testing.

Isabel Nisbet has held senior roles in the regulation of qualifications and
assessment in the UK.

Stuart Shaw is Honorary Professor of University College London in the


Institute of Education – Curriculum, Pedagogy & Assessment, UK.
EDUCATIONAL
ASSESSMENT IN A
CHANGING WORLD
Lessons Learned and the Path Ahead

Isabel Nisbet and Stuart Shaw


Designed cover image: © Getty Images
First published 2025
by Routledge
4 Park Square, Milton Park, Abingdon, Oxon OX14 4RN
and by Routledge
605 Third Avenue, New York, NY 10158
Routledge is an imprint of the Taylor & Francis Group, an informa business
© 2025 Isabel Nisbet and Stuart Shaw
The right of Isabel Nisbet and Stuart Shaw to be identified as authors
of this work has been asserted in accordance with sections 77 and 78
of the Copyright, Designs and Patents Act 1988.
All rights reserved. No part of this book may be reprinted or
reproduced or utilised in any form or by any electronic, mechanical,
or other means, now known or hereafter invented, including
photocopying and recording, or in any information storage or retrieval
system, without permission in writing from the publishers.
Trademark notice: Product or corporate names may be trademarks
or registered trademarks, and are used only for identification and
explanation without intent to infringe.
British Library Cataloguing-in-Publication Data
A catalogue record for this book is available from the British Library

ISBN: 978-1-032-38663-8 (hbk)


ISBN: 978-1-032-38661-4 (pbk)
ISBN: 978-1-003-34616-6 (ebk)
DOI: 10.4324/9781003346166

Typeset in Sabon
by Apex CoVantage, LLC
CONTENTS

About the authors vi


Acknowledgements viii
Authors’ preface ix
Foreword xi

1 Introduction 1

2 Developments in education and assessment 17

3 New priorities and an unexpected shock 58

4 Changes to thinking about society 96

5 Changes to thinking about education and assessment 122

6 The moral compass 170

7 Lessons learned and the path ahead 191

Afterword 208
Index 210
ABOUT THE AUTHORS

Isabel Nisbet’s academic training was in philosophy, with her tutors includ-
ing R.S. Downie in Glasgow and R.M. Hare in Oxford. Her professional
career has been in government and regulation in the UK, including posts in
government departments in Scotland and England and senior roles in the
regulation of medicine and postgraduate medical education. These led to a
Director role in the Qualifications and Curriculum Authority in England.
Isabel was the founding CEO of Ofqual, the statutory regulator of quali-
fications and assessments in England. From 2011 to 2014, she worked for
Cambridge Assessment in South East Asia, based in Singapore. Isabel has
served on the Board of Qualifications Wales and has been governor of four
universities in England. She is currently Vice-Chair of the Board of Gover-
nors of the University of Bedfordshire. In 2021, Isabel was appointed to a
panel carrying out an Independent Review of Education in Northern Ireland,
and their report was published in December 2023. She is a member of the
National Statistician’s Data Ethics Group, and she contributes regularly to
national and international conferences and seminars.

Stuart Shaw is Honorary Professor of University College London in the


Institute of Education – Curriculum, Pedagogy & Assessment. Stuart has
worked for international awarding organisations for over twenty years and
is particularly interested in demonstrating how educational, psychological
and vocational tests seek to meet the demands of validity, reliability and fair-
ness. He left Cambridge Assessment (now Cambridge University Press & As-
sessment) – where he was Head of International Research, in January 2001
to pursue work as an educational assessment consultant. Stuart has a wide
range of publications in English second language assessment and educational/
About the authors vii

psychological research journals (including a number of books). Stuart is Chair


of the Board of Trustees of the Chartered Institute of Educational Assessors
(CIEA). He is also a Fellow of the CIEA. He is a Fellow of the Association for
Educational Assessment in Europe (AEA-Europe), an elected member of the
Council of AEA-Europe, and is Chair of its Scientific Programme Committee.
Stuart is also an elected member of the Board of Trustees of the International
Association for Educational Assessment (IAEA) and Chair of its Commu-
nications Committee. He is also the Chair of the e-Assessment Association
“Research” awards.
ACKNOWLEDGEMENTS

We are very grateful to the following people for comments on draft chapters:

Eleanor Andressen
Ben Colburn
James Conroy
Catarina F. Correia
Martin Johnson
Nick Hillman
Paul Newton
Elisa de Padua
Mick Walker
Lesley Wiseman

The content of the book has benefited from the comments of participants
who attended the 2023 conferences of the Association of Educational As-
sessment, Europe, and the British Educational Research Association; and
events held by the Chartered Institute of Educational Assessors; the Institute
of Education, University College London; and Cambridge University Press &
Assessment.
AUTHORS’ PREFACE

This book has been prompted by our shared awareness of the need for the
rather specialised world of educational assessment to look outside its fa-
miliar spheres of reference to changes in the world and in education and
re-assess where it should go next. We came to this conclusion from different
backgrounds – one from detailed participation in research on educational
assessment in theory and practice; the other bringing an academic training in
philosophy to a professional career in policy and regulation covering educa-
tion and assessment in a wide range of contexts.
We had collaborated before, particularly on fairness in assessment (Nisbet &
Shaw, 2020), and contributed to conferences and seminars for assessment
researchers. During the Covid-19 pandemic, many of these events had to be
held remotely, and this gave us the opportunity to participate in discussions
in the USA, as well as in Europe and in the different constituent parts of the
UK. We were particularly struck by the contrast between the preoccupations
of conference delegates on the two sides of the Atlantic. Our US colleagues
used their coffee breaks and plenary discussions to talk animatedly about
difficult and controversial issues – notably race – which dominated their per-
ception of the context in which they had to work. Some of them were very
worried by the bitterness of the public debate around areas of their work and
about the use being made of the assessments that they had helped to produce.
In European events, there was certainly the feel of a community of practice
meeting each other and producing – and critiquing – high-quality detailed
work. There was an awareness of the national policy contexts in which they
practised, but not the same preoccupation with challenges from the world
beyond assessment.
x Authors’ preface

We came increasingly to the view that, as we approach the end of the first
quarter of the 21st century, it is time to stand back and survey educational
assessment in context. That context includes developments in society and
education, as well as developments in thinking about society and education.
We have attempted to cast our net widely and bring together source material
from different disciplines and very different subject matter. Synthesising such
a wide range of material can be uncomfortable for assessment researchers
used to detailed analytic work, but it reflects the intertwining of different
factors in the real world where assessment is situated.
The wide scope of the material that we have sought to include in our syn-
thesis has made this project very challenging for us. It also means that we
have had to be selective. Some readers may find that issues of particular inter-
est to them have not been covered. But we hope that the questions we have
asked and the approach we have taken will be relevant and helpful. We are
also limited in that almost all of the source material we have used has been
in the English language.
We hope that this book will be of interest not only to assessment research-
ers and academics but also to newcomers to work in educational assessment,
to policymakers and to workers in government and regulation affecting edu-
cational assessment. We also hope that students who are seeking to deepen
their understanding of assessment in context will use the many references
that we have provided to follow up topics of particular interest to them.
We have expressed our own views throughout the book, particularly in
the final chapter. We expect that some readers will disagree with us. Indeed,
we would be disappointed if that were not so. For us, the importance of this
exercise is to use its wide scope to raise important questions for assessment
as we move into the second quarter of the century. Twenty-five years later, it
will be time to take stock again.
Isabel Nisbet and Stuart Shaw
May 2024

Reference
Nisbet, I., & Shaw, S. D. (2020). Is assessment fair? SAGE Publications Ltd.
FOREWORD

History, it might be argued, is about considering both change and continuity


within the scope of human existence. Reflecting on who we are, how we live
and, in the case of this book, how we are educated, matters if we are to un-
derstand and learn from what has been and to consider what might be in the
future. Research and writing about educational assessment might seem, to a
casual bystander, to have little relevance to daily life once we have left formal
education. However, that is not the case. Assessment is crucial in terms of
understanding what we know, reflecting on experience and, perhaps most
importantly, applying these things to our lives.
The history of assessment demonstrates that very little actually changes in
terms of either policy or practice. We tend to privilege and trust certain types
of assessment, notably those resulting in a grade or mark from an examina-
tion result. Such forms of assessment are not bad or wrong, but they have
limitations that are often ignored. However, their use continues despite the
body of evidence emerging from research from the latter part of the 20th
century onwards, advocating new ways of assessing learning that are inclu-
sive, focused on learning and which drive student motivation in more ways
than simply chasing the highest grade. But the question remains: Is there an
appetite for any change, for other ways of thinking about assessing learning?
What this book does is to engage with key issues that are not, on first sight,
obviously linked to assessment and deftly interrogate how and why they
should matter to all of us in education. The authors admit to the somewhat
daunting challenge of such a task and, in doing so, provide a sound argument
for seeking more than technical “solutions” for how to manage the chal-
lenges in assessment. Their approach is not to ignore pragmatic resolutions
xii Foreword

but to use deep thinking, genuine reflection, and a range of examples to inter-
rogate the breadth and reach of assessment issues we currently face.
Assessment is a frequent feature in global news media, and this reflects a
sustained public interest where grades and other assessment outcomes claim
to characterise the success (or otherwise) of education systems. The Covid-19
pandemic revealed the limitations of national testing systems based on ancient
and embedded beliefs that require students to sit in examination halls for fi-
nite periods of time in order to “show their learning”. For example, in Eng-
land, Norway and the Netherlands, examinations were cancelled completely
during the height of the pandemic; in China, Hong Kong and Spain, national
tests were postponed; and in the USA, entire test systems were rewritten at
speed to create something that worked in a socially distanced world. Along-
side these cancellations were hasty enactments of assessments that relied on
incomplete sets of data and school-level reporting. What followed from this
was a global wringing of hands about whether national test results (and simi-
lar assessments) were fair or even accurate. This in turn revealed anger and
fear on the part of students who felt their very futures were in peril. The fall-
out from the pandemic is unknown in terms of its impact on education and
it will be perhaps decades before we have anything approximating a good
understanding of what has unfolded as a result of school closures, lost learn-
ing and, in the case of assessment, lost experience of test taking. But what
we have learned is that students are taught from a young age that assessment
outcomes, particularly examination results, really matter and this message
means that they become a part of a learner’s identity. In turn, teachers know
that assessment outcomes will reflect on their practice, both in the classroom
and as leaders of educational institutions. What this book ponders is how
it is time to consider the value of inculcating such beliefs in our education
systems. It is very rare to see philosophical considerations of the moral and
ethical implications of assessment and their inclusion here is to be welcomed.
For many of us in the assessment “world”, such writing may not make for
comfortable reading, but it is necessary reading. Well-being is now a common
part of public discourse, and here its links to education (and assessment) are
laid bare, in terms not simply of the mental stress resulting from testing but
of a global notion of well-being. This holistic view can be seen in terms of
creating sustainable societies that are able to understand and manage the hu-
man and artificial challenges unfolding in the 21st century; education has a
vital role to play if we wish to assure our future. There are no absolute solu-
tions to the issues presented in this book, but this is not the point because the
authors are not attempting to do this. Rather, they are shining a light on what
has happened and presenting some thoughts about what might be.
Assessment requires an open mind to afford continuous engagement in
reflective practice. It is this openness that allows us to spot the potential to
learn from experience and perhaps to improve the human condition. This is
Foreword xiii

not easy as it challenges that very human wish to take the well-trodden path,
but we stop being curious and attempting to tackle the thorniest of problems
in education at our peril and, importantly, at the peril of those who follow us.
Many of the recent debates around education are highly polarised and critics
often take the easy route and present just two sides to each story. This book
presents ways we might move beyond a binary argument towards more nu-
anced ways of talking about education and assessment; let the debate begin.
Mary Richardson
Professor of Educational Assessment
IOE, Faculty of Education and Society,
University College London
1
INTRODUCTION

Some readers will remember the millennium. We certainly do. It prompted


much reflection and looking forward. The western world celebrated half a
century of comparative international peace and marvelled at the opportuni-
ties offered by worldwide travel and speedy communication. Participation in
education had increased in most countries of the world, and this was seen
as closely linked to economic prosperity and growth. There was an industry
of writing about “21st century skills”, with an emphasis on creative think-
ing, working together, and using the opportunities presented by technological
advance.
There was a short-term panic about risks to computers from the “millen-
nium bug” – the fear that computers that only registered the last two digits
for dates would either treat the year 2000 as 1900 or, worse still, shut down
altogether, with catastrophic consequences, not least for education. In the
event, that fear – which was very real at the time – failed to materialise.
But more lasting concerns remained – about inequality between and within
countries, about poverty and hunger, and about worrying signs of climate
change. However, many shared the largely optimistic spirit of the millennium
speech by the American President Bill Clinton:

Never before have we known as much about each other. Never before
have we depended so much on each other. Never before have we had such
an opportunity to move toward what the generations have prayed for,
peace on Earth and a better life for all. We must both imagine a brighter
future and dedicate ourselves to building it, and I ask you all here today to
reaffirm the clear understanding that we must do it together.1

DOI:10.4324/9781003346166-1
2 Introduction

There was also reflection on where matters stood in the world of educa-
tional assessment. As the 20th century began to draw to a close, Professor
Caroline Gipps wrote Beyond Testing: Towards a Theory of Educational
Assessment, in which she reflected on developments in assessment during
the 1990s. She examined technical issues about the effect of assessment
on curriculum and teaching, the relationship between performance as-
sessment and assessment by teachers, and she began the book with these
words:

This book is written as part of the attempt to reconceptualize assessment


in education in the 1990s. There has been over the last decade an explo-
sion of developments in assessment and a number of key actors have been
reconceptualising the issues. The aim of this book is to bring together
much of this work to discuss and synthesize it in an attempt to further
our understandings and practice in educational assessment: to develop the
theory of educational assessment.
(Gipps, 1994, p. 1)

In our book, written some thirty years later, we are seeking to take up the
baton offered by Gipps. We believe it is now time for a rethink about educa-
tional assessment, taking into account recent developments affecting assess-
ment practice and developments in thinking about education and assessment,
and looking forward towards the mid-21st century.
In this introductory chapter, we set out the approach taken by the book,
and we briefly describe the content of the subsequent chapters. In conclusion,
we offer a scene-setting account of some of the dominant themes in educa-
tion and educational assessment at this time. These themes will be explored
in greater depth throughout the book.

An introduction to the book

Our approach
The size of the challenge that we have taken up has required us to bring
together a wide range of sources and academic disciplines – including, in ad-
dition to education and assessment, psychology, public policy, information
technology, law, science and moral philosophy. Such synthesis is required,
we suggest, as the issues we discuss are essentially interdisciplinary (requir-
ing an integration of contributions from several disciplines),2 as is the real
world in which they are situated. However, it does have the drawback that,
by necessity, we have had to be selective in the examples we discuss. Readers
may have particular interests that are not covered. We hope that they will be
encouraged to explore these further themselves and apply some of the ques-
tions we have posed here.
Introduction 3

Both authors are based in England, though they have worked elsewhere.
The book draws on examples from throughout the UK, but also from the
USA and Europe. Our adoption of an interdisciplinary approach may be of
particular interest in the USA, where academic thinking on assessment is now
much more influenced by other academic disciplines than it was previously.
The book also draws on publications by international organisations such as
the Organisation for Economic Co-operation and Development (OECD) and
the World Economic Forum (WEF). Almost all our source material is in the
English language.
In Chapters 2–6, we explore developments and changes to thinking about
education and assessment. Many of the examples we have cited merit much
longer and more detailed discussion than has been possible for a book of
this scope. Our purpose has been to rise above the details and draw lessons
about the implications for assessment. However, we have offered references
at the end of each of these chapters, which should enable readers to follow
up in more detail particular issues that interest them. That has resulted in
a contrast of styles between different parts of the book. Chapters 2 and 3
are grounded more in the literature, while Chapters 4, 5 and 6 emphasise
more theoretical issues, examining developments in thinking about society
and education and debating the issues that they raise.

Our use of terms


Definitions of concepts such as “education” and “assessment” could be dis-
cussed at length.3 However, at this point, we confine ourselves to saying what
we mean by those terms in this book. By “education” we refer to all processes
that lead to learning or the acquisition of knowledge, skills or understanding.
Our use of “processes” here may be seen as too narrow, but for our purposes
it is sufficient to point out that we are not confining our consideration to
formal education in schools or colleges (we are not using “education” as a
synonym for “schooling”).4 We return to some of these definitional issues in
Chapter 6.
We are using “assessment” to denote “a judgement based on evidence”,5
drawing on the Latin derivation from ad sidere (“sitting beside”). This al-
lows selection judgements and diagnostic processes and conclusions to be
included as forms of “assessment”. By “educational assessment” we mean all
such evidence-based judgements in educational contexts.6 “Assessment”, as
the term is used in this book, is not confined to “exams” or “tests” but does
not exclude either.

Structure of the book


Each of Chapters 2–6 describes and discusses developments and concludes
by posing and attempting to answer the question “What does this (the
4 Introduction

development discussed in the chapter) mean for assessment?” Emerging con-


clusions are brought together in the final chapter. The assessments discussed
in the book are largely educational assessments. However, many of the issues
discussed are also relevant to assessment for entry to – and advancement
in – employment and the professions, although we do not discuss these ap-
plications in depth.
Chapter 2 (“Developments in education and assessment”) offers an over-
view of important educational reviews and educational assessment initiatives
taking place around the turn of the 21st century. In the latter decades of the
20th century, many countries sought to articulate the educational needs of
the next generation, described by the US National Commission on Excel-
lence in Education as a “Learning Society” (NCEE, 1983). There followed an
overabundance of lists of “21st century skills” – the competences, skills and
learning dispositions identified as being required for success in 21st-century
society and workplaces, with linked guidance on curriculum and assessment
(e.g. Trilling & Fadel, 2009). The chapter also describes a developing fo-
cus on what it means to be “competent” in modern-day society (European
Commission Education & Culture, 2007; Vitello et al., 2021), and the im-
plications for the curriculum – and related assessment – in formal education.
Finally, Chapter 2 refers to developments in technology, including digital
data systems, “deep” and transformative technologies, computational intel-
ligences and smart automation, concluding with a discussion of the impact of
generative artificial intelligence (AI).
In Chapter 3 (“New priorities and an unexpected shock”), the two priori-
ties that we identify and discuss in detail are climate change and well-being.
The “unexpected shock” is the Covid-19 pandemic. The “new priorities”
are not new developments, but the priority now given to them is a highlight
of the first quarter of the 21st century. Climate change has very quickly ag-
gravated environmental and social concerns (in both developed and develop-
ing countries), as well as directly and indirectly affecting all organisations,
institutions and areas of life during the early part of the 21st century. And
the two “new priorities” are linked by the reported increase in anxiety and
stress about the future of the planet. Questions about the implications for
educational assessment are raised and discussed in the chapter. Well-being
and mental health, including that of young people, are increasingly seen as
important objectives of education and offer a template to hold against edu-
cational assessment: Does assessment focus on the right things and do its
practices and institutions promote well-being?
Covid-19 was undoubtedly a shock, though many governments had pre-
pared for such an eventuality to some extent. We are only beginning to un-
derstand the impact of Covid-19 on teaching, learning and the content and
practicalities of educational assessment. What is clear is that the pandemic
has created a fissure in long-term thinking about education and assessment:
Introduction 5

it is not possible to chart continuous straight-line development through the


first quarter of the century.
Chapter 4 (“Changes to thinking about society”) seeks to identify trends
in thinking about society and public policy that have come to the forefront in
the 21st century and that are particularly important for education and assess-
ment. Views about the purpose and content of education are at the heart of
debates about society and values and arguably have become more contested
and divisive (Putnam & Garrett, 2020). “Culture wars” have been reflected
in conflicting views about assessment and the use of assessment for selection.
This has played out most notably in the United States (Campbell & Man-
ning, 2018) but has reverberations in Europe, and perhaps particularly in
England. The chapter considers the theoretical challenges presented by criti-
cal theory – and, in particular, by Critical Race Theory – and then presents
two case studies: the debate in the USA about whether the law should allow
race-conscious college admissions policies; and the agenda for “decolonis-
ing” the university curriculum in the UK. All these theoretical developments
have implications for assessment – for what is assessed and how, and how
the outcomes are used.
Chapter 5 (“Changes to thinking about education and assessment”) iden-
tifies and discusses strands of thinking about education and educational as-
sessment that are particularly powerful or important at this point in the 21st
century. These include trends in thinking about the purposes of education,
challenges to any consensus on constructivist views of learning and a revival
of support for “knowledge”. We consider the theoretical issues raised by the
increased focus on “competence” as an aim of education and a construct for
assessment. We also consider the challenges posed to the conceptualisation
of education and assessment by the availability of “big data” and the seismic
impact of generative AI.
Chapter 6 (“The moral compass”) seeks to analyse moral questions about
assessment in educational contexts. It starts with a brief account of the do-
main of “morality” and proceeds to address key, fundamental, questions:
What is the moral justification for educational assessment? What moral chal-
lenges can be made to educational assessment, and are they persuasive? And
what moral principles should govern practice in educational assessment?
In Chapter 7, we draw together lessons learned from the previous chap-
ters and offer conclusions about the path ahead for assessment theory and
practice. We indicate areas in which further work will be required. We give
examples of what needs to be done, but we do not complete the tasks. For
example, we argue that a reconceptualisation of the theoretical “assessment
argument” is required, and we say why that is so, but it will be for others
to follow our lead and complete the development of a new model argument.
And throughout the book – and particularly in the final chapter – we express
our own views. Readers may disagree with them, but our main aim is to
6 Introduction

invite readers to address the questions we have posed and decide what their
own view is.
Before proceeding to give an introductory overview of these discussions,
we would like to mention three examples of areas of assessment that we
have not had space to discuss in detail in this book, but which we hope will
continue to be taken up by others in the years ahead. The first is the role of
assessment in the development of infants and very young children. There are
two overlapping reasons why assessment in the early years is important. The
first is to provide information as early as possible about children who are not
progressing as might be hoped/expected in areas identified as important for
their development. Common sense and research (e.g. Research in Practice,
2022; OECD, 2018) concur in advocating supportive early intervention. The
second reason is that assessment in the early years can look forward to formal
education (preschool, school and beyond) and can denote aspects of learn-
ing, health and well-being which most accurately predict future educational
achievement. Information from longitudinal sample surveys is typically used
for this purpose. With increasing recognition of the importance of motivation
to learn and its interrelationship with mental health and well-being, the two
purposes increasingly intersect.
The second area of assessment that deserves wider study than has been
possible in this book is its role in relation to the education of learners with
special educational needs and disabilities (SEND). The numbers of children
and young people of school age who have been categorised by governments
as having SEND can fluctuate because of definitions or changes in govern-
ment policy, but in many countries, the trend in the 2020s has been steeply
upwards,7 with the highest numbers diagnosed as having autism, followed
by speech and language difficulties (e.g. Lindsay et al., 2016). The questions
raised for assessment are at least twofold: How can and should incidences
of SEND be assessed? And how can educational assessments be made more
equitable and accessible for learners with SEND?
A third area, which we mention here but do not cover in detail elsewhere,
is the link between assessment and eugenics. Early eugenics, in the 1900s and
before, sought to study ways in which the physical and mental characteristics
of the human race might be improved. The most troublesome link with as-
sessment was the use of testing to identify people with “inferior” genes (as
evidenced, e.g., by their IQ test scores), with consequences including national
measures to prevent or discourage them from having children. The horren-
dous implementation by Nazi Germany in the 1930s and 1940s of practices
based on eugenic ideology is well documented. At this time in the 21st cen-
tury, attention focuses mainly on the elimination of genetic disease. However,
two questions remain pertinent for assessment: Is there any defensible and
unbiased form of assessment that can be used to identify inherited attrib-
utes, knowledge, or skills? And second, should qualifications or evidence
Introduction 7

from assessments of levels of education achieved ever be used as a criterion


for steering priorities in national (or international) policies on encouraging
or discouraging childbearing? As late as 1986, Singapore guaranteed pay
increases to female graduates when they gave birth to a child, while offer-
ing grants towards house purchases for non-graduate married women on
condition that they were sterilised after the first or second child. In China, in
June 1995, a law was passed making it illegal for carriers of certain genetic
diseases to marry unless they agreed to sterilisation or long-term contracep-
tion. All couples who wished to marry had to undergo genetic screening.
Although readers may easily conclude that such examples are not relevant to
future decades in the 21st century, they do bring into focus difficult questions
about the use of educational outcomes for social policy and the possibility of
unbiased, standardised testing.
Why did we not cover these important issues – or others that readers
may identify – in detail? The main reason is space and the need to be selec-
tive, given the wide sweep of the survey of issues in this book. However,
we also consider that the issues that we have selected have wide relevance,
beyond the context in which they first arose, for the world of assessment.
For example, many of the theoretical issues about assessment discussed
in Chapter 7 are as relevant to early years as to the assessment of older
learners.
The remainder of this introductory chapter seeks to bring together some
key features of our account of education and educational assessment at
this time.

Setting the scene

Changing worlds, shifting horizons


The opening quarter of the new century has been defined by iconic moments
and groundbreaking developments, all of which had varying impacts on edu-
cation and assessment. The list includes a proliferation of wars: the US in-
vasion of Iraq and the long-term impact on the Middle East; ongoing civil
wars in Syria, Libya and Yemen; the Russian invasion of Ukraine; genocide
in Congo and Darfur; the “Arab Spring” – a series of uprisings and protests
against Arab governments; deepening concern over the rise of Islamic ex-
tremism following the 9/11 terrorist attacks on the USA; and conflict in Israel
and Palestine. Economically, 2008 saw the worst global recession since the
Great Depression in the 1930s; the rise of a global economy and Third World
consumerism; the growth of international migration; and the acceleration of
the global shift from working in agriculture to living in cities.
Developments in communications included the growth of online social me-
dia and networking services such as YouTube and Facebook; the launch of
the first Android smartphone; the emergence of Global Positioning Systems;
8 Introduction

and increasingly faster cellular technologies like the internet. The United
States elected its first African American President; the UK departed from the
European Union; and culturally many countries saw rises in nationalism, in
contrast to the internationalism of communications available, and increas-
ingly polarised differences of view (“culture wars”). And all of these develop-
ments are over and above those we have selected for more detailed discussion
in Chapter 3, such as Covid-19 and the rapid increase in evidence – and
awareness – of the threats posed by climate change.
Shifting horizons have been a prevailing feature dominating the first
quarter of the 21st century: shifts in technology, resources, migration and
demographics – from leveraging assets to accessing ecosystems; from the
knowledge economy to the collaboration economy; and shifts in power from
corporations to technology platforms.
As the 21st century began to unfurl, it was becoming increasingly evident
that technological “connectedness” was not only beginning to pave the way
for transformative changes in the way society and individuals functioned
but also starting to disrupt almost every area of life. At the time of writ-
ing, generative AI is the world’s fastest-growing “deep” technology,8 and is
demonstrating enormous potential to reform the rules of industries and or-
ganisations; drive significant economic growth; and transform all sectors of
life, including education (HM Government, 2021).
In these changing contexts, educational assessment has itself been chang-
ing (e.g. Pellegrino, 1999; Bennett, 2002). A backcloth of growing diver-
sity, increased migration, globalisation, the emergence of new players in the
world economy and the explosion of information technology has meant that
citizens of most countries need to upgrade their skills throughout their adult
lives in order to keep abreast of changes in the requirements of modern liv-
ing, both in the workplace and in their personal lives. “Lifelong learning”9
has become the new mantra for all citizens in the modern world.
Education is expected to prepare learners for a fast-changing world in
which technological, demographic, social, environmental, economic and po-
litical transformation are proving to be seismic. Assessment is increasingly
expected to take account of the need to support all the developments de-
scribed here, including increased participation in schooling and in university
education (particularly in preparation for the increase in careers requiring a
degree); “credentialism” (increased demand for formal qualifications); and
the need for so-called 21st century-competencies (OECD, 2018).

Setbacks and unresolved issues


The early years of the 21st century saw a plethora of visionary initiatives,
strategies, mandates and reform movements that set out key educational
goals to be fulfilled by specific deadlines (see, e.g. UNESCO, 2000; World
Introduction 9

Education Report, 2000; World Education Forum, 2015). However, a mere


15 years after 164 countries agreed to work towards “Education for All”,
the six goals set at the turn of the century were achieved by only one-third of
them, and only half made universal primary education a reality.
The United Nations 2030 Agenda for Sustainable Development included
a Fourth Sustainable Development Goal, which was to “Ensure inclusive
and equitable quality education and promote lifelong learning opportuni-
ties for all” (United Nations, 2015, p. 18). Growing importance was placed
on “lifelong learning”, which had been championed in the latter decades of
the 20th century. Lifelong learning not only seeks to enhance social inclu-
sion, active citizenship and personal development but serves as a catalyst for
competitiveness and employability. However, according to the OECD (Bol-
lington, 2015), actual implementation of related policies was falling behind
quite quickly, with some sources suggesting that adult participation beyond
formal school years was low and has remained low (Smith et al., 2019; UN-
ESCO, 2019).
Nevertheless, the importance of learning for the welfare of the nation
and its citizens beyond formal schooling has continued to be thought to be
crucial in fostering a learning culture fit for the 21st century. Empowering
learners with “new” skills and competencies constituted a nation’s human
capital, upon which the 21st-century economy and society were seen to de-
pend. Though not a new concept, the “learning society” (an educational phi-
losophy backed by the OECD and UNESCO) increased in recognition and
popularity with the proposal that lifelong learning is a condition for global
economic competitiveness (superseding the former conception of it being a
condition for democratic citizenship). However, there were important chal-
lenges to making lifelong learning for all a reality, not least of which was
equitable access to learning.10
The “21st century skills” were thought to be essential for success in
21st-century society and workplaces. Lists of these skills were shared across
the world, and education was seen as linked to growing internationalism
across countries and multiculturalism within countries (European Commis-
sion, 2019). In reality, the skills learners needed for the 21st century were nei-
ther new nor qualitatively different from those required in previous times.11
What was different, however, was the degree to which national and individual
economic success was seen as reliant on the acquisition of such skills – even
though there was never agreement on precisely what the skills were.
The ubiquity of increasingly advanced technology promised novel oppor-
tunities for teaching, learning and assessment. Voices throughout education
made ambitious claims about the extent of change that technology would
drive in education and the speed with which it would take place (Boston,
2005). In the world of educational assessment, technology was seen as
opening doors to many new opportunities and promising much in terms of
10 Introduction

informed interventions, practice and policy. It seemed inevitable that tech-


nology would “force fundamental changes in the format and content of as-
sessment” (Bennett, 2002, p. 2; Boston, 2007). However, in 2016, the OECD
reported that the influence of digital technologies on educational assessment
appeared “shallow” (OECD, 2016, p. 3)12 and in many countries there con-
tinued to be a nervous reluctance to use digital technologies in high-stakes
national examinations. Now, more than two decades into a new century,
we see that while the availability of digital-based learning and assessments
continues to expand, we are still on the journey towards being able to assert
definitively that “we are making appropriate use of good technology” (Rich-
ardson & Clesham, 2021, p. 5).
As key assessment educators and organisations were increasingly coming
to accept the inevitable union of assessment and technology, they were also
becoming more aware of the ethical considerations that the development and
implementation of technology-enhanced assessment practice would create.13
Ethical issues were varied and far-reaching:

• Would technology-enhanced assessment lead to new social and educa-


tional divides?
• What would be the dangers relating to the collection, use and protection
of huge personalised data sets and the ownership and control of informa-
tion? Could – or should – assessment providers take steps to mitigate these
dangers?
• To what extent could digital technologies support fairer assessment meth-
ods and greater involvement of learners in their own assessment?

Ethical concerns touched upon emotive issues: social exclusion, trust, indi-
vidual autonomy, new forms of digital dividedness14 and privacy as well as
the increasing risks associated with “big” data and the rise of learning analyt-
ics.15 We discuss this in more detail in Chapter 5.
The impact of advances in the cognitive sciences on educational assessment
had already been a cause of some optimism in the second half of the 20th
century. It was predicted that the potential of cognitive psychology would
be “fully realized through item design” (Embretson & Gorin, 2001, p. 343).
Aspects of cognitive psychology appeared particularly well-suited to psycho-
metric traditions of theory and practice, where measurement and cognitive
issues intersected. Any means of observing test-taker behaviours and the
mental processes they employed in responding to and solving test questions
were perceived as fundamental to construct validity (Snow & Lohman, 1989;
Messick, 1995, p. 742; Knight & Silverstein, 2001).
Throughout the first decade of the new century, there was growing de-
mand to make assessments more transparent about the cognitive processes
they sought to measure (US. Department of Education, 2004). It was evident,
Introduction 11

for example, that the competencies required for “mathematisation” (OECD,


2004, p. 40) encompassed a number of cognitive activities and demands elic-
ited in assessments for the OECD’s Programme for International Student As-
sessment (PISA) in 2003.
Over the last thirty years, cognitive diagnosis has been increasingly in-
fluential in a range of educational contexts to measure and advance indi-
vidual development. The question of how psychological constructs such as
cognition and personality can be optimally related to observable behaviour
was seen as central to psychometric measurement, particularly in the USA.
Research was also beginning to focus more on theories of learning and their
relationship with educational assessments (see, e.g. Baird et al., 2014).
Alongside cognitive psychology, the application of neuroscience to educa-
tion was also gaining traction, helped by the emergence of innovative im-
aging technologies (Goswami, 2006). Neuroscience and the psychology of
learning were demonstrating their potential relevance, legitimacy and pos-
sibilities when applied to educational assessment (Dhawan, 2014).
In the latter stages of the 20th century, talk of “assessment for learning”
(AfL), as opposed to “assessment of learning”, became prominent in discus-
sion of educational assessment in many countries, with many at the time
championing AfL as one of the most promising approaches for initiating im-
provement in student learning. In their highly acclaimed review of classroom
assessment practices, Black and Wiliam (1998) suggested that increased
adoption of and engagement with formative assessment approaches would
lead to noteworthy improvements in standards of attainment and achieve-
ment. However, they also expressed uneasiness that progress had been
slow-moving, primarily owing to the amount of effort afforded to the vari-
ous developments of summative assessments. In England, the “Assessment
Reform Group” (1989–2010) played a key role over the turn of the century
in making the case that policy on educational assessment should take more
account of relevant research findings. However, there were ideological and
policy differences about education and the place of assessment in it, and the
competing views had their academic champions.
In addition to conceptual confusions and definitional ambiguities, practi-
cal barriers to the integration and implementation of AfL classroom practices
were beginning to be reported in the early research literature, even causing
some to question the legitimacy of treating AfL as a type of “assessment” at
all (e.g. Swaffield, 2009; Bennett, 2011; Didau, 2014; Fletcher-Wood, 2017;
Brown, 2019). It was clear, at the turn of the century, that formative assess-
ment was not well understood by teachers and was weak in practice.
Other theoretical disputes arose during this period. One in particular re-
lated to the scope of validity – a controversy that had been simmering since the
late 1980s. In 1989, Samuel Messick’s conceptualisation of validity widened
the compass of validity inquiry by including social and value-laden aspects
12 Introduction

of assessments. He effectively extended traditional measurement boundaries


into issues relating to policy – what Kane (2001) has termed the prescrip-
tive part of a validity argument. However, almost immediately following the
publication of Messick’s (1989) seminal treatise on validity, his progressive
matrix16 (based on a foundation of construct validity) was subject to intense
scrutiny and criticism (see, e.g. Shepard, 1993, 1997).
Although Messick’s conception of validity provided the basis for what be-
came a broad professional consensus over core validity concepts within the
mainstream educational and psychological assessment community (AERA
et al., 2014), discontent with Messick’s approach has continued to be voiced.
A new wave of validity theorists has decried the “absurdities of construct va-
lidity theory” (Borsboom et al., 2009, p. 135), rejected what they perceive as
complicated validity frameworks, and contended that construct validity is un-
able to restrict the type and extent of test score interpretations to be considered.
What Newton and Baird (2016) have called “The Great Validity De-
bate” has continued over the years we are reviewing. Broadly, a major
issue has been whether or not social consequences should be defined as an
integral part of a definition of validity, with a “for” camp embracing the
evaluation of social consequences (e.g. Linn, 1997; Shepard, 1997), and
an “against” camp rejecting it (e.g. Mehrens, 1997; Popham, 1997). The
debate continues.17 In Chapter 7, we advocate a future direction for think-
ing about assessment, which has implications for validity as well as for the
theoretical model for the “assessment argument”.
.................
In this introductory chapter, we have outlined the approach and structure of
the book and set the scene by describing and briefly discussing some of the
main issues in educational assessment as we approach the second quarter
of the 21st century. Our aim is to bring together disparate trends and intel-
lectual disciplines, to identify and ask questions about them for educational
assessment, and, we hope, to provide a reference point for similar reviews in
the future. We hope that readers – whether policymakers, assessment practi-
tioners or researchers – will be stimulated to follow up some of the issues we
raise and develop their own ideas as assessment moves forward.

Notes
1 Bill Clinton at the “Millennium Around the World” Celebration, 2000 www.
presidency.ucsb.edu/documents/remarks-the-millennium-around-the-world-
celebration
2 See Manolakelli (2022) – Inter, Multi, Cross, Trans, & Intra-disciplinary:
What is the difference, and why is it important? www.archpsych.co.uk/post/
disciplinarities-definitions
3 As, for example, by R.S. Peters in the first chapter of his Ethics and Education
(1966). Aspects of Peters’s account were disputed then and remain so.
Introduction 13

4 See Johnson and Majewska (2022) for a review of the literature outlining the
characteristics, benefits and disadvantages of formal, non-formal and informal
learning.
5 We have discussed this definition at greater length in Nisbet and Shaw (2020,
pp. 7–10).
6 Mary James defines educational assessment as “all those activities that involve
eliciting evidence of student learning and drawing inferences as the basis for deci-
sions” (James, 2010, p. 163).
7 For a discussion of trends in the UK, including among young children, see
www.educationalneuroscience.org.uk/2022/04/01/why-has-there-been-a-rise-
in-number-of-sen-children-especially-in-the-early-years/
8 “Deep” technologies are grounded in important scientific advances and engineer-
ing innovations but which require a longer period of gestation and/or extensive
capital investment prior to commercial application. Transformative technologies
are technologies that have the potential to impact across many sectors of the econ-
omy (as opposed to a single sector).
9 “Lifelong learning” was a term coined by Leslie Watkins and popularised by Pro-
fessor Clint Taylor of City Unified School in 1993. While not a new concept, it is
one that has assumed a greater and new emphasis in the 21st century.
10 See the United Nations 2030 Agenda for Sustainable Development Goals – Goal
4: “Ensure inclusive and equitable quality education and promote lifelong learn-
ing opportunities for all”. https://sdgs.un.org/goals
11 There also exists an ongoing tension in assessment around the conceptualisation
of 21st century skills, that is, how knowledge is embedded in competence and how
this can be recognised.
12 OECD (2016) was a background report to the second Global Education Industry
Summit, held in Jerusalem on 26–27 September 2016, and covered the available
evidence on innovation in education, the impact of digital technologies on teach-
ing and learning, and the role of digital skills and the education industries in the
process of innovation, using data from OECD surveys.
13 See, for example, Lowman (2013) for a discussion of the use of unproctored or
proctored internet testing, p. 107.
14 See Coleman (2021) for a discussion of the digital divide in the UK post-pandemic.
15 See Timmis et al. (2016) for a discussion of the potential, the challenges, and the
risks associated with technology-enhanced assessment.
16 Introduced to illustrate how the evaluation of scientific and ethical questions
could be integrated within a common validity framework.
17 Chronicled by Newton and Shaw (2014).

References
American Educational Research Association, American Psychological Association,
and National Council on Measurement in Education. (2014). Standards for edu-
cational and psychological testing. American Educational Research Association.
Baird, J. A., Hopfenbeck, T. N., Newton, P. E., Stobart, G., & Steen-Utheim,
A. T. (2014). State of the field review: Assessment and learning. Oxford University
Centre for Educational Assessment Report OUCEA/14/2. Norwegian Knowledge
Centre for Education (case number 13/4697).
Bennett, R. E. (2002). Inexorable and inevitable: The continuing story of technology
and assessment. Journal of Technology, Learning, and Assessment, 1(1). www.
jtla.org
Bennett, R. E. (2011). Formative assessment: A critical review. Assessment in Edu-
cation: Principles, Policy & Practice, 18(1), 5–25. https://doi.org/10.1080/09695
94X.2010.513678
14 Introduction

Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in
Education: Principles, Policy & Practice, 5(1), 7–74.
Bollington, A. (2015). Business brief: Why isn’t everyone lifelong learning? OECD
Yearbook. www.oecd.org/education/lifelong-learning.ht
Borsboom, D., Cramer, A. O. J., Kievit, R. A., Zand Scholten, A., & Franić, S. (2009).
The end of construct validity. In R. W. Lissitz (Ed.), The concept of validity. Revi-
sions, new directions, and applications (pp. 135–170). Information Age Publishing.
Boston, K. (2005). Assessment, reporting and technology: System-wide assessment
and reporting in the 21st century. In Tenth Annual Roundtable Conference: Strat-
egy, Technology and Assessment. Qualifications and Curriculum Authority.
Boston, K. (2007, September 25). Ken Boston: Big brother is testing you. The Guard-
ian. Higher Education Profile. Higher Education. www.theguardian.com/educa-
tion/2007/sep/25/highereducation.schools
Brown, G. T. L. (2019). Is assessment for learning really assessment? Frontiers in
Education, 4, Article 64. http://doi.org/10.3389/feduc.2019.00064
Campbell, B., & Manning, J. (2018). The rise of victimhood culture. Palgrave Macmillan.
Coleman, V. (2021). Digital divide in UK education during COVID-19 pandemic: Lit-
erature review. Cambridge Assessment Research Report. Cambridge Assessment.
Dhawan, V. (2014). Education and neuroscience. Research Matters: A Cambridge
Assessment Publication, 17, 46–55.
Didau, D. (2014, March 12). Why AFL might be wrong, and what to do about it.
David Didau Website. https://learningspy.co.uk/myths/afl-might-wrong/
Embretson, S., & Gorin, J. (2001). Improving construct validity with cognitive psy-
chology principles. Journal of Educational Measurement, 38(4), 343–368. https://
doi.org/10.1111/j.1745-3984.2001.tb01131.x
European Commission. (2019). Key competences for lifelong learning. European Union.
European Commission Education & Culture. (2007). Key competencies for lifelong
learning – A European framework. European Communities. https://op.europa.eu/
en/publication-detail/-/publication/5719a044-b659-46de-b58b-606bc5b084c1
Fletcher-Wood, H. (2017, March 26). Is formative assessment fatally flawed? Con-
fusing learning & performance. Improving Teaching. https://improvingteaching.
co.uk/2017/03/26/formative-assessment-flawed-confusing-learning-performace
Gipps, C. C. (1994). Beyond testing: Towards a theory of educational assessment.
The Falmer Press.
Goswami, U. (2006). Neuroscience and education: From research to practice? Na-
tional Review of Neuroscience, 7(5), 406–411.
HM Government. (2021, September). National AI strategy. Presented to Parliament
by the Secretary of State for Digital, Culture, Media and Sport by Command of
Her Majesty. Command Paper 525. Published by the Office for Artificial Intel-
ligence. ISBN 978-1-5286-2894-5.
James, M. (2010). Educational assessment: Overview. In P. Peterson, E. Baker &
B. McGaw (Eds.), International encyclopaedia of education (3rd ed., Vol. 3, pp.
161–171). Elsevier. www.sciencedirect.com/science/article/pii/B978008044894701
7139
Johnson, M., & Majewska, D. (2022). Formal, non-formal, and informal learn-
ing: What are they, and how can we research them? Cambridge University
Press & Assessment Research Report. www.cambridgeassessment.org.uk/Imag
es/665425-formal-non-formal-and-informal-learning-what-are-they-and-how-
can-we-research-them-.pdf
Kane, M. T. (2001). Current concerns in validity theory. Journal of Educational
Measurement, 38(4), 319–342.
Knight, R. A., & Silverstein, S. M. (2001). A process-oriented approach for avert-
ing confounds resulting from general performance deficiencies in schizophre-
nia. Journal of Abnormal Psychology, 110(1), 15–30. https://doi.org/10.103
7/0021-843X.110.1.15
Introduction 15

Lindsay, G., Ricketts, J., Peacey, L. V., Dockrell, J. E., & Charman, T. (2016).
Meeting the educational and social needs of children with language impair-
ment or autism spectrum disorder: The parents’ perspectives. International
Journal of Language & Communication Disorders, 51(5), 495–507. http://doi.
org/10.1111/1460-6984.12226
Linn, R. L. (1997). Evaluating the validity of assessments: The consequences of use.
Educational Measurement: Issues and Practice, 16(2), 14–16.
Lowman, R. (2013). Ethical issues related to personnel assessment and selection.
Chapter 6. In New directions in assessing performance potential of individuals and
groups: Workshop summary. National Academies of Sciences, Engineering, and Med-
icine (pp. 101–107). The National Academies Press. https://doi.org/10.17226/18427
Manolakelli, A. (2022, September 5). Inter, multi, cross, trans, & intra-disciplinary:
What is the difference and why is it important? ArchPsych. www.archpsych.co.uk/
post/disciplinarities-definitions
Mehrens, W. A. (1997). The consequences of consequential validity. Educational
Measurement: Issues and Practice, 16(2), 16–18.
Messick, S. (1989). Validity. In R. Linn (Ed.), Educational measurement (3rd ed.,
pp. 13–100). American Council on Education.
Messick, S. (1995). Validity of psychological assessment: Validation of inferences
from persons’ responses and performances as scientific inquiry into score mean-
ing. American Psychologist, 50(9), 741–749. https://doi.org/10.1037/0003-066X.
50.9.741
NCEE. (1983). National Commission on Excellence in Education (NCEE) A nation
at risk: The imperative for educational reform. NCEE.
Newton, P. E., & Baird, J.-A. (2016). Editorial: The great validity debate. Assessment
in Education: Principles, Policy & Practice, 23(2), 173–177. https://doi.org/10.10
80/0969594X.2016.1172871
Newton, P. E., & Shaw, S. D. (2014). Validity in educational & psychological assess-
ment. SAGE Publications Ltd. https://doi.org/10.4135/9781446288856
Nisbet, I., & Shaw, S. D. (2020). Is assessment fair? SAGE Publications Ltd.
OECD. (2004). Learning for tomorrow’s world: First results from PISA 2003. OECD.
OECD. (2016). Innovating education and educating for innovation: The power of
digital technologies and skills. OECD Publishing. http://doi.org/10.1787/9789
264265097-en
OECD. (2018). The future of education and skills: Education 2030. www.oecd.org/
education/2030-project
Pellegrino, J. W. (1999). The evolution of educational assessment: Considering the
past and imagining the future (William H. Angoff Memorial Lecture Service, Ed.).
The Educational Testing Service.
Peters, R. S. (1966). Ethics and education. George Allen and Unwin.
Popham, W. J. (1997). Consequential validity: Right concern-wrong concept. Educa-
tional Measurement: Issues and Practice, 16(2), 9–13.
Putnam, R. D., & Garrett, S. R. (2020). The Upswing: How we came together a cen-
tury ago and how we can do it again. Swift Press.
Research in Practice (RiP). (2022). What is early help?: Concepts, policy directions
and multi-agency perspectives. Ofsted.
Richardson, M., & Clesham, R. (2021). Rise of the machines? The evolving role of
AI technologies in high-stakes assessment. London Review of Education, 19(1), 9,
1–13. https://doi.org/10.14324/LRE.19.1.09
Shepard, L. A. (1993). Evaluating test validity. Review of Research in Education, 19,
405–450.
Shepard, L. A. (1997). The centrality of test use and consequences for test validity.
Educational Measurement: Issues and Practice, 16(5–8), 13.
Smith, R., Egglestone, C., Jones, E., & Aldridge, F. (2019, December). Adult
participation in learning survey 2019. Learning & Work Institute. https://
16 Introduction

learningandwork.org.uk/wp-content/uploads/2020/04/Adult-Participation-in-Learning-
Survey-2019.pdf
Snow, R. E., & Lohman, D. F. (1989). Implications of cognitive psychology for educa-
tional measurement. In R. L. Linn (Ed.), Educational measurement (pp. 263–331).
Macmillan Publishing Co, Inc; American Council on Education.
Swaffield, S. (2009). The misrepresentation of Assessment for Learning – and the woeful
waste of a wonderful opportunity [Online]. In AAIA national conference, Bourne-
mouth, 16–18 September 2009. Retrieved August 29, 2018, from www.aaia.org.uk/
content/uploads/2010/07/The-Misrepresentation-of-Assessment-for-Learning.pdf
Timmis, S., Broadfoot, P., Sutherland, R., & Oldfield, A. (2016). Rethinking assess-
ment in a digital age: Opportunities, challenges and risks. British Educational Re-
search Journal, 42(3), 454–476.
Trilling, B., & Fadel, C. (2009). 21st century skills – Learning for life in our times.
Jossey-Bass.
UNESCO. (2000). The right to education: Towards education for all throughout
life. World education report 2000. United Nations (UNESCO Publishing). https://
unesdoc.unesco.org/ark:/48223/pf0000119720
UNESCO. (2019). 4th global report on adult learning and education. Leave no one
behind: Participation, equity and inclusion. UNESCO Institute for Lifelong Learn-
ing. https://uil.unesco.org/system/files/grale_4_final.pdf
United Nations. (2015). Transforming our world. The 2030 agenda for sustain-
able development [Online]. UN. https://sustainabledevelopment.un.org/post2015/
transformingourworld
U.S. Department of Education, National Center for Education Statistics. (2004).
Stronger accountability: Testing for results: Helping families, schools, and commu-
nities understand and improve student achievement. www.ed.gov/nclb/account-
ability/ayp/testingforresults.html
Vitello, S., Greatorex, J., & Shaw, S. D. (2021). What is competence? A shared inter-
pretation of competence to support teaching, learning and assessment. Cambridge
University Press & Assessment.
World Education Forum. (2015). New vision for education: Unlocking the potential
of technology. www3.weforum.org/docs/WEFUSA_NewVisionforEducation_Re-
port2015.pdf
World Education Report. (2000). The right to education: Towards education for all
throughout life. UNESCO Publishing.
Introduction
American Educational Research Association, American Psychological Association, and National
Council on Measurement in Education . (2014). Standards for educational and psychological
testing. American Educational Research Association.
Baird, J. A. , Hopfenbeck, T. N. , Newton, P. E. , Stobart, G. , & Steen-Utheim, A. T. (2014).
State of the field review: Assessment and learning. Oxford University Centre for Educational
Assessment Report OUCEA/14/2. Norwegian Knowledge Centre for Education (case number
13/4697).
Bennett, R. E. (2002). Inexorable and inevitable: The continuing story of technology and
assessment. Journal of Technology, Learning, and Assessment, 1(1). www.jtla.org
Bennett, R. E. (2011). Formative assessment: A critical review. Assessment in Education:
Principles, Policy & Practice, 18(1), 5–25. https://doi.org/10.1080/0969594X.2010.513678
Black, P. , & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education:
Principles, Policy & Practice, 5(1), 7–74.
Bollington, A. (2015). Business brief: Why isn’t everyone lifelong learning? OECD Yearbook.
www.oecd.org/education/lifelong-learning.ht
Borsboom, D. , Cramer, A. O. J. , Kievit, R. A. , Zand Scholten, A. , & Franić, S. (2009). The end
of construct validity. In R. W. Lissitz (Ed.), The concept of validity. Revisions, new directions,
and applications (pp. 135–170). Information Age Publishing.
Boston, K. (2005). Assessment, reporting and technology: System-wide assessment and
reporting in the 21st century. In Tenth Annual Roundtable Conference: Strategy, Technology
and Assessment. Qualifications and Curriculum Authority.
Boston, K. (2007, September 25). Ken Boston: Big brother is testing you. The Guardian. Higher
Education Profile. Higher Education.
www.theguardian.com/education/2007/sep/25/highereducation.schools
Brown, G. T. L. (2019). Is assessment for learning really assessment? Frontiers in Education, 4,
Article 64. http://doi.org/10.3389/feduc.2019.00064
Campbell, B. , & Manning, J. (2018). The rise of victimhood culture. Palgrave Macmillan.
Coleman, V. (2021). Digital divide in UK education during COVID-19 pandemic: Literature
review. Cambridge Assessment Research Report. Cambridge Assessment.
Dhawan, V. (2014). Education and neuroscience. Research Matters: A Cambridge Assessment
Publication, 17, 46–55.
Didau, D. (2014, March 12). Why AFL might be wrong, and what to do about it. David Didau
Website. https://learningspy.co.uk/myths/afl-might-wrong/
Embretson, S. , & Gorin, J. (2001). Improving construct validity with cognitive psychology
principles. Journal of Educational Measurement, 38(4), 343–368. https://doi.org/10.1111/j.1745-
3984.2001.tb01131.x
European Commission . (2019). Key competences for lifelong learning. European Union.
European Commission Education & Culture . (2007). Key competencies for lifelong learning – A
European framework. European Communities. https://op.europa.eu/en/publication-detail/-
/publication/5719a044-b659-46de-b58b-606bc5b084c1
Fletcher-Wood, H. (2017, March 26). Is formative assessment fatally flawed? Confusing
learning & performance. Improving Teaching.
https://improvingteaching.co.uk/2017/03/26/formative-assessment-flawed-confusing-learning-
performace
Gipps, C. C. (1994). Beyond testing: Towards a theory of educational assessment. The Falmer
Press.
Goswami, U. (2006). Neuroscience and education: From research to practice? National Review
of Neuroscience, 7(5), 406–411.
HM Government . (2021, September). National AI strategy. Presented to Parliament by the
Secretary of State for Digital, Culture, Media and Sport by Command of Her Majesty. Command
Paper 525. Published by the Office for Artificial Intelligence. ISBN 978-1-5286-2894-5.
James, M. (2010). Educational assessment: Overview. In P. Peterson , E. Baker & B. McGaw
(Eds.), International encyclopaedia of education (3rd ed., Vol. 3, pp. 161–171). Elsevier.
www.sciencedirect.com/science/article/pii/B9780080448947017139
Johnson, M. , & Majewska, D. (2022). Formal, non-formal, and informal learning: What are they,
and how can we research them? Cambridge University Press & Assessment Research Report.
www.cambridgeassessment.org.uk/Images/665425-formal-non-formal-and-informal-learning-
what-are-they-and-how-can-we-research-them-.pdf
Kane, M. T. (2001). Current concerns in validity theory. Journal of Educational Measurement,
38(4), 319–342.
Knight, R. A. , & Silverstein, S. M. (2001). A process-oriented approach for averting confounds
resulting from general performance deficiencies in schizophrenia. Journal of Abnormal
Psychology, 110(1), 15–30. https://doi.org/10.1037/0021-843X.110.1.15
Lindsay, G. , Ricketts, J. , Peacey, L. V. , Dockrell, J. E. , & Charman, T. (2016). Meeting the
educational and social needs of children with language impairment or autism spectrum disorder:
The parents’ perspectives. International Journal of Language & Communication Disorders,
51(5), 495–507. http://doi.org/10.1111/1460-6984.12226
Linn, R. L. (1997). Evaluating the validity of assessments: The consequences of use.
Educational Measurement: Issues and Practice, 16(2), 14–16.
Lowman, R. (2013). Ethical issues related to personnel assessment and selection. Chapter 6. In
New directions in assessing performance potential of individuals and groups: Workshop
summary. National Academies of Sciences, Engineering, and Medicine (pp. 101–107). The
National Academies Press. https://doi.org/10.17226/18427
Manolakelli, A. (2022, September 5). Inter, multi, cross, trans, & intra-disciplinary: What is the
difference and why is it important? ArchPsych. www.archpsych.co.uk/post/disciplinarities-
definitions
Mehrens, W. A. (1997). The consequences of consequential validity. Educational Measurement:
Issues and Practice, 16(2), 16–18.
Messick, S. (1989). Validity. In R. Linn (Ed.), Educational measurement (3rd ed., pp. 13–100).
American Council on Education.
Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’
responses and performances as scientific inquiry into score meaning. American Psychologist,
50(9), 741–749. https://doi.org/10.1037/0003-066X.50.9.741
NCEE . (1983). National Commission on Excellence in Education (NCEE) A nation at risk: The
imperative for educational reform. NCEE.
Newton, P. E. , & Baird, J.-A. (2016). Editorial: The great validity debate. Assessment in
Education: Principles, Policy & Practice, 23(2), 173–177.
https://doi.org/10.1080/0969594X.2016.1172871
Newton, P. E. , & Shaw, S. D. (2014). Validity in educational & psychological assessment.
SAGE Publications Ltd. https://doi.org/10.4135/9781446288856
Nisbet, I. , & Shaw, S. D. (2020). Is assessment fair? SAGE Publications Ltd.
OECD . (2004). Learning for tomorrow’s world: First results from PISA 2003. OECD.
OECD . (2016). Innovating education and educating for innovation: The power of digital
technologies and skills. OECD Publishing. http://doi.org/10.1787/9789264265097-en
OECD . (2018). The future of education and skills: Education 2030.
www.oecd.org/education/2030-project
Pellegrino, J. W. (1999). The evolution of educational assessment: Considering the past and
imagining the future ( William H . Angoff Memorial Lecture Service , Ed.). The Educational
Testing Service.
Peters, R. S. (1966). Ethics and education. George Allen and Unwin.
Popham, W. J. (1997). Consequential validity: Right concern-wrong concept. Educational
Measurement: Issues and Practice, 16(2), 9–13.
Putnam, R. D. , & Garrett, S. R. (2020). The Upswing: How we came together a century ago
and how we can do it again. Swift Press.
Research in Practice (RiP) . (2022). What is early help?: Concepts, policy directions and multi-
agency perspectives. Ofsted.
Richardson, M. , & Clesham, R. (2021). Rise of the machines? The evolving role of AI
technologies in high-stakes assessment. London Review of Education, 19(1), 9, 1–13.
https://doi.org/10.14324/LRE.19.1.09
Shepard, L. A. (1993). Evaluating test validity. Review of Research in Education, 19, 405–450.
Shepard, L. A. (1997). The centrality of test use and consequences for test validity. Educational
Measurement: Issues and Practice, 16(5–8), 13.
Smith, R. , Egglestone, C. , Jones, E. , & Aldridge, F. (2019, December). Adult participation in
learning survey 2019. Learning & Work Institute. https://learningandwork.org.uk/wp-
content/uploads/2020/04/Adult-Participation-in-Learning-Survey-2019.pdf
Snow, R. E. , & Lohman, D. F. (1989). Implications of cognitive psychology for educational
measurement. In R. L. Linn (Ed.), Educational measurement (pp. 263–331). Macmillan
Publishing Co, Inc; American Council on Education.
Swaffield, S. (2009). The misrepresentation of Assessment for Learning – and the woeful waste
of a wonderful opportunity [Online]. In AAIA national conference, Bournemouth, 16–18
September 2009. Retrieved August 29, 2018, from
www.aaia.org.uk/content/uploads/2010/07/The-Misrepresentation-of-Assessment-for-
Learning.pdf
Timmis, S. , Broadfoot, P. , Sutherland, R. , & Oldfield, A. (2016). Rethinking assessment in a
digital age: Opportunities, challenges and risks. British Educational Research Journal, 42(3),
454–476.
Trilling, B. , & Fadel, C. (2009). 21st century skills – Learning for life in our times. Jossey-Bass.
UNESCO . (2000). The right to education: Towards education for all throughout life. World
education report 2000. United Nations (UNESCO Publishing).
https://unesdoc.unesco.org/ark:/48223/pf0000119720
UNESCO . (2019). 4th global report on adult learning and education. Leave no one behind:
Participation, equity and inclusion. UNESCO Institute for Lifelong Learning.
https://uil.unesco.org/system/files/grale_4_final.pdf
United Nations . (2015). Transforming our world. The 2030 agenda for sustainable development
[Online]. UN. https://sustainabledevelopment.un.org/post2015/transformingourworld
U.S. Department of Education, National Center for Education Statistics . (2004). Stronger
accountability: Testing for results: Helping families, schools, and communities understand and
improve student achievement. www.ed.gov/nclb/accountability/ayp/testingforresults.html
Vitello, S. , Greatorex, J. , & Shaw, S. D. (2021). What is competence? A shared interpretation
of competence to support teaching, learning and assessment. Cambridge University Press &
Assessment.
World Education Forum . (2015). New vision for education: Unlocking the potential of
technology. www3.weforum.org/docs/WEFUSA_NewVisionforEducation_Report2015.pdf
World Education Report . (2000). The right to education: Towards education for all throughout
life. UNESCO Publishing.

Developments in Education and Assessment


Adesope, O. O. , Trevisan, D. A. , & Sundararajan, N. (2017). Rethinking the use of tests: A
meta-analysis of practice testing. Review of Educational Research, 87, 659–701.
http://doi.org/10.3102/0034654316689306
Aloisi, C. (2023). The future of standardised assessment: Validity and trust in algorithms for
assessment and scoring. European Journal of Education, 58(1), 98–110.
https://onlinelibrary.wiley.com/doi/abs/10.1111/ejed.12542
Ananiadou, K. , & Claro, M. (2009). 21st century skills and competences for new millennium
learners in OECD countries. OECD Education Working Papers, No. 41. OECD Publishing.
Anders, J. , Foliano, F. , Bursnall, M. , Dorsett, R. , Hudson, N. , Runge, J. , & Speckesser, S.
(2022). The effect of embedding formative assessment on pupil attainment. Journal of Research
on Educational Effectiveness, 15(4), 748–779. https://doi.org/10.1080/19345747.2021.2018746
Anderson, L. W. , & Krathwohl, D. R. (2001). A taxonomy for learning, teaching and assessing:
A revision of Bloom’s taxonomy of educational objectives: Complete edition. Longman.
Anirudh, V. K. (2022, February 10). What are the types of artificial intellig ence: Narrow,
general, and super AI explained. www.spiceworks.com/tech/artificial-intelligence/articles/types-
of-ai/
Assessment Reform Group. (2002). Assessment for learning: 10 principles. Author.
Bagshaw, J. , Knight, C. , & Kernohan, D. (2023, February 20). ChatGPT, assessment and
cheating – have we tried trusting students? Do AI advancements highlight problems with
assessment itself? Wonke. https://wonkhe.com/blogs/chatgpt-assessment-and-cheating-have-
we-tried-trusting-students/
Baig, I. M. , Shuib, L. , & Yadegaridehkordi, E. (2020). Big data in education: A state of the art,
limitations, and future research directions. International Journal of Educational Technology in
Higher Education, 17(1), 44. https://doi.org/10.1186/s41239-020-00223-0
Baird, J. A. , Hopfenbeck, T. N. , Newton, P. E. , Stobart, G. , & Steen-Utheim, A. T. (2014).
State of the field review: Assessment and learning. Oxford University Centre for Educational
Assessment Report OUCEA/14/2. Norwegian Knowledge Centre for Education (case number
13/4697).
Barber, M. (2001, December 7). Pupils will never have had it so good. Times Educational
Supplement, p. 20
Benavot, A. , Antoninis, M. , Bella, N. , Delprato, M. , Härmä, J. , Jere, C. , Joshi, P. , Koseleci,
N. , Longlands, H. , McWilliam, A. , & Zubairi, A. (2015). Education for all 2000–2015: Review
and perspectives. Zeitschrift für internationale Bildungsforschung und Entwicklungspädagogik
[Journal of International Education Research and Development Education], 38(1), 10–15.
Bennett, R. E. (2002). Inexorable and inevitable: The continuing story of technology and
assessment. The Journal of Technology, Learning and Assessment, 1(1).
https://ejournals.bc.edu/index.php/jtla/article/view/1667
Bennett, R. E. (2011). Formative assessment: A critical review. Assessment in Education:
Principles, Policy & Practice, 18(1), 5–25. https://doi.org/10.1080/0969594X.2010.513678.
Bennett, R. E. (2013). Preparing for the future: What educational assessment must do.
Published by the Gordon commission on the future of assessment in education.
www.gordoncommission.org/publications_reports/assessment_paradigms.html
Bennett, W. , & Wilezol, D. (2013). Is college worth it? Thomas Nelson.
Bersin, J. (2016, October 4). HR technology in 2017: Disruption ahead. Insights on corporate
talent, learning, and HR technology. Update November 4, 2016.
https://joshbersin.com/2016/10/hr-technology-in-2017-disruption-ahead/
Black, P. , & Wiliam, D. (1998a). Assessment and classroom learning. Assessment in
Education: Principles, Policy & Practice, 5(1), 7–74.
Black, P. , & Wiliam, D. (1998b). Inside the black box: Raising standards through classroom
assessment. King’s College London School of Education.
Black, P. , & Wiliam, D. (2009). Developing the theory of formative assessment. Educational
Assessment, Evaluation and Accountability, 21(1), 5–31. https://doi.org/10.1007/s11092-008-
9068-5
Black, P. , & Wiliam, D. (2018). Classroom assessment and pedagogy. Assessment in
Education: Principles, Policy & Practice, 25(6), 551–575.
https://doi.org/10.1080/0969594X.2018.1441807
Bloom, B. S. , Engelhart, M. D. , Furst, E. J. , Hill, W. H. , & Krathwohl, D. R. (1956). Taxonomy
of educational objectives: The classification of educational goals. Handbook I: Cognitive
domain. David McKay Company.
Bollington, A. (2015). Business brief: Why isn’t everyone lifelong learning? OECD Yearbook.
www.oecd.org/education/lifelong-learning.ht
Boston, K. (2007). Tipping points in education and skills. Speech to QCA Annual Review,
London.
Boyle, W. F. , & Charles, M. (2010). Leading learning through assessment for learning? School
Leadership & Management, 30(3), 285–300. http://doi.org/10.1080/13632434.2010.485184
Broadfoot, P. M. , Daugherty, R. , Gardner, J. , Gipps, C. , Harlen, W. , James, M. , & Stobart,
G. (1999). Assessment for learning: Beyond the black box. Nuffield Foundation and University
of Cambridge. www.nuffieldfoundation.org/sites/default/files/files/beyond_blackbox.pdf
Broadfoot, P. M. , Daugherty, R. , Gardner, J. , Harlen, W. , James, M. , & Stobart, G. (2002).
Assessment for learning: 10 principles. Assessment Reform Group. Nuffield Foundation and
University of Cambridge.
http://assessmentreformgroup.files.wordpress.com/2012/01/10principles_english.pdf
Broadfoot, P. M. , Timmis, S. E. , Payton, S. , Oldfield, A. , & Sutherland, R. J. (2013).
Rethinking assessment 2012/2013 series of discussion papers: Six discussion papers published
by University of Bristol. www.bris.ac.uk/education/research/sites/tea/publications/index.html
Brown, G. T. L. (2019). Is assessment for learning really assessment? Frontiers in Education, 4,
Article 64. http://doi.org/10.3389/feduc.2019.00064
Bruer, J. T. (2006). Points of view: On the implications of neuroscience research for the science
of teaching and learning: Are there any? CBE Life Sciences Education, 5, 104–110.
http://doi.org/10.1187/cbe.06-03-0153
Claxton, G. (2007). Expanding young people’s capacity to learn. British Journal of Educational
Studies, 55(2), 115–134.
Coe, R. (2013). Improving education: A triumph of hope over experience. Centre for Evaluation
and Monitoring, Durham University.
Coleman, V. (2021). Digital divide in UK education during COVID-19 pandemic: Literature
review. Cambridge Assessment Research Report. Cambridge Assessment.
Cotton, D. R. E. , Cotton, P. A. , & Shipway, J. R. (2023). Chatting and cheating: Ensuring
academic integrity in the era of ChatGPT. Innovations in Education and Teaching International,
1(12). http://doi.org/10.1080/14703297.2023.2190148
Craig, H. , Wilcox, G. , Makarenko, E. , & MacMaster, F. P. (2020). Continued educational belief
in pre- and in-service teachers: A call for de-implementation action for school psychologists.
Canadian Journal of School Psychology. http://doi.org/10.1177/0829573520979605
Cumming, J. J. , & Wyatt-Smith, C. (2009). Framing assessment today for the future: Issues
and challenges. In C. Wyatt-Smith & J. J. Cumming (Eds.), Educational assessment in the 21st
century. Springer. https://doi.org/10.1007/978-1-4020-9964-9_1
D'Agostino, S. (2023, January 11). ChatGPT advice academics can use now. Inside Higher Ed
(IHE). Faculty Issues. www.insidehighered.com/news/2023/01/12/academic-experts-offer-
advice-chatgpt
Dawson, P. (2023, June 8). Don’t fear the robot: Future-authentic assessment and generative
artificial intelligence. Virtual Presentation. University of Calgary, Werklund School of Education.
www.upei.ca/notice/2023/05/don-t-fear-robot-future-authentic-assessment-and-generative-
artificial-intelligence
Delors, J. (1996). Learning: The treasure within. Report to UNESCO of the international
commission on education for the twenty-first century (pp. 99–100). UNESCO Publishing.
Department of Education (DoE) . (2023, March 29). Generative artificial intelligence in
education. Departmental Statement. www.gov.uk/government/publications/generative-artificial-
intelligence-in-education
Department for Education and Skills (DfES) . (2003). Excellence and enjoyment: A strategy for
primary schools. DfES.
Dhawan, V. (2014). Education and neuroscience. Research Matters: A Cambridge Assessment
Publication, 17, 46–55.
Didau, D. (2014, March 12). Why AfL might be wrong, and what to do about it. David Didau
Website. https://learningspy.co.uk/myths/afl-might-wrong/
Drucker, P. F. (1999, October). Beyond the information revolution. The Atlantic.
www.theatlantic.com/magazine/archive/1999/10/beyond-the-information-revolution/304658/
Egan-Simon, D. (2021). Moving in the wrong direction: A critical history of citizenship education
in England from the early twentieth century to the present day. Educational Futures, 12(1).
Elfert, M. (2019). Revisiting the faure report and the delors report: Why was UNESCO’s Utopian
vision of lifelong learning an “unfailure”? Chapter 2. In Power and possibility. Adult education in
a diverse and complex world (pp. 17–26). Brill Sense.
http://doi.org/10.1163/9789004413320_002
Embretson, S. , & Gorin, J. (2001, Winter). Improving construct validity with cognitive
psychological principles. Journal of Educational Measurement, 83(4), 343–368.
European Commission . (2003, November 11). Education and training: the success of the
Lisbon strategy hinges on urgent reforms. IP/03/1520. Brussels.
European Commission Education & Culture . (2007). Key competencies for lifelong learning – A
European framework. European Communities. www.erasmusplus.org.uk/file/272/download
European Patent Office . (2020, December 9). Fourth industrial revolution. www.epo.org/news-
events/in-focus/ict/fourth-industrial-revolution.html
Evans, S. (2021, October 15). New skills for life alliance to tackle England’s adult basic skills
deficit. FE Week. https://feweek.co.uk/new-skills-for-life-alliance-to-tackle-englands-adult-basic-
skills-deficit/
Fatkullina, F. , Morozkina, E. , & Suleimanova, A. (2015). Modern higher education: Problems
and perspectives. Procedia – Social and Behavioral Sciences, 214, 571–577.
https://doi.org/10.1016/j.sbspro.2015.11.762
Faure, E. , Herrera, F. , Kaddoura, A. R. , Lpes, H. , Petrovsky, A. V. , Rahnema, M. , & Ward,
F. C. (1972). Learning to be: The world of education today and tomorrow. UNESCO. Retrieved
October 17, 2022, from
https://unesdoc.unesco.org/ark:/48223/pf0000001801/PDF/001801eng.pdf.multi
Fautley, M. , & Savage, J. (2008). Assessment for learning and teaching in secondary schools.
Learning Matters.
Fengchun, M. , Wayne, H. , Huang, R. , & Zhang, H. (2018). AI and education: Guidance for
policy-makers. UNESCO Education 2030. https://unesdoc.unesco.org/ark:/48223/pf0000376709
Finger, G. , & Jamieson-Proctor, R. (2009). Assessment issues and new technologies:
ePortfolio possibilities. In C. Wyatt-Smith & J. J. Cumming (Eds.), Educational assessment in
the 21st century. Springer. https://doi.org/10.1007/978-1-4020-9964-9_4
Fletcher-Wood, H. (2017. March 26). Is formative assessment fatally flawed? Confusing
learning & performance. Improving Teaching.
https://improvingteaching.co.uk/2017/03/26/formative-assessment-flawed-confusing-learning-
performace
Friedman, T. L. , & Mandelbaum, M. (2011). That used to be us: How America fell behind in the
world it invented and how we can come back. Farrar, Straus and Giroux.
Gallardo-Echenique, E. , Marques-Molas, L. , Bullen, M. , & Strijbos, J. (2015). Let’s talk about
digital learners in the digital era. The international review of research in open and distributed
learning. www.irrodl.org/index.php/irrodl/article/view/2196/3337
Glanville, M. (2023, February 27). Artificial Intelligence in IB assessment and edu cation: A
crisis or an opportunity? https://blogs.ibo.org/2023/02/27/artificial-intelligence-ai-in-ib-
assessment-and-education-a-crisis-or-an-opportunity/
Graham, M. (2019, November 1). How to build a fairer gig economy in 4 steps. World Economic
Forum. www.weforum.org/agenda/2019/11/gig-economy-in-4-steps/
Guli, L. A. (2005). Evidence-based parent consultation with school-related outcomes. School
Psychology Quarterly, 20, 455–472. http://doi.org/10.1521/scpq.2005.20.4.455
Heaven, W. D. (2023, April 6). ChatGPT is going to change education, not destroy it. MIT
Technology Review. www.technologyreview.com/2023/04/06/1071059/chatgpt-change-not-
destroy-education-openai/
Hirsch, E. D. (2016). Why knowledge matters: Rescuing our children for failed educational
theories. Harvard Educational Press.
HM Government . (2021, September). National AI strategy. Presented to Parliament by the
Secretary of State for Digital, Culture, Media and Sport by Command of Her Majesty. Command
Paper 525. Published by the Office for Artificial Intelligence. ISBN 978-1-5286-2894-5.
HM Government . (2022). National AI strategy. Presented to Parliament by the Secretary of
State for Digital, Culture, Media and Sport by Command of Her Majesty. Command Paper 525.
Updated 18 December 2022. Published by the Office for Artificial Intelligence.
Ionnou, A. (2018). A model of gameful design for learning using interactive tabletops:
Enactment and evaluation in the socio-emotional education classroom. Educational Technology
Research and Development, 67(2), 277–302.
Jennings, J. (2023, July 21). Information overload: Unravelling the Paradox of investment
knowledge. Forbes. www.forbes.com/sites/johnjennings/2023/07/21/information-overload-
unraveling-the-paradox-of-investment-knowledge/
Joint Council for Qualifications (JCQ) . (2023). AI use in assessments: Protecting the integrity of
qualifications. Guidance for Teachers & Assessors. www.jcq.org.uk/wp-
content/uploads/2023/04/JCQ-AI-Use-in-Assessments-Protecting-the-Integrity-of-
Qualifications.pdf
Kirby, A. , & Smith, T. (2021). Neurodiversity at work (1st ed.). Kogan Page.
www.perlego.com/book/2800960/neurodiversity-at-work-pdf
Kitchen, W. H. (2014). Authority and the teacher. Bloomsbury.
Kupiainen, S. , Hautamäki, J. , & Karjalainen, T. (2009). The Finnish education system and
PISA. Ministry of Education.
www.pisa2006.helsinki.fi/files/The_Finnish_education_system_and_PISA.pdf
Lavonen, J. , & Laaksonen, S. (2009). Context of teaching and learning school science in
Finland: Reflections on PISA 2006 results. Journal of Research in Science Teaching, 46(8),
922–944. http://doi.org/10.1002/tea.20339
Leckie, G. , & Goldstein, H. (2011). Understanding uncertainty in school league tables. Fiscal
Studies, 32(2), 207–224. http://doi.org/10.1111/j.1475-5890.2011.00133.x
Levy, F. , & Murnane, R. J. (2004). The new division of labor: How computers are creating the
next job market. Princeton University Press.
Literacy Task Force . (1997). The implementation of the national literacy strategy. Department
for Education and Employment.
Lowman, R. (2013). Ethical issues related to personnel assessment and selection. Chapter 6. In
New directions in assessing performance potential of individuals and groups: Workshop
summary. National Academies of Sciences, Engineering, and Medicine (pp. 101–107). The
National Academies Press. https://doi.org/10.17226/18427
Lynch, D. E. (2003). Education in a knowledge economy. Article for Edited Collection EdCA,
CQU 25/. Research Perspectives on Education, pp. 13–20.
Lynch, M. (2019, July 16). Why are some countries slow to adopt digital learning? The TECH
Edv ocate.
Machin, S. , & McNally, S. (2007). Tertiary education systems and labour markets. OECD.
Accessed at Tertiary Education Systems and Labour Markets (oecd.org).
Maguire, M. (2002). Globalisation, education policy and the teacher. Interna tional Studies in
Sociology of Education, 12(3), 261–276. http://doi.org/10.1080/09620210200200093
Major, L. , Francis, G. A. , & Tsapali, M. (2021). The effectiveness of technology-supported
personalised learning in low- and middle-income countries: A meta-analysis. British Journal of
Educational Technology, 52(5), 1935–1964.
Manyika, J. , Lund, S. , Chui, M. , Bughin, J. , Woetzel, J. , Batra, P. , Ko, R. , & Sanghvi, S.
(2017, December). Jobs lost, jobs gained: Workforce transitions in a time of automation.
McKinsey Global Institute. https://epic.org/wp-content/uploads/foia/epic-v-ai-commission/EPIC-
19-09-11-NSCAI-FOIA-20200529-5th-Production-pt4-Outside-Reports-Resource.pdf
Martin, T. , & Sherin, B. (2013). Learning analytics and computational techniques for detecting
and evaluating patterns in learning: An introduction to the special issue. Journal of the Learning
Sciences, 22(4), 511–520. https://doi.org/10.1080/10508406.2013.840466
Maseleno, A. , Sabani, N. , Huda, M. , Ahmad, R. , Jasmi, K. A. , & Basiron, B. (2018).
Demystifying learning analytics in personalised learning. International Journal of Engineering &
Technology, 7(3), 1124–1129.
Mason, L. (2009). Bridging neuroscience and education: A two-way path is possible. Cortex, 45,
548–549. http://doi.org/10.1016/j.cortex.2008.06.003
Mayhew, M. G. , Ashkanasy, N. M. , Bramble, T. , & Gardner, J. (2007). A study of the
antecedents and consequences of psychological ownership in organizational settings. The
Journal of Social Psychology, 147(5), 477–500. https://doi.org/10.3200/SOCP.147.5.477-500
Mayor, F. (1999). Higher education in the 21st century: Vision and action, October 5–9, 1998.
UNESCO.ED.98/CONF.202/CLD.49.
McGinnis, D. (2020, October 27). What is the fourth industrial revolution? The 360 Blog from
Sales force.
Mihai, A. (2023, January 23). Let’s get off the fear carousel! The Educationalist.
https://educationalist.substack.com/p/lets-get-off-the-fear-carousel
Mills, A. , & Goodlad, L. M. E. (2023). Adapting college writing for the age of large language
models such as ChatGPT: Some next steps for educators. Critical AI (Updated 4/17/2023 to
Include New Links). https://criticalai.org/2023/01/17/critical-ai-adapting-college-writing-for-the-
age-of-large-language-models-such-as-chatgpt-some-next-steps-for-educators/
Mislevy, R. J. , Steinberg, L. S. , & Almond, R. G. (2002). Design and analysis in task-based
language assessment. Language Testing, 19, 477–496.
Mogey, N. (2011). What is it that is really acting as a barrier to widespread use of summative e-
assessment in UK higher education? International Journal of e-Assessment, 1(1).
Moser, C. (1999). Improving literacy and numeracy: A fresh start – the report of the working
group in the United Kingdom. Moser Report. Department of Education and Employment.
Mulder, M. (2012). Competence-based education and training. The Journal of Agricultural
Education and Extension, 18(3), 305–314.
Mulder, M. , Weigel, T. , & Collins, K. (2007). The concept of competence in the development of
vocational education and training in selected EU member states: A critical analysis. Journal of
Vocational Education and Training, 59(1), 67–88. http://doi.org/10.1080/13636820601145630
Mullis, I. V. S. , Martin, M. O. , Goh, S. , & Cotter, K. (Eds.). (2016). TIMSS 2015 encyclopedia:
Education policy and curriculum in mathematics and science. Retrieved from Boston College,
TIMSS & PIRLS International Study Center website:
http://timssandpirls.bc.edu/timss2015/encyclopedia/
NCEE . (1983). National Commission on Excellence in Education (NCEE) a nation at risk: The
imperative for educational reform. NCEE.
Nye, J. S. (2003, March). The information revolution. Chapter 2. In The Paradox of American
power: Why the world’s only superpower can’t go it alone (pp. 41–76). Oxford Academic Books.
https://doi.org/10.1093/0195161106.003.0002
Oates, T. (2017, September). A Cambridge approach to improving education: Using
international insights to manage complexity. University of Cambridge Local Examaintions
Syndicate. https://www.cambridgeassessment.org.uk/Images/cambridge-approach-to-
improving-education.pdf
OECD . (2001). Competencies for the knowledge economy. Chapter 4.
https://one.oecd.org/document/DEELSA/ED/CERI/CD(2000)12/PART4/REV2/en/pdf
OECD . (2004). Learning for tomorrow’s world: First results from PISA 2003. Author.
OECD . (2016). Innovating education and educating for innovation: The power of digital
technologies and skills. OECD Publishing. http://doi.org/10.1787/9789264265097-en
OECD . (2021). United Kingdom country note – Skills outlook 2021: Learning for life. OECD.
www.oecd.org/unitedkingdom/Skills-Outlook-UnitedKingdom.pdf
Office for Students . (2022, November 24). Securing student success: Regulatory framework for
higher education in England. Presented to Parliament pursuant to section 75 of the Higher
Education and Research Act 2017. OfS 2022.69. ISBN 978-1-5286-3792-3.
Oldfield, A. , Broadfoot, P. , Sutherland, R. , & Timmis, S. (2012). Assessment in a digital age: A
research review. STELLAR. University of Bristol.
Oxford English Dictionary . (2023). www.oed.com/
Pane, J. F. , Steiner, E. D. , Baird, M. D. , & Hamilton, L. S. (2015, November). Continued
progress: Promising evidence on personalized learning. Report for the RAND Corporation.
Reports no. R-136-BMGF. RAND Corporation.
Pardo, A. , Jovanovic, J. , Dawson, S. , Gašević, D. , & Mirriahi, N. (2019). Using learning
analytics to scale the provision of personalised feedback. British Journal of Educational
Technology, 50(1), 128–138.
Patrinos, H. A. (2016). The skills that matter in the race between education and technology.
Prepared for the 2016 Brookings Institution Blum Roundtable.
https://www.researchgate.net/publication/339956474_The_skills_that_matter_in_the_race_betw
een_education_and_technology
Pellegrino, J. W. (1999, November 17). The evolution of educational assessment: Considering
the past and imagining the future. The Sixth Annual William H. Angoff Memorial Lecture
presented at Educational Testing Service.
Pellegrino, J. W. , Baxter, G. P. , & Glaser, R. (1999). Addressing the “two disciplines” problem:
Linking theories of cognition and learning with assessment and instructional practice. In A. Iran-
Nejad & P. D. Pearson (Eds.), Review of research in education (vol. 24, pp. 307–353).
American Educational Research Association.
Pellegrino, J. W. , Chudowski, N. , & Glaser, R. (Eds.). (2001). Knowing what students know:
The science and design of educational assessment. National Academy Press.
Perrotta, C. , & Wright, M. (2010). New assessment scenarios. A Futurelab report.
www.futurelab.org.uk/resources/new-assessment-scenarios
Prensky, M. (2001, October). Digital natives, digital immigrants. On the Horizon, MCB University
Press, 9(5).
Prensky, M. (2020, August 18). Why “education” can’t be fixed. Medium.
https://marcprensky.medium.com/why-education-cant-be-fixed-6fd264d6fb6b
Priestley, M. , & Sinnema, C. (2014). Downgraded curriculum? An analysis of knowledge in new
curricula in Scotland and New Zealand. Curriculum Journal, 25(1), 50–75.
QAA Briefs on Artificial Intelligence Threat to Academic Integrity . (2023, January 30).
https://www.qaa.ac.uk/news-events/news/qaa-briefs-members-on-artificial-intelligence-threat-to-
academic-integrity
Quach, S. , Thaichon, P. , Martin, K. D. , Scott, W. , & Palmatier, R. W. (2022). Digital
technologies: Tensions in privacy and data. Journal of the Academy of Marketing Science, 50,
1299–1323. https://doi.org/10.1007/s11747-022-00845-y
Raikes, N. (2019). Data, data everywhere? Opportunities and challenges in a data-rich world.
Research Matters: A Cambridge Assessment Publication, 27, 16–19.
Raphael, B. (1976). The thinking computer. W.H. Freeman.
Richardson, M. , & Clesham, R. (2021). Rise of the machines? The evolving role of AI
technologies in high-stakes assessment. London Review of Education, 19(1), 9, 1–13.
https://doi.org/10.14324/LRE.19.1.09
Riegel, C. , & Mete, R. E. (2017). Educational technologies for K-12 learners: What digital
natives and digital immigrants can teach one another. Educational Planning, 24, 49–58.
Robelen, E. W. (2011, February 7). Report aims to DEBUNK “myth” about days of U.S.
achievement. Education Week. www.edweek.org/leadership/report-amims-to-debunk-myth-
about-glory-days-of-u-s-achievemnt/2011/02
Rychen, D. S. , & Salganik, L. H. (2003). Key competencies for a successful life and well-
functioning society. Hogrefe & Huber Publisher.
Sahlgren, G. H. (2015). Real finnish lessons: The true story of an education superpower. Centre
for Policy Studies.
Säljö, R. (2010). Digital tools and challenges to institutional traditions of learning: Technologies,
social memory and the performative nature of learning. Journal of Computer Assisted Learning,
26, 53–64.
Schildkamp, K. , van der Kleij, F. M. , Heitink, M. C. , Kippers, W. B. , & Veldkamp, B. P. (2020).
Formative assessment: A systematic review of critical teacher prerequisites for classroom
practice. International Journal of Educational Research, 103, 101602.
https://doi.org/10.1016/j.ijer.2020.101602.
Schleicher, A . (2010). The case for 21st-century learning. Retrieved February 11, 2013, from
www.oecd.org/document/2/0,3746,en_21571361_44315115_46846594_1_1_1_1,00.html
Schleicher, A. (2011, January). Organisation for economic cooperation and development. The
OECD Observer, Suppl. OECD Yearbook 2011. Paris Issue. 282/283.
Schleicher, A. (2019). Presentation at the forum on transforming education. Global Peace
Convention.
Schmidt, F. L. (2002). The role of general cognitive ability and job performance: Why there
cannot be a debate. Human Performance, 15(1–2), 187–210.
http://doi.org/10.1080/08959285.2002.9668091
Schwab, K. (2016, January 14). The fourth industrial revolution: What it means, how to respond.
World Economic Forum. https://www.weforum.org/agenda/2016/01/the-fourth-industrial-
revolution-what-it-means-and-how-to-respond/
Serrat, O. (2014, April 20). Information overload in the attention economy. Asian De velopment
Board.
www.researchgate.net/publication/275155424_Information_Overload_in_the_Attention_Econom
y
Shilo, S. , Rossman, H. , & Segal, E. (2020). Axes of a revolution: Challenges and promises of
big data in healthcare. Nature Medicine, 26, 29–38.
Shute, V. J. , & Becker, B. J. (2010). Prelude: Assessment for the 21st century. In V. J. Shute &
B. J. Becker (Eds.), Innovative assessment for the 21st century: Supporting educational needs
(pp. 1–11). Springer Science + Business Media. https://doi.org/10.1007/978-1-4419-6530-1_1
Shute, V. J. , Ventura, M. , & Kim, Y. J. (2013). Assessment and learning of informal physics in
Newton’s Playground. The Journal of Educational Research, 106(6), 423–430.
http://doi.org/10.1080/00220671.2013.832970
Soderstrom, N. C. , & Bjork, R. A. (2015). Learning versus performance: An integrative review.
Perspectives on Psychological Science, 10(2), 176–199.
http://doi.org/10.1177/1745691615569000
Stecher, B. M. & Hamilton, L. S. (2014). Measuring hard-to-measure student competencies: A
research and development plan. RAND Corporation.
https://www.rand.org/pubs/research_reports/RR863.html. Also available in print form
Stevenson, A. (2019, November 8). Moser 20 years on: Why improving literacy and numeracy
still matters. NCFE. www.fenews.co.uk/exclusive/moser-20-years-on-why-improving-literacy-
and-numeracy-still-matters/
Stewart, W. (2012). Think you’ve implemented assessment for learning? Times Educational
Supplement. Retrieved February 3, 2023, from ww.tes.com/news/tes-archive/tes-
publication/think-youve-implemented-assessment-learning
Swiecki, Z. , Khosravi, H. , Chen, G. , Maldonado, R. M. , Lodge, J. M. , Milligan, S. , Selwyn, N.
, & Gašević, D. (2022). Assessment in the age of artificial intelligence. Computers and
Education: Artificial Intelligence, 3, 100075.
Swindell, R. , & Thompson, J. (1995, September). An international perspective of the university
of the third age. Accessed at U3A historical paper. worldu3a.org.
Thornton, K. (2012). Editorial. Studies in Self-Access Learning Journal, 3(1), 2–5.
Timmis, S. , Broadfoot, P. , Sutherland, R. , & Oldfield, A. (2016). Rethinking assessment in a
digital age: Opportunities, challenges and risks. British Educational Research Journal, 42(3),
454–476.
Trilling, B. , & Fadel, C. (2009). 21st century skills – Learning for life in our times. Jossey-Bass.
Turing, A. M. (1950). Computing machinery and Intelligence. Mind, 49, 443–460.
Twyman, J. S. (2018). Digital technologies in support of personalised learning. Report, center
on innovations in learning university. Temple University.
UNESCO . (1990, March 5–9). World declaration on education for all and framework for action
to meet basic learning needs. World conference on education for all meeting basic learning
needs. Jomiten, Thailand. UNESCO Publishing.
UNESCO . (2000a). World education report 2000. The right to education: towards education for
all throughout life. United Nations (UNESCO Publishing).
https://unesdoc.unesco.org/ark:/48223/pf0000119720
UNESCO . (2000b). Global synthesis of UNESCO education for all assessment 2000.
UNESCO.
UNESCO . (2011, September). Digital natives: How do they learn? How to teach them? IITE
Policy Brief. UNESCO Institute for Information Technologies in Education. UNESCO Institute.
UNESCO . (2015). Education for all 2000–2015: Achievements and challenges. 12th edition of
the EFA global monitoring report. United Nations Educational, Scientific and Cultural
Organization. UNESCO Publishing.
UNESCO Institute for Information Technologies in Education . (2011, May). Digital literacy in
education. Policy Brief. https://iite.unesco.org/pics/publications/en/files/3214688.pdf
UNITED NATIONS . (2000). World education forum in Dakar, Senegal, 26–28 April to boost
drive for education for all. Press Release SOC/4543.
www.un.org/press/en/2000/20000411.soc4543.doc.html
U.S. Department of Education, National Center for Education Statistics . (2004). Stronger
accountability: Testing for results: Helping families, schools, and communities understand and
improve student achievement. www.ed.gov/nclb/accountability/ayp/testingforresults.html
Vayachuta, P. , Ratana-Ubol, A. , & Soopanyo, W. (2016). The study of “out-of-school” children
and youth situations for developing a lifelong education model for “out-of-school” children and
youth. SHS Web of Conferences, 26, 01015. ERPA 2015.
http://doi.org/10.1051/shsconf/20162601015
Voogt, J. , & Roblin, N. P. (2010). 21st century skills (discussion paper). University of Twente.
Voogt, J. , & Roblin, N. P. (2012). A comparative analysis of international frameworks for 21st
century competences: Implications for national curriculum policies. Journal of Curriculum
Studies, 44(3), 299–321. http://doi.org/10.1080/00220272.2012.668938
Weale, S. (2023, January 23 Friday). Lecturers urged to review assessments in UK amid
concerns over new AI tool: ChatGPT is capable of producing high-quality essays with minimal
human input. The Guardian. www.theguardian.com/technology/2023/jan/13/end-of-the-essay-
uk-lecturers-assessments-chatgpt-concerns-ai
Whitelock, D. , & Watt, S. (2008). Reframing e-assessment: Adopting new media and adapting
old frameworks. Learning, Media and Technology, 33(3), 151–154.
Willetts, D. (2017). A university education. Oxford University Press.
Williams, A. (2015, September 19). Meet alpha: The next “next” generation. Fashion. The New
York Times. Retrieved September 7, 2019. https://www.nytimes.com/2015/09/19/fashion/meet-
alpha-the-next-next-generation.html
Willis, J. , & Klenowski, V. (2018). Classroom assessment practices and teacher learning: An
Australian perspective. In Teacher learning with classroom assessment (pp. 19–37). Springer.
Winthrop, R. , & McGivney, E. (2015, June). Why wait 100 years? Bridging the gap in global
education. The Brookings Institution. www.brookings.edu/reserach/why-wait-100-years-
bridging-the-gap-in-golbal-education
Wong, B. T. M. (2017). Learning analytics in higher education: An analysis of case studies.
Asian Association of Open Universities Journal, 12(1), 21–40. https://doi.org/10.1108/AAOUJ-
01-2
World Bank . (2019). World development report 2019: The changing nature of work. World
Bank. https://doi.org/10.1596/978-1-4648-1328-3
Wyatt-Smith, C. , Lingard, B. , & Heck, E. (2019). Digital learning assessments and big data:
Implications for teacher professionalism. Education research and foresight working paper 25.
UNESCO.
Yin, J. , Goh, T.-T. , Yang, B. , & Xiaobin, Y. (2021). Conversation technology with micro-
learning: The impact of chatbot-based learning on students’ learning motivation and
performance. Journal of Educational Computing Research, 59(1), 154–177.
https://doi.org/10.1177/0735633120952067
Yorke, M. (2003). Formative assessment in higher education: Moves towards theory and the
enhancement of pedagogic practice. Higher Education, 45(4), 477–501.

New Priorities and an Unexpected Shock


Akrofi, M. M. , Antwi, S. H. , & Gumbo, J. R. (2019). Students in climate action: A study of some
influential factors and implications of knowledge gaps in Africa. Environments, 6(12), 1–15.
https://doi.org/10.3390/environments6020012
Anders, J. , Macmillan, L. , Sturgis, P. , & Wyness, G. (2021, June 8). The “graduate parent”
advantage in teacher assessed grades. UCL centre for education policy and equalising
opportunities (CEPEO). https://blogs.ucl.ac.uk/cepeo/2021/06/08/thegraduate-
parentadvantageinteacherassessedgrades/
Arıkan, G. , & Günay, D. (2021). Public attitudes towards climate change: A cross-country
analysis. The British Journal of Politics and International Relations, 23(1), 158–174.
https://doi.org/10.1177/1369148120951013
Bauld, A. (2021, November 1). Usable knowledge 2021 why schools need to look at their own
Carbon footprint. Usable Knowledge. Harvard Graduate School of Education.
www.gse.harvard.edu/news/uk/21/11/why-schools-need-look-their-own-carbon-footprint
Bermingham, D. , & Chainey, J. (2022, December 13). The critical role of assessment in
creating climate-smart education systems. GPE Transforming Education.
https://www.globalpartnership.org/blog/critical-role-assessment-creating-climate-smart-
education-systems
Bond, L. (2005). Teaching to the test. The Carnegie Foundation to the Advancement of
Teaching. www.carnegiefoundation.org/perspectives/teaching-test
The British Psychological Society . (2021). How today’s psychometric tests can help you recruit
and retain the right talent. https://pminsight.cipd.co.uk/how-todays-psychometric-tests-can-help-
you-recruitand-retain-the-right-talent
Brookhart, S. M. , Guskey, T. R. , Bowers, A. J. , McMillan, J. H. , Smith, J. K. , Smith, L. F. , &
Welsh, M. E. (2016). A century of grading research: Meaning and value in the most common
educational measure. Review of Educational Research, 86(4), 803–848.
Burgess, S. , & Greaves, E. (2013). Test scores, subjective assessment, and stereotyping of
ethnic minorities. Journal of Labor Economics, 31(3), 535–576. https://doi.org/10.1086/669340
Carnie, F. (2022). Ten things schools can do to address the climate crisis. Schools Week,
March 18, 2019. https://schoolsweek.co.uk/ten-things-schools-can-do-to-address-the-climate-
crisis/
Childline . (2019). Annual review. Childline NSPCC.
https://learning.nspcc.org.uk/media/1898/childline-annual-review-2018-19.pdf
Civinini, C. (2021, December 10). Climate change and the curriculum: What needs to change?
Times Educational Supplement (TES) Magazine. www.tes.com/magazine/teaching-
learning/secondary/climate-change-and-curriculum-what-needs-change
Clark, H. , Coll-Seck, A. M. , Banerjee, A. , Peterson, S. , Dalglish, S. L. , Ameratunga, S. ,
Balabanova, D. , Bhan, M. K. , Bhutta, Z. A. , Borrazzo, J. , Claeson, M. , Doherty, T. , El-
Jardali, F. , George, A. S. , Gichaga, A. , Gram, L. , Hipgrave, D. B. , Kwamie, A. , Meng, Q. , …
& Costello, A. (2020, February 22). A future for the world’s children? A Who–Unicef–Lancet
Commission (Lancet 2020, Vol. 395, pp. 605–658). Online publication.
https://doi.org/10.1016/S0140-6736(19)32540-1
Cordero, E. C. , Centeno, D. , & Todd, A. M. (2020, February 4). The role of climate change
education on individual lifetime carbon emissions. https://doi.org/10.1371/journal.pone.0206266
Crocker, L. (2003). Teaching for the test: Validity, fairness, and moral action. Educational
Measurements: Issues and Practices, 22(3), 5–11.
Dake, J. A. , Price, J. H. , & Telljohann, S. K. (2003). The nature and extent of bullying at
school. Journal of School Health, 73(5), 174.
Davis, T. (2019, January 2). What is well-being? Definition, types, and well-being skills: Want to
grow your well-being? Here are the skills you need. Psychology Today.
www.psychologytoday.com/gb/blog/click-here-happiness/201901/what-is-well-being-definition-
types-and-well-being-skills
Delgado, P. (2022, June 30). Climate change is a threat to education. Institute for the Future of
Education. Technology de Monterrey. https://observatory.tec.mx/edu-news/climate-change-
impact-on-education
Department for Education . (2022, April 21). Sustainability and climate change strategy. Policy
Paper. www.gov.uk/government/publications/sustainability-and-climate-change-strategy
Downie, R. (2021). Quality of life: A post-pandemic view of medicine. Imprint Academic.
Edge Foundation . (2020). The impact of Covid-19 on education: Evidence on the early impacts
of lockdown. Edge Foundation.
Education Development Trust . (2022, June 22). Connecting education and climate change.
Blog. www.educationdevelopmenttrust.com/our-research-and-insights/commentary/connecting-
education-and-climate-change
Education Endowment Foundation . (2020). Impact of school closures on the attainment gap:
Rapid evidence assessment. Education Endowment Foundation.
Ejaz, W. , Mukherjee, M. , Fletcher, R. , & Kleis Nielsen, R. (2022). How we follow climate
change: Climate news use and attitudes in eight countries. Oxford Climate Journalism Network.
Published by the Reuters Institute for the Study of Journalism at the University of Oxford with
the support of the European Climate Foundation (ECF).
European Institute for Gender Equality . (2021). Gender equality index 2021: Health.
https://eige.europa.eu/publications-resources/toolkits-guides/gender-equality-index-2021-
report/women-report-poorer-mental-well-being-men?
Everett, N. , & Papageorgiou, J. (2011, June). Investigating the accuracy of predicted A level=
grades as part of 2009 UCAS admission process. Department for Business Innovation & Skills.
Research Paper No.37. https://docplayer.net/4526070-Investigating-the-accuracy-of-predicted-
a-level-grades-as-part-of-2009-ucas-admission-process.html
Flitcroft, D. , & Woods, K. (2018). What does research tell high school teachers about student
motivation for test performance? Pastoral Care in Education, 36(2), 112–125.
Gallone, P. , & Syed, R. (2021). Youth in a changing climate. Groundwork. Changing places.
Changing lives. www.groundwork.org.uk/wp-content/uploads/2021/11/Groundwork-Youth-in-a-
Changing-Climate-Report-Final-November-2021.pdf
Giannini, S. , Jenksins, R. , & Saavedra, J. (2022, January 24). 100 weeks into the pandemic:
the importance of keeping schools open and investing in learning recovery programs. World
Bank Blogs. Published on Education for Global Development.
https://blogs.worldbank.org/education/100-weeks-pandemic-importance-keeping-schools-open-
and-investing-learning-recovery
Gill, T. , & Benton, T. (2015). The accuracy of forecast grades for OCR A levels in June 2014.
Statistics Report Series No. 90. Research Division Assessment Research and Development
Cambridge Assessment. www.cambridgeassessment.org.uk/Images/241261-the-accuracy-of-
forecast-grades-for-ocr-a-levels-in-june-2014.pdf
The Guardian . (2022, January 28 Friday). UK pupils failed by schools’ teaching of climate
crisis, experts say. National Curri culum.
Hansard, UK Parliament . (2021). Covid-19: Education settings. Volume 698: Debated on
Tuesday 6 July 2021. https://hansard.parliament.uk/commons/2021-07-06/debates/0CA3E257-
6CDC-46CA-A16F-2B2248A5F372/Covid-19EducationSettings
Hawkey, K. , James, J. , & Tidmarsh, C. (2019). Using wicked problems to foster
interdisciplinary practice among UK trainee teachers. Journal of Education for Teaching, 45(4),
446–460. https://doi.org/10.1080/02607476.2019.1639263
Hodgen, J. , Taylor, B. , Jacques, L. , Tereshchenko, A. , Kwok, R. , & Cockerill, M. (2020).
Remote mathematics teaching during COVID-19: Intentions, practices and equity. UCL Institute
of Education.
Howard, E. (2020). A review of the literature concerning anxiety for educational assessments.
Ofqual Report. Published by Ofqual.
https://assets.publishing.service.gov.uk/media/5e45825340f0b677bf6eb3ea/A_review_of_the_lit
erature_concerning_anxiety_for_educational_assessment.pdf
Intergovernmental Panel On Climate Change (IPCC) . (2023). Climate change 2022: Impacts,
adaptation and vulnerability: Working group II contribution to the sixth assessment report of the
intergovernmental panel on climate change. https://www.ipcc.ch/report/ar6/wg2/
International Institute for Applied Systems Analysis . (2020, April 13). Exploring the link between
education and climate change. ScienceDaily.
www.sciencedaily.com/releases/2020/04/200413120019.htm
Iosad, A. , Wright, J. , & Esmann, M. (2022, July 28). Time for a world education service:
Focused, free and for all. Tony Blair Institute for Global Change.
https://institute.global/sites/default/files/articles/Time-for-a-World-Education-Service-Focused-
Free-and-for-All.pdf
Jamieson, J. P. , Peters, B. J. , Greenwood, E. J. , & Altose, A. J. (2016). Reappraising stress
arousal improves performance and reduces evaluation anxiety in classroom exam situations.
Social Psychological and Personality Science, 9. http://doi.org/10.1177/1948550616644656
Jennings, J. L. , & Bearak, M. (2006). “Teaching to the test” in the NCLB era: How test
predictability affects our understanding of student performance. Educational Researcher, 43(8),
381–389. http://doi.org/10.3102/0013189X14554449
Jerrim, J. (2021). National tests and the wellbeing of primary school pupils: New evidence from
the UK. Assessment in Education: Principles, Policy & Practice, 28(5–6), 507–544.
Kohn, A. (2002). The dangerous myth of grade inflation. The Chronicle of Higher Education,
49(11), B7–B9.
Kulakiewicz, A. , Long, R. , & Roberts, N. (2021). Inclusion of sustainability and climate change
in the national curriculum. House of Commons Library.
https://researchbriefings.files.parliament.uk/documents/CDP-2021-0166/CDP-2021-0166.pdf
Kwauk, C. , & Winthrop, R. (2021, March 26 Friday). Unleashing the creativity of teachers and
students to combat climate change: An opportunity for global leadership.
www.brookings.edu/research/unleashing-the-creativity-of-teachers-and-students-to-combat-
climate-change-an-opportunity-for-global-leadership/
Lawson, D. F. , Stevenson, K. T. , Peterson, M. N. , Carrier, S. J. , Strnad, R. L. , & Seekamp,
S. (2019). Children can foster climate change concern among their parents. National Climate
Chang, 9, 458–462. https://doi.org/10.1038/s41558-019-0463-3
Layard, R. (2011/2006). Happiness: Lessons from a new science (2nd ed.). Penguin Books.
Lazear, E. P. (2006). Speeding, terrorism, and teaching to the test. The Quarterly Journal of
Economics, 121(3), 1029–1061. https://doi.org/10.1162/qjec.121.3.1029
Leal Filho, W. , Tuladhar, L. , Li, C. , Balogun, A.-L. B. , Kovaleva, M. , Abubakar, I. R. , Azadi,
H. , & Donkor, F. K. K. (2023a). Climate change and extremes: Implications on city livability and
associated health risks across the globe. International Journal of Climate Change Strategies
and Management, 15(1), 1–19. https://doi.org/10.1108/IJCCSM-07-2021-0078
Leal Fihlo, W. , Yayeh Ayal, D. , Wall, T. , Shiel, C. , Paco, A. , Pace, P. , Mifsud, M. , Lange
Salvia, A. , Skouloudis, A. , Moggi, S. , LeVasseur, T. , Vinuesa Antonio, G. , Azeiteiro, U. ,
Ioannis, N. , & Kovaleva, M. (2023b). An assessment of attitudes and perceptions of
international university students on climate. Climate Risk Management, 39.
http://doi.org/10.1016/j.crm.2023.100486
Liu, T. , Shryane, N. , & Elliot, M. (2022). Attitudes to climate change risk: Classification of and
transitions in the UK population between 2012 and 2020. Humanities & Social Sciences
Communications, 9, 279. https://doi.org/10.1057/s41599-022-01287-1
Matud, M. P. , López-Curbelo, M. , & Fortes, D. (2019). Gender and psychological well-being.
International Journal of Environmental Research and Public Health, 16(19), 1–11.
www.ncbi.nlm.nih.gov/pmc/articles/PMC6801582/pdf/ijerph-16-03531.pdf
McManus, S. , Bebbington, P. , Jenkins, R. , & Brugha, T. (Eds.). (2016). Adult psychiatric
morbidity survey: Survey of mental health and wellbeing. England, 2014.
https://digital.nhs.uk/data-and-information/publications/statistical/adult-psychiatric-morbidity-
survey/adult-psychiatric-morbidity-survey-survey-of-mental-health-and-wellbeing-england-2014
Müller, L. M. , & Goldenberg, G. (2021). Education in times of crisis: Teachers’ experiences and
recommendations for effective distance learning. Chartered College of Teaching.
https://chartered.college/wp-content/uploads/2021/11/MullerGoldenberg_FULL_NOV21.pdf
Murphy, R. , & Wyness, G. (2020). Minority report: The impact of predicted grades on university
admissions of disadvantaged groups. Education Economics, 28(4), 333–350.
https://doi.org/10.1080/09645292.2020.1761945
Newman, K. , & Smith, L. S. (2021, September 30). Linking global education and the climate
crisis: An alternative approach. Blog. https://riseprogramme.org/blog/linking-global-education-
climate-crisis
Newsome, D. , Newsome, K. B. , & Miller, S. A. (2023). Teaching, Learning, and Climate
Change: Anticipated Impacts and Mitigation Strategies for Educators. Beha viour and Social
Issues, 32, 494–516. https://doi.org/10.1007/s42822-023-00129-2.
Nisbet, I. , & Shaw, S. D. (2020). Is assessment fair? SAGE Publishing Ltd.
Nisbet, I. , & Shaw, S. D. (2022). Fair high-stakes assessment in the long shadow of Covid-19.
Assessment in Education: Principles, Policy & Practice, 29(5), 518–533.
http://doi.org/10.1080/0969594X.2022.2067834
OECD . (2017). PISA 2015 results (volume III): Students’ well-being. PISA, OECD Publishing.
http://doi.org/10.1787/9789264267510-en
OECD . (2021). Education at a glance 2021: OECD indicators. OECD Publishing.
https://doi.org/10.1787/b35a14e5-en
OECD . (2022). Are students ready to take on environmental challenges?. PISA, OECD
Publishing. https://doi.org/10.1787/8abe655c-en
OECD . (2023). PISA 2025 science framework (Draft). https://pisa-framework.oecd.org/science-
2025/assets/docs/PISA_2025_Science_Framework.pdf
Ofqual . (2020). Ofqual welcomes DfE announcement on 2021 exams [Press release].
www.gov.uk/government/news/ofqual-welcomes-dfe-announcement-on-2021-exams
Paris agreement to the United Nations framework convention on climate change (December 12,
2015), T.I.A.S. No. 16–1104. https://unfccc.int/process-and-meetings/the-paris-
agreement?gad_source=1&gclid=Cj0KCQjw1qO0BhDwARIsANfnkv9S7t1GEs-
E8Vba2PGFELwIioHTDsGuHP1hewc6mD9d-rJmoNaQV2YaAgngEALw_wc8
Plutzer, E. , Hannah, A. L. , Rosenau, J. , McCaffrey, M. S. , Berbeco, M. , & Reid, A. H. (2016).
Mixed messages: How climate is taught in America’s schools. National Center for Science
Education. http://ncse.com/files/MixedMessages.pdf
Popham, J. W. (2001). Teaching to the test? Educational Leadership, 58(6), 16–20.
Porter, C. (2021, November 8). Education is under threat from climate change – especially for
women and girls. Blog. www.ox.ac.uk/news/features/education-under-threat-climate-change-
especially-women-and-girls
Priestley, M. , Shapira, M. , Priestley, A. , Ritchie, M. , & Barnett, C. (2020, September). Rapid
review of national qualifications experience 2020. Final Report. Faculty of Social Sciences,
University of Stirling.
www.gov.scot/binaries/content/documents/govscot/publications/independent-
report/2020/10/rapid-review-national-qualifications-experience-20202/documents/rapid-review-
national-qualifications-experience-2020/rapid-review-national-qualifications-experience-
2020/govscot%3Adocument/rapid-review-national-qualifications-experience-2020.pdf
Putwain, D. W. (2009). Assessment and examination stress in Key Stage 4. British Educational
Research Journal, 35(3), 391–411.
Putwain, D. W. , & Daly, A. L. (2014). Test anxiety prevalence and gender differences in a
sample of English secondary school students. Educational Studies, 40, 554–570.
Putwain, D. W. , & Symes, W. (2018). Does increased effort compensate for performance
debilitating test anxiety? School Psychology Quarterly, 33(3), 482–491.
https://doi.org/10.1037/spq0000236
Randell, H. , & Gray, C. (2019, April 15). Climate change and educational attainment in the
global tropics. PNAS, 116(18), 8840–8845. www.pnas.org/doi/epdf/10.1073/pnas.1817480116
Richmond, T. (2018). A degree of uncertainty An investigation into grade inflation in universities.
REFORM. #reformHE. www.tom-richmond.com/wp-
content/uploads/2018/06/A%20Degree%20of%20Uncertainty.pdf
Roberts, N. , & Danechi, S. (2022). Coronavirus: GCSEs, a levels and equivalents in 2022.
House of Commons Library. No. 09045.
https://researchbriefings.files.parliament.uk/documents/CBP-9045/CBP-9045.pdf
Sanchez, E. I. , & Moore, R. (2022, May). Grade inflation continues to grow in the past decade.
ACT Research Report. www.act.org/content/dam/act/unsecured/documents/2022/R2134-
Grade-Inflation-Continues-to-Grow-in-the-Past-Decade-Final-Accessible.pdf
Schleicher, A. (2019). PISA 2018 insights and interpretations. OECD.
https://issuu.com/pajaropolitico/docs/pisa_2018_insights_and_interpretations_final_pdf
Shaw, S. D. , & Nisbet, I. (2021). Attitudes to fair assessment in the light of COVID-19.
Research Matters: A Cambridge Assessment Publication, 31, 6–21.
Sitta, F. A. , Maddox, B. , Casebourne, I. , Hughes, S. , Kuvalja, M. , Hannam, J. , & Oates, T.
(2023). The futures of assessment: Navigating uncertainties through the lenses of anticipatory
thinking. Cambridge University Press & Assessment.
www.cambridgeassessment.org.uk/Images/698413-the-futures-of-assessment-navigating-
uncertainties-through-the-lenses-of-anticipatory-thinking.pdf
Smithers, A. (2014). A-LEVELS 1951–2014. Centre for Education and Employment Research
University of Buckingham August 2014.
Stewart, H. (2020, August 26). Boris Johnson blames “mutant algorithm” for exams fiasco. The
Guardian. www.theguardian.com/politics/2020/aug/26/boris-johnson-blames-mutant-algorithm-
for-exams-fiasco
UNESCO . (2010). Climate change education for sustainable development: The UNESCO
climate change initiative. ED.2010/WS/41, ED.2011/WS/3.
https://unesdoc.unesco.org/ark:/48223/pf0000190101
UNESCO . (2020). Education for sustainable development: A roadmap. ESDfor2030. UNESCO.
UNESCO . (2021). Getting every school climate-ready: How countries are integrating climate
change issues in education. Education 2030. United Nations Educational, Scientific and Cultural
Organization.
UNICEF . (2019). It is getting hot. Call for education systems to respond to the climate crisis.
Perspectives from East Asia and the Pacific. UNICEF East Asia and Pacific Regional Office.
www.unicef.org/eap/media/4596/file/It%20is%20getting%20hot:%20Call%20for%20education%
20systems%20to%20respond%20to%20the%20climate%20crisis.pdf
UNISDR . (2019). Global assessment report 2019. UNISDR.
United Nations . (2015, October 21). Transforming our world: The 2030 Agenda for Sustainable
Development. A/RES/70/1. Resolution adopted by the General Assembly on 25 September
2015. www.refworld.org/docid/57b6e3e44.html
United Nations . (2020). Policy brief: Education during COVID-19 and beyond.
www.un.org/sites/un2.un.org/files/sg_policy_brief_covid-19_and_education_august_2020.pdf
Van der Graaf, L. , Dunajeva, J. , Siarova, H. , & Bankauskaite, R. (2021). Research for CULT
committee – education and youth in post-COVID-19 Europe – crisis effects and policy
recommendations. European Parliament, Policy Department for Structural and Cohesion
Policies.
White, J. (2002). Education, the market and personal well-being. British Journal of Educational
Studies, 50(4), 442–456.
White, J. (2007). Wellbeing and education: Issues of culture and authority. Journal of
Philosophy of Education, 41(1), 17–28.
The World Bank . (2019, October 7). New target: Cut “learning poverty” by at least half by 2030.
The World Bank IBRD IDA. Press Release. www.worldbank.org/en/news/press-
release/2019/10/17/new-target-cut-learning-poverty-by-at-least-half-by-2030
World Bank, the Bill & Melinda Gates Foundation, FCDO, UNESCO, UNICEF, and USAID .
(2022, June 23). The state of global learning poverty: 2022 update. Conference edition. The
World Bank, UNESCO, and UNICEF.
www.unicef.org/media/122921/file/State%20of%20Learning%20Poverty%2022.pdf
The World Bank, UNESCO and UNICEF . (2021). The state of the global education crisis: A
path to recovery. The World Bank, UNESCO, and UNICEF.
https://documents1.worldbank.org/curated/en/416991638768297704/pdf/The-State-of-the-
Global-Education-Crisis-A-Path-to-Recovery.pdf
World Meteorological Organization . (2022). WMO provisional state of the global climate 2022.
https://library.wmo.int/viewer/56335/download?file=Provisional_State_of_the_Climate_2022_en.
pdf&type=pdf&navigator=1
Worth, K. (2021). Miseducation. How climate change is Taught in America (pp. 1–184).
Columbia University.
Zakharov, A. , Carnoy, M. , & Loyalka, P. (2014). Which teaching practices improve student
performance on high-stakes exams? Evidence from Russia. International Journal of Educational
Development. http://doi.org/10.1016/j.ijedudev.2014.01.003

Changes to Thinking about Society


Abulafia, D. (2022, May 14). The culture wars have crept into Oxbridge admissions. The
Spectator. www.spectator.co.uk/article/the-culture-wars-have-crept-into-oxbridge-admissions/
AERA . (2022). Amicus Curiae brief to the Supreme Court on case of students for fair
admissions. Inc. Petitioner, v. University of North Carolina, et al., Respondents, and Students
for Fair Admissions, Inc., Petitioner, v. University of North Carolina, et al., Respondents.
www.aera.net/Portals/38/AERA%20SFFA%20Brief.pdf?utm_source=Informz&utm_medium=em
ail&utm_campaign=test
American Educational Research Association , American Psychological Association, and
National Council on Measurement in Education. (2014). Standards for educational and
psychological testing. American Educational Research Association.
Apple, M. W. (2019). On doing critical policy analysis. Educational Policy, 33(1), 276–287.
http://doi.org/10.1177/0895904818807307
Armstrong, J. (2022, November 14). The sinister attempt to “de-colonise” mathematics. The
Spectator. www.spectator.co.uk/article/the-sinister-attempts-to-decolonise-mathematics/
Armstrong, J. , Ball, J. , Dawid, G. , Hitchin, N. , Kumon, A. , Miheisi, N. , Rees, M. , Reid, M. ,
Salamon, S. , Series, C. , Sokal, A. , Shepard-Barro, N. , Reeves, C. , Webb, J. R. L. , Gilmour,
S. , Jacka, S. , Gardiner, T. , Widmer, M. , Koloydenko, A. , Hiberdink, T. , & Saha, A. (2022).
Open letter about QAA benchmarks for mathematics, statistics and operational research.
Undated. https://nms.kcl.ac.uk/john.armstrong/qaa/QAABenchmarkLetter.pdf
Arnold, M . (1869/2015). Culture and anarchy and other selected prose. Penguin Books.
Atewologun, D. (2018). Intersectionality theory and practice. Oxford Research Encyclopedia of
Business and Management.
https://oxfordre.com/business/view/10.1093/acrefore/9780190224851.001.0001/acrefore-
9780190224851-e-48
Bell, D. (1992). Faces at the bottom of the well: The permanence of racism. Basic Books
(Reprint edition, 6 October 1993).
Bell, G. (2022). The twilight of unionism: Ulster and the future of Northern Ireland. Verso.
Blum, E . (2022, May 3). From the press release of “Student for Fair Admissions”.
https://studentsforfairadmissions.org/students-for-fair-admissions-files-opening-brief-at-u-s-
supreme-court-in-students-for-fair-admissions-v-harvard-and-students-for-fair-admissions-v-
university-of-north-carolina/
Brennan, R. L. (2006). Perspectives on the evolution and future of educational measurement. In
R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 3–16). American Council on
Education/Praeger.
Crenshaw, K. , Gotanda, N. , Peller, G. , & Thomas, K. (Eds.). (1995). Critical race theory: The
key writings that formed the movement. New Press.
Delgado, R. , & Stefancic, J. (2006). Critical race theory: An introduction. NYU Press.
Desmond, M. (2019, August 14). In order to understand the brutality of American capitalism,
you have to start on the plantation. The New York Times.
Dewey, J. (1918/2015). Democracy and education: An introduction to the philosophy of
education. CreateSpace Independent Publishing Platform.
DiAngelo, R. (2019). White fragility: Why it’s so hard for white people to talk about racism.
Penguin Books.
Dreier, P. , Kahlenberg, R. D. , & Oliver, M. L. (2023). The path to diversity at college now that
the Supreme Court has struck down affirmative action. https://slate.com/news-and-
politics/2023/02/supreme-court-affirmative-action-wealth-admissions-
factor.html#:~:text=The%20Path%20to,FEB%2008%2C%202023
Duncan, O. D. (1968). Social stratification and mobility: Problems in the measurement of trend.
In E. B. Sheldon & W. E. Moore (Eds.), Indicators of social change: Concepts and
measurements (pp. 675–720). Russell Sage Foundation.
www.jstor.org/stable/10.7758/9781610446914.15
Economist . (2021, July 30). How has the meaning of the word “woke” evolved? Economist.
www.economist.com/the-economist-explains/2021/07/30/how-has-the-meaning-of-the-word-
woke-evolved
Economist . (2022, July 14). “Critical race theory” is being weaponised. What’s the fuss about?
Economist. www.economist.com/interactive/united-states/2022/07/14/critical-race-theory-is-
being-weaponised-whats-the-fuss-about
Elias, J. , & Perez, N. (2022, September 2). What would the end of race-conscious admissions
mean for minority enrollment? The Chronicle of Higher Education.
https://www.chronicle.com/article/race-conscious-admission-bans
Ford, R. T. (2022, September 2). How affirmative action was derailed by diversity. The
Chronicle of Higher Education. www.chronicle.com/article/derailed-by-
diversity?utm_source=Iterable&utm_medium=email&utm_campaign=campaign_5411224_nl_C
hronicle-Review_date_20221031&cid=cr&source=&sourceid=
Furedi, F. (2021). 100 years of identity crisis: Culture wars over socialisation. De Gruyter.
Gillborn, D. (2005, July). Education policy as an act of white supremacy: Whiteness, critical race
theory and education reform. Journal of Education Policy, 20(4), 485–505.
http://doi.org/10.1080/02680930500132346
Gillborn, D. (2006). Critical race theory and education: Racism and antiracism in educational
theory and praxis. Discourse: Studies in the Cultural Politics of Education, 27(1), 11–32.
http://doi.org/10.1080/01596300500510229
Hannah-Jones, N. (2019, August 14). Our founding ideals of liberty and equality were false.
New York Times Magazine, pp. 14–26.
www.nytimes.com/interactive/2019/08/14/magazine/black-history-american-democracy.html
Hoover, E. (2023, June 29). The Supreme Court’s decision reveals a gulf between two views of
race and merit. www.chronicle.com/article/the-supreme-courts-decision-reveals-a-gulf-between-
two-views-of-race-and-
merit?utm_source=Iterable&utm_medium=email&utm_campaign=campaign_7160785_nl_Acad
eme-Today_date_20230630&cid=at&source=&sourceid=
Joseph, G. G. (2009). Mathematics and eurocentrism. In R. K. Kanth (Eds.), The challenge of
eurocentrism: Global perspectives, policy, and prospects. Palgrave.
Kissel, A. (2009, January 14). How the dorms are politicized: The case of the University of
Delaware. National Association of Scholars.
https://www.nas.org/blogs/article/how_the_dorms_are_politicized_the_case_of_the_university_
of_delaware
Ladson-Billings, G. (1998). Just what is critical race theory and what is it doing in a nice field like
education? International Journal of Qualitative Studies in Education, 11(1), 7–24.
http://doi.org/10.1080/095183998236863
Ladson-Billings, G. (2006, October). From the achievement gap to the education debt:
Understanding achievement in U.S. schools. Educational Researcher, 35(7), 3–12.
http://doi.org/10.3102/0013189X035007003
Ladson-Billings, G. , & Tate, W. F. I. V. (1995, Fall). Towards a critical race theory of education.
Teachers College Record: The Voice of Scholarship in Education, 97(1), 47–68.
http://doi.org/10.1177/016146819509700104
Leonardo, Z. (2022). The Souls of White Folk: Critical pedagogy, whiteness studies, and
globalization discourse. Race Ethnicity and Education, 5(1), 29–50.
http://doi.org/10.1080/13613320120117180.
Liu, O. L. (2022). Holistic admissions in higher education: Challenges and promises.
Educational Testing Service, Journal of Postsecondary Student Success, 1(4).
https://journals.flvc.org/jpss/article/view/131099/134899
Mac Aogáin, E. , Millar, D. , & Kellaghan, T. (2010). The bonus for Irish in the leaving certificate
examination. The Irish Journal of Education, 38, 25–42.
Marmol, E. (2016, Winter). The undemocratic effects and underlying racism of standardized
testing in the United States. Critical Intersection in Education, 4, 1–9.
https://jps.library.utoronto.ca/index.php/cie/article/view/26430/20714
McIntosh, P. (1989). White Privilege: Unpacking the invisible knapsack.
https://nationalseedproject.org/images/documents/Knapsack_plus_Notes-Peggy_McIntosh.pdf
Mowat, J. G. (2018). Closing the attainment gap – a realistic proposition or an elusive pipe-
dream? Journal of Education Policy, 33(2), 299–321.
http://doi.org/10.1080/02680939.2017.1352033
Newman, D. A. , Tang, C. , Song, Q. C. , & Wee, S. (2022). Dropping the GRE, keeping the
GRE, or using GRE-optional admissions? Considering tradeoffs and fairness. International
Journal of Testing, 22(1), 43–71. http://doi.org/10.1080/15305058.2021.2019750
New York Times . (2015, March 18). Noam Chomsky on the roots of American Racism, by
George Yancy and Noam Chomsky.
https://archive.nytimes.com/opinionator.blogs.nytimes.com/2015/03/18/noam-chomsky-on-the-
roots-of-american-racism/#more-156259
Nisbet, I. , & Shaw, S. D. (2020). Is assessment fair? SAGE Publications Ltd.
Pearson, P. D. (2004). The reading wars: The politics of reading research and policy – 1988
through 2003. Educational Policy, 18(1), 216–252.
Peters, M. A. (2015). Editorial: Why is my curriculum white? Educational Philosophy and
Theory, 47(7), 641–646. http://doi.org/10.1080/00131857.2015.1037227
Pierce, C. S. (1878). How to make our ideas clear. Popular Science Monthly, 12, 286–302.
Paragraphs 388–410 (frequently reprinted and cited).
Qualifications Wales & CCEA . (2019, July). Fair access by design: Guidance for awarding
organisations on designing high-quality and inclusive qualifications.
https://qualifications.wales/media/avuda1dk/fair-access-by-design.pdf
Quality Assurance Agency for Higher Education (QAA) . (2022, September). Subject benchmark
statement: Mathematics, statistics and operational research (5th ed.). Version for Consultation.
Rescher, N. (2005). American philosophy. In T. Honderich (Ed.), Oxford companion to
philosophy (pp. 749–750). Oxford University Press. www.qaa.ac.uk/docs/qaa/quality-code/sbs-
mathematics-statistics-and-operational-research-consultation-22.pdf?sfvrsn=f3b9a581_4
Rothstein, R. (2021). The problem with wealth-based affirmative action: It’s not an adequate
substitute for race-based programs. Atlantic.
https://www.theatlantic.com/ideas/archive/2023/06/affirmative-action-race-socioeconomic-
supreme-court/674251/
Saul, S. (2024, February 22). Yale to require standardized test scores for admissions. New York
Times. www.nytimes.com/2024/02/22/us/yale-standardized-testing-sat-act.html
Somerville, E. (2021, September 27). Wearing second hand clothes “an example of white
privilege”, students told. Daily Telegraph. www.telegraph.co.uk/news/2021/09/27/wearing-
second-hand-clothes-example-white-privilege/
Tate, W. F. (1994, February). Race, retrenchment, and the reform of school mathematics. The
Phi Delta Kappan, 75(6), 477–480, 482–484. Published by: Phi Delta Kappa International
Stable.
Tobin, S . (2021, September 28). Students at University of Kent must take “white privilege”
course. The Times. www.thetimes.co.uk/article/students-at-university-of-kent-must-take-white-
privilege-course-clc9zm6nl
Trump, D. (2018, September 25). Remarks by President Trump to the 73rd session of the
United Nations General Assembly. https://trumpwhitehouse.archives.gov/briefings-
statements/remarks-president-trump-73rd-session-united-nations-general-assembly-new-york-
ny
UCAS . (2023, January). Future of undergraduate admissions.
www.ucas.com/file/692816/download?token=LueoDrzn
Williams, T. (2022, November 7). Professors say decolonisation agenda “politicising” maths
degrees: New subject guidance mandates “narrowly skewed perspective on the history of
mathematics”, leading academics claim. www.timeshighereducation.com/news/professors-say-
decolonisation-agenda-politicising-maths-degrees
Worrell, F. (2016). Commentary on perspectives in fair assessment. In N. J. Dorans & L. L.
Cook (Eds.), Fairness in educational assessment and measurement. Routledge.
Changes to Thinking about Education and Assessment
Achtenhagen, F. (2012). The curriculum-instruction-assessment-triad. Empirical Research in
Vocational Education and Training, 4, 5–25.
Alexander, B. , Ashford-Rowe, K. , Barajas-Murphy, N. , Dobbin, G. , Knott, J. , McCormack, M.
, Pomerantz, J. , Seilhamer, R. , & Weber, N. (Hrsg.) (2019). EDUCAUSE Horizon report: 2019
Higher education edition. EDUCAUSE.
Ambrose, S. A. , Bridges, M. W. , DiPietro, M. , Lovett, M. C. , & Norman, M. K. (2010). How
learning works. John Wiley & Sons.
American Educational Research Association, American Psychological Association, and National
Council on Measurement in Education . (2014). Standards for educational and psychological
testing. American Educational Research Association.
Angeli, C. , Howard, S. K. , Ma, J. , Yang, J. , & Kirschner, P. A. (2017). Data mining in
educational technology classroom research: Can it make a contribution? Computers &
Education, 113, 226–242. https://doi.org/10.1016/j.compedu.2017.05.021
Anuradha, J. , Dhiman, T. , Ramachandran, V. , Arulalan, K. V. , & Tripathy, B. K. (2010).
Diagnosis of ADHD using SVM algorithm. In Proceedings of the third annual ACM Bangalore
conference (pp. 1–4). Association for Computing Machinery.
https://doi.org/10.1145/1754288.1754317
Ashworth, P. D. , & Saxton, J. (1990). On “competence”. Journal of Further and Higher
Education, 14(2), 3–25. https://doi.org/10.1080/0309877900140201
Association of Test Publishers (ATP). (2002). Guidelines for computer-based testing: ATP.
https://www.testpublishers.org/assets/documents/CBTGuidelines.pdf
August, D. E. , & Hakuta, K. E. (1997). Improving schooling for language-minority children: A
research agenda. National Academies Press.
Avella, J. T. , Kebritchi, M. , Nunn, S. G. , & Kanai, T. (2016). Learning analytics methods,
benefits, and challenges in higher education: A systematic literature review. Online Learning,
20(2), 17p. https://fles.eric.ed.gov/fulltext/EJ1105911.pdf
Baird, J. A. , Andrich, D. , Hopfenbeck, T. N. , & Stobart, G. (2017). Assessment and learning:
Fields apart? Assessment in Education: Principles, Policy & Practice, 24(3), 317–350.
http://doi.org/10.1080/0969594X.2017.1319337
Baird, J. A. , Hopfenbeck, T. N. , Newton, P. , Stobart, G. , & Steen-Utheim, A. T. (2014). State
of the field review: Assessment and learning. Norwegian Knowledge Centre for Education (case
number 13/4697). Oxford University Centre for Educational Assessment Report OUCEA/14/2.
Baker, R. S. , & Inventado, P. S. (2014). Educational data mining and learning analytics. In J.
Larusson & B. White (Eds.), Learning analytics. Springer.
Baker, R. S. , & Siemens, G. (2014). Educational data mining and learning analytics. In K.
Sawyer (Ed.), Cambridge handbook of the learning sciences (2nd ed., pp. 253–274).
Cambridge University Press.
Barkaoui, K. (2016). What and when second-language learners revise when responding to
timed writing tasks on the computer: The roles of task type, second language proficiency, and
keyboarding skills. Modern Language Journal, 100(1), 320–340.
http://doi.org/10.1111/modl.12316
Barua, P. D. , Vicnesh, J. , Gururajan, R. , Oh, S. L. , Palmer, E. , Azizan, M. M. , Kadri, N. A. ,
& Acharya, U. R. (2022). Artificial intelligence enabled personalised assistive tools to enhance
Education of children with neurodevelopmental disorders – A review. International Journal of
Environmental Research and Public Health, 19(3), 1192.
Batt, A. M. , Tavares, W. , & Williams, B. (2019). The development of competency frameworks
in healthcare professions: A scoping review. Advances in Health Sciences Education.
http://doi.org/10.1007/s10459-019-09946-w
Bennett, R. E. (2002). Inexorable and inevitable: The continuing story of technology and
assessment. Journal of Technology, Learning, and Assessment, 1(1).
https://ejournals.bc.edu/index.php/jtla/article/view/1667/1513
Bennett, R. E. (2011). Formative assessment: A critical review. Assessment in Education:
Principles, Policy & Practice, 18(1), 5–25. http://doi.org/10.1080/0969594X.2010.513678
Bennett, R. E. (2013). Preparing for the future: What educational assessment must do.
Published by the Gordon Commission on the Future of Assessment in Education.
http://www.gordoncommission.org/publications_reports/assessment_paradigms.html
Bennett, R. E. (2023). Toward a theory of socioculturally responsive assessment. Educational
Assessment, 28(2), 83–104. https://doi.org/10.1080/10627197.2023.2202312
Bienkowski, M. , Feng, M. , & Means, B. (2012). Enhancing teaching and learning through
educational data mining and learning analytics. An issue Brief. U.S. Department of Education,
Office of Educational Technology. https://tech.ed.gov/wp-content/uploads/2014/03/edm-la-
brief.pdf
Biesta, G. , & Priestley, M. (2013). Capacities and the curriculum. In M. Priestley & G. Biesta
(Eds.), Reinventing the curriculum: New trends in curriculum policy and practice (pp. 35–49).
Bloomsbury.
Bimpeh, Y. , & West, D. (2022). Adaptive testing: An introduction. AQA Assessment Research
and Innovation. https://filestore.aqa.org.uk/content/research/AQA-ADAPTIVE-TESTING-AN-
INTRODUCTION.PDF
Black, P. (1999). Assessment, learning theories and testing systems. In P. Murphy (Ed.),
Learners, learning and assessment (pp. 118–134). Paul Chapman.
Boston, K. (2004). Speech to e-assessment conference. QCA.
www.qcda.gov.uk/libraryAssets/media/6998_kb_speech_20040420_eassessment.rtf
Brassler, M. , & Dettmers, J. (2017). How to enhance interdisciplinary competence –
interdisciplinary problem-based learning versus interdisciplinary project-based learning.
Interdisciplinary Journal of Problem-Based Learning, 11(2). http://doi.org/10.7771/1541-
5015.1686
Broadfoot, P. (2009). Signs of change: Assessment past, present and future. In C. Wyatt-Smith
& J. Cummings (Eds.), Educational assessment in the 21st century. Connecting theory and
practice (pp. v–xi). Springer.
Broadfoot, P. , & Black, P. (2004). Redefining assessment? The first ten years of assessment in
education. Assessment in Education: Principles, Policy & Practice, 11(1), 7–26.
http://doi.org/10.1080/0969594042000208976
Brookhart, S. M. (2004). Classroom assessment: Tensions and intersections in theory and
practice. Teachers College Record, 106(3), 429–458.
Brown, P. C. , Roediger, H. L. , & McDaniel, M. A. (2014). Make it stick: The science of
successful learning. Harvard University Press.
www.hup.harvard.edu/catalog.php?isbn=9780674729018
Cakmakci, G. , Aydeniz, M. , Brown, A. , & Makokha, J. M. (2020). Situated cognition and
cognitive apprenticeship learning. In B. Akpan & T. J. Kennedy (Eds.), Science education in
theory and practice. Springer Texts in Education. Springer. https://doi.org/10.1007/978-3-030-
43620-9_20
Camacho, D. J. , & Legare, J. M. (2016). Shifting gears in the classroom – movement toward
personalised learning and competency-base education. The Journal of Competency-Based
Education, 1, 151–156.
Chami, G. (2023, October 23). Artificial intelligence and academic integrity: Striking a balance A
look at how universities can encourage the ethical and transparent use of artificial intelligence
tools to support learning while guarding against misconduct. Times Higher Education
Supplement. www.timeshighereducation.com/campus/artificial-intelligence-and-academic-
integrity-striking-balance
Chartered Institute of Professional Development . (2024, January 4). Competence and
competency frameworks. www.cipd.org/uk/knowledge/factsheets/competency-factsheet/#what
Child, S. F. , & Shaw, S. D. (2020). A purpose-led approach towards the development of
competency frameworks. Journal of Further and Higher Education, 44(8), 1143–1156.
http://doi.org/10.1080/0309877X.2019.1669773
Churchill, A. (2015). Bless the tests: Three reasons for standardised testing. Thomas Fordham
Institute. Retrieved March 18, 2023, from
https://fordhaminstitute.org/national/commentary/bless-tests-three-reasons-standardized-testing
Coe, R. (2013, June 18). Improving education: A triumph of hope over experience. Inaugural
Lecture of Professor Robert Coe, Durham University. http://eachandeverydog.net/wp-
content/uploads/2015/05/ImprovingEducation2013.pdf
Coleman, V. (2021). Digital divide in UK education during COVID-19 pandemic: Literature
review. Cambridge Assessment Research Report, accessed at Digital divide in UK Education
During COVID-19 Pandemic: Literature Review. cambridgeassessment.org.uk
Cope, B. , & Kalantzis, M. (2016). Big data comes to school: Implications for learning,
assessment and research. AERA Open, 2(2), 1–19. http://doi.org/10.1177/2332858416641907
Council of Europe . (2001). Common European framework of reference for languages:
Learning, teaching, assessment. Cambridge University Press.
Council of Europe . (2019, September 11). Consultative committee of the convention for the
protection of individuals with regard to automatic processing of personal data (convention 108).
Report on Data in Education. Children’s Data Protection in Education Systems: Challenges and
Possible Remedies. Recommendations Summary Directorate General of Human Rights and
Rule of Law. T-PD(2019)06BIS. https://rm.coe.int/children-s-data-protection-in-education-
systems-challenges-and-possibl/1680973671
Dae-Bong. K. (2009, October 27–30). Human capital and its measurement. The 3rd OECD
World Forum on “Statistics, knowledge and policy”: Charting progress, building visions,
improving life, pp. 1–15. https://www.truevaluemetrics.org/DBpdfs/HumanCapital/Prof-Dr-Kwon-
Human-Capital-Measurement.pdf
Deng, Z. (2018). Bringing knowledge back in: Perspectives from liberal education. Cambridge
Journal of Education, 48(3), 335–351. http://doi.org/10.1080/0305764X.2017.1330874
Dewey, J. (1916). Democracy and education. Macmillan.
Dewey, J. (1938). Experience and education. Collier Books.
Dhawan, V. (2014). Education and neuroscience. Research Matters: Cambridge Assessment
Publication, 17, 46–55. www.cambridgeassessment.org.uk/Images/466322-education-and-
neuroscience.pdf
Driver, R. , Asoko, H. , Leach, J. , Mortimer, E. , & Scott, P. (1994). Constructing scientific
knowledge in the classroom. Educational Researcher, 23(7), 5–12.
http://doi.org/10.3102/0013189X023007005
Drucker, P. F. (2006). The effective executive. HarperCollins.
Elwood, J. (2006). Gender issues in testing and assessment. In C. Skelton , B. Francis , & L.
Smulyan (Eds.), The SAGE handbook on gender and education (pp. 262–278). SAGE
Publications Ltd.
Elwood, J. , & Klenowski, V. (2002). Creating communities of shared practice: The challenges of
assessment use in learning and teaching. Assessment and Evaluation in Higher Education,
27(3), 243–256.
European Commission & Council of the European Union . (2006, December 30).
Recommendation of the European Parliament and of the Council of 18 December 2006 on key
competences for lifelong learning. Official Journal of the European Union, 394, 10–18.
European Commission Education & Culture . (2018). Commission staff working document.
Proposal for a council recommendation on key competencies for lifelong learning. https://eur-
lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:52018SC0014&from=EN
Foster, S. (2019). What barriers do students perceive to engagement with automated immediate
formative feedback. Journal of Interactive Media in Education, 2019(1), 1–5.
https://eric.ed.gov/?id=EJ1228614
Gandhi, M. H. , & Mukherji, P. (2021). Learning theories. StatPearls. Retrieved November 5,
2021, from www.ncbi.nlm.nih.gov/books/NBK562189/
Gibson, D. C. , & Webb, M. (2015, December). Data science in educational assessment.
Education and Information Technologies, 20(4). http://doi.org/10.1007/s10639-015-9411-7
Gobert, J. D. , San Pedro, M. , Raziuddin, J. , & Baker, R. S. (2013). From log fles to
assessment metrics: Measuring students’ science inquiry skills using educational data mining.
The Journal of the Learning Sciences, 22, 521–563.
Goswami, U. (2006). Neuroscience and education: From research to practice? National Review
of Neuroscience, 7(5), 406–411.
Griffths, D. , Drachsler, H. , Kickmeier-Rust, M. , Steiner, C. , Hoel, T. , & Greller, W. (2016,
January 6). Is privacy a show-stopper for learning analytics? A review of current issues and
their solutions. Learning Analytics Review. ISSN: 2057–7494. LACE Project.
Halász, G. , & Michel, A. (2011). Key competences in Europe: Interpretation, policy formulation
and implementatio. European Journal of Education, 46(3), 289–306.
Halpern, D. F. (1998). Teaching critical thinking for transfer across domains: Dispositions, skills,
structure training, and metacognitive monitoring. American Psychologist, 53(4), 449–455.
Halpern, D. F. (2001). Assessing the effectiveness of critical thinking instruction. Journal of
General Education, 50(4), 270–286.
Halpern, D. F. (2003). Thought and knowledge: An introduction to critical thinking. Erlbaum.
Halpern, D. F. (2010). Halpern critical thinking assessment manual. Schuhfried GmbH.
Hanesworth, P. (2019). Inclusive assessment: Where next? Advance HE. www.advance-
he.ac.uk/news-and-views/inclusive-assessment-where-next
Hazan, E. , & Smit, S. (2021, July 13). How defining intangible investments can help grow the
knowledge economy. World Economic Forum. www.mckinsey.com/mgi/overview/in-the-
news/how-defining-intangible-investments-can-help-grow-the-knowledge-economy
Herder, E. , Sosnovsky, S. , & Dimitrova, V. (2017). Adaptive intelligent learning environments.
In D. Erik , S. Mike & S. Rosamund (Eds.), Technology enhanced learning (pp. 109–114).
Springer International Publishing.
Herold, B. (2016, February 5). Technology in education: An overview. Education Week.
www.edweek.org/technology/technology-in-education-an-overview/2016/02
Hirsch, E. D. (1988). Cultural literacy: What every American needs to know. Vintage Books.
Hirsch, E. D. (2016). Why knowledge matters: Rescuing our children from failed educational
theories. Harvard Educational Press.
Hirst, P. H. (1965). Liberal education and the nature of knowledge. In R. D. Archambault (Ed.),
Philosophical analysis and education (pp. 113–138). Routledge and Kegan Paul.
Hirst, P. H. (1973). Liberal education and the nature of knowledge. In P. H. Hirst (Ed.),
Knowledge and the curriculum: A collection of philosophical papers (pp. 30–53). Routledge and
Kegan Paul.
Hirst, P. H. (1993). Education, knowledge and practices. In R. Barrow & P. White (Eds.),
Beyond liberal education: Essays in honour of Paul H. Hirst (pp. 184–199). Routledge.
Hirst, P. H. , & Peters, R. S. (1970). The logic of education. Routledge & Kegan Paul.
Hockings, C. (2010). Inclusive learning and teaching: A synthesis of the research. Higher
Education Academy.
www.heacademy.ac.uk/resources/detail/resources/detail/evidencenet/Inclusive_learning_and_t
eaching_in_higher_education
Holmes, W. , Persson, J. , Chounta, I.-A. , Wasson, B. , & Dimitrova, V. (2022). Artificial
intelligence and Education. A critical view through the lens of human rights, democracy, and the
rule of law. Council of Europe.
Holmes, W. , & Tuomi, I. (2022). State of the art and practice in AI in education. European
Journal of Education, 57, 542–570. https://doi.org/10.1111/ejed.12533
Horowitz, H. L. (1971, Spring). Review: The progressive education movement after World War I.
History of Education Quarterly, 11(1), 79–84. Cambridge: Cambridge University Press.
Hughes, S. (2021, November 18). What do we mean by “digital” and how does that impact
assessment? www.cambridge.org/news-and-insights/insights/what-do-we-mean-by-digital-
assessment
Hughes, S. (2022, January 6). Why don’t we just put our high stakes exams on screen?
Cambridge Assessment. www.cambridge.org/news-and-insights/insights/Why-
don%E2%80%99t-we-just-put-our-high-stakes-exams-on-screen
Hwang, G. J. , Xie, H. , Wah, B. W. , & Gašević, D. (2020). Vision, challenges, roles and
research issues of artificial intelligence in education. Computers and Education: Artificial
Intelligence, 1, 100001.
International Test Commission . (2001). International guidelines for test use. International
Journal of Testing, 1, 93–114.
International Test Commission . (2005). International guidelines on computer-based and
internet delivered testing. www.intestcom.org
Ixer, G. (2016). The concept of reflection: Is it skill based or values? Social Work Education,
35(7), 1227–1470. http://doi.org/10.1080/02615479.2016.1193136
James, M. , Black, P. , Carmichael, P. , Conner, C. , Dudley, P. , Fox, A. , Frost, A. , Honour, L.
, Macbeth, J. , McCormack, R. , Marshall B. , Pedder, D. , Procter, R. , Swaffield, S. , & Wiliam,
D. (2006). Learning how to learn: Tools for schools. Routledge.
Joint Information Systems Committee (JISC). (2007). Effective practice with e-assessment: An
overview of technologies, policies and practice in further and higher education (online).
www.jisc.ac.uk/media/documents/themes/elearning/effpraceassess.pdf
Jones, K. M. L. (2019). Learning analytics and higher education: A proposed model for
establishing informed consent mechanisms to promote student privacy and autonomy.
International Journal of Educational Technology in Higher Education, 16(24), 1–22.
https://doi.org/10.1186/s41239-019-0155-0
Jorg, T. , Davis, B. , & Nickmans, G. (2007). Position paper: Towards a new, complexity science
of learning and education. Educational Research Review, 2(2), 145–156.
http://doi.org/10.1016/j.edurev.2007.09.002
Joynes, C. , Rossignoli, S. , & Fenyiwa Amonoo-Kuofi, E. (2019). 21st century skills: Evidence
of issues in definition, demand and delivery for development contexts. K4D Helpdesk Report.
Institute of Development Studies.
https://assets.publishing.service.gov.uk/media/5d71187ce5274a097c07b985/21st_century.pdf
Kim, H. , Care, E. , & Vista, A. (2019, January 30). Education systems need alignment for
teaching and learning 21st century skills. Brookings Focus on Assessment.
www.brookings.edu/articles/education-system-alignment-for-21st-century-skills/
Kim, J. S. (2008, January). Research and the reading wars. The Phi Delta Kappan, 89(5),
372–375.
Kitchen, W. H. (2014). Authority and the teacher. Bloomsbury Academic.
Krause, K.-L. , Bochner, S. , Duchesne, S. , & McMaugh, A. (2010). Educational psychology for
learning and teaching(3rd ed.). Cengage Learning Australia.
Krutka, D. , Manca, S. , Galvin, S. , Greenhow, C. , Koehler, M. , & Askari, E. (2019). Teaching
“against” social media: Confronting problems of profit in the curriculum. Teachers College
Record, 121(14), 1–42.
Ladson-Billings, G. (2014). Culturally relevant pedagogy 2.0: A.k.a. the remix. Harvard
Educational Review, 84(1), 74–84. https://doi.org/10.17763/haer.84.1.p2rj131485484751
Lave, J. , & Wenger, E. (1991). Learning in doing: Social, cognitive, and computational
perspectives. Legitimate peripheral participation. Cambridge University Press.
https://doi.org/10.1017/CBO9780511815355
Lazarus, S. S. , Johnstone, C. J. , Liu, K. K. , Thurlow, M. L. , Hinkle, A. R. , & Burden, K.
(2022). An updated state guide to universally designed assessments. NCEO Report 431.
National Center on Educational Outcomes.
Lefrançois, G. R. (2019). Theories of human learning: Mrs Gribbin’s cat (Seventh/Guy R.
Lefrançois.). Cambridge University Press.
www.cambridge.org/gb/academic/subjects/psychology/educational-psychology/theories-human-
learning-mrs-gribbins-cat-7th-edition
Leighton, J. P. , & Gierl, M. J. (2007). Why cognitive diagnostic assessment? In J. P. Leighton &
M. J. Gierl (Eds.), Cognitive diagnostic assessment for education: Theory and applications (pp.
3–18). Cambridge University Press. https://doi.org/10.1017/CBO9780511611186.001
Long, C. (2023, March 30). Standardized testing is still failing students. NEA Today.
www.nea.org/nea-today/all-news-articles/standardized-testing-still-failing-students
Lyons, S. , Johnson, M. , & Hinds, B. F. (2021, July). A call to action: Confronting inequity in
assessment. Lyons Assessment Consulting.
www.lyonsassessmentconsulting.com/assets/files/Lyons-JohnsonHinds_CalltoAction.pdf
Madaus, G. , Russell, M. , & Higgins, J. (2009). The paradoxes of high stakes testing: how they
affect students, their teachers, principals, schools and society. Sage Publications, Inc.
Madgavkar, A. , Schaninger, B. , Smit, S. , Woetzel, J. , Samandari, H. , Carlin, D. , Seong, J. ,
& Chockalingham, K. (2022, June 2). Human capital at work: The value of experience.
McKinsey Global Institute. www.mckinsey.com/capabilities/people-and-organizational-
performance/our-insights/human-capital-at-work-the-value-of-experience#/
Mayer-Schönberger, V. , & Cukier, K. (2013). Big data: A revolution that will transform how we
live, work, and think. Houghton Mifflin Harcourt.
McArthur, J. (2016). Assessment for social justice: The role of assessment in achieving social
justice. Assessment & Evaluation in Higher Education, 41(7), 967–981.
https://doi.org/10.1080/02602938.2015.1053429
McFarlan, C. (2022, January 19). Cultural relevance versus construct relevance: How do we
create culturally responsive assessments? 2022 NCME equity in assessment webinar. National
Council on Measurement in Education. Renaissance.
https://higherlogicdownload.s3.amazonaws.com/NCME/4b7590fc-3903-444d-b89d-
c45b7fa3da3f/UploadedImages/Equity_in_Assessment_Resources/NCME_2022_Equity_in_As
sessment_Webinar_1_-_Slides.pdf
McKinsey & Company . (2007). How the world’s best performing school sy stems come out on
top. www.mckinsey.com/industries/education/our-insights/how-the-worlds-best-performing-
school-systems-come-out-on-top
McMurtrie, B. (2018). How artificial intelligence is changing teaching. The Chronicle of Higher
Education. www.chronicle.com/article/How-Artificial-Intelligence-Is/244231
McPhail, G. , & Rata, E. (2015). Comparing curriculum types: “Progressive knowledge” and
“21st century learning”. New Zealand Journal of Educational Studies.
https://doi.org/10.1007/s40841-015-0025-9
Mead, A. D. , & Drasgow, F. (1993). Equivalence of computerized and paper-and-pencil
cognitive ability tests: A meta-analysis. Psychological Bulletin, 114(3), 449–458.
https://doi.org/10.1037/0033-2909.114.3.449
Mislevy, R. J. (2018). Sociocognitive foundations of educational measurement. Routledge.
Mizzi, E. (2022). Conceptualising powerful knowledge in economics. Journal of Curriculum
Studies, 55(4), 409–423. http://doi.org/10.1080/00220272.2023.2225194
Montenegro, E. , & Jankowski, N. (2017). Equity and assessment: Moving towards culturally
responsive assessment (Occasional Paper No. 29). University of Illinois and Indiana University,
National Institute for Learning Outcomes Assessment (NILOA).
www.learningoutcomesassessment.org/wp-content/uploads/2019/02/OccasionalPaper29.pdf
Mulder, M. , Weigel, T. , & Collins, K. (2007). The concept of competence in the development of
vocational education and training in selected EU member states: A critical analysis. Journal of
Vocational Education and Training, 59(1), 67–88. http://doi.org/10.1080/13636820601145630
Murchan, D. , & Siddiq, F. (2021). A call to action: A systematic review of ethical and regulatory
issues in using process data in educational assessment. Large-scale Assessments in
Education, 9(25), 1–27. https://doi.org/10.1186/s40536-021-00115-3
Nagel, M. (2012). Student learning. In R. Churchill , P. Ferguson , S. Godinho , N. Johnson & A.
Keddie (Eds.), Teaching making a difference (Vol. 2, pp. 74–88). Wiley Publishing.
Neisser, U. (1967). Cognitive psychology. Appleton-Century-Crofts.
Newman, J. H. (1852). The idea of a university ( C. F. Harrold , Ed.). Longmans, Green, and
Co.
Nisbet, I. , & Shaw, S. D. (2022). Fair high-stakes assessment in the long shadow of Covid-19.
Assessment in Education: Principles, Policy & Practice.
http://doi.org/10.1080/0969594X.2022.2067834
Nortvedt, G. A. , Wiese, E. , & Brown, M. (2020). Aiding culturally responsive assessment in
schools in a globalising world. Educational Assessment, Evaluation and Accountability, 32(1),
5–27. https://doi.org/10.1007/s11092-020-09316-w
Odendahl, N. V. (2011). Testwise: Understanding educational assessment (Vol. 1). Rowman &
Littlefield Education.
OECD . (2001). The well-being of nations: The role of human and social capital. Author.
OECD . (2013). The future of education and skills. Education 2030. OECD Publishing.
www.oecd.org/education/2030/E2030%20Position%20Paper%20(05.04.2018).pdf
OECD . (2015). PISA 2015 collaborative problem solving. https://www.oecd.org/en/topics/sub-
issues/student-problem-solving-skills/pisa-2015-collaborative-problem-solving.html
OECD . (2018). The future of education and skills: Education 2030.
www.oecd.org/education/2030-project
OECD . (2020). Back to the future of education: Four OECD scenarios for schooling,
educational research and innovation. OECD Publishing. https://doi.org/10.1787/178ef527-en
Ofqual . (2020). Online and on-screen assessment in high stakes, sessional qualifications. A
review of the barriers to greater adoption and how these might be overcome. Ofqual/20/6723/1.
https://www.gov.uk/government/publications/online-and-on-screen-assessment-in-high-stakes-
sessional-qualifications
Pashler, H. , Bain, P. , Bottge, B. , Graesser, A. , Koedinger, K. , McDaniel, M. , & Metcalfe, J.
(2007). Organizing instruction and study to improve student learning (NCER 2007–2004).
National Center for Education Research, Institute of Education Sciences, U.S. Department of
Education. http://ncer.ed.gov
Pellegrino, J. W. (2006). Rethinking and redesigning curriculum, instruction, and assessment:
What contemporary research and theory suggests. Paper commissioned by the National Center
on Education and the Economy for the New Commission on the Skills of the American
Workforce. National Center on Education and the Economy.
Pellegrino, J. W. (2012). Chapter 10. Teaching, learning and assessing 21st century skills.
OECD iLibrary. www.oecd-ilibrary.org/sites/9789264270695-12-
en/index.html?itemId=/content/component/9789264270695-12-
en#:~:text=The%20cognitive%20domain%20involves%20reasoning,responding%20to%20mess
ages%20from%20others
Pellegrino, J. W. , & Hilton, M. L. (Eds.). (2012). Committee on defining deeper learning and
21st century skills. Center for Education, Division on Behavioral and Social Sciences and
Education, National Research Council.
Peña-Ayala, A. (2018). Learning analytics: A glance of evolution, status, and trends according
to a proposed taxonomy. Wiley Interdisciplinary Reviews: Data Mining and Knowledge
Discovery, 8(3), e1243. https://doi.org/10.1002/widm.1243
Peters, R. S. (1966). Ethics and education. Allen and Unwin.
Peters, R. S. (1973). Authority, responsibility and education. Allen & Unwin.
Phelan, J. , Choi, K. , Vendlinski, T. , Baker, E. , & Herman, J. (2011). Differential improvement
in student understanding of mathematical principles following formative assessment
intervention. The Journal of Educational Research, 104(5), 330–339.
Piaget, J. , & Inhelder, B. (1969). The psychology of the child. Basic Books.
Polanyi, M. (1958). Personal knowledge: Towards a post-critical philosophy. University of
Chicago Press.
Polster, P. P. , Detrich, R. , & States, J. (2021). Standardized testing: The controversy
surrounding it. The Wing Institute. www.winginstitute.org/student-standardized-tests
Raikes, N. (2019). Data, data everywhere? Opportunities and challenges in a data-rich world.
Research Matters: A Cambridge Assessment Publication, 27, 16–19.
Reiss, M. , & Oates, T. (2014). Powerful knowledge and national curriculum. Cambridge
Assessment. www.cambridgeassessment.org.uk/news/video/view/the-importance-of-powerful-
knowledge-in-the-national-curriculum-michael-reiss-and-tim-oates/
Ripley, M. (2009). Transformational computer-based testing. In F. Scheuermann & Julius
Björnsson (Eds.), The transition to computer-based assessment new approaches to skills
assessment and implications for large-scale testing. JRC scientific and technical reports. EUR
23679 EN – 2009 (pp. 92–98). European Commission Joint Research Centre Institute for the
Protection and Security of the Citizen.
Roblyer, M. D. , Edwards, J. , & Havriluk, M. J. (1997). Integrating educational technology into
teaching. Prentice Hall.
Rogers, C. , & Freiberg, J. (1994). Freedom to learn (3rd ed.). Merrill Publishing.
Rogoff, B. (1990). Apprenticeship in thinking: Cognitive development and social context. Oxford
University Press.
Rogti, M. (2021). Behaviorism as external stimuli: Improving student extrinsic motivation through
behavioral responses in Algerian college education. Global Journal of Human-Social Science,
21(1), 28–41.
Ryan, M. , & Ryan, M. (2013). Theorising a model for teaching and assessing reflective learning
in higher education. Higher Education Research & Development, 32(2), 244–257.
http://doi.org/10.1080/07294360.2012.661704
Rychen, D. S. , & Salganik, L. H. (2001). Defining and selecting key competencies. Hogrefe &
Huber Publishers.
Rycroft-Smith, L. , & Boylan, M. (2019). Summary of evidence for elements of teaching related
to mastery in mathematics (Espresso 16). Cambridge Mathematics.
www.cambridgemaths.org/Images/espresso_16_mastery_in_mathematics.pdf
Schaeffer, G. A. , Bridgeman, B. , Golub-Smith, M. L. , Lewis, C. , Potenza, M. T. , & Steffen, M.
(1998). Comparability of paper-and-pencil and computer adaptive test scores on the GRE©
general test. GRE Professional Report No. 95 –08P. ETS Research Report 98–38.
http://www.iacat.org/content/comparability-paper-and-pencil-and-computer-adaptive-test-
scores-gre-general-test
Schaeffer, G. A. , Steffen, M. , Golub-Smith, M. L. , Mills, C. N. , & Durso, R. (1995). The
introduction and comparability of the computer-adaptive GRE General Test (Research Rep. No.
95–20). Educational Testing Service.
Schmidt, W. , Houang, R. T. , & Cogan, L. (2002). A coherent curriculum: The case of
mathematics. American Educator, 26, 1–17.
www.aft.org/sites/default/files/media/2014/curriculum.pdf
Schunk, D. H. (2020). Learning theories: An educational perspective (8th ed.). Pearson
Education. www.pearson.com/us/higher-education/program/Schunk-Learning-Theories-An-
Educational-Perspective-8th-Edition/PGM1996609.html
Shepard, L. A. (2000). The role of assessment in a learning culture. Educational Researcher,
29(7), 4–14.
Shiell, H. , Johnson, M. , Hopkin, R. , Nádas, R. , & Bell, J. (2011, January). Extended essay
marking on screen: Does marking mode influence marking outcomes and processes? Research
Matters: A Cambridge Assessment Publication, Issue 11.
www.cambridgeassessment.org.uk/Images/471465-extended-essay-marking-on-screen-does-
marking-mode-influence-marking-outcomes-and-processes-.pdf
Shute, V. J. , Ventura, M. , & Kim, Y. J. (2013). Assessment and learning of qualitative physics
in Newton’s playground. The Journal of Educational Research, 106(6), 423–430.
https://doi.org/10.1080/00220671.2013.832970
Siarova, H. , Sternadel, D. , & Mašidlauskaitė, R. (2017). Assessment practices for 21st century
learning: Review of evidence. NESET II Report. Publications Office of the European Union.
http://doi.org/10.2766/71491
Skinner, B. (1972). Utopia through the control of human behavior. In J. M. Rich (Ed.), Readings
in the philosophy of education. Wadsworth.
Skinner, F. (1938). The behavior of organisms: An experimental analysis. Appleton Century-
Crofts.
Slade, S. , & Prinsloo, P. (2013). Learning analytics: Ethical issues and dilemmas. American
Behavioral Scientist, 57(10), 1509–1528.
Smith, R. (2023). Forms of knowledge and forms of philosophy. Journal of Philosophy of
Education, 57, 65–76. https://doi.org/10.1093/jopedu/qhad007
Snow, R. E. , & Lohman, D. F. (1989). Implications of cognitive psychology for educational
measurement. In R. L. Linn (Ed.), Educational measurement (pp. 263–331). Macmillan
Publishing Co, Inc; American Council on Education.
Snowman, J. , McCown, R. , & Biehler, R. (2009). Psychology applied to teaching (12th ed.).
Houghton Mifflin.
SoLAR [Society for Learning Analytics Research] (online). What is learning analytics?
www.solaresearch.org/about/what-is-learning-analytics/
Stahl, B. C. , & Wright, D. (2018). Ethics and privacy in AI and big data: Implementing
responsible research and innovation. IEEE Security and Privacy, 16(3), 26–33.
http://doi.org/10.1109/MSP.2018.2701164
Stecher, B. M. , & Hamilton, L. S. (2006, April). Using test-score data in the classroom. WR-
375-EDU. RAND Education.
www.rand.org/content/dam/rand/pubs/working_papers/2006/RAND_WR375.pdf
Stecher, B. M. , & Hamilton, L. S. (2014). Measuring hard-to-measure student competencies: A
research and development plan. Rand.
Sternberg, R. J. , Conway, B. E. , Ketron, J. L. , & Bernstein, M. (1981). People’s conceptions of
intelligence. Journal of Personality and Social Psychology, 41(1), 37–55.
https://doi.org/10.1037/0022-3514.41.1.37
Swaffield, S. (2009). The misrepresentation of assessment for learning – and the woeful waste
of a wonderful opportunity. www.aaia.org.uk/content/uploads/2010/07/The-Misrepresentation-of-
Assessment-for-Learning.pdf
Tchibozo, G. (2011). Emergence and outlook of competence-based education in European
education systems: An overview. Education, Knowledge and Economy, 4(3), 193–205.
Threlfall, J. , Pool, P. , Homer, M. , & Swinnerton, B. (2007). Implicit aspects of peer and paper
and pencil mathematics assessment that come to light through the use of the computer.
Educational Studies in Mathematics, 66(3), 335–348. www.jstor.org/stable/27822709
Timmis, S. , Broadfoot, P. , Sutherland, R. , & Oldfield, A. (2016). Rethinking assessment in a
digital age: Opportunities, challenges and risks. British Educational Research Journal, 42(3),
454–476.
Torrance, H. , & Pryor, J. (1998). Investigating formative assessment. Open University.
Twist, L. (2021). Changing times, changing assessments: International perspectives.
Educational Research, 63(1), 1–8. http://doi.org/10.1080/00131881.2021.1876590
UNESCO . (2016). A conceptual framework for competencies assessment.
https://unesdoc.unesco.org/ark:/48223/pf0000245195
UNESCO Education 2030 . (2019). Beijing Consensus on artificial intelligence and education.
Outcome Document of the International Conference on Artificial Intelligence and Education
‘Planning education in the AI era: Lead the leap’, 16–18 May 2019, Beijing, People’s Republic of
China.
UNICEF . (2021). Policy guidance on AI for children. Author.
www.unicef.org/globalinsight/media/2356/file/UNICEF-Global-Insight-policy-guidance-AI-
children-2.0-2021.pdf.pdf
Van de Vijver, F. , & Hambleton, R. (1996). Translating tests: Some practical guidelines.
European Psychologist, 1, 89–99.
von Glasersfeld, E. V. (1974). Piaget and the radical constructivist epistemology. Epistemology
and Education, 1–24. www.aippc.it/wp-content/uploads/2019/04/2014.02.094.107.pdf
Voogt, J. , & Roblin, N. P. (2012). A comparative analysis of international frameworks for 21st
century competencies: Implications for national curriculum policies. Journal of Curriculum
Studies, 44(3), 299–321. http://doi.org/10.1080/00220272.2012.668938
Waitoller, F. R. , & Thorius, K. A. K. (2016). Cross-pollinating culturally sustaining pedagogy and
universal design for learning: Toward an inclusive pedagogy that accounts for dis/ability.
Harvard Educational Review, 86(3), 366–389. https://doi.org/10.17763/1943-5045-86.3.366
Walshe, G. (2020). Radical constructivism – von Glasersfeld. In B. Akpan & T. J. Kennedy
(Eds.), Science Education in Theory and Practice. Springer Texts in Education. Springer.
https://doi.org/10.1007/978-3-030-43620-9_24
Watkins, D. , Dahlin, B. , & Ekholm, M. (2005). Awareness of the backwash effect of
assessment: A phenomenographic study of the views of Hong Kong and Swedish lecturers.
Instructional Sciences, 33(4), 283–309. http://doi.org/10.1007/s11251-005-3002-8
Webb, N. L. (1997). Research Monograph Number 6: “Criteria for alignment of expectations and
assessments on mathematics and science education. CCSSO.
Webb, N. L. (2007). Issues related to judging the alignment of curriculum standards and
assessments. Applied Measurement in Education, 20(1), 7–25.
Weiss, D. J. (1983). New Horizons in testing. Academic Press.
White, J. (2018). The weakness of “powerful knowledge”. London Review of Education, 16(2),
325–335. https://doi.org/10.18546/LRE.16.2.11
Wiek, A. , Withycombe, L. , & Redman, C. L. (2011). Key competencies in sustainability: A
reference framework for academic program development. Sustainable Science, 6, 203–218.
Wilson, G. (2013). Evidencing reflective practice in social work education: Theoretical
uncertainties and practical challenges. British Journal of Social Work, 43(1), 154–172.
Wintrup, J. (2017). Higher education’s panopticon? Learning analytics, ethics and student
engagement. Higher Education Policy, 30, 87–103.
Wyatt-Smith, C. , Lingard, B. , & Heck, E. (2019, October). Digital learning assessments and big
data: Implications for teacher professionalism.25 Education Research and Foresight: Working
papers. https://unesdoc.unesco.org/ark:/48223/pf0000370940
Wyatt-Smith, C. , Lingard, B. , & Heck, E. (Eds.). (2021). Digital disruption in teaching and
testing: Assessments, big data, and the transformation of schooling. Routledge.
Wyckoff, A. (2013). Knowledge is growth. OECD Yearbook 2013.
www.oecd.org/innovation/knowledge-is-growth.html
Yosso, T. J. (2005). Whose culture has capital? A critical race theory discussion of community
cultural wealth. Race Ethnicity and Education, 8(1), 69–91.
http://doi.org/10.1080/1361332052000341006
Young, M. (2008). Bringing knowledge back in: From social constructivism to social realism in
the sociology of education. Routledge.
Young, M. (2009). Education, globalisation and the “voice of knowledge”. Journal of Education
and Work, 22, 193–204. http://doi.org/10.1080/13639080902957848
Young, M. , Lambert, D. , Roberts, C. , & Roberts, M. (2014). Knowledge and the future school:
Curriculum and social justice. Bloomsbury.
Young, M. , & Muller, J. (2013). On the powers of powerful knowledge. Review of Education,
1(3), 229–250. http://doi.org/10.1002/rev3.3017
Zhang, J. , Zhang, Y. , Zou, Q. , & Huang, S. (2018). What learning analytics tells us: Group-
behavior analysis and individual learning diagnosis based on long-term and large-scale data.
Educational Technology & Society, 21(2), 245–258.
Zitter, L. (2022, November 23). What are the 5 V’s of big data? TechnologyAdvice.
https://technologyadvice.com/blog/information-technology/the-four-vs-of-big-data/
The Moral Compass
Alderson, C. J. (1999, May). Testing is too important to be left to testers. Plenary address to the
third annual conference on current trends in English language testing. United Arab Emirates
University, Al Ain and Zayed University, Dubai Campus.
Aristotle . (2009). Nichomachean ethics (c330 BCE) ( D. Ross , Trans.; L. Brown , Ed.). Oxford
World’s Classics.
Bauman, Z. (1993). Postmodern ethics. Blackwell.
Beauchamp, T. L. , & Childress, J. F. (2001). Principles of biomedical ethics. Oxford University
Press.
Benton, T. (2016). Comparable outcomes: Scourge or scapegoat? Cambridge assessment
research report. Cambridge Assessment. 344467-comparable-outcomes-scourge-or-scapegoat-
tom-benton.pdf (cambridgeassessment.org.uk).
Black, P. , & Wiliam, D. (1998). Inside the black box: Raising standards through classroom
assessment. Phi Delta Kappan, 80, 139–148. www.jstor.org/stable/20439383
Black, P. , & Wiliam, D. (2009). Developing the theory of formative assessment. Educational
Assessment, Evaluation and Accountability, 21(1), 5–31.
Blackburn, S. (1993). Essays in quasi-realism. Oxford University Press.
Bramley, T. , & Oates, T. (2011, January). Rank ordering and paired comparisons – the way
Cambridge Assessment is using them in operational and experimental work. Cambridge
Assessment, Research Matters, (11). https://doi.org/10.17863/CAM.100519
Brighouse, T. , & Waters, M. (2021). About our schools. Crown House Publishing Limited.
Convention on the Rights of the Child . (1989). Treaty no. 27531. United Nations Treaty Series,
1577, pp. 3–178. https://treaties.un.org/doc/Treaties/1990/09/19900902%2003-
14%20AM/Ch_IV_11p.pdf
Dearden, R. (1984). Education and training. Westminster Studies in Education, 7(1), 57–66.
https://doi.org/10.1080/0140672840070104
Denscombe, M. (2000). Social conditions for stress: Young people’s experience of doing
GCSEs. British Educational Research Journal, 26(3), 359–374.
http://doi.org/10.1080/713651566
Downie, R. S. (1964). Government action and morality in the democratic state. Macmillan.
Flew, A. (1976). Sociology, equality and education. Macmillan.
Foucault, M. (1975). Discipline and punish: The birth of the prison ( A. Sheridan , Trans.). Allen
Lane, 1977. Penguin Books, 1979, 1991. Penguin Classics, 2000.
Gaw, A. (2006, April). Beyond consent: The potential for atrocity. Journal of the Royal Society of
Medicine, 99(4), 175–177.
Habermas, J. (1990). Discourse ethics: Notes on a program of philosophical justification. In
Moral consciousness and communicative action. MIT Press.
Hand, M. (2017). A theory of moral education. Routledge.
https://doi.org/10.4324/9781315708508
Hare, R. M. (1952). The language of morals. Oxford University Press.
Hare, R. M. (1963). Freedom and reason. Oxford University Press.
Hare, R. M. (1981). Moral thinking: Its levels, method and point. Clarendon Press.
Harrison, R. (1995). The Oxford companion to philosophy ( T. Honderich , Ed.). Oxford
University Press.
Hazell, W. (2019, January 25). Exclusive: “High stress” in exams is good, says exam board
chief. But Cambridge Assessment’s Saul Nassé also admits exam stress is a “live concern right
around the world”. Times Educational Suppl ement (TES) Magazine.
www.tes.com/magazine/archive/exclusive-high-stress-exams-good-says-exam-board-chief
Herranz, G. (2002, June 15). Why the Hippocratic ideals are dead. BMJ, 324.
https://doi.org/10.1136/bmj.324.7351.1463
Hirst, P. H. (1975). Moral education in a secular society (2nd ed.). Hodder Arnold H&S.
House of Commons Education Committee . (2011, October 26). Participation by 16–19 year
olds in education and training: Government response to the committee’s fourth report. Eight
special report of session 2010–12. Ordered by the House of Commons to be Printed.
Illich, I. (1971). Deschooling society. Marion Boyars Publishers Ltd.
Kant, I. (1776–1784). Lectures on Pedagogy, published online by Cambridge University Press
(2013). See also Kant (1900). Kant on Education (über Pädagogik). Translated by Annette
Churton . With an Introduction by C. A. Poley Rhys Davids . D.C. Heath & Co .
Kant, I. (1785). Groundwork of the metaphysic of morals ( H. J. Paton , Trans.). The Moral Law,
1948. Hutchinson.
Kant, I. (2007). Lectures on pedagogy (R. B. Louden, Trans.). In G. Zöller & R. B. Louden
(Eds.), Anthropology, history, and education (pp. 434–485). Cambridge University Press (Päd,
AA 09: 443).
Keiner, E. (2002). Education between academic discipline and profession in Germany after
World War II. European Educational Research Journal, 1(1), 83–98.
https://doi.org/10.2304/eerj.2002.1.1.14
Kitchen, W. H. (2014). Authority and the teacher. Bloomsbury Academic.
Klein, S. P. , Hamilton, L. S. , McCaffrey, D. F. , & Stetcher, B. M. (2000). What do test scores in
Texas tell us? The RAND Corporation.
Linn, R. L. (2000). Assessments and accountability. Educational Researcher, 29(2), 4–16.
Lukes, S. (1995). Moral diversity and relativism. Journal of Philosophy of Education, 29(2),
173–179. https://doi.org/10.1111/j.1467-9752.1995.tb00351.x
MacIntyre, A. (1981). After virtue. University of Notre Dame Press.
Mason, M. (2001). The ethics of integrity: Educational values beyond postmodern ethics.
Journal of Philosophy of Education, 35(1), 47–69. https://doi.org/10.1111/1467-9752.00209
McLaughlin, T. H. , & Halstead, J. M. (2000). John Wilson on moral education. Journal of Moral
Education, 29(3), 247–268. http://doi.org/10.1080/03057240050137328
Messick, S. (1998). Consequences of test interpretation and use: The fusion of validity and
values in psychological assessment. ETS Research Report RR-98-48.
https://www.ets.org/research/policy_research_reports/publications/report/1998/ihem.html
Messick, S. (2000). Consequences of test interpretation and use: The fusion of validity and
values in psychological assessment. In R. D. Goffin & E. Helmes (Eds.), Problems and solutions
in human assessment: Honoring Douglas N. Jackson at seventy (pp. 3–20). Kluwer Academic
Publishers.
Meyer, H.-D. , & Benavot, A. (2013). PISA and the globalization of education governance: Some
puzzles and problems. In H.-D. Meyer & A. Benavot (Eds.), PISA, power, and policy: Oxford
studies in comparative education (pp. 7–26). Symposium Books.
Newton, P. E. (2007). Clarifying the purposes of educational assessment. Assessment in
Education: Principles, Policy & Practice, 14(2), 149–170.
https://doi.org/10.1080/09695940701478321
Polanyi, M. (1958). Personal knowledge: Towards a post-critical philosophy. Routledge &
Kegan Paul.
Putwain, D. W. , & Daly, A. L. (2014). Test anxiety prevalence and gender differences in a
sample of English secondary school students. Educational Studies, 40(5), 554–570.
Ross, W. D. (1930). The right and the good. Clarendon Press (New edition, 2003).
Russell, B. A. W. (1999). ‘Reply to criticisms’ RoE: 149/papers 11: 51. “Russell on ethics” ( C.
Pigden , Ed.). Routledge.
Tuhiwai Smith, L. (2022). Decolonizing methodologies: Research and indigenous peoples.
Bloomsbury Academic.
Wallace, G. , & Walker, A. D. M. (Eds.). (1970). The definition of morality (1st ed.). Routledge.
https://doi.org/10.4324/9781003051961.
White, J. (1999). Thinking about Assessment. Journal of Philosophy of Education, 33(2),
201–212.
White, J. (2005, July). Reassessing 1960s philosophy of the curriculum. London Review of
Education, 3(2), 131–144. http://doi.org/10.1080/14748460500163914
Wiggins, G. (2011). A diploma worth having. Educational Leadership, 68(6), 28–33.
www.ascd.org/publications/educational-leadership/mar11/vol68/num06/A-Diploma-Worth-
Having.aspx
Williams, B. (1985). Ethics and the limits of philosophy. Routledge (Taylor and Francis) (New
edition, 2011).
Winch, W. , & Gingell, J. (1999). Key concepts in the philosophy of education. Routledge.
World Vision . (2023, August 29). Why is education important and how does it affect one’s
future? www.worldvision.ca/stories/education/why-is-education-important#
Lessons Learned and the Path Ahead
American Educational Research Association, American Psychological Association, and National
Council on Measurement in Education . (2014). Standards for educational and psychological
testing. American Educational Research Association.
Bavarian, N. , Lewis, K. M. , Dubois, D. L. , Acock, A. , Vuchinich, S. , Silverthorn, N. , Snyder,
F. J. , Day, J. , Ji, P. , & Flay, B. R. (2013). Using social-emotional and character development
to improve academic outcomes: A matched-pair, cluster-randomized controlled trial in low-
income, urban schools. Journal of School Health, 83(11), 771–779.
https://doi.org/10.1111/josh.12093
Bax, S. (2013). The cognitive processing of candidates during reading tests: Evidence from eye
tracking. Language Testing, 30(4), 441–465. http://doi.org/10.1177/0265532212473244
Bolton, P. (2024, January 2). Higher education student numbers. Research Briefing. House of
Commons Library. Number 7857. https://researchbriefings.files.parliament.uk/documents/CBP-
7857/CBP-7857.pdf
Brown, G. , El-Erian, M. A. , Spence, M. , & Lidow, R. (2023). Permacrisis: A plan to fix a
fractured world. Simon & Schuster.
Clayton, S. , Manning, C. M. , Krygsman, K. , & Speiser, M. (2017). Mental health and our
changing climate: Impacts, implications, and guidance. American Psychological Association,
and ecoAmerica.
Coe, R. , & Kime, S. (2013, January). The DIY evaluation guide. Education Endowment
Foundation (EEF). https://johntomsett.com/wp-
content/uploads/2013/09/eef_diy_evaluation_guide_2013.pdf
Gipps, C. C. (1994). Beyond testing: Towards a theory of educational assessment. The Falmer
Press.
Gorin, J. S. (2012). Assessment as evidential reasoning. White paper commissioned by The
Gordon Commission on the Future of Educational Assessment.
https://www.ets.org/Media/Research/pdf/gorin_assessment_evidential_reasoning.pdf
Gorin, J. S. (2014). Assessment as evidential reasoning. Teachers College Record, 116(11),
1–26. https://doi.org/10.1177/016146811411601101
Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of
Educational Measurement, 50(1), 1–73. https://doi.org/10.1111/jedm.12000
Maddox, B. , Bayliss, A. P. , Fleming, P. , Engelhardt, P. E. , Edwards, S. G. , & Borgonovi, F.
(2018). Observing response processes with eye tracking in international large-scale
assessments: Evidence from the OECD PIAAC assessment. European Journal of Psychology
of Education, 33(3), 543–558. https://doi.org/10.1007/s10212-018-0380-2
Messick, S. (1998). Consequences of test interpretation and use: The fusion of validity and
values in psychological assessment. ETS Research Report RR-98-48.
www.ets.org/research/policy_research_reports/publications/report/199/ihem.html
Mislevy, R. J. (2012). Four metaphors we need to understand assessment. Gordon Commission
on the Future of Assessment in Education.
Mislevy, R. J. (2018). Sociocognitive foundations of educational measur ement. Routledge.
Nisbet, I. , & Shaw, S. D. (2020). Is assessment fair? SAGE Publications Ltd.
Oranje, A. , Gorin, J. , Jia, Y. , & Kerr, D. (2018). Collecting, analysing, and interpreting
response time, eye tracking, and log data. In K. Ercikan & J. Pellegrino (Eds.), Validation of
score meaning for next generation assessments (pp. 39–51). Routledge.
Phillips, V. (2024, January). In 2024, 5 big issues will shape education. Forbes.
www.forbes.com/sites/vickiphillips/2024/01/03/in-2024-5-big-issues-will-shape-education
Putnam, R. D. (2015). Our kids: The American dream in crisis. Simon & Schuster Inc.
Qualifications Wales & CCEA (Regulation) . (2019, July). Fair Access by Design: Guidance for
awarding organisations on designing high-quality and inclusive qualifications.
www.qualificationswales.org/media/4739/fair-access-by-design.pdf
Rosenbaum, P. R. (1986). Dropping out of high school in the United States: An observational
study. Journal of Educational Statistics, 11(3), 207–224.
https://doi.org/10.3102/10769986011003207
Sanchez, J. G. , Christopherson, R. , Echeagaray, M. E. C. , Gibson, D. C. , Atkinson, R. K. , &
Burleson, W. (2011). How to do multimodal detection of affective states? ICALT, 654–655.
http://doi.org/10.1109/ICALT.2011.206
Walland, E. , & Shaw, S. D. (2022). E-portfolios in teaching, learning and assessment: Tensions
in theory and praxis. Technology, Pedagogy and Education, 31(3), 363–379.
http://doi.org/10.1080/1475939X.2022.2074087
Webb, N. M. (1997). Assessing students in small collaborative groups. Theory Into Practice,
36(4), 205–213. http://doi.org/10.1080/00405849709543770
Yeats, W. B. (1920). The second coming. In The Dial Magazine (Vol. 69). University of Virginia.
https://www.poetryfoundation.org/poems/43290/the-second-coming

You might also like