Introduction to Monitoring and

Evaluation
Bouchra Chakroune, Impact Fellow
ESPA

www.espa.ac.uk
 Objectives

(1) To highlight the importance and use of M&E in

development
(2) To introduce some M&E tools
(3) Discuss how projects/programmes are typically
monitored and evaluated in international development
(4) Exercise: Developing an M&E plan
 Key Messages
• Research uptake requires adequate
supply of and demand for research
• DFID-funded research programmes are
expected to plan and implement a
research uptake strategy
• Research uptake strategies should
encompass stakeholder engagement,
capacity building, communication and
monitoring and evaluation.
“DFID takes monitoring and evaluation of
research uptake seriously and expects to
see projects devoting resources to
monitoring and evaluation from the outset of
the programme rather than waiting until the
end and reporting on what has been done”
DFID Research Uptake Guidance, April 2016
 What is M&E?
What? Why?

Monitoring Ongoing gathering (and Document results, processes and

analysis) of experiences and track progress
information/data (usually as a basis for steering decisions
against targets and and identifying issues early on to
milestones) take corrective action.
Evaluation Assessing data and To assess whether a project has
information to establish a achieved its intended
judgement on the success goals/impact. But evaluation is not
of a project. just for accountability reasons, but
- Formative also learning to feed into future
- Summative decisions

Monitoring is a continuous process, whereas evaluations are carried out at specific points of time in
the course of the project (mostly at the end of the project or a project phase).
 Project Cycle
• Business case/ Proposal • Finalisation of
• Evidence base for project partnerships and
• Development of agreements (MoUs)
Logframe/Theory of • Finalisation of M+E
Change frameworks

Design Mobilisation

Closure Delivery

• Evaluate performance. • Implementation of project

• Learn and share lessons. • On-going monitoring and
• Adapt and redesign review
(extension v closure) • Adjust and adapt
Taken from IFRC Project/Programme M&E Guide
http://www.ifrc.org/Global/Publications/monitoring/IFRC-ME-Guide-8-2011.pdf
 M+E Tools
Theory of change Logframe
O.o?
ESPA’s Theory of Change
ESPA’s Logframe
 ToC v. Logframe
Theory of change Logframe
Usually presented as a diagram with Normally shown as a matrix called the
narrative, but no standard format Logframe
Shows the complexities of change: Gives a detailed description of
feedback loops, cyclical processes, programme including monitoring data
and all the different pathways that
might lead to change
Highlights the assumptions behind Includes space for risks and
your intervention, evidence, and the assumptions, though basic, and
drivers of change doesn’t include evidence
Gives the big picture describing how Criticised for being linear, all activities
and why you think change happens lead to outputs which lead to
outcomes and the goal., no feedback
loops, cyclical pathways etc.
If we do X, then Y will change We plan to do X, and Y will happen as
because… a result
 Terminology

inputs The resources, both financial and human resources required to undertake
your project.

Actions taken or work performed which should lead to outputs.

activities e.g. the collection of data, the running of workshops, the organisation of
meetings, the development of models etc.

The immediate results of a grantee’s activities – the processes, products,

outputs goods and services delivered through funded activities e.g. publications,
manuals, dataset, models, workshops, stakeholder meetings etc.
produced.

The short-term and medium-term effects of an intervention’s outputs

outcomes affecting policy or practice. Outcomes are observable behavioural,
institutional or societal changes.

The long term sustained effects of a development intervention, direct or

impact indirect. This is usually the goal of the programme/project.
 “DFID asks all research programmes to
have a framework for results (e.g. logframe)
which is the primary tool used for monitoring
progress. Research uptake indicators
should be embedded in this framework”
DFID Research Uptake Guidance, April 2016
The Logframe
 Monitoring with a Logframe
Indicator Baseline Milestone Target
Objective, Data Realistic Amount/
outputs easily collected and final
measurable against evidence effect
signs of indicators based expected
outcomes change or
progress.
before any
work has
quant./ qual.
expectations
at the
end of
Can be taken of likely the
impact quant/qual place. progress at project
but do not significant cycle
show how points in the
much will project
be cycle.
achieved.
The missing middle
 DAC Criteria for Evaluation
DAC Criteria Description
Relevance The extent to which the aid activity is suited to the priorities
and policies of the target group, recipient and donor
Effectiveness A measure of the extent to which an aid activity attains its
objectives.
Efficiency Are the objectives being achieved economically. This
generally requires comparing alternative approaches to
achieving the same outputs.
Impact This involves the main (negative and positive) impacts and
effects resulting from the activity on the local, social,
economic, environmental and other development indicators.
Sustainability Measuring whether the benefits of an activity are likely to
continue after donor funding has been withdrawn.
 Develop an M+E plan

Review Identifying Develop

Identify
ToC monitoring an M+E
Indicators
questions plan
ToC of Swahili Seas/CESEA
 Developing an M+E plan

Output 1 Evaluation Monitoring Indicator

Questions Question
(DAC)
Journal Effectiveness How many journal articles # journal articles
articles were produced?

Quality and usefulness # downloaded

Citation rates
Has the research fed into Discussions of findings within relevant
policy? southern policy institutions facilitated by
research experts
 M&E plan
• Source: where will the data come from?
• Baseline: data before you started?
• When and who will collect the data?
ToC of Swahili Seas/CESEA
 Developing an M+E plan
ToC Evaluation Monitoring Question Indicator
Question
Development of the first Effectiveness Did accreditation take place as planned? Plan Vivo certificate
technical specification for the Efficiency Price of carbon
accreditation of mangrove Relevance Income generated from sale of carbon
carbon via Plan Vivo.

Creation of a new charity Effectiveness Is it being accessed by the target groups? # parties involved/ new partnerships created
(Association for Coastal Impact Has it established the formal processes around funding mechanisms? # carbon credits purchased
Ecosystem Services Sustainability Has it contributed to improving the outcomes and scope of the Mikoko Pamoja # conservation projects sponsored
project? Value of additional funding outside of the funding for
Mikoko Pamoja

Establishment of the East African Relevance Is it being accessed by the target groups? # parties involved/ new partnerships created
Forum for Payments for Sustainability Is it influencing the development of new practices in this area? Nature of relationships
Ecosystem Services (EAFPES) Is it owned by local stakeholders? # meetings/workshops held
Is it contributing to enhanced knowledge of PES # collaborative initiatives launched
Nature of debates
# co-created publications/ guidance
Value of materials/activities - feedback
# stakeholder led reports/workshops

Mangrove carbon credits Efficiency Did the project generate the income forecast from the carbon credits? Value of carbon credits
generates US$13,000 a year Effectiveness Is the income generated from the carbon credits benefiting the Ha of forest conserved/ # trees planted
which is used to fund forest community/forest conservation? # people benefiting (e.g. thru new school etc.)
conservation and community # / value of community projects sponsored
development activities Value of project from community perspective - feedback

Contribution to national Sustainability How has the project contributed to the national plan? Change/amendments to national documentation/policies
plan for the REDD programme. Impact Has the project contributed to the goals of the national plan? Tonnes of carbon stored

Contribution to the National Sustainability How has the project contributed to the national plan? Change/amendments to national documentation/policies
Mangrove Management Plan. Impact Has the project contributed to the goals of the national plan? Ha of conserved forest. # trees planted
# relationships with key stakeholders actively working on
mgmt. plan

Key decision-makers have an Effectiveness Do decision makers have an enhanced understanding of mangrove goods # relationships with key individuals/organisations at policy
enhanced understanding of and services? level
mangrove goods & services Degree of integration of conservation goals in policy
# key individuals trained
Level of understanding of policy makers - feedback
Research Uptake Checklist

DFID Research Uptake Guidance, April 2016