Monitoring and Evaluation - Process, Design, Methods
Monitoring and Evaluation - Process, Design, Methods
iEduNote.com ☰ 🌐 🌙
Monitoring and evaluation are tools and strategies that help a project know when plans are
They give the management the information it needs to make decisions about the project
and the necessary changes for strategy or plans. In this sense, monitoring and evaluation
are iterative.
https://www.iedunote.com/monitoring-and-evaluation 1/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
thing, monitoring and evaluation are, in fact, two distinct sets of organizational activities.
https://www.iedunote.com/monitoring-and-evaluation 2/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
proceed as planned.
At the same time, evaluation involves the assessment of the programs towards the
achievement of results, milestones, and impact of the outcomes based on the use of
performance indicators.
Both activities require dedicated funds, trained personnel, monitoring and evaluation tools,
effective data collection and storage facilities, and time for effective inspection visits in the
field.
What follows from the discussion is that both monitoring and evaluation are necessary
https://www.iedunote.com/monitoring-and-evaluation 3/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
Monitoring Definition
Monitoring is the continuous and systematic assessment of project implementation based
on targets set and activities planned during the planning phases of the work and the use of
inputs, infrastructure, and services by project beneficiaries.
It is about collecting information that will help answer questions about a project, usually
about the way it is progressing toward its original goals and how the objectives and
approaches may need to be modified.
Monitoring tracks the actual performance against what was planned or expected by
If done properly, it is an invaluable tool for good management and provides a useful base
for evaluation. It also identifies strengths and weaknesses in a program.
It enables you to determine whether the resources available are sufficient and are being
well used, whether the capacity you have is sufficient and appropriate, and whether you are
doing what you planned to do.
https://www.iedunote.com/monitoring-and-evaluation 4/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
At some point, this information needs to be collated, brought together, and analyzed so that
it can answer questions such as:
Example
This example is drawn from the World Bank Technical paper entitled “Monitoring and
Evaluating Urban Development Programs: A Handbook for Program Managers and
Researchers” by Michael Bamberger.
The author describes a monitoring study that, by way of rapid survey, was able to
determine that the amount of credit in a micro-credit scheme for artisans in Brazil was too
small.
The potential beneficiaries were not participating due to the inadequacy of the loan size for
their needs. This information was then used to make some important changes in the
project.
Bamberger defines it as: “an internal project activity designed to provide constant feedback
on the progress of a project, the problems it is facing, and the efficiency with which it is
being implemented.”
Evaluation Definition
https://www.iedunote.com/monitoring-and-evaluation 5/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
Evaluation, on the other hand, is a periodic in-depth time-bound analysis that attempts to
assess systematically and objectively the relevance, performance, impact, success, or the
lack thereof and sustainability of the on-going and completed projects about stated
objectives.
It studies the outcome of a project (changes in income, better housing quality, distribution
of the benefits between different groups, the cost-effectiveness of the projects as compared
discussions, etc.
Project managers undertake interim evaluations during the implementation as the first
review of progress, a prognosis of a project’s likely effects, and as a way to identify
In essence, evaluation is the comparison of actual project impacts against the agreed-upon
strategic plans.
It is essentially undertaken to look at what you set out to do, at what you could accomplish,
and how you accomplished it.
Example
Monitoring Evaluation
https://www.iedunote.com/monitoring-and-evaluation 7/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
Keeps track; oversight; analyzes and In-depth analysis; Compares planned with
documents progress actual achievements.
Answers what activities were Answers why and how results were achieved.
implemented and the results Contributes to building theories and models for
achieved. change.
The summative evaluation, on the other hand, is undertaken to make an overall judgment
about the effectiveness of a completed project that is no longer functioning, often to ensure
accountability.
https://www.iedunote.com/monitoring-and-evaluation 8/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
Did the program work? Did it contribute towards the stated goals and outcomes?
Apart from the questions raised above in formative and summative evaluation, more often,
we raise the following questions in the evaluation process to gain knowledge and a better
understanding of the mechanisms through which the program results have been achieved.
What is the assumed logic through which it is expected that inputs and activities will
produce outputs conducive to bring ultimate change in the status of the target
population or situation?
What types of interventions are successful under what conditions?
How can outputs/outcomes best be measured?
https://www.iedunote.com/monitoring-and-evaluation 9/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
This approach differs from what we know as a conventional approach in several ways. The
following section adapted from Estrella (J997) is designed to compare these two
approaches of evaluation.
Conventional Evaluation
It aims at making a judgment on the program for accountability purposes rather than
empowering program stakeholders.
It strives for the scientific objectivity of Monitoring and Evaluation findings, thereby
distancing the external evaluators from stakeholders.
It tends to emphasize the need for information on program funding agencies and
policymakers rather than program implementers and people affected by the program.
It focuses on the measurement of success according to predetermined indicators.
Participatory Evaluation
https://www.iedunote.com/monitoring-and-evaluation 10/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
1. Relevance
2. Efficiency
3. Effectiveness
4. Impact
5. Sustainability
6. Causality
7. Alternative strategy
https://www.iedunote.com/monitoring-and-evaluation 11/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
Relevance
https://www.iedunote.com/monitoring-and-evaluation 12/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
The term relevance refers to whether the program examines the appropriateness of results
to the national needs and priorities of target groups. Some critical questions related to the
relevance include:
Efficiency
Efficiency tells you whether the input into the work is appropriate in terms of the output. It
assesses the results obtained with the expenditure incurred and the resources used by the
program during a given time.
The analysis focuses on the relationship between the quantity, quality, and timeliness of
inputs, including personnel, consultants, travel, training, equipment, and miscellaneous
costs, and the quantity, quality, and timeliness of the outputs produced and delivered.
It ascertains whether there was adequate justification for the expenditure incurred and
examines whether the resources were spent as economically as possible.
Effectiveness
If not, the evaluation will identify whether the results should be modified (in the case of a
mid-term evaluation) or the program be extended (in the case of a final evaluation) to
achieve the stated results.
https://www.iedunote.com/monitoring-and-evaluation 13/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
If, for example, we conducted an intervention study to improve the qualifications of all high
school teachers in a particular area, did we succeed?
Impact
Impact tells you whether or not your action made a difference to the problem situation you
were trying to address.
Referring to the above example, we ask: did ensure that teachers were better qualified,
improved the results in the final examination of the schools?
Sustainability
Sustainability refers to the durability of program results after the termination of the technical
cooperation channeled through the program. Some likely questions raised on this issue
are:
How likely is that the program achievements will be sustained after the withdrawal of
external support?
Do we expect that the involved counterparts are willing and able to continue the
program activities on their own?
Have program activities been integrated into current practices of counterpart
institutions and/or the target population?
Causality
An assessment of causality examines the factors that have affected the program results.
Some key questions related to causality, among others, are:
https://www.iedunote.com/monitoring-and-evaluation 14/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
Alternative strategy
Program evaluation may find significant unforeseen positive or negative results of program
activities.
Once identified, appropriate action can be taken to enhance or mitigate them for a more
significant overall impact. Some questions related to unanticipated results often raised are:
Ad
https://www.iedunote.com/monitoring-and-evaluation 15/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
1. Self-evaluation
2. Internal evaluation
Self-evaluation
This involves an organization or project holding up a mirror to itself and assessing how it is
doing, as a way of learning and improving practice.
It takes a very self-reflective and honest organization to do this effectively, but it can be a
practical learning experience too.
Internal evaluation
This is intended to involve as many people with a direct stake in the work as possible.
This may mean project staff and beneficiaries are working together on the evaluation. If an
outsider is called in, he or she is to act as a facilitator of the process, but not as an
evaluator.
It is used as a starting point for understanding a local situation and is a quick, cheap, and
useful way to gather information. It involves the use of secondary data review, direct
observation, semi-structured interviews, key informants, group discussions, games,
diagrams, maps, and calendars.
In an evaluation context, it allows one to get valuable input from those who are supposed to
be benefiting from the development work. It is flexible and interactive.
External evaluation
This is an evaluation done by a carefully chosen outsider or outsider team with adequate
experience and expertise.
Interactive evaluation
This involves a very active interaction between an outside evaluator or evaluation team and
the personnel in an organization or project being evaluated.
https://www.iedunote.com/monitoring-and-evaluation 17/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
Monitoring and evaluation enable us to check the bottom line of development work.
In development work, the term bottom line means whether we are making a difference in
the problem or not, while in business, the terms refer to whether we are making a profit or
not in doing the business.
In monitoring and evaluation, we do not look for a profit; rather, we want to see whether we
are making a difference from what we had earlier. Monitoring and evaluation systems can
be an effective way to
https://www.iedunote.com/monitoring-and-evaluation 18/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
1. Provide constant feedback on the extent to which the projects are achieving their
goals;
2. Identify potential problems and their causes at an early stage and suggest possible
solutions to problems;
3. Monitor the efficiency with which the different components of the project are being
implemented and suggest improvement;
4. Evaluate the extent to which the project can achieve its general objectives;
5. Provide guidelines for the planning of future projects;
6. Improve project design and show the need for mid-course corrections;
7. Incorporate the views of the stakeholders;
8. Show need for mid-course corrections.
Evaluation results are useful for making adjustments in the ongoing program or for
purposes of designing a new program cycle.
Ad
https://www.iedunote.com/monitoring-and-evaluation 19/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
Careful planning of evaluations and periodic updating of evaluation plans also facilitates
their management and contributes to the quality of evaluation results.
When you do your planning process, you will set indicators. These indicators provide the
https://www.iedunote.com/monitoring-and-evaluation 20/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
What do we want to know? This question refers to the main objectives of the
evaluation and the question it should address.
Why is the program (project/organization) being evaluated?
How will be the data for evaluation collected? This refers to the data sources and
methods to be used.
Who will undertake the evaluation task? What expertise is required?
When will the evaluation be undertaken? This refers to the timing of each evaluation
so that their results in each case or combination can be used to make important
program-related decisions.
What is the budgetary provision to implement the evaluation plan?
A logical framework of analysis is a very useful approach in the planning of the monitoring
and evaluation processes, which lend itself well in the process.
The following flowchart displays such a framework incorporating all the levels of monitoring
and evaluation process.
https://www.iedunote.com/monitoring-and-evaluation 21/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
Most evaluations are concerned with the issue of program design. Design issue refers to
the factors affecting evaluation results. These factors appear during program
implementation.
1. Are input and strategies realistic, appropriate, and adequate to achieve the results?
2. Are output, outcomes, and impact clearly stated, describing solutions to identified
implementation been identified and have the assumptions about such risk factors
https://www.iedunote.com/monitoring-and-evaluation 22/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
been validated?
5. Have the execution, implementation, and evaluation responsibilities been
identified?
6. Does the program design address the prevailing gender situation? Are the expected
Proper monitoring and evaluation design during project preparation is a much broader
exercise than just the development of indicators.
1. Clear statements of measurable objectives for the project and its components, for
which indicators can be defined;
3. Provisions for collecting data and managing project records so that the necessary
data for indicators are comparable with existing statistics, and are available at a
reasonable cost;
4. Institutional arrangements for gathering, analyzing and reporting project data, and for
investing in capacity building to sustain the monitoring and evaluation services;
5. Proposals for how the monitoring and evaluation will be fed back into decision-making.
As there are differences between the design of a monitoring system and that of an
evaluation process, we deal with them separately.
1. purpose of evaluation,
https://www.iedunote.com/monitoring-and-evaluation 23/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
consider:
and impact;
Clarify what variables you are interested in to gather data on these variables;
Decide the method of collecting the data you need. Also, decide how you are going to
manage data;
Designing an evaluation process means being able to develop Terms of Reference (TOR)
for such a process so that timely evaluation information is available to inform decision
making and ensure that program implementation can demonstrate accountability to its
stakeholders.
Evaluation results are important for making adjustments in the ongoing program, or to
Ad
https://www.iedunote.com/monitoring-and-evaluation 24/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
Careful designing of evaluation and periodic updating of evaluation plans also facilitates
their management and contributes to the quality of evaluation results.
In planning and designing an evaluation study, the following issues are usually addressed:
The purpose of evaluation, including who will use the evaluation findings;
The main objectives of the evaluation and the questions it should address;
The sources of data and the methods to be followed in collecting and analyzing data;
Purpose
The purpose of an evaluation is the reason why we are doing this job. It goes beyond what
we want to know why we want to know it.
For example, an evaluation purpose may be: “To assess whether the project under
evaluation has its planned impact to decide whether or not to replicate the model
elsewhere,” or “To assess the program in terms of its effectiveness, impact on the target
Evaluation questions
https://www.iedunote.com/monitoring-and-evaluation 25/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
The key evaluation questions are the central questions we want the evaluation process to
Here are some examples of key evaluation questions related to an ongoing project:
Who is currently being benefited from the project, and in what way?
Do the inputs (money and time) justify the outputs? If so or if not, on what basis is this
claim justified?
What other strategies could improve the efficiency, effectiveness, and impact of the
current project?
What are the lessons that can be learned from the experiences of this project in terms
of replicability?
Methodology
The methodology section of the ‘terms of reference’ should provide a broad framework for
how the project wants the work of the evaluation done.
Both primary and secondary data sources may be employed to obtain evaluation
information.
The primary sources may include such sources as a survey, key informants, and focus
group discussions. The secondary sources may be, among others, published reports,
datasheets, minutes of the meetings, and the like.
Information collection
2. Methods.
By damage control, we mean what one would need to do if he/she failed to get baseline
information when the evaluation started.
The collection of baseline information may involve general information about the situation.
Ad
Official statistics often serve this purpose. If not, you may need to secure these data by
conducting a comprehensive field survey. In doing so, be certain that you collect that
Suppose you decide to use life expectancy as an indicator of the mortality condition of a
country.
https://www.iedunote.com/monitoring-and-evaluation 27/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
The right choice of the variables will enable you to measure the impact and effectiveness of
Unfortunately, it is not always possible to get the baseline information as desired after you
have begun work because the situation over time might have changed, and you failed to
collect this information at the beginning of the project.
You may not even have decided what your important indicators were when the project
began.
However, you may get anecdotal information from those who were involved at the
beginning, and you can ask participants retrospectively if they remember what the situation
Sometimes the use of control groups is a neat solution to this problem. Control groups are
groups of people that have not had input from your project but are very similar to those
Monitoring and evaluation processes can extensively use random sampling procedures.
The usually employed sampling methods are simple random sampling, stratified sampling,
https://www.iedunote.com/monitoring-and-evaluation 28/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
Methods of data collection may also vary widely depending on the purpose and objectives
of your program.
Analyzing Information
A vital component of both monitoring and evaluation is information analysis. The analysis is
the process of turning the detailed information into an understanding of patterns, trends,
and interpretations.
Once you have analyzed the information, the next step is to write up your analysis of the
findings in the form of a report as a basis for reaching conclusions and making
recommendations.
Ad
https://www.iedunote.com/monitoring-and-evaluation 29/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
solutions, evaluate the project’s overall success, and guide the planning of future projects.
on inputs, activities, and outputs. On the other hand, evaluation is periodic and offers an in-
depth analysis, comparing planned achievements with actual results and evaluating the
Avoiding duplication ensures that resources aren’t wasted on previously studied topics.
Before undertaking a study, it’s important to review existing research to see if significant
questions remain unanswered or if there’s no new perspective to offer.
https://www.iedunote.com/monitoring-and-evaluation 30/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
The core monitoring and evaluation objectives include relevance, efficiency, effectiveness,
Ad
objectives. It studies the outcomes of a project to inform the design of future projects.
https://www.iedunote.com/monitoring-and-evaluation 31/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
Related Posts
https://www.iedunote.com/monitoring-and-evaluation 32/33
8/12/24, 5:08 AM Monitoring and Evaluation: Process, Design, Methods
Management
Leadership Studies
Conflict Management
Total Quality
Management
Operation Management
© 2024. iEduNote.com™
https://www.iedunote.com/monitoring-and-evaluation 33/33