Imagine you are hired as an M&E Manager for a newly formed NGO.

Your organization does

not have an M&E system in place. Your responsibility is to develop an effective M&E system
for the organisation.

a) Explain in detail the steps you are going to follow in developing the M&E system

Developing an effective Monitoring and Evaluation (M&E) system from scratch for a newly
formed NGO requires a structured approach to ensure that the system is tailored to the
organization's goals and operational context. Below are the detailed steps I would follow in
developing the M&E system:

Define the Purpose and Scope

Begin by understanding the NGO’s mission, vision, and strategic objectives. This provides the
foundation for what the M&E system will be tracking. Get a detailed understanding of the
programs and projects the organization is planning or currently implementing. Knowing the
expected outcomes and impacts is crucial for designing relevant indicators. Identify internal and
external stakeholders who have a vested interest in the organization’s work (e.g., donors,
beneficiaries, staff, and partners). Involve stakeholders in the M&E planning process through
workshops, meetings, or interviews to gather their input on what the M&E system should track.
This ensures the system meets their needs and expectations. (First Steps in monitoring and
evaluation, 2002)

Develop a Logical Framework (LogFrame)

Create a logical framework matrix that outlines the program’s hierarchy, including inputs,
activities, outputs, outcomes, and impacts. This helps in visualizing the flow and linking each
element to specific indicators. Develop SMART (Specific, Measurable, Achievable, Relevant,
Time-bound) indicators for each level of the LogFrame. Indicators should be both qualitative and
quantitative, capturing the full scope of the program's impact. Identify or collect baseline data to
understand the starting point. Set realistic targets that the program aims to achieve within the
specified timeframe. Select appropriate data collection methods based on the indicators (e.g.,
surveys, interviews, focus groups, observations, administrative data). Design or adapt data
collection tools (questionnaires, checklists, data entry forms) that align with the indicators.
Ensure that tools are user-friendly and culturally appropriate. Pilot the data collection tools with
a small sample to identify any issues and refine them before full-scale implementation. (First
Steps in monitoring and evaluation, 2002)

Define the flow of data from collection to analysis and reporting.

Identify who is responsible for data collection, entry, analysis, and reporting at each level.
Establish procedures for data entry, cleaning, storage, and retrieval. Ensure that data is stored
securely and that there are backup systems in place. Choose appropriate software or tools for
data management and analysis (e.g., Excel, SPSS, Tableau). If possible, integrate these tools with
the organization's existing IT systems. Conduct training sessions for staff on M&E concepts, data
collection methods, tool usage, and data management procedures. Ensure that everyone involved
understands their role in the M&E process. Provide continuous support and refresher training as
needed to address any challenges staff may face during implementation. Good data management
includes storing data securely to avoid unauthorized access, theft, or unintentional destruction of
data and to comply with any legal requirements, such as data protection legislation. This often
involves IT protection methods, such as passwords, firewalls and virus checks. But it might also
simply mean having a lock on a filing cabinet. Moreover, an effective M&E system requires
capable people. Therefore, when defining roles and responsibilities for M&E, specific
consideration should be given to the M&E qualifications and expectations, including the
approximate proportion of time for each person to support the system. A first step in planning for
M&E human resources is to determine the available M&E experience within the project/program
team, partner organizations, target communities and any other potential participants in the M&E
system. This will inform the need for capacity building or outside expertise. For long-term and
larger projects/programs, it may be useful to create an M&E training schedule. (World Bank
2004)

Data analysis

Develop a data analysis plan that outlines how data will be analyzed to generate meaningful
insights. This includes specifying the types of analyses (e.g., trend analysis, comparative
analysis). Create standardized reporting templates that align with donor requirements, internal
needs, and stakeholder expectations. Reports should include both narrative and visual elements
to effectively communicate findings. Establish the frequency of reporting (e.g., monthly,
quarterly, annually) and ensure that this is communicated to all stakeholders. Develop
mechanisms for regular feedback from stakeholders on the M&E system and findings. This could
include feedback sessions, stakeholder meetings, or surveys. Use the insights gained from the
M&E process to inform decision-making and adapt program strategies. Encourage a culture of
learning within the organization where M&E findings lead to continuous improvement. (World
Bank 2004)

Budgeting

Estimate the budget and resources needed for the M&E system, allocating 3-10% of the overall
project budget for M&E activities. Identify training needs for staff to enhance their M&E skills
and ensure that the organization has the capacity to implement the system effectively. It is good
to start planning the M&E budget already in the project or program design phase so that adequate
funds are allocated and later available for M&E activities. According to Rossi et al (2004) there
is no standard formula to determine the budget for a project or program’s M&E system. An
industry standard is that between 3 and 10 percent of a project or program’s budget should be
allocated to M&E. A planning table for key M&E activities can be useful in this regard. It is
particularly important to budget for any expensive items, such as baseline surveys and
evaluations.

Clearly document all processes, tools, and methodologies used in the M&E system. This ensures
that there is institutional memory and continuity, even if staff turnover occurs. Establish a
knowledge management system where lessons learned, best practices, and success stories are
shared within the organization and with external stakeholders. Ensure that there is adequate
budget allocation for M&E activities, including staffing, training, data collection, and analysis
tools. Assess the need for dedicated M&E staff and allocate sufficient resources to support the
system's implementation and sustainability. Obtain final approval from senior management and
relevant stakeholders on the M&E framework, tools, and processes. Implement the M&E system,
starting with a roll-out phase where you monitor the effectiveness of the system in real-time and
make any needed adjustments. Ensure that the M&E system is sustainable by integrating it into
the organization's core operations. This includes ongoing capacity building, securing long-term
funding for M&E activities, and embedding M&E into the organizational culture. (Practical
monitoring and evaluation 2002)

By following these steps, the NGO can establish a robust M&E system that enhances its ability
to assess program effectiveness, inform decision-making, and demonstrate impact to
stakeholders.

(b) Explain the key components of the M&E system and provide examples of the key
components

An effective Monitoring and Evaluation (M&E) system is comprised of several key components,
each of which plays a critical role in ensuring that the system functions properly and delivers
meaningful insights. Here’s an explanation of these components with examples:

M&E Framework

The M&E framework is the overarching structure that guides the M&E process, often visualized
through tools like the Logical Framework (LogFrame) or Theory of Change (ToC). A matrix that
outlines the logical flow of a project, including the inputs, activities, outputs, outcomes, and
impacts, along with corresponding indicators, means of verification, and assumptions. A detailed
description of how and why a desired change is expected to happen in a particular context, often
illustrated with a flowchart or diagram. (UNDP 2009)

Indicators

These are the cornerstones of measurement within your ME system. They should be SMART
Indicators are specific, measurable markers that are used to track the progress and impact of a
program. They are categorized as input, output, outcome, and impact indicators. For example the
number of training sessions conducted for staff (e.g., “10 training sessions on child protection
were held in the first quarter”). The number of community members reached through awareness
campaigns (e.g., “500 community members attended health awareness workshops”). The
percentage increase in vaccination rates in the target community (e.g., “Vaccination rates
increased by 20% in the target area over 12 months”). The reduction in the incidence of a
particular disease within the community (e.g., “The incidence of malaria in the region decreased
by 30% after two years of intervention”). There are different types of indicators namely, Process
indicators monitor the activities completed during implementation, Output indicators monitor the
production of goods and delivery of services by the project. Outcome indicators are specific to a
project’s purpose and the logical chain of cause and effect that underlies its design. Impact
indicators usually refer to medium or long-term developmental change to which the project is
expected to contribute. Exogenous indicators are those that cover factors outside the control of
the project, but which might affect its outcome, including risks (parameters identified during
project design that might compromise project benefits) and the performance of the sector in
which the project operates
(Government of Zimbabwe, 2020).

Baseline Data

Baseline data is the initial set of data collected at the beginning of a project to serve as a
reference point for assessing changes and progress over time For example baseline data on the
prevalence of malnutrition among children under five before a nutrition program is implemented.
Baseline literacy rates in a community before launching an adult education program.

Data Collection Methods and Tools

These are the techniques and instruments used to gather information relevant to the indicators.
Data collection methods can be qualitative or quantitative. Structured tools used to collect
quantitative data from a large number of respondents (e.g., household surveys to assess income
levels), for example, a qualitative method where a group of individuals discusses specific topics
to gather in-depth insights such as FGDs with women’s groups to understand barriers to
accessing healthcare. It is used to systematically record observations during field visits (e.g.,
observing the hygiene practices in schools). Overall, a data collection system used for project
M&E should be assessed in terms of reliability, validity, and timeliness. Reliability is the extent
to which the data collection system is stable and consistent across time and space. Validity is
achieved when indicators measure as directly and accurately as possible the changes of interest
and relevance to project management. (Kothari 2004)

Data Management System

Data Management system is a system or process for storing, processing, and managing the data
collected. This ensures data integrity, security, and accessibility for analysis and reporting. For
example a digital platform such as Microsoft Excel, Access, or specialized software like
KoboToolbox or ODK can be used for storing and managing data. Structured forms for manual
data entry, either paper-based or digital, that ensure consistency in how data is recorded. Using
cloud-based solutions like Google Drive or Dropbox to store and share data securely with team
members.

Data Analysis

It is process of systematically applying statistical and techniques to describe, summarize, and

compare data to generate insights and conclusions. It is of significance to use software like
SPSS, R, or Excel to perform calculations and identify trends or correlations in quantitative data
(e.g., regression analysis to explore factors affecting school attendance). Analyzing qualitative
data from interviews or FGDs to identify recurring themes or patterns (e.g., categorizing
responses about challenges faced by farmers). Comparing baseline and follow-up data to assess
changes over time (e.g., comparing pre- and post-intervention test scores among students).

Reporting and Communication

Reporting and Communication is the process of sharing M&E findings with stakeholders through
structured reports, presentations, and other formats. Clear concise M&E reports are important for
communicating your findings. These reports should showcase your projects progress, highlight
successes and challenges, and translate data into actionable recommendations. This is essential
for transparency, accountability, and learning. Quarterly or annual reports that summarize
progress toward achieving project goals, including data on key indicators (e.g., a quarterly report
on project outcomes for donors). Visual tools are important because they provide real-time data
insights, often used by management to monitor key metrics (e.g., a dashboard showing project
performance against targets). Narrative reports that highlight significant achievements or lessons
learned (e.g., a case study on how a community’s water supply was improved). (World Bank
2004)

Feedback and Learning Mechanisms

These are processes that allow the organization to learn from M&E findings and adapt its
strategies and programs accordingly. This is often part of a broader knowledge management
system. For example there are After-Action Reviews (AARs). According to UNDP (2004) they
are structured review process after major project milestones to discuss what worked well and
what didn’t (e.g., a workshop to reflect on the outcomes of a pilot project). Surveys conducted
with beneficiaries to get their input on the effectiveness and relevance of services provided (e.g.,
post-training surveys to gather feedback from participants).Conducting regular workshops where
staff and stakeholders come together to discuss M&E findings and their implications for future
programming (e.g., a workshop to discuss the findings from a mid-term evaluation)

Evaluation Processes

Formal assessments conducted at specific points in the project cycle to assess the effectiveness,
efficiency, relevance, and impact of the project For example an evaluation conducted halfway
through the project to assess progress and make any necessary adjustments (e.g., an evaluation of
a three-year health project after 18 months). An assessment conducted at the end of a project to
measure the overall impact and outcomes, for instance, an evaluation to determine the project’s
impact on reducing child malnutrition. A more rigorous form of evaluation that specifically aims
to determine the causal effects of the project for example, using randomized control trials to
measure the impact of a new teaching method on student performance. (First Steps in monitoring
and evaluation, 2002)

Resource Allocation and Budgeting

The financial and human resources dedicated to implementing the M&E system. Without
adequate resources, even the best-designed M&E system may fail. Allocating a specific
percentage of the project budget for M&E activities, including data collection, analysis, and
reporting (e.g., 10% of the project budget earmarked for M&E). Hiring or designating staff
members specifically responsible for M&E functions (e.g., an M&E officer or data analyst).
Supportive Supervision and Data Auditing

Every M&E system needs a plan for supervision and data auditing. Supportive supervision
implies that an individual or organization can supervise regularly the M&E processes in such a
way that the supervisor offers suggestions on ways of improvement. Data auditing implies that
the data is subjected to verification to ensure its reliability and validity. Supportive supervision is
important since it ensures the M&E process is run efficiently, while data auditing is crucial since
all project decisions are based on the data collected

Ethical Considerations and Data Security

In Monitoring and Evaluation, ensuring that M&E activities are conducted ethically, with respect
for the rights and dignity of participants, and that data is managed securely is important..
Obtaining consent from participants before collecting data, ensuring they understand the purpose
and how their data will be used such as a consent form signed by survey respondents. Removing
or coding personal identifiers in the data to protect participants’ privacy (e.g., using participant
ID codes instead of names in datasets). Implementing measures to protect data from
unauthorized access or breaches (e.g., password-protected databases and encrypted data storage).
(Kothari 2004)

(c) Mention the Step-by-Step process of conducting the Baseline Survery

Conducting a baseline survey is a critical step in establishing the starting point for a program or
project, against which future changes and impacts can be measured. Below is a step-by-step
process for conducting a baseline survey:

Define the Purpose and Objectives of the Baseline Survey

Determine what the baseline survey aims to achieve. This usually involves identifying key
indicators that will be measured at the start of the project. Ensure that the objectives of the
baseline survey are directly linked to the project’s goals, outcomes, and impact indicators. If
your NGO is launching a project to improve literacy rates among children, the baseline survey’s
objective could be to measure the current literacy levels in the target community. Develop the
Survey Design by deciding on the geographic area, population group, and the specific indicators
to be measured. This includes identifying what data needs to be collected and from whom. Select
an appropriate survey methodology (e.g., quantitative, qualitative, or mixed methods). Consider
factors like the complexity of data, resources available, and the context of the target population.
A quantitative survey may involve structured questionnaires, while a qualitative survey might
include focus group discussions. ( Wheelen and Hunger 2002)

Develop Survey Instruments

Create the survey questionnaire or data collection tools, ensuring they are aligned with the
indicators. The questions should be clear, relevant, and culturally appropriate. Conduct a pilot
test with a small sample to ensure that the questions are understood correctly and that the tool
captures the required information accurately. Refine the tools based on feedback from the pilot.
If measuring household income levels, ensure that the questionnaire includes clear and precise
questions on income sources, amounts, and frequency.

Sample Selection

Identify the target population for the survey, ensuring it represents the broader group impacted
by the project. Choose a sampling method (e.g., random sampling, stratified sampling, cluster
sampling) based on the survey’s objectives, the population size, and resources. Determine the
sample size needed to achieve statistically significant results, considering factors like the
confidence level, margin of error, and expected variability. For a health project targeting a
specific community, the sample might include a random selection of households within that
community. Develop a Data Collection Plan by outlining the logistics for data collection,
including the timeline, locations, and resources needed (e.g., enumerators, transport, tools). Hire
data collectors and provide training on the survey instruments, data collection techniques, and
ethical considerations (e.g., obtaining informed consent, maintaining confidentiality If using
mobile data collection tools, train enumerators on how to use these devices effectively. Kothari
(2004)

Conduct the Survey

Deploy data collectors to the field to administer the survey according to the data collection plan.
Ensure quality control through spot checks, supervision, and regular feedback to the team.
Monitor the progress of data collection to ensure it stays on track with the plan. Address any
issues that arise, such as low response rates or logistical challenges. Enumerators visit
households, conduct interviews, and record responses using digital tablets. If using paper-based
methods, enter the collected data into a database or spreadsheet. For digital data collection,
ensure data is uploaded, organized, and cleaned. Review the data for any inconsistencies,
missing values, or errors, and correct them as necessary. According to Rossi et al (2004), this
step is crucial for ensuring the accuracy and reliability of the data. Checking for duplicate entries
or ensuring that all mandatory fields have been completed. Use appropriate statistical or
qualitative analysis methods to analyze the data and generate findings. This may involve
calculating means, frequencies, correlations, or performing thematic analysis for qualitative data.
Interpret the data to draw meaningful conclusions that relate to the baseline indicators. This will
provide a clear picture of the initial conditions before the project’s interventions begin.
Calculating the average literacy rate in the community and comparing it across different age
groups. (Practical monitoring and evaluation 2002)

Reporting

Prepare the Baseline Report: Write a comprehensive report that presents the findings from the
baseline survey. The report should include an introduction, methodology, findings, conclusions,
and recommendations. Use graphs, charts, and tables to present data in a clear and accessible
way. This helps stakeholders easily understand the baseline conditions. A report section that
describes the current state of child nutrition in the target area, with graphs showing the
prevalence of malnutrition by age group. Disseminate the baseline report to all relevant
stakeholders, including project staff, donors, and community representatives. Tailor the
presentation of findings to the audience. Utilize the baseline data to inform the planning and
implementation of the project. The findings should guide decision-making, target setting, and
strategy development. Using baseline literacy levels to set realistic targets for the number of
children expected to achieve functional literacy by the end of the project. (World Bank 2004)

Review and Incorporate Feedback

After disseminating the report, gather feedback from stakeholders on the survey process and
findings. This may involve debriefing sessions or stakeholder meetings. Use the feedback to
improve future surveys or M&E activities. Document any lessons learned to refine survey
methodologies, tools, or data collection process Stakeholders may suggest additional indicators
or adjustments to the sampling strategy for future survey. Record all steps of the baseline survey,
including the methodology, tools, data collection process, and lessons learned. This
documentation will be valuable for future surveys and evaluations. Ensure that all data and
related materials are securely stored and easily accessible for future reference. This includes raw
data, analysis files, and the final report. Storing digital copies of the baseline data on a secure
cloud server with restricted access is also important. (UNDP 2009)

Conducting a baseline survey involves careful planning, execution, and analysis to establish a
clear starting point for a project. Following these steps ensures that the baseline data collected is
accurate, reliable, and useful for guiding the project's implementation and evaluating its impact.

Reference List

First Steps in monitoring and evaluation, 2002 Publisher Charities Evaluation Service

Government of Zimbabwe, (2020). NATIONAL MONITORING AND EVALUATION

GUIDELINES, Harare
Kothari, C. R. (2004). Research methodology: Methods and techniques, (Revised 2 nd Ed). New
Delhi, New Age International (P) Limited Publishers.

Practical monitoring and evaluation – a guide for voluntary Organisations, 2002

Publisher Charities Evaluation

Rossi H. P., Lipsey, W M., Freeman, H. 2004. Evaluation: A systematic Approach 7 th Edition.
Sage Publications: Thousand Oaks California.

UNDP, (2009) HANDBOOK ON PLANNING, MONITORING AND EVALUATING FOR

DEVELOPMENT RESULTS, New York

Wheelen, T.L. and Hunger, J.D. (2002) Concepts in Strategic Management and Business Policy,
Eighth Edition, India/Singapore: Pearson Education

World Bank, (2004) Monitoring and Evaluation: Some Tools, Methods and Approaches. World
Bank Publications