Cleared - MT - Performance Indicator Targets R
Cleared - MT - Performance Indicator Targets R
Monitoring Toolkit
PERFORMANCE INDICATOR TARGETS
Introduction
This resource supplements ADS 201.3.5.7 and offers guidelines and good practices for USAID and its
partners to set targets for performance indicators, use targets to compare to actual data, and adjust
targets when necessary.
WHAT IS A TARGET?
A target is a specific, planned level of a result to be achieved within a specific timeframe with a given level
of resources. In setting a performance indicator target, USAID and its implementing partners (IPs) turn
statements about expected results from planning documents into a measurable quantity against which
future progress can be objectively compared.
Targets help USAID staff, IPs, and other partners determine whether progress is being made according to
expectations originally envisioned. When actual data deviate significantly from a set target, it should
trigger adjustments in expectations for results or adaptations in program implementation or design.
For all other performance indicators, targets should be set at the most appropriate time intervals as
determined by Project or Activity Manager. Typically, targets are set at the same interval as the data are
reported to USAID; however, this need not be the case. Indicator data that are reported to USAID on a
quarterly basis may only have annual targets if that is considered more appropriate or useful for
management purposes. In setting the timeframe for the target, managers should consider not only how
often the data are collected and reported, but also the extent of change that is expected from one time
period to the next. For instance, if performance indicator data that are reported quarterly are not
expected to change much from one quarter to the next, then a yearly target might make more sense.
Although performance indicator targets must be set as a specific value, managers may find it useful to also
specify and document an acceptable target range along with the specific target value. An acceptable target
range is a range of values above and below the specified target which are equally as acceptable as the
specific target. It is rare that a single value is the only acceptable expected value for an indicator. If an
indicator value does not exactly match the target but falls inside the acceptable range, then it may
indicate that no action is needed. For example, in the annual PPR, a deviation of less than 10% of the
target does not require a deviation narrative. This is because it has been determined that the values
within 10% of the target are all equally acceptable. Conversely, if an indicator value falls outside of this
acceptable range, it might indicate that some action should be taken.
FINALIZING TARGETS
Whether targets are proposed by an IP or developed by USAID staff, setting performance indicator
targets is ultimately the responsibility of USAID. Project and Activity Managers should ensure that
performance indicator targets are approved within the timeframe specified in project or activity
documents or according to the procedures described in their performance monitoring Mission Order.
When setting targets for output performance indicators, it is useful to consider both supply and demand
for those outputs. On the demand side, it is important to consider who will be receiving the output and
how much of the output will be desired. For instance, consider an intervention that plans to train
healthcare workers to decrease infection rates in health care facilities. If the output indicator is number
of health care workers trained, it is useful to know how many health care workers are eligible for the
training and if any will be required to take the training as part of their job. If the training is voluntary,
market research might be needed to determine how many would be interested in taking the training.
On the supply side, the level of outputs that a USAID intervention will produce is dependent on the
extent of resources that USAID and its partners put into the intervention, the speed at which those
resources are mobilized, and the process by which those resources are transformed into outputs. For
the number of health care workers trained indicator example, it should be possible to determine how much
it costs to train a health care worker based on understanding the costs of the inputs to the training (e.g.,
instructors, texts, and facilities) and the quality of training that will be delivered per person. A one month
training course, for instance, will likely cost more per person than a one week training. With that
information, it will then be possible to calculate the overall number of health workers that may be trained
in a specific timeframe based on the overall budget for training and how quickly the training courses can
be created and delivered.
It is possible to create a range of acceptable targets by calculating expected supply of outputs and
estimating the level of demand for those outputs. For example, if an activity budget allows for 400 health
care workers to be trained, but there are only an estimated 300 health care workers in the targeted
geographic area, it can be assumed the target will not exceed 300. An acceptable target range might also
consider previous attendance rates of similar trainings, the degree to which the target health care worker
population is already trained, and the location of the training. If average health care worker training
attendance is 30% and this training is the first centrally-located training opportunity in a year, an
acceptable target range for number of health care workers trained might be 90-135 health care workers
or 30-45%. A final consideration for setting the output targets concerns the relation of the outputs to
outcomes. As noted in the previous section on good practices, it is important to consider how the
outputs are related to outcomes and to set these targets together.
Because outcomes are affected not only by outputs, but also by factors outside of the control the
intervention, setting targets for outcome performance indicators is typically a more complex task than
setting targets for output performance indicators. Complexity increases as you move from intermediate
outcomes to end outcomes. For instance, in the example of training healthcare workers, the intermediate
outcome of improving the knowledge of health care workers will depend not only on the quality of the
training, but also on the knowledge the health care workers bring to the training course and how
receptive they are to the information they are taught. An end outcome of decreasing infection rates in
health care facilities will depend on even more external factors, including the behaviors of healthcare
workers who did not attend the training course but work in the same facilities as those who did attend
the training.
Despite these difficulties, there are a variety of tools that can help in setting targets for outcome
performance indicators. These include:
• Reviewing historical trends. As previously noted, knowing the baseline is an important first step
in setting targets, especially for outcome targets. Examining historical trend data for your
indicator or similar indicators is even better. Past trends do not predict the future, but
knowing if the indicator is on an upward or downward trajectory or if it fluctuates widely
from season to season can help in suggesting an initial target.
• Disaggregating your data. Disaggregating indicator data is often useful for target setting if you
expect that an intervention is likely to affect some populations more than others or have a
greater effect in some geographic areas more than others. It might help to set targets for
each disaggregated group separately and then aggregate them to develop a more robust
overall target. Disaggregating data can also help in understanding the range of possible target
values, as the status of groups with better outcomes at baseline may serve as a useful target
for groups with worse baseline outcomes. For more information on data disaggregation
see Additional Help: Disaggregating Monitoring Data.
• Consulting with stakeholders and experts. Local stakeholders and technical experts are an
excellent source for target setting. Technical experts, including USAID staff, IPs, and outside
experts who have knowledge of USAID’s programmatic approaches, can provide helpful
information about what is realistic with respect to the outcomes that can be achieved with a
particular type of intervention. Local stakeholders, including end users and beneficiaries, can
also provide valuable insights on what might be possible to achieve in their particular context
in a given period of time. There are a number of methods that can be used to solicit expert
and stakeholder judgments, including surveys, key informant interviews, and focus group
discussions.
• Reviewing evidence from similar programs or research. Past programing by USAID or other
donors can provide evidence to help in setting targets. Impact evaluations are particularly
helpful as they attempt to estimate the size of the effect of the program over a specific
timeframe. Assessments, performance evaluations, and pre-design documents may also be
helpful to inform outcome target setting.
• Examining similar contexts. Outcome data from similar contexts may be useful as benchmarks
for target setting. For instance, if an education intervention is implemented in one low
performing geographic area of a country, examining education outcomes in higher
performing, but demographically similar areas of the country may help in determining what
outcome targets are feasible.
As already mentioned, reporting guidelines for the PPR require that Missions provide a deviation
narrative when the actual values for an indicator reported in the PPR are 10 percent above or below the
target. A Mission may use more stringent margins if the Mission considers it appropriate. For example, a
Mission may determine that five percent is a more appropriate margin to trigger a deviation narrative
requirement for indicators that measure critical public health changes. This is also a way to ensure a
Mission is being both ambitious and realistic in its target setting.
Comparison of actual data to targets is also required at the end of a USAID project as specified in the
Project Appraisal Document Approval Memorandum. As noted in ADS 201.3.3.17, within 90 days of the
end of a project, Missions must summarize, in writing, progress toward achievement of the Project
Purpose and end-of-project targets for key project performance indicators. Where the deviation
between a target result and actual result is significant (a deviation of 10 percent or more), the document
should provide an explanation as to the Project Team’s best understanding, based on existing materials
and sources, of why this deviation occurred. Reasons may include, but are not limited to:
• Errors underlying the theory of change revealed over the course of implementation;
• Shifts in the operating context;
• Internal shifts in funding or priorities that required a re-scoping of the project design; and/or
• An explanation of why end-of-status indicators did not adequately capture results actually
achieved.
Adjusting Targets
Learning and adapting is expected to occur over the course of a project and/or activity. As interventions
are implemented, more information becomes available that may influence target setting. Targets may be
adjusted to reflect changes in context or implementation approach, although caution is recommended.
Adjusting targets is most likely to occur during the middle of implementation, when context changes are
clear or the implementation approach has stabilized. It is not recommended to change targets too early in
the implementation phase or to change current year targets. Some questions to consider before adjusting
indicator targets include:
• Actual outcomes. How have actual outcomes aligned with what was expected to happen with the
project or activity?
• Work plan and implementation approach. Is the work plan on schedule? Has the implementation
approach changed?
• Critical assumptions. Have assumptions held true? If not, how have they changed?
• Resources. Have resource levels changed from the time the target was set?
• Stakeholder input. What are stakeholders saying?
Missions and Washington OUs have the authority to approve changes to targets for strategy and project
level indicators. At the level of an activity, the COR/AOR or Government Agreement Technical
Representative (for government-to-government agreements) approves changes to the performance
indicator targets in collaboration with the partner. If it is determined that targets should be changed, then
efforts should be made to document the reasoning. USAID staff should refer to Mission-specific
processes for approving and documenting changes to targets.
Changes to targets for indicators reported in the PPR need to be formally updated each year. The PPR
process prevents current year targets from being changed during the course of the year, but targets for
later years can be changed during the annual PPR process.