Communicating With Communities Using Outreach: A Good Practice Guide
Communicating With Communities Using Outreach: A Good Practice Guide
Prepared by: Stephane Gray, Christine Roberts, Patricia Macauley & Ross James
COI Strategic Consultancy
Hercules Road
London SE1 7DU
T: 020 7261 8408
F: 020 7261 8832
E: [email protected]
Contents
1. Executive Summary................................................................................. 3
2. Background to Good Practice Guide ....................................................... 5
3. Defining Outreach in Context ................................................................... 7
Issues with terminology............................................................................ 9
4. The Role and Purpose of Outreach ....................................................... 11
How outreach is used............................................................................. 11
Strengths of outreach approaches ......................................................... 13
Limitations of outreach approaches ....................................................... 14
Making the case for using Outreach....................................................... 15
Barriers to access and the enablers outreach can employ..................... 17
5. Forms of Outreach Activity..................................................................... 21
Street Marketing & Stunts ...................................................................... 21
Peer Education, Street Teams or Referral Marketing............................. 22
Sponsorship ........................................................................................... 23
Active Service Delivery .......................................................................... 24
Community Networking & Events........................................................... 26
Community Development....................................................................... 27
Participation & Active Citizenship........................................................... 29
6. Audiences, Messages & Channels for Outreach ................................... 30
Identifying audiences for outreach ......................................................... 30
Tailoring messages for outreach............................................................ 30
Key channels for outreach ..................................................................... 33
Developing integrated campaigns incorporating outreach ..................... 34
7. Delivering Outreach ............................................................................... 35
Who can do outreach? ......................................................................... 35
Models for delivering outreach ............................................................... 36
What are the practicalities to consider when planning outreach?........... 40
8. Measuring and evaluating the impact of outreach ................................. 46
The challenge of measuring and evaluating outreach............................ 46
Principles for evaluating outreach .......................................................... 48
What to measure.................................................................................... 48
Approaches to evaluation....................................................................... 50
9. Applying Outreach Effectively: Some Tools........................................... 57
Tool 1: Selecting outreach techniques ................................................... 57
Tool 2: Outreach dos and donts ............................................................ 58
Tool 3: Outreach planner ....................................................................... 59
Links & Contacts........................................................................................ 63
1. Executive Summary
Increasingly, public services are using different forms of communication to
engage with and to get stronger messages over to communities. Whether
it is about accessing opportunities to work, raising awareness and take-up of
entitlements, or increasing knowledge and understanding around what to
expect from the Criminal Justice System, public services have an interest in
ensuring their messages reach all the UKs diverse communities.
Complementing other media and communications techniques, outreach can
be used as a new and different form of communication to engage
communities with what public services have to offer. It can help for example to
overcome barriers of culture and language which can sometimes make
certain ethnic minority groups harder to reach.
By reaching out to, and directly engaging with, these communities, outreach
can help overcome these barriers. In doing so it can help the Government
and its partners to achieve better results in changing peoples perceptions of
public services, challenging racism and improving the take-up of services to
tackle inequalities all goals to which the Government is highly committed.
This Guide has been prepared for communicators considering how they might
use outreach, and is based on the experiences of outreach practitioners
across and beyond government. Our primary focus has been on outreach
applied to the objectives of increasing race equality and community cohesion.
The techniques of outreach span a wide spectrum from simple field marketing
through to community development and participation. Practitioners of these
disciplines sometimes prefer to use other terms such as community
development or community engagement for the kinds of techniques outreach
involves. They emphasise the importance of respecting the priorities of local
communities and supporting their capacity to address issues for themselves.
Based on our conversations with those involved in outreach-style activities,
we have defined it here as an active process of engaging a target
community around an issue of concern, through personal relationships,
credible information, trusted networks and feedback.
Where other forms of marketing typically aim to raise awareness or influence
attitudes through frequent, shallow or broadcast means, outreach is much
more targeted and localised, using powerful personal interaction to create
dialogue, overcome barriers and change minds.
Acknowledgements
We would like to thank all the organisations and individuals involved in
commissioning, delivering and evaluating outreach who helped us in
compiling this Guide.
Techniques
Audiences
It is also clear that the term outreach is used in different ways by different
arms of central government:
Communications
Objectives
for outreach
Approaches
adopted
Policy
Delivery
Raising awareness,
changing attitudes and
behaviour
Consulting hard to
reach audiences,
ensuring policy meets
community needs
Improving access to
services, correcting
under-representation
Engage specialist
ethnic marketing
agencies, e.g. via COI,
or cascade materials to
regional teams
Establish stakeholder
groups, cascade
funding through
regional and local
umbrella organisations
Employ specialist
workers on the ground,
form multi-agency
partnerships with
community groups,
cascade funding
through groups
Type of
outreach
Street marketing,
community events
Active citizenship or
participation,
community
development
Community events,
networking, community
development
COI, specialist
agencies, regional
marketing teams
Traditionally larger
stakeholder
representatives,
umbrella organisations,
government region
offices
Government region
offices, local agency
offices
(described
later in this
Guide)
Contacts
While this Guide addresses all of these to some extent, we have emphasised
outreach in communications and delivery settings.
Still, outreach is a term which has currency for most communicators, and can
potentially be useful shorthand for a range of effective approaches to
communication.
Zone of outreach:
Field
marketing
Community
events &
sponsorship
One-off,
face to face
contact
Presence,
contact with
community
Community
networking
Community
Development
Developing
trusting
relationships
with groups/
individuals
Bottom up
empowerment
and capacity
building
Active
Citizenship &
Participation
Community
decisionmaking and
ownership
10
11
12
Reach: often outreach is the only way to reach non-English speakers who
cant easily access material in other formats or other less accessible
groups (e.g. some disabled people, Gypsies and Travellers). It also
provides a means of overcoming multiple barriers such as lack of access
to channels or media combined with problems of substance misuse or
domestic violence.
13
check aptitude and qualifications for a post, before entering the formal
process.
Scope to take measured risks in the course of activity since it often flies
below the radar, saying what needs to be said but is difficult to say with an
official voice. Sometimes outreach is given freedom to take a more holistic
view of the client, and is under less pressure to show immediate hard
outcomes with more effective long-term outcomes for people with multiple
or complex barriers to be overcome.
Can take a long time to develop trust to the level needed in order to be
able to access the community. For example, some groups may be
suspicious of authority or require months of patient work before opening
their networks to an outsider.
14
a roster of ethnic marketing agencies and lots of experience in coordinating effective outreach to address communications objectives see
the Links section for more details.
15
Our conclusion is that a strong case for outreach can be made in addressing
some communications, policy or delivery objectives, in the context of the
strengths and limitations of the approaches described earlier. In preparing the
case and demonstrating the value of outreach, it is vital to:
Set clear objectives, which outreach can fairly be expected to deliver on,
and which can be evaluated. These should not represent evaluation cop
out (Source 10: Sutton, Perry et al, 2005) in the sense of claiming to
merely raise awareness, where the real purpose is behaviour change
Consider the role for outreach in an integrated campaign, including
why it is being used instead or as well as other channels, how it can
support and be supported by other media
Follow good practice in how the outreach is planned and delivered
Ensure the outreach and the wider organisation is informed by
feedback, to improve its effectiveness through refining the proposition or
targeting of it
Ensure that a valid approach to evaluation is in place (see section on
Evaluation) which incorporates a range of measures, ideally including both
response data and attitudinal research amongst participants and
practitioners
17
Barriers
Enablers
Access to
channels
Community
networks
Language
Issues of
concern
Culture, faith
& family
Culture, faith
& family
Exclusion
from a service
Contact with
any service
Multiple
problems
Barriers to access:
18
Enablers:
In response to these, outreach can draw on a set of enablers:
19
20
21
It was set up in various high street locations and a smaller exhibition unit was
used at a number of cultural and lifestyle events.
The outreach was part of a wider campaign involving press and radio
advertising in ethnic minority media as well as PR activity, it contributed to a
20 percentage point increase in awareness of legislation amongst the target
audiences and extensive PR coverage.
Website: http://www.defra.gov.uk/animalh/illegali/
22
Sponsorship
What is it?
Sponsoring a community event or service is a conventional way of raising
awareness of a brand. But it can also work hand in hand with outreach, by
using sponsorship as a way to initiate a relationship supported by face-to-face
contact, for example by having a stall or marketing team at a sponsored
event, to help convey the message with greater impact, answer questions and
even capture responses (sign ups, application forms) on the spot.
Good for:
Generally larger, established community events seeking sponsors, and willing
to give sponsors access the event for example, melas, sports tournaments
or large festivals. Ideally, there should be a strong connection between the
event and the sponsors message for example, sport and an active career in
23
24
Good for:
Services to which there are practical barriers such as the need to visit an
office, understand written information or make a formal application. Given the
cost per person, it probably works best when the services are essential or as
a way of joining up to overcome the same barriers to accessing several
services in one visit. Potentially an effective way of achieving targets for takeup of entitlements amongst under-represented groups.
It can also help overcome psychological or social barriers to accessing help,
for example in relation to domestic violence:
Evaluation of outreach projects found:
25
Community Development
What is it?
Community Development approaches emphasise the importance of involving
and empowering members of the target audience in taking action themselves,
in response to issues they have identified themselves. For example, this can
mean facilitating local neighbourhood groups to meet and agree priorities for
action, and helping them build capacity to address the problem for themselves
27
or access the agencies they need to effect change but not imposing
solutions or priorities from outside.
Good for:
Communities which are motivated to take action about a complex set of
issues but lack the support, skills or co-ordination to seize the initiative.
Commonly used in regeneration work where local communities need
ownership of the solutions adopted in order to buy into them, but have a
strong incentive to do so. Useful in situations where local or even individual
needs may be difficult for central or remote agencies to respond to
appropriately.
Not so good when:
There is a simple message to be conveyed or consistency with a central
campaign or brand is needed. Empowering communities takes time and
commitment to devolve power and responsibility, so is typically used more for
policy and delivery objectives than for communications campaigns.
Case Study: Department of Health, Community Development Workers
As part of its strategy for delivering greater equality in mental health services
Delivering Race Equality, the Department of Health launched a scheme to
create 500 Community Development Workers within Primary Care Trusts by
the end of 2006. These outreach workers are tasked with building bridges
between statutory agencies and voluntary sector service providers, within
which there is a great deal of good practice in supporting ethnic minority
mental health. Though only a few of the 500 are in post so far, the intention is
that they will act as change agents, facilitators and links and fulfil the roles of:
It is expected that some CDWs will come from existing PCT teams, whereas
others may be drawn from voluntary organisations.
28
29
30
31
Target Audience
Cultural Decorum/Images
It is important that any images which appear on leaflets targeted at people
from ethnic minority communities, e.g. photographs of people or use of other
design symbols, should be culturally appropriate. For example:
Images used on the cover or in the body of the text must be compatible
with the community language used
Publicity material aimed at Muslims, e.g. Pakistanis and Bangladeshis,
Somalis, should take into account the fact that Islam requires men and
women to be dressed modestly in all contexts
Use of religious symbolism should be avoided; e.g.
Quotes from the Koran
Images of Hindu gods
32
Something-for-something
Outreach practitioners talk of the importance of ensuring the message and
proposition includes something of value to offer to the audience a gift or a
useful service of some sort (e.g. home fire safety checks, free lanyards etc).
Where community groups help deliver the campaign, it is important not to
abuse this goodwill for example you might offer to pay for catering at an
event they are hosting on your behalf.
Intermediaries
Intermediaries are often used by organisations to deliver outreach activity. It
is important to be able to select the most relevant and appropriate
intermediaries dependent on the target audience. In this respect it is essential
to distinguish between community workers and community leaders as both
fulfil different functions.
33
34
7. Delivering Outreach
Who can do outreach?
Fundamentally, outreach techniques depend on trust, credibility and personal
interaction.
Some practitioners believe that outreach activity works best when the
outreach worker is drawn from the target community, or at least shares their
faith or race. Other practitioners feel this is not necessarily important for some
issues, where other aspects of the work such as the individuals personality
or the suitability of the supporting materials and proposition are right. In fact,
in some situations, an outreach worker from outside the community can
benefit from a degree of independence and neutrality, which can help when
facilitating community cohesion or where communities are segregated by
tribal or language divisions.
Case Study: Electoral Commission Ethnic Minority Voter Registration
Campaign
The Electoral Commission ran a campaign in the West Midlands in 2006
designed to increase voter registration amongst young ethnic minority groups.
Alongside radio advertising and posters provided to local community
organisations, field marketing was used. Street teams and an 'ad wagon' (a
vehicle with blacked out windows and a large plasma screen) was used to
engage the audience, explain the need to register to vote, help people to
complete registration forms and return them to the local Council office. The
support of local councils was of vital importance to help identify key target
areas and ensure the registration forms could be processed effectively.
Evaluation of the campaign found that having Black outreach workers did help
to engage the audience because they were able to discuss the issues that
mattered to young people and thus explain why registration is important:
'Street teams also reported that the presence of a Black public
information team provoked considerable public interest not only
because it was unusual and intriguing but also because young ethnic
minority audiences were likely to communicate with them.
Source 9: Evaluation of Electoral Commission ethnic minority voter
registration campaign, 2006
The street team achieved almost 900 registrations in a three week period
and the Commission is currently considering rolling out the activity.
35
36
37
Case Study: Dept for Communities & Local Government, Fire Safety
Fire and Rescue Services around the
country do a lot of active outreach work in
their communities to increase awareness of
fire safety issues. In particular, there are
specific fire safety issues affecting some
ethnic minorities which use fire as part of
celebrations such as Diwali, Eid, Chinese
New Year and Chinese Lantern Festival.
Through COI, the department engaged a
specialist ethnic marketing agency, Media
Moguls, to deliver training to Fire Safety
Officers to help them approach and inform
local ethnic minority communities about
these specific fire safety issues.
The training involved regional briefings incorporating a tailored analysis of the
profile of, and likely issues affecting, local ethnic minority populations, as well
as guidance on how to engage groups effectively and support materials to
help with this. A number of local teams took up the offer of further specialist
training to give them the knowledge, skills and tools to take their outreach
work further into these communities. The Commission for Racial Equality
highlighted the campaign as an example of good practice regarding
engagement with ethnic minority communities in its evidence to the (then)
ODPM Select Committee on Fire.
Website: http://www.communities.gov.uk/index.asp?id=1123799
39
Community development/empowerment
With a community development objective, outreach is not so much delivered
as facilitated were not just organisers of other peoples agendas says one
community development specialist. The commissioning or supporting
organisation will try to identify community figures, but rather than designing
the marketing approach directly, will work with the group to build their capacity
(such as through training workshops) and provide on-going support as the
group take the activity forward. This might involve giving a grant, providing
specialist help on evaluation or contacts in relevant statutory agencies.
Case Study: University of Central Lancashire, Centre for Ethnicity &
Health
The Centre for Ethnicity and Health has taken a community engagement
approach to delivering a recent research project into the health needs and
priorities of ethnic minorities. Rather than conduct the research directly, they
form a relationship with an establish host organisation in the community, help
them to recruit a team of researchers from the community and provide six
days of training workshops in research and analysis techniques. They then
offer advice and quality assurance in a mentoring role, but leave decisions
over the research method to the community research team, overseen by a
local steering group of community and agency representatives. This approach
enables research to be conducted on a much larger scale and according to
community priorities, with the central team focusing on quality assurance and
management, rather than direct implementation.
40
Forming partnerships
Many of the examples of outreach we found were formed of partnerships,
typically between statutory agencies (sometimes at both central, and regional
or local level) and the voluntary sector, with funding and governance
arrangements in place to formalise the relationship. As well as achieving
business goals more efficiently, these partnerships can also help improve
stakeholder relationships, demonstrating that central and local government
respects and trusts the voluntary sector, and that there is something useful to
offer community groups. The Department for Work and Pensions found:
many reported that outreach offered a way to work in much greater
partnership with local services and agencies, and to raise the profile of
their services and organisations more generally. In the case of
Jobcentre Plus, one project manager stated that they were able to put
something on the table in relation to local regeneration which improved
relationships with other local stakeholders significantly.
Source 17: Maximising the role of outreach in client engagement, 2006
Data capture
Though it is easy to overlook, capturing accurate and consistent data from
marketing activity including outreach is important if you want to evaluate
its impact. For example, this may involve ensuring that contact centres record
source of awareness or the ethnicity of the caller, so you can monitor how
many participants in outreach or members of the target audience follow up an
outreach contact.
41
Developing colleagues
Outreach can provide a lot of value in developing colleagues within the
organisation, to increase their awareness of and empathy with the
communities they serve, and the potential impact on them of services or
campaigns.
Cultural visits and exchanges where individuals or teams tour a community
facility or place of worship are one technique for connecting the community
with others in the organisation. Some organisations run internal training in
cultural awareness or community cohesion. Making colleagues part of the
feedback loop is important, so that issues which emerge from outreach
workers on the ground are communicated to those responsible for the policy,
service or campaign.
Case Study: Leicester City Football Club
As part of its extensive community work, Leicester City FC organises cultural
visits for its executives and customer-facing staff to local places of worship
such as mandirs (Hindu), gurdwaras (Sikh), and mosques (Muslim) for a tour
and explanation of the faith, through question and answer sessions. There are
reciprocal behind the scenes tours for faith leaders at the Leicester City
stadium.
Funding streams
Several of the practitioners we spoke to mentioned that funding for outreach is
sometimes a hurdle in itself. Consistency can be an issue, with short term
funding running out before outreach has a change to take root, leading to
relationships being cut short.
Postcode funding was also mentioned, where funders try to target activity
with pinpoint accuracy to areas of statistically high deprivation. Most funders
are only interested in what ethnicity and postcode they are from says one
outreach worker, frustrated at this bureaucratic hurdle to delivering outreach
to groups they know fit the real profile of the target audience.
Case Study: Calderdale Early Years Childcare and Development
Partnership
The Early Years Childcare and Development Partnership is tasked with
increasing and improving the representativeness of childcarers in the area.
43
For some ethnic minority residents, one barrier is the need for prospective
recruits to achieve a vocational qualification in childcare, which typically
involves attending a course at a local college, which can seem unfamiliar and
intimidating. For them even to cross the threshold of an educational
establishment was a barrier says Lynda Ball of the EYCDP.
Following on from a national campaign led by DfES, Calderdale created a
series of short stepping stone courses to help bridge the gap between initial
orientation sessions and the vocational course. The EYCDP formed a
relationship with a local association for Asian women, which opened up its
centre to run the sessions, and helped to promote them. The courses
themselves are delivered by established childcare tutors and provide more
information and build participants confidence, in a familiar setting. They also
offer extra support in the form of interpreters and careers advisers on-hand,
and a crche for participants use. This style of inter-agency working at local
level has been picked up by other organisations, and is being formalised to
help ensure the scheme is able to withstand changes in funding or personnel.
Website: http://mailhost.calderdale.gov.uk/learning/early-years/
Use of brands
To what extent outreach activity draws on established brands depends on the
relationship the audience have with the brand, and its role in providing
awareness for outreach without carrying negative perceptions. For example,
the FRANK campaign branded its outreach clearly as linked to a well-known
but arms-length government brand. By contrast, the Department for Work and
Pensions found:
Many respondents thought it was absolutely crucial not to use
Jobcentre Plus livery, staff badges, etc. in order to build trust with nontraditional customer groups who were often suspicious of government
organisations. This is not to say that customers were deliberately
misled about the fact that Jobcentre Plus was funding or delivering the
provision, but rather that this type of information was played down, and
not deemed to be of any import, especially early on in the intervention.
Essentially, customers have to be won over in the first instance and
distancing outreach provision from statutory services was often seen
as facilitating this.
Source 12: Maximising the role of outreach in client engagement, 2006
44
listening skills
personality:
o courage/confidence (including talking to large groups)
o persistence & patience (one outreach worker told us: In the
best of all worlds, youre a broker; in the worst of all words,
everybody hates you)
45
46
47
Ensure the objectives are clearly defined, along with the desired
outcomes and any assumptions. Make the ultimate aim explicit and
specific but also challenging (i.e. probably not just about raising
awareness) but manageable (i.e. playing a specific part in delivering better
community cohesion). It is hard to establish what to measure unless these
objectives and assumptions have been set out.
Use multiple, meaningful sources: including a representative range of
participants wherever possible, but not forgetting the feedback from people
involved in delivering the outreach, such as outreach workers, street
teams, front line staff who handle enquiries etc. Count everything, says
one agency involved in community development: You need to evaluate in
10 different ways.
Adopt multiple, meaningful measures: the measures selected should
address the activity as a whole, including the amount of activity (numbers
attended etc) but also perceptions of the outputs, and data about response
or long term change. In the case of outreach, simply collecting the number
of contacts tells you nothing about the quality of those contacts, or the
barriers which individuals have to overcome in order for the desired
outcome to be achieved.
So, keep in mind that data doesnt have to mean numbers: qualitative
data, or loosely-structured feedback from people about their experiences
and perceptions provides depth and detail, and is no less valuable than
percentages from surveys or operational statistics. In fact, where the
numbers of people involved are very small, statistical data may be
inconclusive (and will usually need expert help to interpret) so qualitative
data from people involved is essential to properly measuring performance.
You really see the difference from little interactions, says one grass roots
outreach worker Showing that youre interested in them makes them
happier. Charlton Athletic estimate that around 20% of community
schemes do not work effectively at launch, and are quickly revised or
cancelled as a result of informal feedback from frontline staff.
What to measure
The ideal set of measures for evaluating outreach would be able to provide
answers across the lifecycle of the project:
48
Inputs:
Activities:
Outputs:
Sometimes, it may not be possible to gather data on each of these, but aiming
for lots of different meaningful measures, from lots of different sources should
help to build a rounded picture of performance, identify at what point things
have gone unexpectedly well or poorly, and help you suggest opportunities for
improvement to the activity. This will often involve evaluating and getting
feedback from the outreach practitioner or stakeholder, as well as the target
audience:
Participants
Outreach
practitioners &
stakeholders
Involvement
Who?
Awareness
Attitudes
Response &
Behaviour
change
Awareness
49
Attitudes
Response &
behaviour change
Approaches to evaluation
Pre and Post tracking or benchmarking (quantitative)
What does it involve?
Conducting two similar surveys amongst a sample of the target audience, one
before any activity starts, and one after the activity has completed or is well
underway. The surveys measure awareness of the activity, attitudes to the
issues and reported behaviour or responses. By comparing responses
amongst the same type of people to the same questions at different points in
time, you can measure the change that has occurred in awareness, attitudes
and behaviour.
What are the advantages?
If a sufficiently large, representative sample is used, pre-post surveys can
provide robust measurement of change, and help distinguish between
different levels of awareness or action.
50
51
Outcomes model
What does it involve?
An outcomes model (sometimes known as a logic model, developed by the
WK Kellogg Foundation) involves establishing at the outset how the activity is
designed to achieve its objectives, and collecting data on performance at
different stages of the process, to see how well these have worked
individually and in conjunction.
Applied to outreach activity, the elements of the logic model might be:
What resources
were used in the
outreach
activity?
Outcomes
Impact
Inputs
Activities
Outputs
10 full-time staff,
150k budget
A community
meeting with 300
attendees,
5,000 leaflets
distributed,
a database of 500
organisations was
compiled
52
The proportion of
ethnic minority
recruits rose by 5%,
There were no
racist attacks for 6
months,
Colleagues started
to ask how they can
improve service
delivery to groups
Community
cohesion
improved,
Perceptions of
discrimination fell
At one level, this is little more than common sense but by applying a
framework to the evaluation and looking at whether each step has had the
intended outcome, it is easier to spot unexpected problems objectively and
avoid using trivial or unfair measures.
What are the advantages?
By using a range of different measures, these can be made more appropriate
to the basic purpose of the activity, and provide better diagnostic feedback.
This can help to make evaluation of complex or long-term outcomes more
valid, for example by considering qualitative feedback as well as hard
response data.
What are the drawbacks?
The building of the model is a subjective process, so there is a danger that the
evaluation can be undermined if the measures established are not sufficiently
objective. Outreach activity may take unexpected forms and have unintended
consequences both positive and negative so it is important that the model
reflects this in some way, and assess why and what impact the change in plan
had on the intended outcomes.
Qualitative techniques
What does it involve?
To understand why people behave in a particular way rather than just how
many people have taken action, or hold a particular opinion you should
consider using qualitative techniques such as in-depth interviews or group
discussions.
What are the advantages?
Moderated carefully (ideally by a trained professional) they can provide rich
detail and stories, some of which only come out in the course of discussion or
debate. In the case of outreach, qualitative evaluation can tap into the change
in attitudes or perceptions which may have occurred, which is harder to detect
in quantitative survey results. In some situations, trying to conduct a robust
survey can be difficult or prohibitively expensive, whereas convening some
discussion groups (with an interpreter if necessary), may be easier and more
revealing. It can also be an effective approach at the start of a project, to
explore issues within the community to inform subsequent outreach, as well
as creating a qualitative baseline from which to compare later.
53
54
Observation
What does it involve?
Since outreach can take so many forms including ones not originally
planned for it can be useful simply to observe the approaches taken from
the point of view of evaluating the dynamics of the interactions. For example,
a community engagement project in the East Midlands involved evaluators
sitting in on three different community consultants as they facilitated different
types of group sessions or workshops. The evaluators noted the group
behaviour, the facilitators work, and followed the outputs and outcomes from
the sessions, and combined these with feedback from participants to derive
conclusions about which of the approaches were most effective.
As a contrasting example, an agency which runs a street team of young
people uses their affinity with technology to help monitor the activity on the
ground. It equips them with digital cameras or camera phones and asks them
to take pictures of the locations they go to when working for the team, and
where they put up posters. This helps not only to verify that the activity has
taken place, but also provides insights into the kinds of areas where the target
audience in this case, peers of the street team members are to be found.
What are the advantages?
Observation can provide lively first-hand or visual testimony about the
outreach, which brings evaluation to life. It also introduces an objective
assessment of outreach activities such as events, which the outreach worker
and participants may not be able to offer.
What are the drawbacks?
Observation is by definition an outsider activity, so does not provide
feedback from the point of view of the target audience the activity may look
good, but did it achieve its objectives? It also demands that the evaluators
make a strong effort to remain objective, and not be unduly influenced by the
participants or by isolated examples they later remember. Observation can
also be very intrusive introducing a third party observer to some outreach
situations which demand trust and relationship building may be impossible.
Feedback
What does it involve?
One of the most common approaches, feedback typically uses a standard
form to collect participants views on the activity shortly afterwards. It differs
55
from surveys in that those who respond are self-selecting, i.e. there is no
specific effort made to ensure the source of the data collected represents the
profile of everyone involved. In the course of a face to face interaction, there
is a golden opportunity to collect feedback, even without a form: simply asking
a question or two of visitors - and recording their answers - can provide
information about perceptions or reactions.
What are the advantages?
Feedback can be easy to collect, and relatively straightforward to analyse it
can simply involve distributing a simple form and adding up the responses. It
is also a quick way of collecting views with a view to checking the activity
meets its objective. For example, one agency collected feedback from visitors
to a stand in a shopping centre about the location of the stall, and found that
people recommended they move to the other side of the centre in order to
reach a wider audience.
What are the drawbacks?
Because it is self-selecting, feedback may not represent the opinion of
everyone involved in the activity. Often, people who give feedback have
stronger views than average, or perhaps have more time or inclination
(including literacy, importantly) to complete a form. Since feedback is often
given directly to or collected by the outreach workers, people may be less
willing to be frank.
56
Objectives
Depth of
Engagement
Barriers
Community
infrastructure
Raise awareness?
(e.g. help available)
A B C
A. Street marketing
and stunts
B E
Change behaviour?
(e.g. stop risky activity)
D E
B. Peer education,
street teams or
referral marketing
Convey a message?
A B
D. Active service
delivery
Deliver a service?
E. Community
networking &
events
Get community
ownership of the issue?
(e.g. regenerating the area)
F G
F. Community
development
Attitudinal or cultural?
B C E
Language?
B D F
C E
A B D F
C. Sponsorship
G. Active citizenship
& participation
57
Dont
58
Objectives
Audiences
Proposition
Format
Who will deliver the outreach? Specialist agency, in-house team, new recruits?
Which techniques will be most effective in reaching/engaging the audience?
Integration
Evaluation
What information are you collecting to help measure change due to outreach?
How will feedback be used to improve the effectiveness of the outreach activity?
59
Fairly
helpful
Not very
helpful
Not at all
helpful
Dont
know
Overall
Leaflets
Website
Staff you spoke to
2. Do you have any other comments about [THE ACTIVITY]?
.
3. Have you heard or noticed any other elements of the campaign in the following
media?
q Newspapers
q
Radio
TV
Posters
Fairly suitable
If you feel the location was unsuitable, please tell us why: ...
5. How much, if anything, did you learn about [ISSUE] as a result of [THE ACTIVITY]?
q I learned a lot about [ISSUE]
q
If you feel the that you didnt learn anything, please tell us why: .
Thank you for your time.
60
Team: __________________
2 Roughly how many of the young people you met had heard of <CAMPAIGN>
before?
All of them
Most of them
A lot of them
About half of them
Some of them
Not many at all
None of them
3 When people heard it was a <CAMPAIGN> campaign what the most common reaction you got?
They thought <CAMPAIGN> was cool
They were interested in <CAMPAIGN>
They didnt react because they didnt know what <CAMPAIGN> was
They thought <CAMPAIGN> was naff
4 How did the scratch cards go down with most of the young people you handed
them to?
They liked them and played the quiz
They liked them at first, but then didnt bother with the quiz
They didnt do the quiz but said theyd keep the cards to enter the prize draw
They thought it was naff
5 How did the dog-tags go down with most of the young people you handed them to?
They really liked them
They thought they were OK
They didnt seem too keen to have one
They thought they were naff
61
62
Christine Roberts
Ross James
Ethnic Minority
Campaign Manager
Head of Inclusivity
Christine.Roberts@
coi.gsi.gov.uk
Ross.James@
coi.gsi.gov.uk
Patricia.Macauley@
coi.gsi.gov.uk
020 7261 8215
63
Involve
http://www.involving.org
A new organisation focused on the practical issues of making public
participation work, and authors of the People & Participation report.
Neighbourhood Statistics
http://www.neighbourhood.statistics.gov.uk
Local area profiles based on census and other data from the Office for
National Statistics. Includes breakdown of wards by ethnicity and faith.
Renewal.net
http://www.renewal.net/
Resources for practitioners in the field of neighbourhood renewal including
tools and case studies for how involvement techniques have been employed.
Southwark Alliance
http://www.southwarkalliance.org.uk
Non-statutory group set up to improve quality of life and community cohesion
in Southwark. Has published a How To guide of community cohesion ideas
and principles.
Together We Can
http://www.togetherwecan.info
Supports active citizenship and participation in local decision-making.
Contains reports and guides to techniques for empowering local communities.
64
Bibliography
1. Bringing Communities Together Through Sport and Culture. Department of Culture,
Media and Sport. 2004.
2. Building Community Cohesion into Area-based Initiatives. Home Office. 2004
3. Common Good Research: Ethnic Minority Communities. Turnstone Research & Connect
Research for Central Office of Information. 2003
4. Community Cohesion: An action guide. Local Government Association. 2004
5. Delivering Race Equality in Mental Health: an action plan for reform inside and outside
services. Department of Health. 2005
6. Developing effective Community Involvement Strategies (Guidance for preparing SRB
bids). Joseph Rowntree Foundation. March 1999.
7. Ethnic Minority Outreach: An evaluation (Research Report 229). Helen Barnes, Maria
Hudson, Jane Parry, Melahat Sahin-Dikmen, Rebecca Taylor, and David Wilkinson.
Policy Studies Institute. 2005
8. Evaluation of the Connecting Communities Programme. M. McLeod, D. W. Owen, L. C.
Kelly. Centre for Research in Ethnic Relations, University of Warwick. January 2004
9. Evaluation of The Electoral Commission ethnic minority voter registration campaign.
Unpublished report by Cragg Ross Dawson for COI. 2006
10. Getting the message across: Using media to reduce racial and ethnic prejudices. Mike
Sutton, Barbara Perry, Jonathon Parke, Catherine John-Baptiste. Unpublished draft
report for the Home Office. 2005
11. Getting to know you: Engagement & Relationship building, First Interim National Positive
Futures Case Study Research Report. Tim Crabbe. June 2005.
12. In the Boot Room: Organisational contexts. Second Interim National Positive Futures
Case Study Research Report. Tim Crabbe. January 2006.
13. Improving Opportunity, Strengthening Society: The Governments strategy to increase
race equality and community cohesion. Home Office. 2005
14. Kirklees Community Facilitation Fund: end of programme summary report. Fiona Weir for
KMC Community Support Service. 2004.
15. Logic Model Development Guide. WK Kellogg Foundation. 2004.
(http://www.wkkf.org/Pubs/Tools/Evaluation/Pub3669.pdf)
16. Mapping Community Involvement in Brent 2001/2. Silkap for Brent PCT. 2002.
17. Maximising the role of outreach in client engagement (Research Report 326). Sara
Dewson, Sara Davis and Jo Casebourne. Institute of Employment Studies for the
Department for Work and Pensions. 2006
18. Mental Health Policy Implementation Guide: Community Development Workers for Black
and Minority Ethnic Communities (Interim Guidance). Department of Health. Dec 2004.
19. People & Participation: How to put citizens at the hart of decision-making. Involve, with
Together We Can. 2005.
20. Sure Start Inclusion Pilot Projects Summary Report. C Pascal & T Bertram, Centre for
Research in Early Childhood, University College Worcester for Sure Start. 2004.
21. Tackling Domestic Violence: effective interventions and approaches (HO Research Study
290). Marianne Hester and Nicole Westmarland for Home Office. 2005.
22. The role of police authorities in public engagement (online report 37/03). Andy Myhill,
Stella Yarrow, David Dalgliesh & Maria Docking for Home Office. 2003.
23. Understanding the service needs of vulnerable pensioners: Disability, ill-health and
access to The Pension Service (DWP Research Report 263). Wendy Sykes, Alan
Hedges, Kit Ward, Kate Melvin and Mathew Bose. 2005
24. Widening access: improving Police relations with hard to reach groups (Paper 138).
Trevor Jones & Tim Newburn for the Home Office. 2001.
65