UNE Invasive - Species - Handbook - 2017 - Web
UNE Invasive - Species - Handbook - 2017 - Web
UNE Invasive - Species - Handbook - 2017 - Web
ENGAGEMENT
FOR COLLECTIVE
ACTION
INTRODUCTION . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . i
FINAL THOUGHTS. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
RESOURCE LIST . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
The project team included (in alphabetical order): Ted Alter, Aaron
Driver, Paloma Frumento, Tanya Howard, Bill Shuffstall, Lyndal
Thompson, Walt Whitmer. Editorial assistance provided by Denise
Palmer. The team thank all of our industry, government and community
collaborators who have provided feedback, resources and support to
this work.
Cover image: Wild dog Facilitator Dave Worsley at work with community
members. Image supplied by the Invasive Animals CRC.
INTRODUCTION
Across Australia and the world, governments, industry bodies seek to build social capital
and community members are struggling to tackle serious and strengthen community
relationships and trust. Others
and complex environmental and social issues. Growing are designed to address specific
economic inequality, increasing population pressure and the challenges or issues, by unlocking
the social resources that emerge
unpredictable impacts of climate change are all issues that
when individual citizens think and
have both global and local dimensions. act collectively.
Regardless of the issue under
consideration, the practice of
Policy interventions are often incorporating community values community engagement is a
based on assumptions of both into decisions can increase growing one. This handbook brings
scientific and social values. the likelihood of community together key theories and practices
However, when faced with acceptance and community-led of community engagement to
difficult decisions in complex action. assist practitioners develop their
contexts, better decisions and Effective community own engagement plans, put them
more effective action are likely to engagement seeks to engage a into practice and learn how to
result from combining specialised broad range of stakeholders to improve through evaluation of
knowledge with community values achieve long-term and sustainable these efforts. The handbook also
and local knowledge. outcomes to complex problems. encourages practitioners to
This recognition has led to Community engagement efforts develop the skill of ‘reflective
calls for increased community come in many shapes and sizes learning’ and a range of ‘practice
engagement, as policy makers and may be designed to meet tips’ are identified throughout to
and practitioners realise that a number of goals. Many efforts strengthen this practice.
PRACTICE TIP
1. A tension between what 4. Resolution and insight that
THE REFLECTIVE you see taking place in your is often described as an
PRACTITIONER engagement effort and what “aha!” moment when the
you would expect to be concern is resolved.
‘Reflexive learning’ is the happening based on 5. Considering your personal
process of considering, previous experience. perspectives with past and
contemplating and deliberating 2. Identification or clarification present experiences and
on an issue, topic or experience of the source(s) of the how these might impact
that results in a change in your differences. your relationships and work
perspective and understanding. 3. Openness to new in the future.
There are six basic components information from internal 6. Deciding whether to act
of reflexive learning: and external sources and on the outcome of the
perspectives. reflective process.
(Source: Boyd and Fales 1983, Reflective Learning: Key to Learning from Experience.
Journal of Humanistic Psychology, Vol. 23 No. 2, Spring 1983 99-117.)
Source: Bassler, Brasier, Fogle and Taverno (2008) ‘Developing Effective Citizen
Engagement: A How-to Guide for Community Leaders.’ Center for Rural America, 2008.
http://www.rural.palegislature.us/Effective_Citizen_Engagement.pdf
4. Openness and Learning. Help all involved listen to each other, explore
new ideas unconstrained by predetermined assumptions, learn and
apply information in ways that generate new options, and rigorously
evaluate community engagement activities for effectiveness.
5. Transparency and Trust. Be clear and open about the process and
goals, and provide a public record of the organizers, sponsors,
outcomes, views and ideas expressed.
6. Impact and Action. Ensure each engagement effort has real potential to
make a difference, and that participants are aware of that potential.
Source: National Coalition for Dialogue and Deliberation (NCDD), International Association
for Public Participation (IAP2), and the Co-Intelligence Institute, 2009. “Core Principles for
Public Engagement.” http://ncdd.org/rc/wp-content/uploads/2010/08/PEPfinal-expanded.pdf
Several factors contribute to a decline in trust – many of which highlight issues that an
effective engagement process can be designed to anticipate and/or address. These include:
This flow chart illustrates the steps of problem clarification, definition and analysis.
• Should unconventional gas • Should the country support an • Should landholders be forced
development be banned or agricultural land preservation to undertake invasive species
fostered? program? control?
Reframed – How can we Reframed – What are our Reframed – How can
balance the economic benefits best and most cost-effective we increase landholder
of natural gas development options for preserving cooperation while minimising
while protecting our vital agricultural land in the legal interventions?
environmental assets? country?
Community engagement
facilitators commonly have a
deep understanding about the
issue or problem around which
they are facilitating. The facilitator
will likely have an opinion about
the decision or direction the
group should take to address a
problem. Effective facilitators use
their understanding of the issue,
meeting purpose and expected
outcomes along with process
skills and tools, to help the groups
they are working with engage in
effective dialogue, understand the
information and decisions they are
considering and develop plans for
group action.
BUILDING AN AGENDA
PRACTICE TIP
A well thought-out agenda is an
important tool for a successful
meeting. The agenda should state The agenda is a guide to help keep both the facilitator and
the meeting’s objective or purpose participants on task.
and include an outline of the
topics to be discussed during the The agenda should include the following:
meeting. • A short, simple statement of the meeting purpose or objective
Tougher topics should either • A list of topics to be discussed and the names of individuals
be placed at the beginning or the who will be responsible for presenting or leading discussion for
end of the agenda. Depending each topic
on the group dynamic, attendees • A brief statement about why each topic is being discussed and
may feel refreshed and eager its importance to those attending
to participate in the beginning; • The time allotted for each topic
at the end, members may be • Basic information relevant to the topic and other necessary
tired and unwilling to participate. background information
Conversely, in the beginning, • Important deadlines and dates to highlight what needs to be
some attendees may be timid done and the subsequent timeline.
and uncomfortable about sharing • Key questions for attendees to consider before the meeting to
with the group. Determine how help guide facilitation.
your group interacts before
you finalise your agenda to
avoid either of these barriers to
participation. Begin and end with PRACTICE TIP
a “unifying note” or summary so
the group starts and ends feeling
as if they are a part of an effective It can be helpful to develop two separate agendas: one for the
discussion with a clear purpose. facilitator that is in depth and detailed, and another outline version
for participants to refer to during the meeting. A copy of the
outline agenda should be sent to participants before the meeting,
and copies should be available as a hand out prior to starting the
meeting.
INTERNAL ALIGNMENT Is everyone within your And if not, how will you justify
organisation – and more and communicate these
The first, and perhaps most broadly across your decisions, both internally and
obvious aspect of alignment engagement team – externally?
relates to the procedures, policies, supportive of, and fully
and communications within your understanding of the goals,
organisation. If your group, intentions, processes, and
organisation or government agency promises of your engagement PRACTICE TIP
is undertaking a community effort? Are you all speaking
engagement effort, the following from the same page? If not,
questions should be explored: what can you do to address If you are promising that
this before it’s too late? The the input you gather in your
Are there policies, limitations last thing you want is for engagement efforts will
on your authority or control, participants or members be incorporated into the
or internal decision-making of the community getting actions and decisions that
procedures that you need to mixed signals from your follow, are there internal
consider before beginning organisation. reasons or limitations to
your engagement efforts? this promise? If there ARE
How do these alter the overall How can you best internal limitations, you need
goals, issue identification, incorporate the input and to recognise them early on
discussion questions, deliberations into policies, and be transparent about
processes or promises you procedures, or activities? these from the outset. Better
make to those participating in Are there adjustments you to investigate these issues
your engagement effort? can make to accommodate rather than be blindsided
this new information? What by them later on, as this
strategies will you use to will diminish the trust and
ensure you able to keep the relationships you’ve been so
promises you’ve made to the carefully developing.
participants and members?
Here are a few reasons why you • Most importantly, it will help types of evaluation, the best
should develop an evaluation plan: improve your engagement practices for developing your
practice. overall strategy and the potential
• It guides you through each uses for the data and information
step of the process of you collect.
evaluation. WHEN SHOULD Effective evaluation is not
• It helps you decide what sort only an “event” that occurs at
YOU DEVELOP AN
of information you and your the end of a project, but is an
stakeholders really need. EVALUATION PLAN? ongoing process which helps
• It keeps you from wasting time As soon as possible! The best time decision-makers better understand
gathering information that isn’t to do this is before you begin your the project; how it is impacting
needed. community engagement effort. participants, partner agencies
• It helps you identify the After that, you can do it anytime, and the community; and how it is
best possible methods and but the earlier you develop a plan being influenced by both internal
strategies for getting the and begin to implement it, the better and external factors. Evaluation
needed information. your effort will be, and the greater should not be conducted simply
• It helps you come up with the outcomes will be at the end. to prove that a project worked,
a reasonable and realistic This section is designed to but also to improve the way it
timeline for evaluation. introduce you to the different worked. Evaluation is not only an
PRACTICE TIP
Your evaluation strategies, if they are to be successful, must be directly tied to the goals of your community
engagement efforts.
• I f your community engagement effort is designed to address a specific issue, then your evaluation goal
will be to assess the issue-specific outcomes that have occurred as a result of your program efforts.
Examples might include decreasing the number of feral pigs in an area, increasing in the acres of
farmland preserved, or decreasing the levels of sediment in a river.
• If your goal is to enhance local community participation or involvement, your evaluation goals might
consider how well the program reached the intended audience, involved residents in decision-making,
empowered them to implement strategies on their own, or simply increased community understanding
and knowledge about the issue.
In either case, deciding ahead of time what’s important to your project – and to your stakeholders – is a
critical first step.
There are three levels of evaluation that are especially relevant to many community-based
projects and engagement efforts. Together, they maximise our collective understanding and
ability to strengthen individual and organisation engagement efforts.
PROJECT-LEVEL EVALUATION
Project-level evaluation focuses on a specific initiative. The project leader, with appropriate
staff and input from participants and other relevant stakeholders, determines the critical
evaluation questions, decides whether to use an internal evaluator or hire an external
consultant and conducts and guides the project-level evaluation. While these measures
can be a combination of both formative and summative metrics, the focus here is on the
specific project or initiative. The primary goal of project-level evaluation is to improve and
strengthen the overall project and engagement effort. Ultimately, project-level evaluation
can be defined as the consistent, ongoing collection and analysis of information for use in
decision making.
ORGANISATION-BASED EVALUATION
Organisation-based (or internal) evaluations are geared primarily toward answering the
questions: How are we (as an organisation) engaging our stakeholders? What impact have
our efforts had on the issue(s) we are seeking to address? What can we learn from these
experiences to improve our engagement strategies and techniques? Evaluation efforts
addressing these questions reflect on all the engagement efforts in the organisation to
assess impact, and gain valuable information for improvement.
CLUSTER EVALUATION
Cluster evaluation is a means of determining how well a collection of projects, often across
multiple organisations, fulfils the objective of effective engagement. The primary purpose
for grouping similar projects together in “clusters” is to bring about more systemic change
than would be possible in a single project or in a series of unrelated projects. For instance,
evaluation efforts that assess the cross-project impact of changes in trust, relationships,
or participant behaviour may be instructive for funders, practitioners and host agencies or
organisations – and hopefully lead to sustained positive change at the community level.
A key element in your evaluation efforts is 1. What is it you most want to change and how
establishing baseline data, generally referred to as can you measure that change? In general this
‘benchmarking’. This is particularly important if your should come directly from your program goals
intention is to measure change in either the short- and objectives. Be as specific as possible.
or the long-term. If your evaluation efforts are
meant to tell you how much the ‘needle moved,’ 2. What do you know (or what can you document)
benchmarking tells you where that needle is now. about the current state of conditions? This
Two questions can help you benchmark your could be a wide range of individual, social,
efforts: economic, or environmental conditions.
LOGIC MODEL
Logic models require that each of these components be specifically identified and tied to the evaluation metrics
and methods that can measure them. A simplified example might be:
PRACTICE TIP
BALANCED SCORECARD
One way to develop multiple indicators is to create a ‘balanced scorecard’, which contains indicators that
are carefully selected to complement one another. According to this strategy, program processes and effects
are viewed from multiple perspectives using small groups of related indicators.
For example, a balanced scorecard might include indicators of how the program is being delivered; what
participants think of the program; what effects are observed; what goals were attained; and what changes
are occurring in the environment around the program.
Remember that your choice of metrics or indicators can, and in many cases should, be developed in
concert with participants in your engagement efforts. This can provide important insight regarding what’s
most important to measure from their perspective as well as enhance ‘buy-in’ and connection between the
project and your target audience.
Source: University of Wisconsin “Developing a Logic Model: Teaching And Training Guide”.
http://www.uwex.edu/ces/pdande/evaluation/pdf/lmcourseall.pdf
(Adapted from Rowe, Gene, and Lynn J. Frewer. “Evaluation public-participation exercises: a research agenda.”
Science, technology & human values 29, no. 4 (204): 512-556.).
PARTICIPATORY EVALUATION
Community-based participatory about what they need and what which they would determine
research enlists those who they think will help. success. Incorporating these
are most affected by an issue At another level, academic or considerations creates another
– typically in collaboration or other researchers recruit or hire powerful community engagement
partnership with others who have members of an affected group – opportunity.
evaluation skills – to conduct often because they are familiar
evaluation on and analyse that with and known by the community
issue or project, with the goal of – to collect data. In this case, the MOST SIGNIFICANT
devising (or revising) strategies to collectors may or may not also
address it. help to analyse the information
CHANGE
In other words, community-based that they have gathered. Most Significant Change (MSC) is
participatory research adds A third level of participatory a story-based method designed
to, or replaces academic and research sees academic, to contribute to summative
other professional research with government, or other professionals evaluation. This method
research done by community recruiting members of an affected represents a radical departure
members, so that research results group as partners in a research from traditional, positivist
both comes from and goes directly project. The community members approaches to evaluation in that it
back to the people who need become colleagues, participating is a bottom-up, rather than top-
them most and can make the in the conception and design down, process with no pre-defined
best use of them. of the project, the metrics to be indicators. It is useful as part of a
There are several levels of assessed, data collection, and data strategy for evaluating programs
participatory research. At one analysis. that address complex problems
end of the spectrum is academic The essence of this approach that may have unexpected
or government research that is respecting the fact that outcomes, and those that have
gathers information directly participants are likely to have a broad range of funders and
from community members. The project metrics that are important stakeholder groups.
community members may (or may to them, and recognising that The process begins when those
not) be asked for their opinions these are the measures by managing the program, along with
Each type of stakeholder will have The project team may want to use WHEN ARE FEEDBACK
a different perspective about evaluation results to guide them
AND REPORTS
what they want to learn from the in decisions about their programs,
evaluation. Every group is unique, and where they are putting their NEEDED?
and you may find that there efforts. Whenever you feel it’s appropriate.
are other sorts of stakeholders Of course, you will provide
to consider within your own Researchers will most likely feedback and reports at the end
organisation. The easiest way to be interested in understanding of the evaluation, but you should
shape your communications is to whether any improvements also provide periodic feedback
ask each stakeholder what they in the issue were a result of and reports throughout the
want to know from the evaluation. your engagement programs or duration of the project or initiative.
initiatives; they may also want to In particular, since you should
Grant makers and funders, for study the overall structure of your provide feedback and reports
example, will usually want to know group or initiative to identify the at meetings of your steering
how many people were reached conditions under which success (or committee or overall coalition, find
and served by the initiative, as well otherwise) may result. out ahead of time how often they’d
as whether the initiative had the like updates. Funding partners will
community-level impact it intended want to know how the evaluation
to have. is going as well.
Brainstorming – Combines individual 1. Allow time for each member to write When additional time is
idea generation thinking and group ideas down on their own necessary to generate to think
idea time, encouraging 2. Ask each person to read one idea about issues
participation from all from their list When introverted or dominant
3. After one or two rounds of collecting members are in the group
ideas on a flip chart open up the list
A variation for this process
for broader discussion.
includes having participants
4. Once list is complete ask members pass their list to another
to add any additional ideas that have person to provide anonymity
come to mind
Sticky note Individuals write single 1. Give each member sticky notes and When members need to
brainstorming – ideas on large sticky markers and ask them to write down move around
idea generation notes which are then one idea per note
placed on the wall When people want some
2. Have them place sticky notes on the
Ideas are then grouped distance or anonymity from
wall
by similar themes certain ideas
3. Have members read other’s ideas
and begin to collectively group similar When you want to have the
themes as appropriate ability to quickly move ideas
around into effective groups
Visioning – idea Highly participatory 1. Follow similar steps as brainstorming When you need to get
generation approach to goal setting detailed above. initial ideas and goals and a
that asks participants shared vision of the future
to consider what
their community or
organisation will look
like in some future point
(usually 2-5 years)
Force field Structured method for 1. Once you have identified a topic, When you need to identify
analysis – idea looking at two opposing situation, or project ask participants to all the factors at play in a
generation forces list two ideas under two categories – situation so that barriers and
a) forces that help us and problems can be overcome
b) forces that hinder us
Root cause Sometimes referred to as 1. Explain the differences between When you need to delve
analysis – idea the Fishbone method. A causes and effects below symptoms
generation systematic analysis of root 2. Once the main effect or problem is
causes of an issue rather identified place this at the ‘head’ of
than it’s symptoms. the fish.
3. All possible causes and their causes
are identified as the ‘ribs’ of the fish
4. Have participants identify solutions to
each of the causes
Decision grid – Quantitative method for 1. Ask members to identify 3-5 criteria When you need to bring
narrowing ideas scoring solution choices by which a decision should be based objectivity and criteria to
against an agreed upon 2. Each option or solution (placed in bear in a decision or priority
set of criteria the rows with criteria as the column setting
headers) is then evaluated based
on the extent to which it meets each
criteria (e.g. 1=does not meet criteria,
2=somewhat meets criteria, 3=good at
meeting criteria)
3. Scores are then totalled both down
columns and across rows. Highest
row scores will determine overall best
choice
Nominal group Method to objectively 1. Each person individually rank orders When you need to manage
process – assess each individual’s his or her preference for identified strong personalities or value
narrowing ranked preference of solution choices (first choice = 1, differences. Avoids getting
choices choices and to then second choice = 2, etc) into endless debates
combine into overall 2. Individual ranks are recorded (usually
picture of group’s Provides objective
on a flip chart) in a grid with choices
priorities evaluation and discussion.
in the column headings and people
May however gloss over
listed in the rows
important considerations or
3. Facilitator asks each member to perspective if not effectively
discuss the reasoning behind their addressed
choice.
4. Members are then offered the
opportunity to revise individual
rankings
5. Scores are then totalled for each
column. Lowest number identifies
group’s overall highest priority