Finbox – Monitoring & Evaluation Pillar

  • back to finbox button small whiteA monitoring and evaluation program is essential to ensure that communication and engagement activities are ‘best practice’ and effective.
  • To date rigorous monitoring has not been undertaken at any existing demonstration reach.
  • Surrogates can be used to give some indication of the effectiveness of communication activities but given the importance of community support for river rehabilitation and demonstration reaches, they are no substitute for direct monitoring.
  • A monitoring and evaluation framework similar to the Boys et al. (2009) document needs to be developed for monitoring community engagement.

 

All existing demonstration reaches were required to develop Communication and Engagement Plans, which clearly identify all stakeholders and develop strategies for engagement (see Planning Pillar). These plans all lack a comprehensive monitoring component. Although this has long been recognised as a deficiency in demonstration reaches, and most NRM activities, it has not been acted upon, largely due to funding constraints.

There are a myriad of communication activities that can be undertaken when implementing a demonstration reach (e.g. brochures, websites, school presentations, public meetings etc.) and without adequate monitoring and evaluation it is not possible to evaluate their effectiveness and ensure that resources are being allocated in the most cost effective way.

Suggested steps for developing a community engagement monitoring and evaluation program

The logic behind any monitoring and evaluation program for community engagement should be similar to the biological monitoring, that is:

  1. Establish the communication goals.
  2. Determine how these goals could be achieved within the stakeholder community. (Hypotheses to be tested).
  3. Develop the set of actions/activities to be undertaken (Point 1 to 3 would all be articulated in the Communication and Engagement Plan).
  4. Develop a monitoring and evaluation plan using appropriate expertise.
  5. Undertake pre-intervention monitoring of the proposed target audiences including control groups.
  6. Undertake regular post intervention monitoring of control and post intervention groups.
  7. Modify communication and engagement activities as appropriate.

Consideration must be given to choosing the appropriate indicators and sampling methods, experimental design and analysis methodology. If a monitoring and evaluation framework is developed for communication and engagement, this could identify the array of types of monitoring that could be undertaken, their pros and cons, as well as issues to be mindful of when monitoring communities.

Use of surrogates

In the absence of a monitoring and evaluation program, demonstration reaches have used surrogates to give an indication of the success of engagement activities. These can include number of “hits” on a website, attendance at meetings, level of involvement at demonstration reach activity days, number of newspaper articles, number of brochures used etc (see Planning Pillar). While they do provide a “feeling” for the level of community engagement and can indicate some things that may not be working (e.g. unused brochures), they do not provide the same level of feedback as a monitoring program.

A field day at Yarrawonga (Photo- Fern Hames)

A field day at Yarrawonga (Photo- Fern Hames)

A field day on the Hollands Creek demonstration reach  (Photo - Fern Hames)

A field day on the Hollands Creek demonstration reach (Photo – Fern Hames)

 

References

Boys, C.A., Robinson, W., Butcher, A., Zampatti, B. and Lyon, J. 2009. Framework for developing and implementing ecological monitoring and evaluation of aquatic rehabilitation in demonstration reaches. MDBA Publication No. 43/08. Murray-Darling Basin Authority, Canberra.

The following two tabs change content below.