Measuring success in disaster risk communication through systematic data analysis.
Monitoring is the systematic collection and analysis of data to track the performance of your disaster risk communication over time, based on your measurable indicators. Monitoring data is vital in informing whether your goals have been achieved.
Monitoring typically takes place at regular intervals (e.g. monthly or quarterly). If your project length and budget require, monitoring can be a one-off process (e.g. half-way through a project).
Depending on what you want to measure, you can gather data through surveys, focus groups, interviews and/or observation.
Ways to gather monitoring data
Choose methods that fit your resources, audience and what you need to learn.
Structured questionnaires to quantify knowledge, attitudes and behaviour change at scale.
Small guided discussions that surface how communities interpret and act on risk messages.
One-on-one conversations for depth on individual decision-making and barriers.
Direct, in-context observation of behaviours the communication is meant to change.
Feedback loops can also be used to gather monitoring data, though their primary purpose is to make iterative changes to content — whereas monitoring data is used to evaluate performance against objectives.
Example indicators
SMART indicators are specific, measurable, achievable, relevant and time-bound.
GOAL :
The target population takes actions that reduce flood risk. The project can demonstrate that the changes it has brought about have helped people make better risk-informed decisions.
| Objectives | Indicator | Baseline Month 1 (Target versus actual) | Midline Month 12 (Target versus actual) | Endline Month 24 (Target versus actual) | Verification method |
|---|---|---|---|---|---|
| Knowledge | % of listeners report understanding risk information provided | Local quantitative evaluation (baseline/midline/endline) | |||
| Risk perception | % of listeners are confident in their ability to to take action to reduce flood risk | ||||
| Attitudes | % of listeners who believe there is a real risk of flooding | ||||
| Decision making | % of listeners who report that the communication helps them to make better weather- related and risk- informed decisions | ||||
| Practice/behaviour | % of listeners who report taking a recommended action to prepare for heavy rainfall |