A credible impact story for a rural well-being program answers five questions. What did the program deliver? What changed for the people involved, compared with where they started? Who benefited, and who was missed? How confident can we be that the program caused the change? And are the benefits still there once the project team has moved on? A good report also says how its evidence was collected and what that evidence cannot show.
Impact reports can place considerable emphasis on activities completed and people reached. Those figures matter, but they do not tell the whole story. This guide explains how to measure the rest, using the kinds of rural development work that the Art of Living and many other organisations carry out in India.
Why this matters today. 15 October is the International Day of Rural Women, established by the UN General Assembly in resolution 62/136 (December 2007) and first observed in 2008. The UN’s theme for 2026 is “Rural Women Farmers Caring for Mother Nature”, and 2026 is also the International Year of the Woman Farmer. The UN notes that, globally and with few exceptions, rural women fare worse than rural men and urban women on every gender and development indicator for which data are available. That is partly a measurement problem: a report that never asks who benefited cannot see who was left out.
Outputs, outcomes and impact: get the vocabulary right
Evaluators separate four things that reports often blur together:
- Activities: what the program did, such as running training or building check dams.
- Outputs: what was directly delivered, and to whom, such as the number of women who completed a tailoring course.
- Outcomes: what changed for participants, such as how many of those women are earning from tailoring six months later.
- Impact: broader, longer-term change that can reasonably be linked to the program, such as household income, school attendance, or reduced distress migration.
The table below shows how this works for five common types of rural intervention. The indicators are illustrative. They are not drawn from any specific project.
| Intervention | Output (what was delivered) | Outcome (what changed) | Longer-term question |
|---|---|---|---|
| Drinking water | Systems installed; households connected | Days per month that water is available; time spent collecting water; water-quality test results | Has water-related illness fallen? Is the time saved going to school or paid work? |
| Sanitation | Toilets built | Share of toilets that work and are in regular use at follow-up; whether women and girls report they can use them safely | Has open defecation ended across the village, not only in project households? |
| Skills training | People enrolled and certified | Employment, self-employment or earnings at six and twelve months | Do the enterprises survive? Do participants find work locally? |
| Natural farming | Farmers trained | Farmers still using the practices one or two seasons later; input costs; soil or yield records. | Do the changes hold through a poor monsoon or a price shock? |
| Local governance | Panchayat members trained | Attendance at the gram sabha (village assembly), including women’s attendance; village plans prepared; funds used | Do village institutions keep working without outside facilitation? |
One counting trap deserves a mention. Ten sessions attended by the same twenty people produce two hundred attendances, not two hundred beneficiaries. Every number should say whether it counts unique people, households, attendances, facilities, or villages. “Reached” needs a definition too, because it can mean anything from direct participation to living in a village where an activity took place.
Where the OECD criteria fit
The most widely used framework for judging development work is the set of six OECD evaluation criteria, revised in 2019. Each comes with a plain-language question:
- Relevance: is the intervention doing the right things?
- Coherence: how well does it fit with other interventions?
- Effectiveness: is it achieving its objectives?
- Efficiency: how well are resources being used?
- Impact: What difference does it make?
- Sustainability: will the benefits last?
Treat these as prompts for judgement, not a form to fill in. The OECD’s 2021 guidance, Applying Evaluation Criteria Thoughtfully, explains how to interpret each one in context.
“Compared with what?” Baselines and causation
A baseline records conditions before a program starts: how far women walk for water, how many trainees already have paid work, or what farmers spend on fertilizer. Without one, a report can describe the present but cannot show change.
Timing matters as well. Course completion can be recorded on the last day of training. Employment, enterprise survival and changes in farming practice take months or whole seasons to appear.
Even a clean before-and-after comparison does not prove that the program caused the change. Trainees may have found jobs because a factory opened nearby, and yields may have risen because the monsoon was good. Impact evaluation deals with this by estimating the counterfactual: what would have happened without the program? This is usually done by comparing participants with a similar group who did not take part. The World Bank’s free textbook Impact Evaluation in Practice explains these methods for non-specialists.
Most community projects cannot run a formal comparison study, but they can still report honestly. They can:
- Collect a baseline before work starts, even a simple one;
- name other changes in the area that could explain the results;
- Describe their contribution (“the training was one factor, alongside a new market road”) instead of claiming sole credit;
- Say plainly when it is too early to judge.
A modest claim that the evidence supports is worth more than a dramatic one that it does not.
Who benefited? Measuring women’s participation properly
A program can look successful in aggregate while missing the people it most needed to reach. Where it is appropriate and safe, breaking data down by gender, age, social group, disability, and hamlet shows whether benefits were shared.
For women’s participation, attendance is the weakest measure. A stronger report looks at four things:
- Access: Could women attend? Were sessions timed around care work and farm work, and was travel safe and affordable?
- Use: Could they apply what they learned? Did they have access to credit, equipment, land, or markets?
- Voice: Did women influence decisions, such as where the hand pump went, which crops the training covered, or how a village fund is spent? Or did they only attend the meeting?
- Control: Who controls the income or asset that resulted?
These questions reflect the barriers that UN Women’s 2026 statement highlights for rural women: rights to land and water, access to finance, markets and services, unpaid care work, and a say in the decisions that affect them.
Collecting this data carries responsibilities:
- Ask only for information you will use, and explain why you are collecting it in the local language.
- Record consent separately for interviews, quotations, and photographs.
- Accept a refusal without any effect on the person’s access to the program.
- Take particular care with minors, with anyone describing violence or a health condition, and with combinations of details (a name, a village, and a photograph) that could identify someone.
Participants are the authorities on their own lives. A story should never be edited to suggest a result they did not describe.
Three kinds of evidence and how to label them
Each kind of evidence is valuable, but none should be presented as another.
| Evidence | What it shows well | What it cannot establish on its own | How to label it |
|---|---|---|---|
| Participant testimony | What the change felt like; reasons; unexpected effects | How typical that experience is | “One participant described…” |
| Program monitoring (the organisation’s own records and surveys) | Scale, delivery and trends over time | Causation, or an independent view | “According to program records for [period]…” |
| Independent evaluation | Whether change can be attributed to the program, using stated methods | Every local nuance, and it is limited by its own design | “An evaluation by [named body], published [year], found…” |
If the organisation running the programme funded or commissioned an evaluation, the report should say so. The same principle of separating self-reported experience from measured outcomes, and naming conflicts of interest, runs through our review of what research shows about Sudarshan Kriya.
Will the benefits last?
A water system that breaks down within a year has delivered an output, not a lasting outcome. Sustainability should be planned from the start and checked later. Useful follow-up indicators include:
- the share of facilities still working at twelve and twenty-four months;
- who maintains each asset, and whether a fund or user fee covers repairs;
- whether local committees or youth groups still meet and act without outside facilitation;
- whether trained people are still using, or teaching, the skill.
Applying this to the Art of Living’s rural work
The Art of Living describes its rural development work as three strands that run in parallel: infrastructure, empowering local youth (through the Karma Yoga programme, formerly YLTP) and community-building. The principle behind them, as the same page puts it, is that “infrastructure development walks hand-in-hand with people development“. Its integrated community development page describes needs assessment, “ensuring community involvement in decision making” and “identifying and training local leaders”, with the aim of “making the people themselves true agents of their progress”. Its skill development programme lists skill-gap surveys among its initiatives.
Because this approach invests in people as well as infrastructure, its impact stories could look beyond counts. They could ask whether trained youth leaders are still leading projects a year later, whether village decisions involve women and marginalised households, and whether the needs assessment shaped what was built. These suggestions come from general evaluation practice. They do not describe the organisation’s internal methodology.
The organisation’s public pages also report scale figures, such as villages, trainees and facilities. These are the organisation’s own counts. When such figures are quoted, they should be labelled as organisationally reported, with the source page, the unit counted and the reporting period. As our introduction to the Art of Living puts it in its section on seva, specific claims about reach and impact “need reliable sources and clear reporting”.
Leave a Reply