Impact evaluation

Polity & Governance glossary

Also called: Outcome evaluation · Topic: Transparency, Accountability and e-Governance · NCERT: Beyond NCERT

Meaning

An impact evaluation tests whether a government scheme itself caused a change in people's lives. It asks two questions. Did the change happen? And would it have happened anyway without the scheme? To answer the second question, it compares results with what would likely have happened if the scheme had never existed. In India, NITI Aayog's Development Monitoring and Evaluation Office (DMEO) runs such studies. DMEO was formed in 2015 by merging the Programme Evaluation Organisation and the Independent Evaluation Office. Impact evaluation matters for accountability. It shows whether public money actually produced results, which a list of activities or officials' memories cannot show.

Example

Under Direct Benefit Transfer (started on 1 January 2013), the government claims large savings from fewer leakages. An impact evaluation would check whether those savings came from DBT itself, or from other causes such as removing fake names in other ways. DMEO carries out process, output, outcome and impact evaluations of schemes. Its work is guided by the Development Evaluation Advisory Committee, which was reconstituted in June 2021.

Don't confuse with

  • Outcome evaluation: This only checks whether the expected result happened, for example "did enrolment rise?" It does not prove the scheme caused the rise. Impact evaluation goes one step further and tests cause and effect.
  • Social audit: Here beneficiaries and the community check a programme's records and results, then discuss them at a public hearing. Examples are gram-sabha audits under MGNREGA s.17. It is a citizen check on honesty and delivery, not a study of cause and effect.

Read more