Enables the incorporation of findings into the decision making process.
Documents robust and credible evidence on performance and outcomes.
Provides comprehensive information on what works and what does not.
Evaluation is not a one time event, but is an ongoing process which helps decision makers better understand the project
Impact Evaluation is not only the work of the evaluator but every stakeholder should be involved in determining impact
Evaluation should not be viewed as an accountability measuring stick imposed on projects, but rather as a management and learning tool for projects
A monitoring & Evaluation system should encourage stakeholder feedback fuelling reflection and learning at regular intervals
A comprehensive methodology used in the philanthropy, not-for- profit and Government sector to promote social change. It is mapped in an ‘Outcome Framework’ which defines long-term goals for social change and then maps backward the activities that must be undertaken to achieve and sustain the desired change. A well-developed ToC ensures efficiency in planning, implementation and evaluation of development projects.
Social Return on InvestmentA principles-based methodology for measuring financial values i.e. environmental and social dimensions which are not reflected in conventional financial accounts. It is derived through an SROI ratio which analyses the value of the social and environmental benefits created as against the value of the economic investment. It incorporates social, environmental, economic and other values into the decision making process.
A rigorous evaluation based on secondary data, stakeholder consultations and field visits was conducted to make a reasonable inference on the programmatic impact of Samarthanam Trust’s work. Key programs include establishing Livelihood Resource Centres, Rehabilitation Centres, Social Enterprises and a Sports Association for the visually impaired. Main tasks included developing a Theory of change framework on an organisational level and testing hypotheses about the five key programs’ impact on a quantitative scoring scale.
CEval, Germany was undertaking a follow up study on assessing the impact of fair trade on poverty reduction through rural development in 2 states of India – Gujarat and West Bengal. 4th Wheel team served as local consultants to support research activities – developing contextualised tools, conducting Focus Group Discussions (FGDs) and expert interviews, and providing logistic support. The research support was substantiated with two reports on the impact outcomes achieved by fair trade certifications for cotton farmers in Gujarat and tea plantation workers in Bengal.
Through a human- centred design approach, M4ID has developed solutions for improving the ‘care journey’ for mothers of low-income communities. Service design outcomes include a set of recommendations and tools to improve provider-patient communication, understanding of the delivery process, as well as safety. In the pilot project, the innovations and tools are applied to two facilities: A local hospital and a community centre in Balasore district, Orissa. 4th Wheel is engaged with designing and implementing a Monitoring & Evaluation framework for the project based on the WHO framework for the quality of maternal and newborn health care.
NSDC partners with corporates and the National Skill Development Fund to provide skill training to youth candidates across India. 4th Wheel has developed Standard Operating Procedures (SOP) for some of these partnerships to monitor and evaluate progress and impact of the training programs. We conduct regular impact evaluations and documentation which is an integral part of these programs.
Fifth Estate works on a collaborative social development model with the Government of Uttar Pradesh. Fifth Estate has been able to garner monetary and administrative support to 20 social enterprises through its model. 4th Wheel is assessing the impact created by Fifth Estate on a policy as well as beneﬁciary level, basing the research on secondary literature, qualitative interviews and a quantitative feedback survey.
The After School Life Skills Program (ASLSP) was conceptualised in 2002 by Dream A Dream. ASLSP uses the medium of sports and arts to engage and develop critical life skills. The purpose of the retrospective evaluation is to find out if and how the ASLSP has developed the knowledge, skills and attitudes for young people between the ages 20 - 22 to have a significant impact on life outcomes. A quasi-experimental study was initiated to measure the life outcomes of participants on the basis of the World Health Organisation Quality of Life assessment (WHOQOL) tool and scores on the Prepared For Life (PFL) scale.
EmPower Foundation is funding a program on non-traditional livelihoods for women in the urban slums of Ahmedabad. Saath, the implementing agency, is undertaking training programs on micro-entrepreneurship and non-traditional trades for 500 adolescents and women. 4th Wheel has undertaken data collection for the baseline, midline and endline through SurveyCTO and has devised an impact index for the project to measure different indicators like the increase in knowledge, impact on livelihood options, market linkages, changes in income levels of the participants among others.
4th Wheel conducted an SROI for Adani Foundation’s Education programs in Mundra, Gujarat. By monetizing these indicators, ﬁnancial equivalents to social and environmental returns were created. The study undertook behavioral experiments with stakeholders including principals, teachers, parents, students, SMC, local implementing team and community leaders. This resulted in a ﬁnancial representation of the value created by Adani Foundation’s efforts. It showcased tangible and measurable results achieved by the organisation and contributed to strengthening old programs and devising future initiatives.
Orion Edutech along with corporate support has set up Kaushal Vikas Kendras One year retainer for impact assessment, communication and documentation for Orion Projects for 2017-18. 4th Wheel develops extensive monitoring and evaluation frameworks which works towards assessing the impact that Orion has created through their projects. Based on the framework indicators are developed and regular monitoring of the data points is undertaken by the local on field teams. 4th Wheel also works on equiping the field team with the right knowledge and training of such frameworks. Regular monitoring of data leads to a more extensive eveluation report which can be shared with varied stakeholders.
Learning Delight (LD) is an ICT software designed to make learning interactive, easy and effective. Reach of the software extends to over 700 schools in Gujarat. It is mainly used in Government schools and supported by Corporates to enhance learning in classroom teaching.A pre-post evaluation was conducted by 4th Wheel to test knowledge levels of the students and the expectations of the students, teachers and principles from the usage of Learning Delight.
4WSI supported Quest Alliance in creating a consistent, transparent and context sensitive Monitoring & Evaluation (M&E) framework for their ‘MasterCoach’ program – a blended learning model to build 21st century skills among trainers and teachers across the country. The conceptualization of the framework followed a participatory process, involving crucial stakeholders to draft and verify a Theory of Change for the program. The final deliverable was a detailed M&E plan and toolkit, which includes key outcomes and indicators, tools and instruments, and roles and responsibilities. This enabled Quest Alliance to roll out a consistent M&E system for their Train the Trainer programme to assess short, medium and long-termoutcomes. Further handholding support has been provided during the implementation phase.