Here's how you can overcome challenges in evaluating the impact of social initiatives.

SMART or SPICED indicators aren't going to be useful everywhere, so don't default to that. However, your goals and objectives need to be clear, and shared by your team members, partners, communities, and others in your context, issue, or region. Your goal should contribute to sustainable change in the place you're working in, not just furthering your programmatic goals. Take an ecosystem - or Blue Marble - approach and look even beyond your project timeframe to help you define a valuable goal.

A coleta de dados de qualidade é fundamental para uma avaliação eficaz, especialmente em iniciativas de impacto social. Identificar fontes de dados relevantes e métodos eficientes de coleta garante que as informações obtidas sejam precisas e úteis. A combinação de dados quantitativos, como respostas a pesquisas e números de participação, com dados qualitativos, como histórias pessoais e depoimentos, oferece uma visão abrangente do impacto. Coletar dados em vários pontos ao longo do tempo é crucial para acompanhar as mudanças e avaliar o progresso. Essa abordagem holística e contínua na coleta de dados permite uma compreensão mais profunda e detalhada dos resultados, facilitando ajustes informados e melhorias nas iniciativas.

Co-design a data framework with principles and ethics to which everyone involved can hold each other accountable. Get experts to help you with this - from outside your organisation - so data collection helps you contribute to this big-picture goal. Reach out for any questions or tips on this too, btw!

It's important to make sure that data collection is not extractive. Oftentimes, the necessary data either already exists, or can be extrapolated with community input. We should only collect the information that we need to make a decision or understand impact, and avoid overburdening communities with survey after survey. One thing that I have found helpful is framing data as "information." Often, the word "data" implies a level of technical expertise that can be counterproductive. Organizations may shy away from evaluation because they "don't have the data" or don't want to collect it, when in reality, all of the necessary information already exists, and just needs to be reformatted and annotated.

What is very significant in evaluating Impact is that evaluator needs to transition the analysis role to respondents or communities who are the change agent. This shift is crucial. Otherwise, evaluator would just be cherry-picking the evidences and patterns to prove or disprove the existing worldview. Now, how to shift this is the question? 1. Your tool should seek information as well as potential analysis of information. 2. Your FGD should have space for sharing data captured- so that you get a glimpse of analysis from communities. 3. Use mapping tools. 4. Form Community panels to analyse information with liver exprience of change and struggle for change being criterion of expertise. 5. Provide space for multiple viewpoints.

The role of evaluator is very critical here in capturing the transition informed by the stakeholders . The mapping of outcome is very crucial in this process and followed by a structured journaling of the outcome stakeholder wise in a simple framework. The shift from quanti evidence to qualitative evidence generation and mapping it scientifically in a structured framework is very important for evaluation of program input leading to outcome and impact .

As Pradeep mentioned above - use a Participatory Action Research perspective for deeper engagement. Ensure plurality of thought across teams so you can question each other's biases and assumptions too. This will make the evaluation all the richer. At regular intervals, share draft versions of your work inviting feedback. Compensate people for doing so. Incorporate their thoughts into your work, and credit anyone who takes the time to share their expertise with you - by naming them in the final report. Keep communication open and invite critical feedback, because your research by default will have many biases, which a wide group of people can help you mitigate.

Utilizing mixed methods and participatory approaches as mentioned above can help with this, as you can trial multiple initiatives and collect feedback in real time. One thing to remain aware of as you iterate is the tendency to add (survey questions, data sources, etc.) to frameworks without subtracting what hasn't been as helpful.

One thing I find essential is deciding early on with stakeholders how they want the results of the evaluation shared. If you want true social impact, a 35 policy report in NGO jargon is not going to cut it. That's why you need to factor in action and dissemination planning into the project cycle.

Communicating your evaluation results effectively is crucial. Present your findings in a clear and accessible way for all stakeholders. This enhances transparency, builds trust, and ensures everyone learns from the evaluation. Whether the results are positive or suggest changes are needed, open communication is key to maximizing your impact

There are so many ways to measure success in social impact and understanding what your company culture values is an important part of measurement. In some environments, telling your story broadly, externally and cost efficiently is the win. In others, bringing everyone together to feel engaged and included in 1-2 thought leadership moments feels more impactful. Read your room and plan accordingly.