Testing the strength of evidence (TestE)
Testing the Strength of Evidence for Outcome and Impact
HR&S has developed a practical strategy for assessing if outcome and impact have been reached. The strategy is based on evidence and is called; TestE (Testing the strength of Evidence).
We aim for scientifically sound evidence and to benefit from a control, randomization, quantitative statistics, qualitative probability assessment, and contribution tracing.
We compile evidence for each expected outcome and each expected impact. The strongest cases use multiple forms of evidence, some addressing the weaknesses of others. Reported effects should be plausible as outcomes of the programme activities and consistent with the strategy for change and the observations compiled as evidence should be easier to reconcile with the programme’s claims than with other possible explanations.
It is of no importance whether an outcome was achieved or not, this is plain testing of evidence with no bias. Lessons learned on lack of outcome is as important.
Monitoring data shall eventually be uploaded real-time on RISEsupport.se, a designated IT platform accessible through computers, tablets, and cell phones. We offer RISEsupport.se to our partners thus enabling efficient communication around tools, strategies, and results.
Change & Sustainability
The key aspects of our surveys are change and sustainability.
Concerning change we measure two aspects; i) contribution tracing; is it our programme that causes the change, and ii) outcome; do we reach Outcome? The measurement of change needs a reference. The contribution tracing measures against a control, the control can be a randomized population that did not take part in the programme.
Measurement of change can also benefit from the macro survey, how is the situation elsewhere at large, in the region, in the country, in the world? The outcome measures against the base-line, thus the situation within the population prior to the initiation of the programme.
Outcome benefits from progress markers that are identified during the planning stage of a new programme.
Concerning sustainability, we also measure two aspects; i) institutional capacity and ii) financial balance. Institutional capacity is a wide concept that covers all aspects of the programme management’s ability to maintain the programme. Financial balance measures whether the income from the programme, without donations, are more than the costs. Sustainability is with the ROPE terminology referred to as the impact.