What do you get when you mix cuts, demands for evidence and charities? Answer: confusion.
In their desperate search for ways to demonstrate their worth to statutory funders, many charities have fixated on the latest craze in the world of measurement, Social Return on Investment (SROI). And with their coffers empty, they are asking their independent funders (trusts and foundations) to foot the bill. But should they?
Back in May NPC published a position paper on Social Return on Investment (SROI), in part to try to clear up some of the confusion around what SROI is and who it works for best. The paper was aimed at charities that were considering embarking on what is often a time-consuming, expensive but potentially highly rewarding process. Last week we published the sequel—SROI for funders. This paper looks at SROI from the perspective of a funder wondering whether or not to fund its grantees to undertake SROIs.
The core message of both papers is the same: charities that are best suited to SROI are those with good measurement systems and outcomes that are straightforward to express in financial terms.
But for funders there are additional things to consider. Often, funders want to be able to look across their grantees to see what is being achieved for their whole portfolio or compare organisations. But I have never seen an SROI that was accurate enough to be able to say ‘Organisation A has an SROI ratio of 2.8 and organisation B has an SROI ratio of 3.5, therefore organisation B is more effective’. If this is what funders are after, SROI is not the answer.
Funders that want to compare interventions and share lessons between their grantees are probably better off encouraging more collaborative approaches to measuring results among the charities they support. NPC believes that collective measurement approaches are the best way of improving levels of measurement in the charity sector. You can read more here about one such project we are doing with charities working to improve ties between prisoners and their families.
What has surprised me over the last year is that the rising popularity of SROI amongst charities has not been met by a similar interest by funders. In fact, I haven’t spoken to more than two or three funders that are actively interested in this approach. If you are a funder and have funded grantees to perform SROIs or are thinking about doing so, I would love to hear your views.
Many years ago the Aspen Institute took a position (email if you want details of the paper), that it was the funder’s responsibilities to finance performance standards to help the world identify better ways of operating rather than focusing purely on project-related work. Granted, this pertained largely to health and International Development – but they were on to something.
If charities don’t know what drives impact, than how do funders? Isn’t that a slightly worrisome question? Granted I personally don’t think that SROI is the ‘tool’ to benchmark the whole sector’s performance as too often people misunderstand what it is trying to say and so its merits get lost in translation.
However implementing something like SROI is effective and worth investing in for funders when its combined with solid capacity building (see the Samaritans Inn example in http://www.vppartners.org/learning/reports/capacity/assessment.pdf or Community Vocational Enterprise (CVE) in ‘REDF’s “Stepping Out of the Maze” Series: SROI Act II: A Call to Action for Next Generation SROI’).
The problems is that too much emphasis is put on the end result or the quantified measures and not what is learned in the process and how best to leverage that learning. More importantly, I believe that there is limited value focusing purely on impact. Performance frameworks should be about A) ensuring the charity is achieve its full remit of objectives (strategically, operationally, etc as one hopes they are aiming for impact) and B) that funders hopefully bought into these when deciding to support the work in the first place. The outcome (put intended) of both is that maximum impact is achieved.
Finally, if there was not value in implementing such measurement approaches for funders – why would Acumen, Rockefeller et al fund IRIS for example? Again perhaps the problem is SROI or how funders think its supposed to work? Funders know charities struggle with core costs. In my opinion, if they want to identify best practice and thereby improve their own impacts – its going to have to be up to them facilitate the sector to put measures into place to capture them.