Back in August I attended a roundtable hosted by the Carnegie UK Trust and the Alliance for Useful Evidence (AFUE) in Glasgow about the extent to which we can discern a Scottish approach to evidence that would underpin the so-called Scottish approach to public policy. The findings from that event has now been put together in a helpful discussion paper by Pippa Coutts and Jenny Brotchie.
What Works Scotland (WWS) is a multi-disciplinary programme of work carried out by the Universities of Glasgow and Edinburgh, supported by its many partners and funded by ESRC and the Scottish Government. I am part of the WWS team. WWS is fundamentally concerned with the use of evidence to inform and support public service reform in Scotland and different dimensions of the Scottish approach to public policy, as exemplified by whole place based policies at community planning partnership levels (and also disaggregated down to local community or neighbourhood levels).
How might we characterise the Scottish approach to public policy? The discussion paper stresses the combination of the outcomes focus of the National Performance Framework estsblished in 2007, the impact of the Christie Commission and its emphasis on the four pillars of empowering people, shifting to preventative spend, promoting partnership and more efficient public services. The Scottish approach stresses integrated, joined up and cross–sectoral co-produced working. Subsequent developments have included espousing greater government openness, legislating on community empowerment and with further decentralising proposals proposed for the current parliamentary session. The discussion paper describes this approach as emergent and the summary states (p.2): ‘whilst we understand these intentions may not be matched in implementation, we think the Scottish approach offers exciting opportunities’.
The discussion paper goes on to argue that the system or modes of evidence required to support the Scottish approach is not yet in place. What is required is a system-wide production and use of mixed forms of evidence rather than concentrating on specific sectors or programmes. The paper argues that the evidence base for greater collaboration and co-production across the research producer and user community in Scotland needs to be strengthened and needs to better involve citizens in that process. At the same time, evidence, from whatever sources (quantitative or qualitative), should be rigorous and seek to minimise bias. The paper speculates that there are lessons and evidence from participatory research and directly from communities (e.g. undertaking participatory budgeting exercises or other forms of deliberative decision-taking) that could improve policy effectiveness.
What needs to happen? The road map suggested by the Carnegie UK Trust and the AFUE involves first, strengthening the national performance framework and promoting its use coherently at local level. Second, they contend that there should be investment in research on co-production. Third, high quality evidence should be embedded to support decision-makers at all levels. Fourth, there would be value in brokering and developing boundary-spanning relationships across professional, academic and third sector communities to enable them to better work together. Fifth, there is much to learn from outside of Scotland and also a duty to share the Scottish experience more widely.
The paper is an interesting read and one that cannot be adequately captured in a short blog post. Experience from What Works Scotland (see outputs on our website) leads me to make the following points. First, the game-changer for me is how to embed evidence systematically into working practice at local level in all localities. We know that presently there is considerable variety of experience, capacity, resource and use of evidence. At the same time, second, there is actually something of a crowded landscape of providers of profiles and indicators from national levels to the local and there is clearly much interest in how this could be better co-ordinated and more locally contextualised. Third, the Scottish approach is clearly evolving and parts of it have to be refreshed. The Scottish Government is currently consulting widely over the National Performance Framework including its local dimensions and we in WWS look forward to contributing to that process.
Finally, I strongly concur with one of the roundtable participants who stressed (p.13) the importance of learning from failed projects, from what does not work: ‘There’s also something for me about….it’s a kind of form of publication bias, because we only ever hear about the success stories….you don’t send ministers to visit the failed projects’. Indeed.