My latest policy paper for Common Weal – Scotland’s Data Desert – has just been published and can be read here or by clicking the image below. There has also been coverage of the report in The National here and here.

As a region of the UK, Scotland is in many ways better served by data gathering and analysis than its counterparts. However, as Scotland takes greater control over domestic issues and as the constitutional debate continues to look towards a future in which Scotland takes full responsibility for its own affairs the question is raised as to whether even this level of data provision is adequate for current or future needs – especially in a world where data becomes ever more vital in the development and support of policy. Well served though Scotland may be as a region, as a country it remains a relative “data desert” compared to nearby independent countries.

Many times we’ve watched as politicians and activists have misused data in the public sphere. Sometimes this manifests as a simple misunderstanding of what the data actually says (As when people ask how much of Scotland’s trade leaves the UK via “English ports”). Sometimes though, it’ll be used to make a political point in ways that the data doesn’t really support (such as discussions which use GERS to project beyond what it actually says on Scotland’s finances). There have also been instances of policies being implemented on the basis of limited evidence or of policies being implemented and then left to run without any program in place to monitor their effectiveness.

My latest policy paper for Common Weal is the culmination of over a year of research into the gaps and limitations of data provision in Scotland and discussion with people within the data sectors and civil service in Scotland and the UK. As a political lobbying and research organisation, we are – like many others – dependent on access to data to be able to inform our work and many times we have hit barriers where key data couldn’t be released or simply did not exist.

A Scottish Statistics Agency could help address many of these issues by expanding, co-ordinating and codifying data gathering within Scotland.

An independent Scotland will certainly need its own data and statistics agency but this isn’t just an independence issue as it could be done right now in a devolved Scotland and there are compelling reasons to do so. As said, Scotland already goes above and beyond the UK’s data gathering in many areas but there is certainly room to grow further.

The SSA could well take the form of a monolithic, centralised agency – a bit like the UK’s ONS – in which most or all policy level data is gathered by or for them. It could equally take the form of a more decentralised system whereby a central body co-ordinates and issues targets and directives but the actual gathering could be done by specialised bodies, statisticians embedded within government departments and even by academics and think-tanks. If this model was employed then a system of “kitemarks” could be used to mark data which meets the stringent Code of Practice which would identify data as being good enough for policy-making.

This kitemark system is already used by the UK Statistics Agency (the governing body which regulates the ONS) but could be used to either reflect a Scotland which applies even higher standards than the UK or could be expanded to identify data from outside of government (such as academics and think tanks) which meet those standards. This could allow for greater prespectives to influence government but could also limit the misuse of data by third parties by setting a benchmark to meet.

Of course, this isn’t just a problem of gathering data. As said above, often the data is gathered but difficult to find, difficult to manipulate or cannot be easily combined with other data due to conflicts in their methodologies. Where data can be combined, it has been a reported problem that different groups may be doing the same processing independently. This increases the chance of errors creeping in and also, crucially, results in a lot of time wasted between those groups.

An SSA could therefore be charged with ensuring that policy data meets high standards of trust, transparency, usability and consistency. It could also be responsible for maintaining a central data portal – much like Eurostat or the Gapminder Project – which would allow access to as much data as possible but can do it in a way which makes that data easy to view whether the viewer is an interested member of the public or an expert researcher.

People will, of course, ask how much an SSA would cost and, in truth, the answer is difficult unless we know the precise model – it’s harder to count the budget of a decentralised model than a centralised one – but where Scotland’s proportional share of the UK’s spend on statistics may be around £15 million, other nearby countries like Denmark and Sweden spend several times this figure and create several hundred highly skilled jobs in the process. Even these sums are comparatively small in terms of national budgets but will surely pay for themselves in terms of better targeted, better monitored and, quite simply, better policies.

Common Weal’s ability to do research of this kind is entirely reliant on the generosity of our donors and supporters, both one-off and regular. If you would like to contribute, please visit our website at: allofusfirst.org/donate/