Support Us

Opening Public Data in South Africa

Cape Town City Hall, Felix Gottwald

It seems somewhat absurd to me that publicly funded institutions in South Africa should be allowed to copyright data produced using public funds. Of course, it is reasonable to expect that physical assets such as buildings, vehicles or machinery should appear on their balance sheets and be reserved for their exclusive use. But knowledge? I’m not so sure. Assuming that the information in question cannot reasonably be considered a state secret, the revelation of which would harm national interests, I would expect that it cannot be owned or its use restricted to taxpayers.

Here’s an recent example:

municipal demarcation board The Municipal Demarcation Board is an independent organisation tasked by government with determining the borders between municipalities in South Africa. They are publicly funded, having received R38.5m ($4.3m) last year from the national treasury. Boundaries are published in the government gazette and are considered to be public knowledge. I am not a lawyer, but intuitively, this data cannot be considered to enjoy protection of copyright laws.

In order to clarify the situation, I contacted them and asked whether, as a citizen of South Africa, I was allowed to download the data from their site and use it for commercial purposes. The response that I received was:

“Unfortunately there is a lot of commitment to our data and it is copyright to us and we cannot allow you to use it commercially at all.”

As an exercise, I surveyed copyrights on the websites of 4 national agencies, including the national statistics agency and the electoral commission, as well as the websites of all 9 provinces and the 8 metropolitan municipalities. In some cases, licensing was unclear or missing. In the remaining cases, copyright was claimed and commercial use excluded, even for derived data products. This is stats sa reminiscent of the GPL licence but in reverse (all derived products should be restricted under the same rules). Most licences allowed for personal use and for reference purposes while some granted re-distribution rights (to third-parties for personal use or reference purposes).

It is of course possible that these copyrights have been applied as boilerplate by over-zealous lawyers, but our one data point – the response of the Municipal Demarcation Board – suggests that this is not the case.

As an exercise, I emailed each of these agencies requesting special permission for commercial rights (commercial is important here – in lieu of an actual open data policy, commercial rights give me the broadest possible scope for data use that I can hope for). I am eagerly awaiting their responses. You can follow the action on this spreadsheet as I update their policies as the replies come in.

Taking a step back, we should understand why this is important and not just a bunch of navel gazing. After all, we have a few really fantastic datasets “freely” available (free as in beer). The elections datasets (e.g. here and here) are unprecedented in their depth and detail. The City of Cape Town manages a very rich dataset on municipal valuations, and the national parliament hosts an intriguing database on gifts received by parliamentarians and other elected officials. However, aside from the fact that most of our data is not in machine-readable format (easily solved by web-scraping although this technology is itself encumbered by sticky legal questions), we are explicitly excluded from using this data for anything but personal use.

Open data has not yet percolated into the collective national consciousness. Some momentum has started to build through a number of niche groups of individuals seduced by the goings-on up north and even on the African continent. For this small sign of life to grow into a fully-fledged ecosystem of data consumers and producers, we need greater access to data under the stewardship of public entities. We need to be able to access that data for personal and for commercial use. We need to be able to download it and distribute derived products. And we should not have to ask for permission every time we do so.

Our post-apartheid constitution guarantees the right to access of information. It’s time that citizens of South Africa asserted that right.

  • http://rufuspollock.org/ Rufus Pollock

    Great post Adi. Some of this reminded of the challenges getting open data out of government in the UK especially prior to the commitment to open data in recent years. For example, I wrote back in 2008 about the the tortuous (and disappointing) experience trying to get access to transport data: http://blog.okfn.org/2008/02/18/a-traffic-data-odyssey/

    However, the main point I wanted to make though is that I’m not sure the problem is that government has copyright in data. Rather, the problem is the government not making the data open by applying a suitable open license. For example, in the UK the government have not waived their copyright (or more specifically their database rights) in the data but have instead taken steps to make the data open by applying a suitable open data license.

    This distinction can be important, because, for example the government may not wish to waive all copyright (because e.g. they wish to require attribution or some explicit crediting of the source) but they can still apply an open license.

    • http://twitter.com/SoapSudTycoon Adi Eyal

      You’ve left me in suspense with your blog post. Did you ever get the data licensed under an open licence in the end?

      • http://rufuspollock.org/ Rufus Pollock

        Sadly not: they refused to do give it out!

  • http://twitter.com/SoapSudTycoon Adi Eyal

    Thanks Rufus. I completely agree with your comment. Copyright is not the problem but rather the lack of a clear open data license. I should have been clear about that in the post. Having said that, I think we are some way off from having an official open data policy. This post and other conversations will hopefully raise the profile of the issue and hopefully it will reach decision makers’ ears.

    For now, I would be happy to be granted commercial rights to government data simply to set a precedent. I’m happy for some rights to be reserved (e.g. attribution rights) as long as I can produce derived products and distribute them for commercial gain.

  • http://knoema.com Vladimir Bougay

    You should check http://southafrica.opendataforafrica.org just recently released by African Development Bank

    • http://rufuspollock.org/ Rufus Pollock

      Or http://africaopendata.org/ – but the issue Adi is raising remains. Those data portals can only host data, they can’t necessarily make it open …

      • http://knoema.com Vladimir Bougay

        I would be surprised to see anything more open than Open Data for Africa. Their license is crystal clear: “Users are free to copy, distribute, disseminate or include the data in other products for commercial and/or noncommercial purposes at no cost subject to conditions below. This includes the use of the data on a user’s website and/or on any other applications.

        • http://twitter.com/SoapSudTycoon Adi Eyal

          Vladimir, you’re right. The AfDB data portal has a very liberal licence. That’s a good start but from what I see, the data hosted there is only the result of their own research.

          This portal can (and will) be used as an example of important African organisations embracing open data. We still need to convince other institutions to do the same but it is definitely a step in the right direction.

      • http://knoema.com Vladimir Bougay

        You can browse data, download it and even access via API at no cost for both commercial/non commercial use

  • Pingback: the onyx razor » Blog Archive » Opening Public Data in South Africa | Open Knowledge Foundation …

  • Joymae Asebmem

    To view latest job posting in South Africa you check out this link. http://www.joblife.co.za/jobs/it.html

  • Andrew_Rens

    A new development is that the Draft Intellectual Property Policy speaks about a need for government to control its intellectual property. There is a call for public submissions on the policy http://www.thedti.gov.za/invitations/36816_4-9_TradeIndustry.pdf. Its vital that open government advocates data get the policy to acknowledge that data should generally be open.

Get Updates