The following guest post is by Anna Powell-Smith from the Open Domesday project. Anna is a member of our brand new Working Group on Open Humanities.
Domesday Book might be one of the most famous government datasets ever created. Which makes it all the stranger that it’s not freely available online – at the National Archives, you have to pay £2 per page to download copies of the text.
Domesday is pretty much unique. It records the ownership of almost every acre of land in England in 1066 and 1086 – a feat not repeated in modern times. It records almost every household. It records the industrial resources of an entire nation, from castles to mills to oxen.
As an event, held in the traumatic aftermath of the Norman conquest, the Domesday inquest scarred itself deeply into the mindset of the nation – and one historian wrote that on his deathbed, William the Conqueror regretted the violence required to complete it. As a historical dataset, it is invaluable and fascinating.
In my spare time, I’ve been working on making Domesday Book available online at Open Domesday. In this, I’ve been greatly aided by the distinguished Domesday scholar Professor John Palmer, and his geocoded dataset of settlements and people in Domesday, created with AHRC funding in the 1990s.
I’m very happy to announce that we’re now able to make full-page, high-resolution images of the Domesday folios available under CC-BY-SA. You can browse or download the folios en masse at the Internet Archive (recommended), or page-by-page at Open Domesday.
I’ve also been working on a RESTful API to Domesday Book, to accompany the release of the folios. Our API supports geographic queries, and returns the economic and social statistics for each settlement in Domesday – from the number of households to (where listed) the number of pigs, sheep and oxen.
As an example, here is the folio entry for Marsh Gibbon in Buckinghamshire, still a thriving village today:
Domesday is not often descriptive, but this entry gives us a glimpse of the state of the English population. The entry tells us that Marsh Gibbon held 11 households, including 3 slaves, and it has woodland on which the locals paid a tax of 30 pigs. The owner in 1066 was one Aelric, and he still lives there “harshly and wretchedly”.
There are entries like this for nearly 15,000 places. We hope that this data release will lead to some interesting new applications (may a thousand iPad apps bloom) and research – like this population heatmap of Domesday England, created from Professor Palmer’s raw data by
Andrew Bevan at University College London:
To end on a downbeat note, it’s worrying that among historic texts, Domesday may become the exception, rather than the rule, by being available under an open licence. The only reason we are able to make the folios available at all is that Professor Palmer took his own images of the Ordnance Survey’s photozincographic copies some years ago, and has kindly agreed to release them for the benefit of others.
In particular, although the British Library has teamed up with Google to make thousands of historic texts available online, it seems the digitised copies will not be truly open, as Glyn Moody has warned.
But enough grumbling – I hope you enjoy the Domesday data. If nothing else, it’s something to show elderly relatives over Christmas! Please contact me with comments.
Sam is a data trainer and wrangler at Open Knowledge. He Tweets from @Noel_Mas
There are versions of the Domesday Book available on-line and free of charge. eg: Domesday Explorer (Palmer and Palmer) and this translation which allows you to search for specific Vills : Domesday – Prosopography of Anglo-Saxon England (2010) from http://domesday.pase.ac.uk/
@John: are these other versions such as the one you link to Open in the the sense of the Open Definition — that is allowing anyone the freedom to use, reuse and redistribute. It is frequent to see textual material that is publicly online for ‘free’ viewing but which is not open.
@John – is Domesday Explorer available online? I use the same raw data in my site, but I thought Domesday Explorer was only available as a CD-ROM.
The PASE site is important academic work, but it doesn’t (as far as I know) have folio images or map search, nor it is indexable for Google discoverability, or open for others to build on. I would controversially suggest it isn’t as easy to use as my site, either!
It certainly is unfortunate that the most famous government datasets ever created has not been made freely available. It’s great that you’re making it easier for everyone with the Open Domeday site. It makes for pretty interesting reading – the parts I can understand so far, anyway!