Open Knowledge Foundation Blog
Launch of Open Data Grid
May 13, 2009 in News, OKF, OKF Projects, Open Data, Technical
In the last couple of months we’ve had several threads on the okfn-discuss list about distributed storage for open data (see here and here).
Last month we started a distributed storage project, aiming to provide distributed storage infrastructure for OKF and other open knowledge projects.
After researching various technical options, we’ve launched an Open Data Grid based on Allmydata’s open-source “Tahoe” system at:
Anyone can store open data on the grid, or start running a storage node. For more details see the readme. If you’d like to comment on the service feel free to post on the okfn-discuss list!
Related posts:
- Storing and Visualizing Open Data The basic purpose of the Open Knowledge Foundation is to ‘promote open knowledge’. In particular we want to: Get data out there — that’s why we’re developing KnowledgeForge Make sure that data is open data (i.e. is properly licensed) —...
- Beta version of the Open Database Licence (ODbL) As we announced in January the OKF has adopted the Open Data Commons project. As part of the project Jordan Hatcher has been working on a new Open Database License (ODbL) – which went into beta at the end of...
- After the first Open Visualisation Workshop The first Open Visualisation Workshop took place on Saturday as we mentioned last week. Details, notes and links are available on the event’s wiki page. The event took place at Trampoline Systems’ new site in East London. To make sure...
admin
Rufus Pollock
jwalsh
ianibbo
jordanhatcher
Friedrich Lindenberg
Daniel Dietrich
Stefano Costa
James Gardner
beckyhogge
francis
davidjones
lisa
mhholloway
oovrebo
saul
Sara Wingate Gray
timcowlishaw
countculture
kathryncorrick
Guo
Jason Kitcat
Adrian Pohl
Mark MacGillivray
psychemedia
Nils Toedtmann
Stefan Wehrmeyer
theodora
Lucy Chambers
James Harriman-Smith
Hauke Gierow
wwaites
Kat Braybrooke
trio3o
Mark Brough
Robert Harm
Velichka Dimitrova
Laura Newman
ctagg said on May 13, 2009
Congrats on this Jonathan. Very timely and I like the distributed nature of it.
Mike said on May 14, 2009
What are some of the intended uses of this? Can files also be deleted/moved? Are there any security features? The ODG page doesn’t say much about this.
admin said on June 2, 2009
Its intended usage is as distributed storage for open (see http://opendefinition.org/) data and content. In particular, here at the Open Knowledge Foundation, we plan to use it to store datasets associated with packages on http://www.ckan.net/ and projects on http://knowledgeforge.net/
Yes files can be deleted and moved depending on their permissions (as encapsulated in the “capabilities” url — see the Tahoe documentation). Usually a file uploader will have full capabilities while others may just have read-only access. We want to to more work here to provide a better, more flexible, permissioning model, as well as a simple to use uploader front-end and we’d love to collaborate with others on this.
What kind of security features?
Tracey Lauriault said on July 3, 2009
Greetings;
I am excited about this but alas I have read the ‘readme’ text and I am unsure what to do. I do have ubuntu running but I am not sure how to follow your instructions. Can someone help?
Cheers t
admin said on July 6, 2009
Hi Tracey,
Thanks for the feedback: installing and setting up Tahoe isn’t as easy as it could be!
Anyway, we’d love to help: just get in touch at info@okfn.org.
In the mean time if you’re having trouble actually installing tahoe (as opposed to setting it up), the easiest way is to use the prebuilt ubuntu/debian packages as listed on http://allmydata.org/trac/tahoe/wiki/DownloadDebianPackages.