Launch of Open Data Grid

May 13, 2009 in News, OKF, OKF Projects, Open Data, Technical

storage facility 37 by sevensixfive

In the last couple of months we’ve had several threads on the okfn-discuss list about distributed storage for open data (see here and here).

Last month we started a distributed storage project, aiming to provide distributed storage infrastructure for OKF and other open knowledge projects.

After researching various technical options, we’ve launched an Open Data Grid based on Allmydata’s open-source “Tahoe” system at:

Anyone can store open data on the grid, or start running a storage node. For more details see the readme. If you’d like to comment on the service feel free to post on the okfn-discuss list!

Related posts:

  1. Storing and Visualizing Open Data The basic purpose of the Open Knowledge Foundation is to ‘promote open knowledge’. In particular we want to: Get data out there — that’s why we’re developing KnowledgeForge Make sure that data is open data (i.e. is properly licensed) —...
  2. Beta version of the Open Database Licence (ODbL) As we announced in January the OKF has adopted the Open Data Commons project. As part of the project Jordan Hatcher has been working on a new Open Database License (ODbL) – which went into beta at the end of...
  3. After the first Open Visualisation Workshop The first Open Visualisation Workshop took place on Saturday as we mentioned last week. Details, notes and links are available on the event’s wiki page. The event took place at Trampoline Systems’ new site in East London. To make sure...

5 responses to Launch of Open Data Grid

  1. Congrats on this Jonathan. Very timely and I like the distributed nature of it.

  2. Mike said on May 14, 2009

    What are some of the intended uses of this? Can files also be deleted/moved? Are there any security features? The ODG page doesn’t say much about this.

  3. What are some of the intended uses of this?

    Its intended usage is as distributed storage for open (see http://opendefinition.org/) data and content. In particular, here at the Open Knowledge Foundation, we plan to use it to store datasets associated with packages on http://www.ckan.net/ and projects on http://knowledgeforge.net/

    Can files also be deleted/moved?

    Yes files can be deleted and moved depending on their permissions (as encapsulated in the “capabilities” url — see the Tahoe documentation). Usually a file uploader will have full capabilities while others may just have read-only access. We want to to more work here to provide a better, more flexible, permissioning model, as well as a simple to use uploader front-end and we’d love to collaborate with others on this.

    Are there any security features? The ODG page doesn’t say much about this.

    What kind of security features?

  4. Greetings;

    I am excited about this but alas I have read the ‘readme’ text and I am unsure what to do. I do have ubuntu running but I am not sure how to follow your instructions. Can someone help?

    Cheers t

  5. Hi Tracey,

    Thanks for the feedback: installing and setting up Tahoe isn’t as easy as it could be!

    Anyway, we’d love to help: just get in touch at info@okfn.org.

    In the mean time if you’re having trouble actually installing tahoe (as opposed to setting it up), the easiest way is to use the prebuilt ubuntu/debian packages as listed on http://allmydata.org/trac/tahoe/wiki/DownloadDebianPackages.

Leave a reply

Your email address will not be published. Required fields are marked *


*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>