Launch of Open Data Grid

May 13th, 2009

storage facility 37 by sevensixfive

In the last couple of months we’ve had several threads on the okfn-discuss list about distributed storage for open data (see here and here).

Last month we started a distributed storage project, aiming to provide distributed storage infrastructure for OKF and other open knowledge projects.

After researching various technical options, we’ve launched an Open Data Grid based on Allmydata’s open-source “Tahoe” system at:

Anyone can store open data on the grid, or start running a storage node. For more details see the readme. If you’d like to comment on the service feel free to post on the okfn-discuss list!

Related posts:

  1. Warwickshire County Council launch new open data site! Warwickshire County Council pinged us ea
  2. Launch of it.ckan.net for open data in Italy! The following guest post is by Stefano C
  3. Launch of Norwegian instance of CKAN! The following guest post is from Olav An
  4. Launch of the Panton Principles for Open Data in Science and ‘Is It Open Data?’ Web Service We are pleased to announce the Panton Pr
  5. Open Knowledge Foundation Newsletter No. 11 Open Knowledge Foundation Newsletter No.

Related posts brought to you by Yet Another Related Posts Plugin.

6 Responses to “Launch of Open Data Grid”

  1. ctagg Says:

    Congrats on this Jonathan. Very timely and I like the distributed nature of it.

  2. Mike Says:

    What are some of the intended uses of this? Can files also be deleted/moved? Are there any security features? The ODG page doesn’t say much about this.

  3. Rufus Pollock Says:

    What are some of the intended uses of this?

    Its intended usage is as distributed storage for open (see http://opendefinition.org/) data and content. In particular, here at the Open Knowledge Foundation, we plan to use it to store datasets associated with packages on http://www.ckan.net/ and projects on http://knowledgeforge.net/

    Can files also be deleted/moved?

    Yes files can be deleted and moved depending on their permissions (as encapsulated in the “capabilities” url — see the Tahoe documentation). Usually a file uploader will have full capabilities while others may just have read-only access. We want to to more work here to provide a better, more flexible, permissioning model, as well as a simple to use uploader front-end and we’d love to collaborate with others on this.

    Are there any security features? The ODG page doesn’t say much about this.

    What kind of security features?

  4. Open Knowledge Foundation Blog » Blog Archive » Open Knowledge Foundation Newsletter No. 11 Says:

    [...] Launch of Open Data Grid [...]

  5. Tracey Lauriault Says:

    Greetings;

    I am excited about this but alas I have read the ‘readme’ text and I am unsure what to do. I do have ubuntu running but I am not sure how to follow your instructions. Can someone help?

    Cheers t

  6. Rufus Pollock Says:

    Hi Tracey,

    Thanks for the feedback: installing and setting up Tahoe isn’t as easy as it could be!

    Anyway, we’d love to help: just get in touch at info@okfn.org.

    In the mean time if you’re having trouble actually installing tahoe (as opposed to setting it up), the easiest way is to use the prebuilt ubuntu/debian packages as listed on http://allmydata.org/trac/tahoe/wiki/DownloadDebianPackages.

Leave a Reply

Subscribe without commenting