9fans - fans of the OS Plan 9 from Bell Labs
 help / color / mirror / Atom feed
From: "Richard Bilson" <rcbilson@gmail.com>
To: "Fans of the OS Plan 9 from Bell Labs" <9fans@cse.psu.edu>
Subject: Re: [9fans] plan9.bell-labs.com
Date: Fri, 21 Sep 2007 10:18:25 -0400	[thread overview]
Message-ID: <676c3c4f0709210718v59962c8cyac3796a35ac04a1d@mail.gmail.com> (raw)
In-Reply-To: <3e1162e60709210655t14235d6cn9c4d379deb6c1b77@mail.gmail.com>

> Venti arenas stored on S3, with locally hosted indexes?

You can't just throw a whole arena into an S3 file, since the S3 API
doesn't support seeking within files.

On the other hand, an S3 bucket is essentially a big hash table, and
so is venti. So I opted for the simple approach of storing the blocks
themselves in S3. Given that, a local index doesn't help much. A local
bloom filter probably would help, but for now my server is stateless
(aside from cache).

Right now the server supports the basic venti api, but it falls over
if anything goes wrong on the connection. Once I make it more robust,
I'll put it in contrib for interested parties.


  parent reply	other threads:[~2007-09-21 14:18 UTC|newest]

Thread overview: 14+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2007-09-20 18:02 Iruata Souza
2007-09-20 18:54 ` geoff
2007-09-20 21:34   ` David Leimbach
2007-09-20 22:40     ` Richard Bilson
2007-09-21 13:55       ` David Leimbach
2007-09-21 14:18         ` Eric Van Hensbergen
2007-09-21 14:18         ` Richard Bilson [this message]
2007-09-21 14:41           ` David Leimbach
2007-09-23 18:41             ` Uriel
2007-09-23 19:48               ` geoff
2007-09-20 21:46   ` Iruata Souza
2007-09-20 23:58     ` geoff
2007-09-21  0:05       ` Iruata Souza
  -- strict thread matches above, loose matches on Subject: below --
2003-11-16  3:55 David Presotto

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=676c3c4f0709210718v59962c8cyac3796a35ac04a1d@mail.gmail.com \
    --to=rcbilson@gmail.com \
    --cc=9fans@cse.psu.edu \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).