From mboxrd@z Thu Jan  1 00:00:00 1970
Message-ID: <087b06bcf86bfd29df76102d98e19b1f@coraid.com>
From: erik quanstrom <quanstro@coraid.com>
Date: Tue, 14 Aug 2007 09:16:45 -0400
To: 9fans@cse.psu.edu
Subject: Re: [9fans] FS to skip/put-together duplicate files
In-Reply-To: <bf64731d0708122032r15da2773w489891c0fdd68d9f@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset="US-ASCII"
Content-Transfer-Encoding: 7bit
Topicbox-Message-UUID: a8de7f82-ead2-11e9-9d60-3106f5b1d025

> how about mounting venti-backed fossil files from a linux as an AoE drives?
> vblade on sources exports the plan 9 file and the aoe driver for linux
> does the mounting.
> 
> Venti would be compressing and condensing duplicated blocks to a single block.
> I'm not sure if same files are boundaried in same manner to each other though.
> 

this is always cited as the "killer functionality" of venti.  essentially it trades cpu time
for disk space.  however, the couple of times where a concrete venti solution was
discussed (seperating attachments into seperate files, e.g. for de-duping), it was
deemed to be slower because attachments need to be split out to be recognized
as the same.  (9fans.net/archive/2005/10 and 9fans.net/archive/2005/11/1).

i wonder about this today with such large disks.

does anyone have an example of a case where compression and uniquing are required?

- erik