Re: [9fans] FS to skip/put-together duplicate files

[erik quanstrom <quanstro@coraid.com>]

> how about mounting venti-backed fossil files from a linux as an AoE drives?
> vblade on sources exports the plan 9 file and the aoe driver for linux
> does the mounting.
> 
> Venti would be compressing and condensing duplicated blocks to a single block.
> I'm not sure if same files are boundaried in same manner to each other though.
> 

this is always cited as the "killer functionality" of venti.  essentially it trades cpu time
for disk space.  however, the couple of times where a concrete venti solution was
discussed (seperating attachments into seperate files, e.g. for de-duping), it was
deemed to be slower because attachments need to be split out to be recognized
as the same.  (9fans.net/archive/2005/10 and 9fans.net/archive/2005/11/1).

i wonder about this today with such large disks.

does anyone have an example of a case where compression and uniquing are required?

- erik