From mboxrd@z Thu Jan 1 00:00:00 1970 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on inbox.vuxu.org X-Spam-Level: * X-Spam-Status: No, score=1.0 required=5.0 tests=DKIM_SIGNED,DKIM_VALID, MAILING_LIST_MULTI,PDS_OTHER_BAD_TLD,RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H4,RCVD_IN_MSPIKE_WL autolearn=no autolearn_force=no version=3.4.4 Received: (qmail 3341 invoked from network); 29 Dec 2020 13:07:32 -0000 Received: from tb-ob1.topicbox.com (64.147.108.173) by inbox.vuxu.org with ESMTPUTF8; 29 Dec 2020 13:07:32 -0000 Received: from tb-mx1.topicbox.com (tb-mx1.nyi.icgroup.com [10.90.30.61]) by tb-ob1.topicbox.com (Postfix) with ESMTP id B3FE21C78D for ; Tue, 29 Dec 2020 08:07:26 -0500 (EST) (envelope-from bounce.mMd9c09155880fcdeb3dc85cfc.r522be890-2105-11eb-b15e-8d699134e1fa@9fans.bounce.topicbox.com) Received: by tb-mx1.topicbox.com (Postfix, from userid 1132) id 9C25BF7F651; Tue, 29 Dec 2020 08:07:26 -0500 (EST) ARC-Authentication-Results: i=2; topicbox.com; arc=pass; dkim=none (no signatures found); dmarc=pass policy.published-domain-policy=none policy.applied-disposition=none policy.evaluated-disposition=none (p=none,d=none,d.eval=none) policy.policy-from=p header.from=musolino.id.au; spf=pass smtp.mailfrom=alex@musolino.id.au smtp.helo=vultr.musolino.id.au; x-internal-arc=fail (as.1.topicbox.com=pass, ams.1.topicbox.com=fail (message has been altered)) (Message modified while forwarding at Topicbox) ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d= topicbox.com; h=message-id:to:subject:from:date:in-reply-to :mime-version:content-type:content-transfer-encoding:list-help :list-id:list-post:list-subscribe:reply-to:list-unsubscribe; s= sysmsg-1; t=1609247246; bh=+kbwCQSX5kl6/5FgaugTIB0vBq4xvVY5Q+mxD o3IImw=; b=jpMta1aoRtcYapZAnlEUK5YWmD/O68ae6Zbq40620sWo/f73AthW+ mi8JWI8687uGwsdsi2EUWV6olZNKv0X/QkJLC/XlI7Iz2q+6Kj0FEK+gIFKh2mpA 7lUieUwBkX3x5zACDon1fo22XnkNAKWVx2ph+kNm5wh1UdKTRorxpo= ARC-Seal: i=2; a=rsa-sha256; cv=pass; d=topicbox.com; s=sysmsg-1; t= 1609247246; b=l3nxIQNNjLylyj9+g4rRrL06WU7iQ/NSjirpuXsLEenWSZc4Pl JZRSLjsx/2Zxh40YQY00HY0zzLJlG1PeiMQlUFSGmRqwvpHWY2hLjs2jeOLkgssM oCQTfWHaHyM9De7JZEZ4j5v0uJMXPewTjCFpm1SjQVIeyhrdQH9Lf982w= Authentication-Results: topicbox.com; arc=pass; dkim=none (no signatures found); dmarc=pass policy.published-domain-policy=none policy.applied-disposition=none policy.evaluated-disposition=none (p=none,d=none,d.eval=none) policy.policy-from=p header.from=musolino.id.au; spf=pass smtp.mailfrom=alex@musolino.id.au smtp.helo=vultr.musolino.id.au; x-internal-arc=fail (as.1.topicbox.com=pass, ams.1.topicbox.com=fail (message has been altered)) (Message modified while forwarding at Topicbox) X-Received-Authentication-Results: tb-mx1.topicbox.com; arc=none (no signatures found); bimi=none (Domain is not BIMI enabled); dkim=none (no signatures found); dmarc=pass policy.published-domain-policy=none policy.applied-disposition=none policy.evaluated-disposition=none (p=none,d=none,d.eval=none) policy.policy-from=p header.from=musolino.id.au; iprev=pass smtp.remote-ip=45.76.123.158 (vultr.musolino.id.au); spf=pass smtp.mailfrom=alex@musolino.id.au smtp.helo=vultr.musolino.id.au; x-aligned-from=pass (Address match); x-ptr=pass smtp.helo=vultr.musolino.id.au policy.ptr=vultr.musolino.id.au; x-return-mx=pass header.domain=musolino.id.au policy.is_org=yes (MX Records found: musolino.id.au); x-return-mx=pass smtp.domain=musolino.id.au policy.is_org=yes (MX Records found: musolino.id.au); x-vs=clean score=35 state=0 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed; d=9fans.net; h=message-id :to:subject:from:date:in-reply-to:mime-version:content-type :content-transfer-encoding:list-help:list-id:list-post :list-subscribe:reply-to:list-unsubscribe; s=dkim-1; bh=MjUs4u5r HrHhmfdFMLtSCBf0s974yZLBQ4QoXq/nLFs=; b=kMR0w4rFbE0i4+VyNbr7L2QD VvaCw70nfLbInv/oaCHoPXaXFTJCGPZPjrHZDwYvyk9E2Jdq3Y9n0RT/pu+CuoHd k6TfgRL6KBs1+oP8eVadTbY3xaH03CDD35tHqxVx/e/iIHfWf6lQWrwKsewPo2aV 2BtL3mBqu9kkegnD0/k= Received: from tb-mx1.topicbox.com (localhost.local [127.0.0.1]) by tb-mx1.topicbox.com (Postfix) with ESMTP id 3634AF7F295 for <9fans@9fans.net>; Tue, 29 Dec 2020 08:07:07 -0500 (EST) (envelope-from alex@musolino.id.au) Received: from tb-mx1.topicbox.com (localhost [127.0.0.1]) by tb-mx1.topicbox.com (Authentication Milter) with ESMTP id C540117704A; Tue, 29 Dec 2020 08:07:07 -0500 ARC-Seal: i=1; a=rsa-sha256; cv=none; d=topicbox.com; s=arcseal; t= 1609247227; b=BTRZNEvyUuz/SHYcwyGfuvERuo5c+Kcg0npBXp+PEpSRVhhN0K RmITr/lrJNslFp0bp0/TN4zpUWcxL/LcgkL++536GbbBnYlAP+1sZqPYr5FhtgT9 AA8QPmcB1uujhW4/AkB8hbvLB4HI+zcW6JE5T1luyx8id7ie68+G6rUxPY00C5yW 8x6cCeiQQHagP0ITPqfRd4Icq5MtgqNKGaFGARSKQoZ0EGiQYh6xNIagig7fJ/Tq 69xtTanQUJN1OQ4IMpBJbNyxsEjOPRzPR5g+MSeJDelU+vROd1cqQjp/VJXYR1R7 HxKaUMjkK+GHq8kw7WX2wsxb7LdIHIWWwCHg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d= topicbox.com; h=message-id:to:subject:from:date:in-reply-to :mime-version:content-type:content-transfer-encoding; s=arcseal; t=1609247227; bh=uayCZfJ54xipezlo1KJoKyjp9qACGvlhCxAH36fSQbc=; b= XC4JPqp6+gFjgGEgxVysp3yexDLtJoqv5SlVgNmq7hlTIQ6YFo8guzd6PIC9VhUC V7stpyyGhQNzMzNVoUrYLVxbc+GlmgXBD0BekCHo6I8236u+B/jhpo2RdlCldwEJ KxxtM4ATez0CLA0GHiEqLB3MAH5TaD/cfIMX0BSzloFr2MBwsyswDLRt++8RW5zN 3idqPyYgJa814kgO1Mig5z3H0sBODHIiodhmZ4Rjs8dKZ9JtAl8w/Bm/at8qjFFD IWpxG92om46RPjkJPkbPWuviTmEP4GWAR0EmqxAoPRVbK12vVaHVfIPms64rdx/j LPTSBcyXZLNBOYCWFler0w== ARC-Authentication-Results: i=1; tb-mx1.topicbox.com; arc=none (no signatures found); bimi=none (Domain is not BIMI enabled); dkim=none (no signatures found); dmarc=pass policy.published-domain-policy=none policy.applied-disposition=none policy.evaluated-disposition=none (p=none,d=none,d.eval=none) policy.policy-from=p header.from=musolino.id.au; iprev=pass smtp.remote-ip=45.76.123.158 (vultr.musolino.id.au); spf=pass smtp.mailfrom=alex@musolino.id.au smtp.helo=vultr.musolino.id.au; x-aligned-from=pass (Address match); x-ptr=pass smtp.helo=vultr.musolino.id.au policy.ptr=vultr.musolino.id.au; x-return-mx=pass header.domain=musolino.id.au policy.is_org=yes (MX Records found: musolino.id.au); x-return-mx=pass smtp.domain=musolino.id.au policy.is_org=yes (MX Records found: musolino.id.au); x-vs=clean score=35 state=0 X-ME-VSCause: gggruggvucftvghtrhhoucdtuddrgedujedrvddvuddggeekucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdggtfgfnhhsuhgsshgtrhhisggvpdfu rfetoffkrfgpnffqhgenuceurghilhhouhhtmecufedttdenucgfrhhlucfvnfffucdlfe ehmdenucfjughrpefkvffuhfffjgggtgfgsehtkeejtddttdejnecuhfhrohhmpeetlhgv gicuofhushholhhinhhouceorghlvgigsehmuhhsohhlihhnohdrihgurdgruheqnecugg ftrfgrthhtvghrnhepgfdtffeujeegudfgffevvefgteeutdevveehgefgveffffdtgeff ffeiieejheegnecuffhomhgrihhnpegrqdgsrdighiiinecukfhppeeghedrjeeirdduvd efrdduheekpdehkedrudejtddrudefuddrkeenucevlhhushhtvghrufhiiigvpedtnecu rfgrrhgrmhepihhnvghtpeeghedrjeeirdduvdefrdduheekpdhhvghlohepvhhulhhtrh drmhhushholhhinhhordhiugdrrghupdhmrghilhhfrhhomhepoegrlhgvgiesmhhushho lhhinhhordhiugdrrghuqe X-ME-VSScore: 35 X-ME-VSCategory: clean Received-SPF: pass (musolino.id.au: 45.76.123.158 is authorized to use 'alex@musolino.id.au' in 'mfrom' identity (mechanism 'a' matched)) receiver=tb-mx1.topicbox.com; identity=mailfrom; envelope-from="alex@musolino.id.au"; helo=vultr.musolino.id.au; client-ip=45.76.123.158 Received: from vultr.musolino.id.au (vultr.musolino.id.au [45.76.123.158]) by tb-mx1.topicbox.com (Postfix) with ESMTP for <9fans@9fans.net>; Tue, 29 Dec 2020 08:07:04 -0500 (EST) (envelope-from alex@musolino.id.au) Received: from 58.170.131.8 ([58.170.131.8]) by vultr; Wed Dec 30 00:06:16 +1100 2020 Message-ID: <152DF34E0A1AC6447419775BA4030B1F@musolino.id.au> To: 9fans@9fans.net Subject: Re: [9fans] 9Front / cwfs64x and hjfs storage From: Alex Musolino Date: Tue, 29 Dec 2020 23:36:14 +1030 In-Reply-To: <16091997520.72404.916174@composer.9fans.topicbox.com> MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Topicbox-Policy-Reasoning: allow: sender is a member Topicbox-Message-UUID: c3a267d4-49d6-11eb-a9de-b2f723722f34 Archived-At: =?UTF-8?B?PGh0dHBzOi8vOWZhbnMudG9waWNib3guY29tL2dyb3Vwcy85?= =?UTF-8?B?ZmFucy9UYzk1MWEyMjRkZGU2ZGRlNS1NZDljMDkxNTU4ODBmY2RlYjNkYzg1?= =?UTF-8?B?Y2ZjPg==?= List-Help: List-Id: "9fans" <9fans.9fans.net> List-Post: List-Software: Topicbox v0 List-Subscribe: Precedence: list Reply-To: 9fans <9fans@9fans.net> List-Unsubscribe: , Topicbox-Delivery-ID: 2:9fans:437d30aa-c441-11e9-8a57-d036212d11b0:522be890-2105-11eb-b15e-8d699134e1fa:Md9c09155880fcdeb3dc85cfc:1:ZbA5iR2qQyEycE3azI-bYLtLHrvR-6sPnAcTwKeUE0s > While it is not yet a concern, I am trying to figure something out > that does not seem to be well documented in the man pages or the fqa > about the file systems. Parts of fs(4), fs(8), and fsconfig(8) can be applied to cwfs. The syntax that Ethan talked about for concatenating WORM devices is described in fsconfig(8). > I am currently running a plan9front instance with cwfs64x (the whole > "hjfs is experimental, you could loose your files" seemed to be a > bit dangerous when I started everything) and I understand that it is > a WORM file system.=C2=A0 My question is for the end game.=C2=A0 If the > storage gets full with all of the diffs, is there a way for the > oldest ones to roll off, or do you need to expand the storage or > export them or ?=C2=A0 I come from the linux world where this is not a > feature file system wise and worst case I would have lvm's that I > could just grow or with repos I could cull the older diffs, if > needed. Cwfs doesn't know anything about diffs as such, it just keeps track of dirty blocks and writes these out to the WORM partition when a dump is requested. The plan 9 approach to storage is to just keep adding capacity since the price of storage falls faster than you can use it up. I recently upgraded my home file server from an 80GB HDD to a 240GB SSD and documented the process [1]. The WORM partition contained 25GB and dates back to 2016-04-12. Now, maybe you'll generate much more data than me over less time, but in this day and age of cheap multi-terrabyte HDDs and hundred-gigabyte SSDs I think it's still perfectly reasonable to just keep adding capacity as you need it. Another thing to consider is how much data you really need to be sending to the WORM in the first place. Multimedia, for example, might be better stored on a more convential file system since the lack of content-based deduping in cwfs might result in these files being dumped multiple times as they are moved around or have their metadata edited. Even venti won't dedup in the latter case as it doesn't do content-defined chunking. Plan 9 is really good at combining multiple filesystems from multiple machines (running different operating systems!) together into a single namespace. My music collection lives on an ext4 filesystem mirrored across 2 drives (and backed up elsewhere) but can be easily accessed from 9front using sshfs(4). I just run `9fs music` and the entire collection appears under /n/music. [1] http://docs.a-b.xyz/migrating-cwfs.html ------------------------------------------ 9fans: 9fans Permalink: https://9fans.topicbox.com/groups/9fans/Tc951a224dde6dde5-Md9c09= 155880fcdeb3dc85cfc Delivery options: https://9fans.topicbox.com/groups/9fans/subscription