From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on inbox.vuxu.org X-Spam-Level: X-Spam-Status: No, score=0.2 required=5.0 tests=DKIM_ADSP_CUSTOM_MED, DKIM_SIGNED,DKIM_VALID,FORGED_GMAIL_RCVD,FREEMAIL_FORGED_FROMDOMAIN, FREEMAIL_FROM,HEADER_FROM_DIFFERENT_DOMAINS,HTML_MESSAGE, MAILING_LIST_MULTI,RCVD_IN_DNSWL_NONE,T_SCC_BODY_TEXT_LINE autolearn=no autolearn_force=no version=3.4.4 Received: from tb-ob0.topicbox.com (tb-ob0.topicbox.com [64.147.108.117]) by inbox.vuxu.org (Postfix) with ESMTP id D751A236FE for ; Sat, 22 Jun 2024 14:51:14 +0200 (CEST) Received: from tb-mx1.topicbox.com (tb-mx1.nyi.icgroup.com [10.90.30.61]) by tb-ob0.topicbox.com (Postfix) with ESMTP id 2EA5B22244 for ; Sat, 22 Jun 2024 08:51:13 -0400 (EDT) (envelope-from bounce.mM2d7633f621192ac59497b79b.r522be890-2105-11eb-b15e-8d699134e1fa@9fans.bounce.topicbox.com) Received: by tb-mx1.topicbox.com (Postfix, from userid 1132) id 25E0C1C00DB8; Sat, 22 Jun 2024 08:51:13 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed; d=9fans.net; h=from:to :message-id:date:mime-version:content-type :content-transfer-encoding:list-help:list-id:list-post :list-subscribe:reply-to:subject:list-unsubscribe; s=dkim-1; t= 1719060673; x=1719147073; bh=MGXyll1MNTGwAtPwmJKRXgS2uefDS4BczJo WSLeq7Bg=; b=BEFTp1TkKK7UW6/X1RPVh0YXpWxvJEpzhXrOSrxdeaZkDAhknmf CoQjyofM6SUYUGKp7Tyci05TYXEjIe09Rv/xzWdW/pr8LPrbBM6kgbNTW1cl9+N4 gyvPbu9al2bpuFO6zlYjRczkgWZbj0GbWn6C6xtTL7Be6gDwW4jTAhJA= From: wb.kloke@gmail.com To: 9fans <9fans@9fans.net> Message-Id: <17190606630.bf105.173321@composer.9fans.topicbox.com> Date: Sat, 22 Jun 2024 08:51:03 -0400 MIME-Version: 1.0 Content-Type: multipart/alternative; boundary=17190606631.A8FFe.173321 Content-Transfer-Encoding: 7bit Topicbox-Policy-Reasoning: allow: sender is a member Topicbox-Message-UUID: 1652d032-3096-11ef-9dcd-c256242d11b0 Archived-At: =?UTF-8?B?PGh0dHBzOi8vOWZhbnMudG9waWNib3guY29tL2dyb3Vwcy85?= =?UTF-8?B?ZmFucy9UYmM4NWVhMTcyYTcwMjFkNy1NMmQ3NjMzZjYyMTE5MmFjNTk0OTdi?= =?UTF-8?B?NzliPg==?= List-Help: List-Id: "9fans" <9fans.9fans.net> List-Post: List-Software: Topicbox v0 List-Subscribe: Precedence: list Reply-To: 9fans <9fans@9fans.net> Subject: [9fans] duplicate scores in venti arenas List-Unsubscribe: , Topicbox-Delivery-ID: 2:9fans:437d30aa-c441-11e9-8a57-d036212d11b0:522be890-2105-11eb-b15e-8d699134e1fa:M2d7633f621192ac59497b79b:1:1Mq3Zsh_ErVzb_8iRNiARb9VfLmzAmrVc4r3Q0cC-iU --17190606631.A8FFe.173321 Date: Sat, 22 Jun 2024 08:51:03 -0400 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Working on my data set, I found that there are several duplicate entries in= the arenas. I am confident that the data are consistent, though. Which may be the circumstances, that this happens more than 1 time? The arenas have been written by p9p venti server on my wdmycloud NAS.=C2=A0 Perhaps I should look at the times, when the blocks have been written. ------------------------------------------ 9fans: 9fans Permalink: https://9fans.topicbox.com/groups/9fans/Tbc85ea172a7021d7-M2d763= 3f621192ac59497b79b Delivery options: https://9fans.topicbox.com/groups/9fans/subscription --17190606631.A8FFe.173321 Date: Sat, 22 Jun 2024 08:51:03 -0400 MIME-Version: 1.0 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Working on my data set, I found that there are= several duplicate entries in the arenas.
I am confident th= at the data are consistent, though.

Which may be= the circumstances, that this happens more than 1 time?
The= arenas have been written by p9p venti server on my wdmycloud NAS. 

Perhaps I should look at the times, when the= blocks have been written.
= --17190606631.A8FFe.173321-- From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on inbox.vuxu.org X-Spam-Level: X-Spam-Status: No, score=0.3 required=5.0 tests=DKIM_ADSP_CUSTOM_MED, DKIM_SIGNED,DKIM_VALID,FORGED_GMAIL_RCVD,FREEMAIL_FORGED_FROMDOMAIN, FREEMAIL_FROM,HEADER_FROM_DIFFERENT_DOMAINS,HTML_MESSAGE, MAILING_LIST_MULTI,RCVD_IN_DNSWL_NONE autolearn=no autolearn_force=no version=3.4.4 Received: from tb-ob1.topicbox.com (tb-ob1.topicbox.com [64.147.108.173]) by inbox.vuxu.org (Postfix) with ESMTP id 02F5D28820 for ; Tue, 2 Jul 2024 18:29:35 +0200 (CEST) Received: from tb-mx0.topicbox.com (tb-mx0.nyi.icgroup.com [10.90.30.73]) by tb-ob1.topicbox.com (Postfix) with ESMTP id EFEEC18599 for ; Tue, 2 Jul 2024 12:29:33 -0400 (EDT) (envelope-from bounce.mMdf3ed7fe43245b96e302311b.r522be890-2105-11eb-b15e-8d699134e1fa@9fans.bounce.topicbox.com) Received: by tb-mx0.topicbox.com (Postfix, from userid 1132) id EC3811DE33EA; Tue, 2 Jul 2024 12:29:33 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed; d=9fans.net; h=from:to :message-id:in-reply-to:references:date:mime-version :content-type:content-transfer-encoding:list-help:list-id :list-post:list-subscribe:reply-to:subject:list-unsubscribe; s= dkim-1; t=1719937773; x=1720024173; bh=PY9htbdxhtdN8+S6hEr5RvMxb aT+IKdYASMAzXSZaXU=; b=FaSdM4QTnaYIUIk7OvEdhCWr9m/qK4KNOjKz9ZElA FulFj0iHE6SmD+GJi8B24ARv5uubypq2lZfotcEGYBbe8wjxm10Lfrwt6SU14TsO 4dMN7eVgSmBcK1LgstRXgtb7qzTGFmIbvwn+1jqnsD93Z+I8OHY4+GSEj6Ivv8QP nY= From: wb.kloke@gmail.com To: 9fans <9fans@9fans.net> Message-Id: <17199377620.6C25AbC.369784@composer.9fans.topicbox.com> In-Reply-To: <17190606630.bf105.173321@composer.9fans.topicbox.com> References: <17190606630.bf105.173321@composer.9fans.topicbox.com> Date: Tue, 2 Jul 2024 12:29:22 -0400 MIME-Version: 1.0 Content-Type: multipart/alternative; boundary=17199377621.A9dea21c.369784 Content-Transfer-Encoding: 7bit Topicbox-Policy-Reasoning: allow: sender is a member Topicbox-Message-UUID: 3da652ce-3890-11ef-92c0-c256242d11b0 Archived-At: =?UTF-8?B?PGh0dHBzOi8vOWZhbnMudG9waWNib3guY29tL2dyb3Vwcy85?= =?UTF-8?B?ZmFucy9UYmM4NWVhMTcyYTcwMjFkNy1NZGYzZWQ3ZmU0MzI0NWI5NmUzMDIz?= =?UTF-8?B?MTFiPg==?= List-Help: List-Id: "9fans" <9fans.9fans.net> List-Post: List-Software: Topicbox v0 List-Subscribe: Precedence: list Reply-To: 9fans <9fans@9fans.net> Subject: [9fans] Re: duplicate scores in venti arenas List-Unsubscribe: , Topicbox-Delivery-ID: 2:9fans:437d30aa-c441-11e9-8a57-d036212d11b0:522be890-2105-11eb-b15e-8d699134e1fa:Mdf3ed7fe43245b96e302311b:1:PNSBw5u41i8vFYjtAht9vONHlNPku6Ih-d2LMZld35s --17199377621.A9dea21c.369784 Date: Tue, 2 Jul 2024 12:29:22 -0400 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable I now have a vague idea, what may have happened. The really strange thing is that I did not write to this venti at all (at l= east not intentionally). Now I tried to repair the config by deleting=C2=A0 the last arena parttion,= reformat a new one and buildindex from scratch. After some time, when I used venti/copy to copy a tree to another venti, th= e last partition filled up again. I noticed that the venti.conf stored in the first arena partition was not a= ctualised.=C2=A0 Is this the cause of the strange behaviour? The http storage and index listings showed nothing which could alert me. ------------------------------------------ 9fans: 9fans Permalink: https://9fans.topicbox.com/groups/9fans/Tbc85ea172a7021d7-Mdf3ed= 7fe43245b96e302311b Delivery options: https://9fans.topicbox.com/groups/9fans/subscription --17199377621.A9dea21c.369784 Date: Tue, 2 Jul 2024 12:29:22 -0400 MIME-Version: 1.0 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
I now have a vague idea, what may have happene= d.

The really strange thing is that I did = not write to this venti at all (at least not intentionally).

Now I tried to repair the config by deleting  the l= ast arena parttion, reformat a new one and buildindex from scratch.
After some time, when I used venti/copy to copy a tree to another = venti, the last partition filled up again.

I noticed that the venti.conf stored in the first arena partition was not = actualised.  Is this the cause of the strange behaviour?
The http storage and index listings showed nothing which could alert me.= = --17199377621.A9dea21c.369784-- From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on inbox.vuxu.org X-Spam-Level: X-Spam-Status: No, score=0.3 required=5.0 tests=DKIM_ADSP_CUSTOM_MED, DKIM_SIGNED,DKIM_VALID,FORGED_GMAIL_RCVD,FREEMAIL_FORGED_FROMDOMAIN, FREEMAIL_FROM,HEADER_FROM_DIFFERENT_DOMAINS,HTML_MESSAGE, MAILING_LIST_MULTI,RCVD_IN_DNSWL_NONE autolearn=no autolearn_force=no version=3.4.4 Received: from tb-ob20.topicbox.com (tb-ob20.topicbox.com [173.228.157.66]) by inbox.vuxu.org (Postfix) with ESMTP id BB7EC271EE for ; Sat, 6 Jul 2024 22:01:37 +0200 (CEST) Received: from tb-mx0.topicbox.com (tb-mx0.nyi.icgroup.com [10.90.30.73]) by tb-ob20.topicbox.com (Postfix) with ESMTP id C146F3548A for ; Sat, 6 Jul 2024 16:01:35 -0400 (EDT) (envelope-from bounce.mM3df29cb8e4d0b71a87b719c6.r522be890-2105-11eb-b15e-8d699134e1fa@9fans.bounce.topicbox.com) Received: by tb-mx0.topicbox.com (Postfix, from userid 1132) id 9C64D1E50916; Sat, 6 Jul 2024 16:01:35 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed; d=9fans.net; h=from:to :message-id:references:in-reply-to:date:mime-version :content-type:content-transfer-encoding:list-help:list-id :list-post:list-subscribe:reply-to:subject:list-unsubscribe; s= dkim-1; t=1720296095; x=1720382495; bh=1ZVUOEwhAdx3eLqhDr7x7CmYR EG4YntnwVqSxIYO3gM=; b=c9HQXPLCfW96NtkRMYk6Q0Ich8+KHqXXorLagEWBT ErNDHxDFXgyboEuANqjFwJGQdfGyuHQvVhTJsKpVEG9tDmw58sn661DIIlodBJ5f 0RJSkj/qtaMcdZ1INmfWUWa1HhJ3KOtgGbJhm7v7SqG+iUfoqE9n9wPdwt5UVQRT i8= From: wb.kloke@gmail.com To: 9fans <9fans@9fans.net> Message-Id: <17202960870.4BFEfb.95078@composer.9fans.topicbox.com> References: <17190606630.bf105.173321@composer.9fans.topicbox.com> <17199377620.6C25AbC.369784@composer.9fans.topicbox.com> In-Reply-To: <17199377620.6C25AbC.369784@composer.9fans.topicbox.com> Date: Sat, 6 Jul 2024 16:01:27 -0400 MIME-Version: 1.0 Content-Type: multipart/alternative; boundary=17202960871.2cDc.95078 Content-Transfer-Encoding: 7bit Topicbox-Policy-Reasoning: allow: sender is a member Topicbox-Message-UUID: 87f6e9b6-3bd2-11ef-92e1-b81740decc0b Archived-At: =?UTF-8?B?PGh0dHBzOi8vOWZhbnMudG9waWNib3guY29tL2dyb3Vwcy85?= =?UTF-8?B?ZmFucy9UYmM4NWVhMTcyYTcwMjFkNy1NM2RmMjljYjhlNGQwYjcxYTg3Yjcx?= =?UTF-8?B?OWM2Pg==?= List-Help: List-Id: "9fans" <9fans.9fans.net> List-Post: List-Software: Topicbox v0 List-Subscribe: Precedence: list Reply-To: 9fans <9fans@9fans.net> Subject: [9fans] Re: duplicate scores in venti arenas List-Unsubscribe: , Topicbox-Delivery-ID: 2:9fans:437d30aa-c441-11e9-8a57-d036212d11b0:522be890-2105-11eb-b15e-8d699134e1fa:M3df29cb8e4d0b71a87b719c6:1:FTZFOCB7TbwpAzSEyp83B716HI-vHmiRt_d46bHcoI4 --17202960871.2cDc.95078 Date: Sat, 6 Jul 2024 16:01:27 -0400 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable The main reason for the remaining mventi issues were, that I ignored the me= ssage about clump miscalculation in one arena. Why it is not really destruc= tive in the original venti, I don't know. So, if this message occurs, mventi will not serve the venti protocol. Clump miscalculation indicates that the arena directory is not in sync with= arena content.=C2=A0 As the arena directory is only used for index rebuild= and some external utilities, the most conservative option seems to delay t= he build of the directory till sealing of the arena. This avoids also usele= ss writes to the arena partitions for the sake of SSD wear. ------------------------------------------ 9fans: 9fans Permalink: https://9fans.topicbox.com/groups/9fans/Tbc85ea172a7021d7-M3df29= cb8e4d0b71a87b719c6 Delivery options: https://9fans.topicbox.com/groups/9fans/subscription --17202960871.2cDc.95078 Date: Sat, 6 Jul 2024 16:01:27 -0400 MIME-Version: 1.0 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
The main reason for the remaining mventi issue= s were, that I ignored the message about clump miscalculation in one arena.= Why it is not really destructive in the original venti, I don't know.<= br />

So, if this message occurs, mventi will no= t serve the venti protocol.

Clump miscalcu= lation indicates that the arena directory is not in sync with arena content= .  As the arena directory is only used for index rebuild and some exte= rnal utilities, the most conservative option seems to delay the build of th= e directory till sealing of the arena. This avoids also useless writes to t= he arena partitions for the sake of SSD wear.
= --17202960871.2cDc.95078--