From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from tb-mx0.topicbox.com (localhost.local [127.0.0.1]) by tb-mx0.topicbox.com (Postfix) with ESMTP id 9F9BBBB4C14 for ; Thu, 5 Sep 2024 07:01:52 -0400 (EDT) (envelope-from gea@napp-it.org) Received: from tb-mx0.topicbox.com (localhost [127.0.0.1]) by tb-mx0.topicbox.com (Authentication Milter) with ESMTP id D1088E7B49C; Thu, 5 Sep 2024 07:01:52 -0400 ARC-Seal: i=1; a=rsa-sha256; cv=none; d=topicbox.com; s=arcseal; t= 1725534112; b=aD29CiA2chhdTJl5E1B6mG2BBdnshdmQX4rIAcV+J50ZecLyee b4al/kpyIF6ebfVMy9tJd8ChlzraRqjt3nwGa5oUmrIsFgFmrDOKjK/C4/vxZvAJ y7FZz4qhW/kdG4QiTL9qFLMvOm1+wbgUNmMrbPF9AqPZxV94c8GQ9XqlVHw1LTZj AEiJ84jWarBTLNoCZsvV5KrzncQY1F4NYomopXU5Z6CKKhRc3H1q6RFnFs0HOGK9 RVpmnYoQDankCKSZf+pcrYuEtOqusJa5sKKuG5rTtEoBZs+kK81r99pHDbhd91EK tHo8evPEBO/IQlyApNBCTbDMKDjCrU78nXsA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d= topicbox.com; h=message-id:date:mime-version:from:subject :reply-to:to:content-type:content-transfer-encoding; s=arcseal; t=1725534112; bh=isitxEA3aBrFx11z1BvyItvTqKmfQgsr6mywRjVq/q8=; b= eAaQswbpLiNTEtD3uI3KQ5oMlaq/dXOV1lQQ4FcfwHcxTJ0OutTzUS3j2x/CQl4O 3Y8w4Sq/AhAljJGDUt8BX77zh1uc2qEO2lBdvq0psMem6BHv+DSjtOrhmTKjpscV cd5vFb4AE6+dLioySaUYwEps3u+qOsE3tLnaRiTm185Ig8FhqzzWdXAvoOg8U8iV fnN7RdNDuOF2v+R6BNE4nFQGRiWGPdYDXLgZpDZwX2lmFYp5cpkbHwVX0HCdX8LX AkhH3VdOuiu0g+nhV+t3mfjmtKhh2hEDMfg4F2Npu/2kdazmo7bBfcXbNe4bmnH1 YadlqVtq7SjWdHUhzl3jeQ== ARC-Authentication-Results: i=1; tb-mx0.topicbox.com; arc=none (no signatures found); bimi=skipped (DMARC did not pass); dkim=none (no signatures found); dmarc=none policy.published-domain-policy=none policy.applied-disposition=none policy.evaluated-disposition=none (p=none,d=none,d.eval=none) policy.policy-from=p header.from=napp-it.org; iprev=pass smtp.remote-ip=80.241.59.204 (mout-u-204.mailbox.org); spf=none smtp.mailfrom=gea@napp-it.org smtp.helo=mout-u-204.mailbox.org; x-aligned-from=pass (Address match); x-me-sender=none; x-ptr=pass smtp.helo=mout-u-204.mailbox.org policy.ptr=mout-u-204.mailbox.org; x-return-mx=pass header.domain=napp-it.org policy.is_org=yes (MX Records found: mx04.secure-mailgate.com,mx03.secure-mailgate.com); x-return-mx=pass smtp.domain=napp-it.org policy.is_org=yes (MX Records found: mx04.secure-mailgate.com,mx03.secure-mailgate.com); x-tls=pass smtp.version=TLSv1.2 smtp.cipher=ECDHE-RSA-AES256-GCM-SHA384 smtp.bits=256/256; x-vs=clean score=0 state=0 Authentication-Results: tb-mx0.topicbox.com; arc=none (no signatures found); bimi=skipped (DMARC did not pass); dkim=none (no signatures found); dmarc=none policy.published-domain-policy=none policy.applied-disposition=none policy.evaluated-disposition=none (p=none,d=none,d.eval=none) policy.policy-from=p header.from=napp-it.org; iprev=pass smtp.remote-ip=80.241.59.204 (mout-u-204.mailbox.org); spf=none smtp.mailfrom=gea@napp-it.org smtp.helo=mout-u-204.mailbox.org; x-aligned-from=pass (Address match); x-me-sender=none; x-ptr=pass smtp.helo=mout-u-204.mailbox.org policy.ptr=mout-u-204.mailbox.org; x-return-mx=pass header.domain=napp-it.org policy.is_org=yes (MX Records found: mx04.secure-mailgate.com,mx03.secure-mailgate.com); x-return-mx=pass smtp.domain=napp-it.org policy.is_org=yes (MX Records found: mx04.secure-mailgate.com,mx03.secure-mailgate.com); x-tls=pass smtp.version=TLSv1.2 smtp.cipher=ECDHE-RSA-AES256-GCM-SHA384 smtp.bits=256/256; x-vs=clean score=0 state=0 X-ME-VSCause: gggruggvucftvghtrhhoucdtuddrgeeftddrudehledgfeehucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdggtfgfnhhsuhgsshgtrhhisggvpdfu rfetoffkrfgpnffqhgenuceurghilhhouhhtmecufedttdenucenucfjughrpefkffgghf furhfvtgfgsehtqhertddttdejnecuhfhrohhmpedfghgvrgesnhgrphhpqdhithdrohhr ghdfuceoghgvrgesnhgrphhpqdhithdrohhrgheqnecuggftrfgrthhtvghrnhepkeeihe dukedtudfffedtveegffdtvddtgedtvdelgefghfetfeethefhiefhtedtnecuffhomhgr ihhnpegrvhgrshhtrdgtohhmnecukfhppeektddrvdeguddrheelrddvtdegnecuvehluh hsthgvrhfuihiivgeptdenucfrrghrrghmpehinhgvthepkedtrddvgedurdehledrvddt gedphhgvlhhopehmohhuthdquhdqvddtgedrmhgrihhlsghogidrohhrghdpmhgrihhlfh hrohhmpeeoghgvrgesnhgrphhpqdhithdrohhrgheqpdhnsggprhgtphhtthhopedupdhr tghpthhtohepoeguvghvvghlohhpvghrsehlihhsthhsrdhilhhluhhmohhsrdhorhhgqe X-ME-VSScore: 0 X-ME-VSCategory: clean Received-SPF: none (napp-it.org: No applicable sender policy available) receiver=tb-mx0.topicbox.com; identity=mailfrom; envelope-from="gea@napp-it.org"; helo=mout-u-204.mailbox.org; client-ip=80.241.59.204 Received: from mout-u-204.mailbox.org (mout-u-204.mailbox.org [80.241.59.204]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by tb-mx0.topicbox.com (Postfix) with ESMTPS for ; Thu, 5 Sep 2024 07:01:51 -0400 (EDT) (envelope-from gea@napp-it.org) Received: from smtp1.mailbox.org (smtp1.mailbox.org [10.196.197.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mout-u-204.mailbox.org (Postfix) with ESMTPS id 4WzxJD2v8qz9sPl for ; Thu, 5 Sep 2024 13:01:48 +0200 (CEST) Message-ID: <6b5e74cf-499e-4919-b23a-2524b5283f0f@napp-it.org> Date: Thu, 5 Sep 2024 13:01:46 +0200 MIME-Version: 1.0 From: "gea@napp-it.org" Subject: Fast Dedup Reply-To: illumos-developer To: developer@lists.illumos.org Content-Language: en-US Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Antivirus: Avast (VPS 240905-0, 5.9.2024), Outbound message X-Antivirus-Status: Clean Topicbox-Policy-Reasoning: allow: sender is a member Topicbox-Message-UUID: 4605307a-6b76-11ef-9ffb-6dd3fe8b7b06 Dedup When realtime dedup was implemented in ZFS many years ago I thought, wow, a real killer feature. Shortly after it was clear that it has negative implications on RAM usage up to a catastrophic impact on RAM performance especially in low RAM situations. In nearly all cases, the general recomendation was then, keep it off. In my current tests with Open-ZFS on Windows, currently 2.2.6 rc where the new Fast Dedup feature is part of with newest commits from this week, i came to the conclusion, that this time it can be the killer feature as it improves performance, limits dedup table size to a value or size if a dedup vdev and can clean up tables. Maybe in most cases it can be enabled by default similar to the compress feature as it offers mostly more advantages than disadvantages. I hope this will be integrated in Illumos as the amount of advantages of Illumos ZFS over generic Open-ZFS is limited to usability, stability and the kernelbased SMB server as more and more newer ZFS features are not available what affects compatibility. Gea -- Diese E-Mail wurde von Avast-Antivirussoftware auf Viren gepr=C3=BCft. www.avast.com