From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from tb-mx1.topicbox.com (localhost.local [127.0.0.1]) by tb-mx1.topicbox.com (Postfix) with ESMTP id 0FC601F0658B for ; Mon, 5 Aug 2024 04:57:44 -0400 (EDT) (envelope-from tsoome@me.com) Received: from tb-mx1.topicbox.com (localhost [127.0.0.1]) by tb-mx1.topicbox.com (Authentication Milter) with ESMTP id 026F66C4F0F; Mon, 5 Aug 2024 04:57:44 -0400 ARC-Seal: i=1; a=rsa-sha256; cv=none; d=topicbox.com; s=arcseal; t= 1722848264; b=vzUXGvPAfl2yqCusZyo1nYXTmgr2NkZw+ienbPoTJCUkC5EzMS L63v9543LCWIYMNpAH/Wn+g9J/+NOQlgYiDP2p9vNT53fwIfP5Gb78EefuJ9IjPs gI5oNZv4Ov/SU08ConOptd4UV0pB5dgMViyaja1KqlbzvpBSUG5Y2EbGjSK4yAdP 9fZZxO1Gr3sf1/aXEdUhegl2ZF18hmRdJsuMtyqcrNBwksNkPCTr8MQI4Uxjxdpk zCYOP6zqIDfAp6z2CyOgQqcEs1kaeRsMSLxHnRJVrTBPMxcE1CtIiFmwIslHKxIO q/Vyx3wxz6z4fpUeOJmF3cWWL4O+JerApy/w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d= topicbox.com; h=from:content-type:mime-version:subject:date :references:to:in-reply-to:message-id; s=arcseal; t=1722848264; bh=tByjRW5/eM7GEuXgubEHHTI41Y/e3eZx41yLY7QLb+I=; b=n1SsaD5Q1iLP n0uzs0h/ZXyAu5Fjcs6T1sLTXrhwYU1xP1Bi3IncRbfqOybtiFDJR4vbRwPEdn6/ IOJoAt7H78Iz+PmzWQnx/m5A67EvlYKnLyo1fciZU1J205kNWoMiQlvVJtQdJM6m 1GOsF5NkEqTMyjDCFPnGH2ElE49DgKE31w2UCJd7P6GY8ctAEXbUOqL0Vlj4StQ6 uWATZSuGHgCBMw9yHufR/JsUGGy1I/zemsnGMSr9gQM8BWms6u3z68tGDoCPfGsf wqxb7zvaRNhYGMu2A3mpGs8FyRW4OkUtCYShXVaz1lcJvibEp0XkY+aguJ1IFKi4 JiM47z8cTg== ARC-Authentication-Results: i=1; tb-mx1.topicbox.com; arc=none (no signatures found); bimi=declined (Domain declined to participate); dkim=pass (2048-bit rsa key sha256) header.d=me.com header.i=@me.com header.b=FTOpf8wo header.a=rsa-sha256 header.s=1a1hai x-bits=2048; dmarc=pass policy.published-domain-policy=quarantine policy.published-subdomain-policy=quarantine policy.applied-disposition=none policy.evaluated-disposition=none (p=quarantine,sp=quarantine,d=none,d.eval=none) policy.policy-from=p header.from=me.com; iprev=pass smtp.remote-ip=17.58.6.48 (pv50p00im-hyfv10021501.me.com); spf=pass smtp.mailfrom=tsoome@me.com smtp.helo=pv50p00im-hyfv10021501.me.com; x-aligned-from=pass (Address match); x-me-sender=none; x-ptr=pass smtp.helo=pv50p00im-hyfv10021501.me.com policy.ptr=pv50p00im-hyfv10021501.me.com; x-return-mx=pass header.domain=me.com policy.is_org=yes (MX Records found: mx01.mail.icloud.com,mx02.mail.icloud.com); x-return-mx=pass smtp.domain=me.com policy.is_org=yes (MX Records found: mx01.mail.icloud.com,mx02.mail.icloud.com); x-tls=pass smtp.version=TLSv1.2 smtp.cipher=ECDHE-RSA-AES256-GCM-SHA384 smtp.bits=256/256; x-vs=clean score=-100 state=0 Authentication-Results: tb-mx1.topicbox.com; arc=none (no signatures found); bimi=declined (Domain declined to participate); dkim=pass (2048-bit rsa key sha256) header.d=me.com header.i=@me.com header.b=FTOpf8wo header.a=rsa-sha256 header.s=1a1hai x-bits=2048; dmarc=pass policy.published-domain-policy=quarantine policy.published-subdomain-policy=quarantine policy.applied-disposition=none policy.evaluated-disposition=none (p=quarantine,sp=quarantine,d=none,d.eval=none) policy.policy-from=p header.from=me.com; iprev=pass smtp.remote-ip=17.58.6.48 (pv50p00im-hyfv10021501.me.com); spf=pass smtp.mailfrom=tsoome@me.com smtp.helo=pv50p00im-hyfv10021501.me.com; x-aligned-from=pass (Address match); x-me-sender=none; x-ptr=pass smtp.helo=pv50p00im-hyfv10021501.me.com policy.ptr=pv50p00im-hyfv10021501.me.com; x-return-mx=pass header.domain=me.com policy.is_org=yes (MX Records found: mx01.mail.icloud.com,mx02.mail.icloud.com); x-return-mx=pass smtp.domain=me.com policy.is_org=yes (MX Records found: mx01.mail.icloud.com,mx02.mail.icloud.com); x-tls=pass smtp.version=TLSv1.2 smtp.cipher=ECDHE-RSA-AES256-GCM-SHA384 smtp.bits=256/256; x-vs=clean score=-100 state=0 X-ME-VSCause: gggruggvucftvghtrhhoucdtuddrgeeftddrkeeigddutdcutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpggftfghnshhusghstghrihgsvgdpuffr tefokffrpgfnqfghnecuuegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnth hsucdlqddutddtmdenucfjughrpefhtggguffffhfvjgfkofesrgdtmherhhdtjeenucfh rhhomhepvfhoohhmrghsucfuohhomhgvuceothhsohhomhgvsehmvgdrtghomheqnecugg ftrfgrthhtvghrnhepvedttefggfeufeeggfelvefhffejudeghfeivdetteeigefhieev iedtkeeigfevnecuffhomhgrihhnpehkihhtrdgvughupdhtohhpihgtsghogidrtghomh enucfkphepudejrdehkedriedrgeekpddujedrheeirdelrddutdenucevlhhushhtvghr ufhiiigvpedtnecurfgrrhgrmhepihhnvghtpedujedrheekrdeirdegkedphhgvlhhope hpvhehtdhptddtihhmqdhhhihfvhdutddtvdduhedtuddrmhgvrdgtohhmpdhmrghilhhf rhhomhepoehtshhoohhmvgesmhgvrdgtohhmqedpnhgspghrtghpthhtohepuddprhgtph htthhopeeoughishgtuhhssheslhhishhtshdrihhllhhumhhoshdrohhrgheq X-ME-VSScore: -100 X-ME-VSCategory: clean Received-SPF: pass (me.com: 17.58.6.48 is authorized to use 'tsoome@me.com' in 'mfrom' identity (mechanism 'ip4:17.58.0.0/16' matched)) receiver=tb-mx1.topicbox.com; identity=mailfrom; envelope-from="tsoome@me.com"; helo=pv50p00im-hyfv10021501.me.com; client-ip=17.58.6.48 Received: from pv50p00im-hyfv10021501.me.com (pv50p00im-hyfv10021501.me.com [17.58.6.48]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by tb-mx1.topicbox.com (Postfix) with ESMTPS for ; Mon, 5 Aug 2024 04:57:43 -0400 (EDT) (envelope-from tsoome@me.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=me.com; s=1a1hai; t=1722848262; bh=tByjRW5/eM7GEuXgubEHHTI41Y/e3eZx41yLY7QLb+I=; h=From:Content-Type:Mime-Version:Subject:Date:To:Message-Id; b=FTOpf8wo58PKwnyUV7L64eY8qeFHO7bZL1MXlwC/yxJrNd9qWDAq0Cdm3mGoFUjxZ 6z8V12upN2rfSp9mAyOYg0kPJdla4Xw03mxXoVlTbAToS2/VVEV56AMDIGAYKuDT9E iwubwW45OsAKVYkI2yOfICHvRbibeF1U9p49SAIgH8JhDSSmwsiB1vTm/OLtYe/XtT pQTyKtJ9uH7D/bO8bDV+Ye8xLMswZaA20c47v+W4suv4KsTIOZpe5aipdYZ6e4DGUF BGncDd+H4YwGHN8y+bNbdgrM2DL8pC941Wt6BLjI42UYGVD5XDEigEYJWirfnkprSw QuScdUOCcS3FQ== Received: from smtpclient.apple (pv50p00im-dlb-asmtp-mailmevip.me.com [17.56.9.10]) by pv50p00im-hyfv10021501.me.com (Postfix) with ESMTPSA id AAA722C01C6 for ; Mon, 5 Aug 2024 08:57:38 +0000 (UTC) From: Toomas Soome Content-Type: multipart/alternative; boundary="Apple-Mail=_F5ED4ADD-D5C5-4403-9D54-CEA86746D1CE" Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3776.700.51\)) Subject: Re: [discuss] Cannot receive older ZFS dumps Date: Mon, 5 Aug 2024 11:57:24 +0300 References: <4d887d0d-140b-949a-a553-71960c26dde8@kit.edu> <1c2abfa3-df73-91cb-79da-c34eaeca3af7@kit.edu> <4WbC486kcJzlgVnN@009.lax.mailroute.net> <789D4B76-7A94-427B-91F1-AF8852181392@me.com> To: illumos-discuss In-Reply-To: Message-Id: <76876C7E-C1AC-4B90-B8F2-CBCD89D77FEC@me.com> X-Mailer: Apple Mail (2.3776.700.51) X-Proofpoint-GUID: fB6Ozklv5J8rdm5SFfrpjcXs-NVZoJVt X-Proofpoint-ORIG-GUID: fB6Ozklv5J8rdm5SFfrpjcXs-NVZoJVt X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.272,Aquarius:18.0.1039,Hydra:6.0.680,FMLib:17.12.28.16 definitions=2024-08-04_14,2024-08-02_01,2024-05-17_01 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 mlxscore=0 clxscore=1015 bulkscore=0 adultscore=0 malwarescore=0 suspectscore=0 spamscore=0 mlxlogscore=999 phishscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.19.0-2308100000 definitions=main-2408050063 Topicbox-Policy-Reasoning: allow: sender is a member Topicbox-Message-UUID: ccbeea60-5308-11ef-9b50-ea8757dcbe99 --Apple-Mail=_F5ED4ADD-D5C5-4403-9D54-CEA86746D1CE Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On 5. Aug 2024, at 11:03, Udo Grabowski (IMK) = wrote: >=20 > On 02/08/2024 19:21, Toomas Soome via illumos-discuss wrote: >>=20 >>=20 >>> On 2. Aug 2024, at 20:09, John D Groenveld via illumos-discuss = wrote: >>>=20 >>> In message <1c2abfa3-df73-91cb-79da-c34eaeca3af7@kit.edu>, "Udo = Grabowski (IMK)" writes: >>>> Did some more testing, could also import it on an 8 years old pool >>>> (illumos-a90d75b) with all the features (known at that time) active = or enab=3D >>>> led: >>>=20 >>> I'm not able to reproduce. >>> Here's my test procedure: >>> Booted 151a8 >>> Created two pools: >>> # mkfile 64M /root/features >>> # mkfile 64M /root/version28 >>> # zpool create features /root/features >>> # zpool create -d -o version=3D28 version28 /root/version28 >>> # zfs create features/test >>> # zfs create version28/test >>> # dd if=3D/dev/urandom of=3D/features/test/wee bs=3D1024k count=3D16 >>> # md5sum /features/test/wee >>> # cp /features/test/wee /version28/test/ >>> # md5sum /version28/test/wee >>> # zfs snapshot features/test@foo >>> # zfs snapshot version28/test@bar >>> # zfs send features/test@foo>features.snapshot >>> # zfs send version28/test@bar>version28.snapshot >>>=20 >>> copy the snapshots to today's OI, illumos-533d257436 >>>=20 >>> # zfs receive -v rpool/features< features.snapshot >>> # zfs receive -v rpool/version28< version28.snapshot >>> # md5sum rpool/features/test/wee >>> # md5sum rpool/version28/test/wee >>>=20 >>> John >>> groenveld@acm.org >>=20 >> I=E2=80=99m afraid it is related to specific feature; we would need = to get list of enabled and active features from receiving side (as = sending side does not have features). >>=20 >> And then there is a question what is specific about that file which = is triggering the receive error=E2=80=A6 is it possible to get hands on = send stream maybe? >>=20 >> (I=E2=80=99m investigating one send+receive case which is triggering = receiving pool to get to suspended state and it is quite a challenge). >=20 > Here is the ZFS dump (1.8GB) = : >=20 > 32@20100825 > 32@20100825_xxhsum > features_importable > features_nonimportable >=20 > + xxhsum checksum , + features active/enabled on 2018/4 pool where > it can be imported, and features on a very recent pool where it can't. > The zfs filesystem contained is Results/imk/32. ok, so the feature difference is: tsoome@beastie:~/zfs-receive-problem$ diff -u features_* --- features_importable E aug 5 11:30:53 2024 +++ features_nonimportable E aug 5 11:32:31 2024 @@ -1,4 +1,4 @@ -OI Hipster 2018/4 +OI Hipster illumos-5a33fb2d62 (>2024/4) rpool feature@async_destroy enabled = local rpool feature@empty_bpobj active = local rpool feature@lz4_compress active = local @@ -6,11 +6,12 @@ rpool feature@spacemap_histogram active = local rpool feature@enabled_txg active = local rpool feature@hole_birth active = local -rpool feature@extensible_dataset enabled = local +rpool feature@extensible_dataset active = local rpool feature@embedded_data active = local rpool feature@bookmarks enabled = local rpool feature@filesystem_limits enabled = local rpool feature@large_blocks enabled = local +rpool feature@large_dnode enabled = local rpool feature@sha512 enabled = local rpool feature@skein enabled = local rpool feature@edonr enabled = local @@ -18,3 +19,10 @@ rpool feature@obsolete_counts enabled = local rpool feature@zpool_checkpoint enabled = local rpool feature@spacemap_v2 active = local +rpool feature@allocation_classes enabled = local +rpool feature@resilver_defer enabled = local +rpool feature@encryption enabled = local +rpool feature@bookmark_v2 enabled = local +rpool feature@userobj_accounting active = local +rpool feature@project_quota active = local +rpool feature@log_spacemap active = local tsoome@beastie:~/zfs-receive-problem$ IMO the first suspects are added active features: extensible_dataset, = userobj_accounting, project_quota, log_spacemap. So one test scenario would be to test newer build, but with those = features disabled, if receive is good, then enable one feature and = re-test, till we have suspect:) rgds, toomas=20 > --=20 > Dr.Udo Grabowski Inst.of Meteorology & Climate Research IMK-ASF-SAT > https://www.imk-asf.kit.edu/english/sat.php > KIT - Karlsruhe Institute of Technology https://www.kit.edu = > Postfach 3640,76021 Karlsruhe,Germany T:(+49)721 608-26026 F:-926026 >=20 >=20 > ------------------------------------------ > illumos: illumos-discuss > Permalink: = https://illumos.topicbox.com/groups/discuss/T575f82eecd117456-M9f0eb10cbc5= 9ea9652b39fe0 > Delivery options: = https://illumos.topicbox.com/groups/discuss/subscription --Apple-Mail=_F5ED4ADD-D5C5-4403-9D54-CEA86746D1CE Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8

On 5. Aug 2024, at 11:03, Udo Grabowski (IMK) = <udo.grabowski@kit.edu> wrote:

On 02/08/2024 19:21, = Toomas Soome via illumos-discuss wrote:


On 2. Aug = 2024, at 20:09, John D Groenveld via illumos-discuss = <discuss@lists.illumos.org> wrote:

In message = <1c2abfa3-df73-91cb-79da-c34eaeca3af7@kit.edu>, "Udo Grabowski = (IMK)" writes:
Did some more testing, could = also import it on an 8 years old pool
(illumos-a90d75b) with all the = features (known at that time) active or = enab=3D
led:

I'm not able to reproduce.
Here's = my test procedure:
Booted 151a8
Created two pools:
# mkfile 64M = /root/features
# mkfile 64M /root/version28
# zpool create = features /root/features
# zpool create -d -o version=3D28 version28 = /root/version28
# zfs create features/test
# zfs create = version28/test
# dd if=3D/dev/urandom of=3D/features/test/wee = bs=3D1024k count=3D16
# md5sum /features/test/wee
# cp = /features/test/wee /version28/test/
# md5sum /version28/test/wee
# = zfs snapshot features/test@foo
# zfs snapshot version28/test@bar
# = zfs send features/test@foo>features.snapshot
# zfs send = version28/test@bar>version28.snapshot

copy the snapshots to = today's OI, illumos-533d257436

# zfs receive -v = rpool/features< features.snapshot
# zfs receive -v = rpool/version28< version28.snapshot
# md5sum = rpool/features/test/wee
# md5sum = rpool/version28/test/wee

John
groenveld@acm.org
=
I=E2=80=99m afraid it is related to specific feature; we would need = to get list of enabled and active features from receiving side (as = sending side does not have features).

And then there is a = question what is specific about that file which is triggering the = receive error=E2=80=A6  is it possible to get hands on send stream = maybe?

(I=E2=80=99m investigating one send+receive case which is = triggering receiving pool to get to suspended state and it is quite a = challenge).

Here is = the ZFS dump (1.8GB) <https://imk-asf-mipas.imk.kit.edu/users/grabow/> :

32@20100825
32@20100825_xxhsum
features_importable
features_nonimportable

+ = xxhsum checksum , + features active/enabled on 2018/4 pool = where
it can be imported, and = features on a very recent pool where it can't.
The zfs filesystem = contained is Results/imk/32.

ok, so = the feature difference is:

tsoome@beastie:~/zfs-receive-problem$ diff -u = features_*

--- = features_importable E aug  5 11:30:53 2024

+++ = features_nonimportable      E aug  5 11:32:31 = 2024

@@ -1,4 +1,4 = @@

-OI Hipster = 2018/4

+OI Hipster = illumos-5a33fb2d62 (>2024/4)

 rpool  = feature@async_destroy          enabled  =                     =   local

 rpool  = feature@empty_bpobj            active =                     =     local

 rpool  = feature@lz4_compress           active   =                     =   local

@@ -6,11 +6,12 = @@

 rpool  = feature@spacemap_histogram     active       =                   = local

 rpool  = feature@enabled_txg            active =                     =     local

 rpool  = feature@hole_birth             active =                     =     local

-rpool  = feature@extensible_dataset     enabled      =                   = local

+rpool  = feature@extensible_dataset     active       =                   = local

 rpool  = feature@embedded_data          active   =                     =   local

 rpool  = feature@bookmarks              = enabled                  =       local

 rpool  = feature@filesystem_limits      enabled    =                     = local

 rpool  = feature@large_blocks           enabled  =                     =   local

+rpool  = feature@large_dnode            = enabled                  =       local

 rpool  = feature@sha512                 = enabled                  =       local

 rpool  = feature@skein                =   enabled                =         local

 rpool  = feature@edonr                =   enabled                =         local

@@ -18,3 +19,10 = @@

 rpool  = feature@obsolete_counts        enabled    =                     = local

 rpool  = feature@zpool_checkpoint       enabled    =                     = local

 rpool  = feature@spacemap_v2            active =                     =     local

+rpool  = feature@allocation_classes     enabled      =                   = local

+rpool  = feature@resilver_defer         enabled    =                     = local

+rpool  = feature@encryption             = enabled                  =       local

+rpool  = feature@bookmark_v2            = enabled                  =       local

+rpool  = feature@userobj_accounting     active       =                   = local

+rpool  = feature@project_quota          active   =                     =   local

+rpool  = feature@log_spacemap           active   =                     =   local

tsoome@beastie:~/zfs-receive-problem$


IMO the first suspects are added active = features: extensible_dataset, userobj_accounting, project_quota, log_spacemap.

So = one test scenario would be to test newer build, but with those features = disabled, if receive is good, then enable one feature and re-test, till = we have suspect:)

rgds,
toomas 

-- 
Dr.Udo Grabowski =  Inst.of Meteorology & Climate Research IMK-ASF-SAT
https://www.imk-asf.kit.edu/english/sat.php
KIT - Karlsruhe = Institute of Technology =          https://www.kit.edu
Postfach 3640,76021 Karlsruhe,Germany T:(+49)721 608-26026 = F:-926026


------------------------------------------
illumos: = illumos-discuss
Permalink: https://illumos.topicbox.com/groups/discuss/T575f82eecd117456-M9f0eb= 10cbc59ea9652b39fe0
Delivery options: https://illumos.topicbox.com/groups/discuss/subscription

= --Apple-Mail=_F5ED4ADD-D5C5-4403-9D54-CEA86746D1CE--