From mboxrd@z Thu Jan 1 00:00:00 1970 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on inbox.vuxu.org X-Spam-Level: X-Spam-Status: No, score=-3.4 required=5.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,MAILING_LIST_MULTI,RCVD_IN_DNSWL_MED,UNPARSEABLE_RELAY autolearn=ham autolearn_force=no version=3.4.4 Received: (qmail 10982 invoked from network); 25 Jun 2021 00:16:17 -0000 Received: from zero.zsh.org (2a02:898:31:0:48:4558:7a:7368) by inbox.vuxu.org with ESMTPUTF8; 25 Jun 2021 00:16:17 -0000 ARC-Seal: i=1; cv=none; a=rsa-sha256; d=zsh.org; s=rsa-20200801; t=1624580177; b=XjMh9ZlPlSjIPiHRW28gx1FGcXTNdKAdaLV7+nU5PxZobRWDKZ9JJr9uY+m8jG+GPw/U98v7zy 9MKThY1YNIk7rJcR+K3mQQY2P5aicqNG3O+G//BElrrmlVoNuKtETPo4RMQ3I42jUsEXa/YPtg wIvWjZdvX4Pz56INDgkrim5LDB8Zke1BN/3z6aAKGRtRvvHz/X1yh+ZvqYMzw7fO8gkWmvU4n9 IWEaHyszRiEDhiWJbCg+kzPgqano2BDDF6c0pTOSYWuCLdrrSF1S65g/1B1mlHokqpXKk8H9TO agMrQ6uTuP3CN/yqy8hBYCpvB1p5F3H/rXy/CIoO1X1deg==; ARC-Authentication-Results: i=1; zsh.org; iprev=pass (out3-smtp.messagingengine.com) smtp.remote-ip=66.111.4.27; dkim=pass header.d=daniel.shahaf.name header.s=fm3 header.a=rsa-sha256; dkim=pass header.d=messagingengine.com header.s=fm3 header.a=rsa-sha256; dmarc=none header.from=daniel.shahaf.name; arc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed; d=zsh.org; s=rsa-20200801; t=1624580177; bh=TjL/AAipiUUdjRGzQObOCp3DmdBdV6M0QvTC2kPc7Rc=; h=List-Archive:List-Owner:List-Post:List-Unsubscribe:List-Subscribe:List-Help: List-Id:Sender:Content-Transfer-Encoding:Content-Type:Subject:To:From:Date: References:In-Reply-To:Message-ID:MIME-Version:DKIM-Signature: DKIM-Signature:DKIM-Signature; b=0rjtDyYIo0xr1EhJ2HeumDBdLbtyFFoT9QCfhXXvNJSrILV1ld6N8LzQ72JndfTeBcY9w1bcJT prWoFfG8Zjdh2UEwlKk0ZspQVeXnDJHyDoqPVunQc4Blxc0i4wI+h/3AVIULPW7SjQBZVA0N6/ 0fbsaTMDECzwBAviMB0cDjbS01K1FOYvOpHIrdOu0IwPvaVUK4mqvTuuubLVNnkoFxycTVhKgk 16/GqWEmhq+dIqwfjKxJK3xMKjqsHaKO+Luy70U5XBiG6s2WtLtmOS9KeAFxIVErlRkSkQUw5C 9+ROSjHKuRCamhLrPTZ9ovpwruVUJNPqwpfa4T2U4Rub4A==; DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=zsh.org; s=rsa-20200801; h=List-Archive:List-Owner:List-Post:List-Unsubscribe: List-Subscribe:List-Help:List-Id:Sender:Content-Transfer-Encoding: Content-Type:Subject:To:From:Date:References:In-Reply-To:Message-Id: Mime-Version:Reply-To:Cc:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID; bh=BXgDXbGI0JDjFVP8NcwXxuCxn/yA80R2uYzirD+eBRQ=; b=FrN5jxR0MEqr8crur6/1eF4yQS y3Naz+3Sf7EXA1Q/YagVvYJ7mMOzjtpZrpX996vkmCmW7bCsR5WyVb1ERaGqT0eJXoPV9Dy+Ff3+D 4trxT+nsgjvq2+ohhwPiyyOsUI7/2gpj7rBb27eS4dUDmO85+DjUYL2PDSKgMu5EO2NebUnHtv/xO QWghZ/wqIWXOTR0dTqx+MXDlWTiQSI3gqpoKkcZMbGzo0AVmvJSEgAU3X+QwvbZxi6I+GRXhY5SRV 5Hb6XZUiEdyTbo5Kmz4ovsBFLhP9ypWOZVHjNaoppJQSAvcCV2fiYW9Ciubg/OsusKEZczBgE/5dU IHHxQeuQ==; Received: from authenticated user by zero.zsh.org with local id 1lwZW1-000J3I-PY; Fri, 25 Jun 2021 00:16:13 +0000 Authentication-Results: zsh.org; iprev=pass (out3-smtp.messagingengine.com) smtp.remote-ip=66.111.4.27; dkim=pass header.d=daniel.shahaf.name header.s=fm3 header.a=rsa-sha256; dkim=pass header.d=messagingengine.com header.s=fm3 header.a=rsa-sha256; dmarc=none header.from=daniel.shahaf.name; arc=none Received: from out3-smtp.messagingengine.com ([66.111.4.27]:40889) by zero.zsh.org with esmtps (TLS1.3:TLS_AES_256_GCM_SHA384:256) id 1lwZVm-000Ile-KQ; Fri, 25 Jun 2021 00:15:59 +0000 Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 7B6855C012C; Thu, 24 Jun 2021 20:15:57 -0400 (EDT) Received: from imap37 ([10.202.2.87]) by compute4.internal (MEProxy); Thu, 24 Jun 2021 20:15:57 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= daniel.shahaf.name; h=mime-version:message-id:in-reply-to :references:date:from:to:subject:content-type :content-transfer-encoding; s=fm3; bh=BXgDXbGI0JDjFVP8NcwXxuCxn/ yA80R2uYzirD+eBRQ=; b=pWQewB2Pr+EWHuP8uguZ5lbRiWGqt7awFKNGW9ExZN MuKme/Y+XGZNlKFEUMQhg2Vvtza9/He6NR2VHpDrqtfDM+VPRsdGP7gGaZO2KQ92 sKLNEhOp3zis3pW+PbRkpcl8YCfAHKm88s1HM+asDUhIBmGnyYR/qZydktKlguns dsJuPPTGVZOhJkb0QfSnDz40W2c/0HZDiwYYBvPiU0dFBdZlq2HDervQAGN1Sf+W 8QSNnMnXjC1duvySgY2oDDUfhvvSPYYeduCr8UW1QBOuSmOlkqCKJq9HDe6HFXUP 4YLrXIipWZD8WHzHycv+TFKlv4/YCeq92LuBPUqqtTzg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm3; bh=BXgDXbGI0JDjFVP8NcwXxuCxn/yA80R2uYzirD+eB RQ=; b=CJL8ssRjKY2PaprS3lP0Kw2DtEf7Jg1vx46KA866s4uvgshDsZNx0hZ6s otzUt2T9M7aKLTz8SxZH4YgFBdaL0cp+hLNbDjtLIeAbAGE56X1tZvRvyp83xoi0 oeWLzoNvxKv45VBHezP4uYLPd38xy33OPG7Ldh0qEROYeC4gLhB0Qr7RGbLdqIDU ryNsRfqoXqkBbGDchhutSzmc/2Wpix3DPM/aQA9UxGw2kC48JdzSiVuC6C6jBejt /ThecT2RLSuY4jT4a3ZAQysn6//LjwGUIInXes8lf5LD8BL8cykgXxUAi+9W5KES USoYZGtWOIkAdZ5M0wZVtGTAVlZaw== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrfeegiedgfeefucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepofgfggfkjghffffhvffutgfgsehtqhertderreejnecuhfhrohhmpedfffgr nhhivghlucfuhhgrhhgrfhdfuceougdrshesuggrnhhivghlrdhshhgrhhgrfhdrnhgrmh gvqeenucggtffrrghtthgvrhhnpeegvddtgeejjefhgfeutdetveetueehteelhfeugefh heffgefhleelkeekledtteenucffohhmrghinhepiihshhdrohhrghdpmhhhohhnrghrtg drohhrghenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhm pegurdhssegurghnihgvlhdrshhhrghhrghfrdhnrghmvg X-ME-Proxy: Received: by mailuser.nyi.internal (Postfix, from userid 501) id 09B476B4006A; Thu, 24 Jun 2021 20:15:56 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.5.0-alpha0-530-gd0c265785f-fm-20210616.002-gd0c26578 Mime-Version: 1.0 Message-Id: <940b6df4-cc06-4091-8d9a-13d7928eb4e9@www.fastmail.com> In-Reply-To: <20210624233634.GA211890@zira.vinc17.org> References: <20210624083612.GA170692@zira.vinc17.org> <20210624191156.GC16386@tarpaulin.shahaf.local2> <20210624233634.GA211890@zira.vinc17.org> Date: Fri, 25 Jun 2021 00:15:36 +0000 From: "Daniel Shahaf" To: "Vincent Lefevre" , zsh-workers@zsh.org Subject: Re: archived messages with "From " get truncated Content-Type: text/plain;charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Seq: 49123 Archived-At: X-Loop: zsh-workers@zsh.org Errors-To: zsh-workers-owner@zsh.org Precedence: list Precedence: bulk Sender: zsh-workers-request@zsh.org X-no-archive: yes List-Id: List-Help: List-Subscribe: List-Unsubscribe: List-Post: List-Owner: List-Archive: Vincent Lefevre wrote on Thu, 24 Jun 2021 23:36 +00:00: > On 2021-06-24 19:11:56 +0000, Daniel Shahaf wrote: > > Vincent Lefevre wrote on Thu, Jun 24, 2021 at 10:36:12 +0200: > > > Below is a message that was sent by Stephane to workers. > > > It has been archived here: > > >=20 > > > https://www.zsh.org/mla/workers/2021/msg01272.html > > >=20 > > > but got truncated just before a line starting with "From ". > > > It seems that the mail archive software is buggy, thinking > > > that this starts a new mail message. > >=20 > > The problem might be either in the mailing list software or in how w= e > > invoke it. > >=20 > > We invoke mhonarc as follows: > >=20 > > 134 /usr/local/bin/mhonarc \ > > 135 -quiet \ > > 136 -definevar listlocalpartsansprefix=3D${listl= ocalpart#zsh-} \ > > 137 -title "${title}" \ > > 138 -ttitle "${title}" \ > > 139 -tlevels 9999 \ > > 140 -rcfile /usr/local/www/mhonarc.zsh \ > > 141 -add \ > > 142 -- "$munged_tmpfile" \ > > 143 || exit EX_UNAVAILABLE > >=20 > > Here, ${munged_tmpfile} is a file that was created by > > =C2=AB() { munged_tmpfile=3D$1; cat > $munged_tmpfile } =3D(:)=C2=BB= , the whole thing > > being invoked by Exim using a =C2=AB"| /path/to/script"=C2=BB target= in > > /etc/aliases. (The "munged" terminoilogy is because there's also > > a =C2=ABperl -pi -E 's/^X-Seq: =E2=80=A6/=E2=80=A6/ if (1../^$/)'=C2= =BB in there.) > >=20 > > Does anyone happen to see off the top of their heads what we're doin= g > > wrong? >=20 > If I understand correctly, $munged_tmpfile is a *single* message. Indeed. > Then, according to the mhonarc documentation >=20 > https://www.mhonarc.org/MHonArc/doc/quickstart.html#adding >=20 > you must not use the "-add" option, but "-single". Thanks! I missed that flag. I'll have a look. (If someone can beat me= to it, please do.) > Alternatively, > you may use "-add" for a single message, but the message must be > read from the standard input instead of being a filename argument. Yup. We actually already have a pending merge request for this, but it fell through the cracks =E2=98=B9 (MR !5, issue #37; not public, sorry). > The examples: > (1) mhonarc -add /mailfolder > (2) mhonarc -add < single.msg > (3) cat single.msg | mhonarc -add > (4) mhonarc -single < messagefile > file.html > (5) mhonarc -single messagefile > file.html >=20 > The syntax above is case (1), i.e. with a folder. And I suppose > that mhonarc regards a line starting with "From " as the beginning > of a new mail message from the folder, even if this line has a > wrong syntax for such a mail separator. Hence the truncation. > Then, I don't know what happens with the remaining part as this > would yield an invalid mail message; perhaps it is just discarded. Apparently it's discarded, unless it looks like a valid email message, as in the case of git-format-patch(1) emails; see workers/48587 (which is https://www.zsh.org/mla/workers/2021/msg00812.html). And yes, I had to give the full link, because the numlist file (=3D the database for the "X-Seq number to HTML" redirection script) is broken =E2= =98=B9 So, action items: 1. Review =C2=ABmhonarc -single=C2=BB 2. Deploy either =C2=ABmhonarc -single=C2=BB or =C2=ABmhonarc -add < $mu= nged_tmpfile=C2=BB 3. Regenerate broken messages in the archives [for all lists] 4. Fix appends to the numlist file 5. Regenerate the missing part of the numlist file [for all lists] Anyone interesting in helping, don't be shy =E2=98=BA Thanks a lot, Vincent. Daniel