From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/67827 Path: news.gmane.org!not-for-mail From: Reiner Steib Newsgroups: gmane.emacs.gnus.general Subject: Re: bug#1174: 23.0.60; Some UTF-8 mails displaying wrongly in Emacs 23 Date: Sat, 29 Nov 2008 16:30:18 +0100 Message-ID: <87d4geim7p.fsf@marauder.physik.uni-ulm.de> References: <871vyf6q40.fsf@marauder.physik.uni-ulm.de> <87k5ampwej.fsf@marauder.physik.uni-ulm.de> <878wr2ohde.fsf@mocca.josefsson.org> Reply-To: Reiner Steib NNTP-Posting-Host: lo.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Trace: ger.gmane.org 1227972709 21213 80.91.229.12 (29 Nov 2008 15:31:49 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Sat, 29 Nov 2008 15:31:49 +0000 (UTC) Cc: Frank Schmitt , James Cloos , Stefan Monnier , ding@gnus.org, 1174@emacsbugs.donarmstrong.com, Clemens Schueller To: Simon Josefsson Original-X-From: ding-owner+M16274@lists.math.uh.edu Sat Nov 29 16:32:51 2008 Return-path: Envelope-to: ding-account@gmane.org Original-Received: from util0.math.uh.edu ([129.7.128.18]) by lo.gmane.org with esmtp (Exim 4.50) id 1L6RoL-0001Mk-J3 for ding-account@gmane.org; Sat, 29 Nov 2008 16:32:45 +0100 Original-Received: from localhost ([127.0.0.1] helo=lists.math.uh.edu) by util0.math.uh.edu with smtp (Exim 4.63) (envelope-from ) id 1L6RmL-0006vJ-0o; Sat, 29 Nov 2008 09:30:41 -0600 Original-Received: from mx1.math.uh.edu ([129.7.128.32]) by util0.math.uh.edu with esmtps (TLSv1:AES256-SHA:256) (Exim 4.63) (envelope-from ) id 1L6RmJ-0006v0-GN for ding@lists.math.uh.edu; Sat, 29 Nov 2008 09:30:39 -0600 Original-Received: from quimby.gnus.org ([80.91.231.51]) by mx1.math.uh.edu with esmtp (Exim 4.69) (envelope-from ) id 1L6RmF-0006jw-VJ for ding@lists.math.uh.edu; Sat, 29 Nov 2008 09:30:39 -0600 Original-Received: from mail.uni-ulm.de ([134.60.1.11]) by quimby.gnus.org with esmtp (Exim 3.36 #1 (Debian)) id 1L6RmQ-0002UL-00 for ; Sat, 29 Nov 2008 16:30:46 +0100 Original-Received: from bridgekeeper.physik.uni-ulm.de (bridgekeeper.physik.uni-ulm.de [134.60.10.175]) by mail.uni-ulm.de (8.14.2/8.14.2) with ESMTP id mATFUMjS001952; Sat, 29 Nov 2008 16:30:22 +0100 (MET) Original-Received: from localhost (localhost [127.0.0.1]) by bridgekeeper.physik.uni-ulm.de (Postfix) with ESMTP id 6CE551340D; Sat, 29 Nov 2008 16:30:22 +0100 (CET) X-Face: :6KQZ[nyoS_edmB.%gw-=)BYth^|2+Y+^cu%I$FSx!&>-'om>3H7A|M&n(V7fIo3P.;yo.b yq4$p;ZaBtkv)\}biaiBQe"mD}iib1AA@99-fZ7i*bLhNRVC&0Wkxg9)SH?oWc@{ In-Reply-To: <878wr2ohde.fsf@mocca.josefsson.org> (Simon Josefsson's message of "Sat, 29 Nov 2008 13:18:21 +0100") User-Agent: Gnus/5.110011 (No Gnus v0.11) Emacs/22.1 (gnu/linux) X-DCC-CTc-dcc1-Metrics: poseidon 1030; Body=9 Fuz1=9 Fuz2=9 X-Virus-Scanned: by amavisd-new X-MIME-Autoconverted: from 8bit to quoted-printable by mail.uni-ulm.de id mATFUMjS001952 X-Spam-Score: -2.6 (--) List-ID: Precedence: bulk Xref: news.gmane.org gmane.emacs.gnus.general:67827 Archived-At: On Sat, Nov 29 2008, Simon Josefsson wrote: > Reiner Steib writes: >>>>>> ;; BEWARE: we used to use string-as-multibyte here which is brai= ndead >>>>>> ;; because it will turn accidental emacs-mule-valid byte sequenc= es >>>>>> ;; into multibyte chars. --Stef >>>>>> ;; Reverted, braindead got 7.5 out of 10 on imdb, so it can't be >>>>>> ;; that bad. --Simon >> >> Simon, could you please clarify why you reverted Stefan's change in >> `nnimap-demule'? It breaks reading UTF-8 articles via nnimap.el in >> Emacs 23. > > I don't recall, but people should notice relatively quickly if there ar= e > problems in this area (wrong display of non-ascii)=20 Hm, both changes happened 2004, but I don't recall any reports beside the recent ones in 2008: http://thread.gmane.org/gmane.emacs.gnus.general/67112 (bug#464, reported by James Cloos) http://thread.gmane.org/gmane.emacs.bugs/21524 (bug#1174, reported by Frank Schmitt) =20 ---------------------------- revision 7.9 date: 2004-09-13 13:52:48 +0200; author: jas; state: Exp; lines: +5 = -3 (nnimap-demule): Revert 2004-08-30 change. ---------------------------- > so feel free to revert the patch or apply another patch instead. It > needs to be tested under Emacs 22 too, though, I never saw this problem myself. I cannot see any difference with a few UTF-8 articles (C-T-E: 8bit, [1]), neither with Emacs 22 (with current Gnus trunk) or Emacs trunk (Gnus 5.13 from there). Stefan, what are the "accidental emacs-mule-valid byte sequences" that trigger this problem? It would be good if someone could send me a problematic article. [2] I've just checked in (Gnus and Emacs) some code to debug this problem. I'd like to ask those who saw the bug in Emacs 23 to test the articles in question: - With current Emacs 23 (Emacs CVS trunk) - With Emacs 22 plus current Gnus CVS trunk (No Gnus) - If you see wrong display: does it display correctly after evaluating the following: M-x gnus-backlog-shutdown RET (setq nnimap-demule-use-string-to-multibyte nil gnus-verbose 10) Check the *Messages* buffer for messages "nnimap-demule-use-string-to-multibyte: nil" to ensure that the article is decoded again with this setting. You may need to re-enter the group. > if it is installed in the Gnus CVS. I don't want different code in Gnus and Emacs. If all else fails, we can make it conditional. Bye, Reiner. [1] Cc-s of the following articles (available on Gmane) from Aidan Kehoe: <18492.30425.377545.700503@parhasard.net> <18518.43672.183610.662699@parhasard.net> <18712.43474.265690.792714@parhasard.net> Non-ascii characters in the attribution line ("scr=C3=ADobh"), the signature ("=C2=BFD=C3=B3nde estar=C3=A1 ahora mi sobrino Yoghurtu Ng= h=C3=A9 ..."), and "=E2=80=99", "=C4=B0", "=C4=B1" [2] (push '(utf-8 . 8bit) mm-body-charset-encoding-alist) --> trying to produce a problematic article here: AE-=C3=84 OE-=C3=96 UE-=C3=9C ae-=C3=A4 oe-=C3=B6 ue-=C3=BC ss-=C3=9F Should be sent with:=20 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: 8bit --=20 ,,, (o o) ---ooO-(_)-Ooo--- | PGP key available | http://rsteib.home.pages.de/