From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/47007 Path: main.gmane.org!not-for-mail From: Ted Zlatanov Newsgroups: gmane.emacs.gnus.general Subject: Re: Do nnmail-split-fancy-with-parent for nnimap? Date: Sat, 05 Oct 2002 20:52:30 -0400 Organization: =?koi8-r?q?=F4=C5=CF=C4=CF=D2=20=FA=CC=C1=D4=C1=CE=CF=D7?= @ Cienfuegos Sender: owner-ding@hpc.uh.edu Message-ID: References: <87y99cik4g.fsf@crybaby.cs.uni-dortmund.de> <87lm5cij8u.fsf@crybaby.cs.uni-dortmund.de> NNTP-Posting-Host: localhost.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Trace: main.gmane.org 1033865369 4872 127.0.0.1 (6 Oct 2002 00:49:29 GMT) X-Complaints-To: usenet@main.gmane.org NNTP-Posting-Date: Sun, 6 Oct 2002 00:49:29 +0000 (UTC) Cc: ding@gnus.org Return-path: Original-Received: from malifon.math.uh.edu ([129.7.128.13]) by main.gmane.org with esmtp (Exim 3.35 #1 (Debian)) id 17xzbs-0001GS-00 for ; Sun, 06 Oct 2002 02:49:28 +0200 Original-Received: from sina.hpc.uh.edu ([129.7.128.10] ident=lists) by malifon.math.uh.edu with esmtp (Exim 3.20 #1) id 17xzbj-0005k3-00; Sat, 05 Oct 2002 19:49:19 -0500 Original-Received: by sina.hpc.uh.edu (TLB v0.09a (1.20 tibbs 1996/10/09 22:03:07)); Sat, 05 Oct 2002 19:50:01 -0500 (CDT) Original-Received: from sclp3.sclp.com (qmailr@sclp3.sclp.com [209.196.61.66]) by sina.hpc.uh.edu (8.9.3/8.9.3) with SMTP id TAA08944 for ; Sat, 5 Oct 2002 19:49:48 -0500 (CDT) Original-Received: (qmail 25110 invoked by alias); 6 Oct 2002 00:49:02 -0000 Original-Received: (qmail 25105 invoked from network); 6 Oct 2002 00:49:02 -0000 Original-Received: from ns2.beld.net (208.229.215.82) by gnus.org with SMTP; 6 Oct 2002 00:49:02 -0000 Original-Received: from heechee.beld.net (dhcp-0-50-8b-df-51-5e.cpe.beld.net [65.202.179.7]) by ns2.beld.net (Postfix) with ESMTP id EC67A3B8A3; Sat, 5 Oct 2002 20:49:01 -0400 (EDT) Original-To: Kai.Grossjohann@CS.Uni-Dortmund.DE (Kai =?iso-8859-1?q?Gro=DFjohann?=) X-Face: bd.DQ~'29fIs`T_%O%C\g%6jW)yi[zuz6;d4V0`@y-~$#3P_Ng{@m+e4o<4P'#(_GJQ%TT= D}[Ep*b!\e,fBZ'j_+#"Ps?s2!4H2-Y"sx" Mail-Followup-To: Kai.Grossjohann@CS.Uni-Dortmund.DE (Kai =?iso-8859-1?q?Gro=DFjohann), ?=@ns2.beld.net, ding@gnus.org In-Reply-To: <87lm5cij8u.fsf@crybaby.cs.uni-dortmund.de> (Kai.Grossjohann@CS.Uni-Dortmund.DE's message of "Sun, 06 Oct 2002 01:00:33 +0200") Original-Lines: 68 User-Agent: Gnus/5.090008 (Oort Gnus v0.08) Emacs/21.2 (i386-redhat-linux-gnu) Precedence: list X-Majordomo: 1.94.jlt7 Xref: main.gmane.org gmane.emacs.gnus.general:47007 X-Report-Spam: http://spam.gmane.org/gmane.emacs.gnus.general:47007 On Sun, 06 Oct 2002, Kai.Grossjohann@CS.Uni-Dortmund.DE wrote: >> Why not store the group name as Gnus shows it, e.g. when moving >> articles? nnxyz+abcdef:groupname is what I'm thinking of. Then >> the unqualified groups are in the primary backend - as they would >> be if you manually moved articles around. I'm talking as a Gnus >> user, maybe the implementation is much more complex that way. I >> don't know the internals of mail moving. > > The problem is backward compatibility. Suppose people have nntp as > their primary server, and nnml and nnimap as secondary servers. > Then right now foo.bar means the group nnml:foo.bar (because nnml is > the "primary mail backend"), but your suggestion would change it to > mean a group on the nntp server. Right, so the problem is that right now, the cache assumes nnml. You could have a cache version at the top of the file (like BBDB), and upgrade users to the newer cache version when they run the new function, rewriting every group name to "nnml:groupname". Or you could have a file called .nnimap.cache, separate from the nnml cache. > (One possibility would be to make all groups be prefixed, maybe > we could use "native" for the primary server.) That's what I was thinking, but realize that the "native" prefix or whatever we use for the primary server is superfluous - if it's an arbitrary string, you may as well skip it. >>> It would be really cool if ~/.nnmail-cache was stored on the >>> server somehow. Is there a way to store data like this alongside >>> IMAP mail on a server? >> >> I think the network usage would be too high for this. > > You must be kidding. Right now, nnimap splitting transfers each > message over the net twice (one fetch from nnimap:INBOX, one put to > the target group). I don't see how it can hurt to add 60 or 80 > bytes to this traffic. > (It conceivable that .nnmail-cache must always be transferred in > full, maybe via ange-ftp. This is a bad solution indeed, and for > this your counter argument would be right. I wasn't even > considering such bad solutions before you mentioned the possibility > :-) You would have to either break up the cache in some way, or transfer the entire cache every time. You can store the cache in a group (e.g. "gnus-imap-split-cache") that would basically be a mail group like any other; corruption of its data is the user's problem. Any other storage of the cache would need support on the IMAP server, AFAIK. Now, if you transfer the entire cache, the chance of data corruption is smaller, and the code is much simpler. That's the solution I thought of, initially. Breaking up the cache in some way would complicate the code considerably. Also, you would have to devise an efficient way to search all the cache elements for an article ID, or have the subject of each article in the cache group somehow contain the article ID. Either way, with a single cache, or with a piecemeal cache, it's a lot of traffic when your cache grows to 50000 articles. Am I missing something obvious? Ted