From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/87063 Path: news.gmane.org!not-for-mail From: Ted Zlatanov Newsgroups: gmane.emacs.gnus.general Subject: Re: gnus-sync work Date: Tue, 24 May 2016 15:17:36 -0400 Organization: =?utf-8?B?0KLQtdC+0LTQvtGAINCX0LvQsNGC0LDQvdC+0LI=?= @ Cienfuegos Message-ID: <87bn3vs1tb.fsf@lifelogs.com> References: <87twzdc86f.fsf@building.gnus.org> <8761bhzz0f.fsf@lifelogs.com> <878ugdxpuc.fsf@lifelogs.com> <86twv7p7nu.fsf_-_@dod.no> <86r3pnciof.fsf_-_@dod.no> <87io0y4bw4.fsf_-_@lifelogs.com> <87lh3439r6.fsf@dod.no> Reply-To: ding@gnus.org NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain X-Trace: ger.gmane.org 1464117902 20720 80.91.229.3 (24 May 2016 19:25:02 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Tue, 24 May 2016 19:25:02 +0000 (UTC) To: ding@gnus.org Original-X-From: ding-owner+M35284@lists.math.uh.edu Tue May 24 21:24:45 2016 Return-path: Envelope-to: ding-account@gmane.org Original-Received: from lists1.math.uh.edu ([129.7.128.208]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1b5Hwa-0001mO-MH for ding-account@gmane.org; Tue, 24 May 2016 21:24:44 +0200 Original-Received: from localhost ([127.0.0.1] helo=lists.math.uh.edu) by lists1.math.uh.edu with smtp (Exim 4.86_2) (envelope-from ) id 1b5Hvp-0007M0-8D; Tue, 24 May 2016 14:23:57 -0500 Original-Received: from mx2.math.uh.edu ([129.7.128.33]) by lists1.math.uh.edu with esmtps (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.86_2) (envelope-from ) id 1b5Hq5-0007HB-CU for ding@lists.math.uh.edu; Tue, 24 May 2016 14:18:01 -0500 Original-Received: from quimby.gnus.org ([80.91.231.51]) by mx2.math.uh.edu with esmtps (TLSv1.2:DHE-RSA-AES128-SHA:128) (Exim 4.86_2) (envelope-from ) id 1b5Hq3-0001to-1P for ding@lists.math.uh.edu; Tue, 24 May 2016 14:18:01 -0500 Original-Received: from plane.gmane.org ([80.91.229.3]) by quimby.gnus.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:256) (Exim 4.80) (envelope-from ) id 1b5Hpq-0004dw-CT for ding@gnus.org; Tue, 24 May 2016 21:17:48 +0200 Original-Received: from list by plane.gmane.org with local (Exim 4.69) (envelope-from ) id 1b5Hpo-0007lU-ID for ding@gnus.org; Tue, 24 May 2016 21:17:44 +0200 Original-Received: from c-98-229-60-157.hsd1.ma.comcast.net ([98.229.60.157]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 24 May 2016 21:17:44 +0200 Original-Received: from tzz by c-98-229-60-157.hsd1.ma.comcast.net with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 24 May 2016 21:17:44 +0200 X-Injected-Via-Gmane: http://gmane.org/ Mail-Followup-To: ding@gnus.org Original-Lines: 36 Original-X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: c-98-229-60-157.hsd1.ma.comcast.net X-Face: bd.DQ~'29fIs`T_%O%C\g%6jW)yi[zuz6;d4V0`@y-~$#3P_Ng{@m+e4o<4P'#(_GJQ%TT= D}[Ep*b!\e,fBZ'j_+#"Ps?s2!4H2-Y"sx" Mail-Copies-To: never User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.1.50 (gnu/linux) Cancel-Lock: sha1:uJQvhDkBUexOTq8OJM/+r7OqqzA= X-Spam-Score: -4.3 (----) List-ID: Precedence: bulk Xref: news.gmane.org gmane.emacs.gnus.general:87063 Archived-At: On Fri, 20 May 2016 19:43:57 +0200 Steinar Bang wrote: >>>>>> Dave Abrahams : >> I wonder how ridiculous it would be to, for every newsgroup, create >> imap folders with empty shadow articles for each news article? Then >> you could access NNTP and IMAP in parallel and just use IMAP for the >> article marks. I think that's not a bad idea, but it creates a lot of opportunities for things to get out of sync and would be very slow (using these shadow articles requires spooling them, waiting, then setting their marks). Entering a large group could take hours. Lars' idea, from when we talked about it, was to create articles with a data description of what has changed since the last full sync, so you can read the articles to recreate the marks. SB> The problem will be synching the article numbers in an efficient manner SB> (ie. based on the NOV data), I think...? SB> Or...? Perhaps not...? Is the message-id a part of the NOV data? That SB> would be identical in both folders, I think...? How about this protocol: * designate an IMAP folder as the sync home * message subject is the group name * message body is just a dump of the Lisp data for the marks * messages marked Important (ticked) are full syncs of the marks for that group * messages not marked Important are differential syncs (protocol to be determined, let's stick to full sync only) This would be fast and you can even go back to older marks if you catch up by accident or something. The marks would be stored in a small consistent data store, atomically updated (most recent wins). Ted