From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/86476 Path: news.gmane.org!not-for-mail From: myglc2 Newsgroups: gmane.emacs.gnus.general Subject: Re: nnimap backend performances ? Date: Thu, 31 Dec 2015 22:51:03 -0500 Message-ID: <87h9iyq7o8.fsf@gmail.com> References: <874mgh1amt.fsf@ericabrahamsen.net> <87twn19hwq.fsf@gmail.com> <87h9iz1789.fsf@ericabrahamsen.net> NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain X-Trace: ger.gmane.org 1451620456 11654 80.91.229.3 (1 Jan 2016 03:54:16 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Fri, 1 Jan 2016 03:54:16 +0000 (UTC) To: ding@gnus.org Original-X-From: ding-owner+M34701@lists.math.uh.edu Fri Jan 01 04:54:05 2016 Return-path: Envelope-to: ding-account@gmane.org Original-Received: from lists1.math.uh.edu ([129.7.128.208]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1aEqmy-0000at-AS for ding-account@gmane.org; Fri, 01 Jan 2016 04:54:04 +0100 Original-Received: from localhost ([127.0.0.1] helo=lists.math.uh.edu) by lists1.math.uh.edu with smtp (Exim 4.85) (envelope-from ) id 1aEqlk-00052U-7Z; Thu, 31 Dec 2015 21:52:48 -0600 Original-Received: from mx1.math.uh.edu ([129.7.128.32]) by lists1.math.uh.edu with esmtps (TLSv1.2:AES128-GCM-SHA256:128) (Exim 4.85) (envelope-from ) id 1aEqlh-000529-6t for ding@lists.math.uh.edu; Thu, 31 Dec 2015 21:52:45 -0600 Original-Received: from quimby.gnus.org ([80.91.231.51]) by mx1.math.uh.edu with esmtps (TLSv1.2:DHE-RSA-AES128-SHA:128) (Exim 4.85) (envelope-from ) id 1aEqld-0002iY-6u for ding@lists.math.uh.edu; Thu, 31 Dec 2015 21:52:45 -0600 Original-Received: from plane.gmane.org ([80.91.229.3]) by quimby.gnus.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:256) (Exim 4.80) (envelope-from ) id 1aEqlZ-0005Li-N8 for ding@gnus.org; Fri, 01 Jan 2016 04:52:37 +0100 Original-Received: from list by plane.gmane.org with local (Exim 4.69) (envelope-from ) id 1aEqlW-0007HD-QY for ding@gnus.org; Fri, 01 Jan 2016 04:52:34 +0100 Original-Received: from c-73-167-118-254.hsd1.ma.comcast.net ([73.167.118.254]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 01 Jan 2016 04:52:34 +0100 Original-Received: from eric by c-73-167-118-254.hsd1.ma.comcast.net with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 01 Jan 2016 04:52:34 +0100 X-Injected-Via-Gmane: http://gmane.org/ Original-Lines: 140 Original-X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: c-73-167-118-254.hsd1.ma.comcast.net User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.0.50 (gnu/linux) Cancel-Lock: sha1:NOKQidL0aMTyv5rpwUojpxRSEBI= X-Spam-Score: -1.8 (-) List-ID: Precedence: bulk Xref: news.gmane.org gmane.emacs.gnus.general:86476 Archived-At: Eric Abrahamsen writes: > On 12/29/15 14:25 PM, myglc2 wrote: >> >> Eric Abrahamsen writes: >> >>> My understanding is that the nnimap backend was re-written quite >>> significantly two or three years ago (?). At any rate, the people who >>> used the first iteration and were horrified now seem mostly happy with >>> the new version, YMMV. I used to use isync and local dovecot, now use >>> the direct connection, and it doesn't kill me. It isn't great (I'm in >>> China), but it doesn't kill me. >>> >>> eric >> >> So Eric, it sounds like you abandoned ... >> >> https://ericabrahamsen.net/tech/2014/oct/gnus-dovecot-lucene.html > > > No, I haven't abandoned that setup! Or rather, I've moved halfway away > from it, but I'm going back. > > I recently switched my two main email accounts from Google Apps to > self-hosted, and for the moment I'm having Gnus talk directly to the > remote server for the new accounts. > > Basically I deleted the two Google Apps accounts, but left the > corresponding imap accounts on my local Dovecot. I didn't want to move > all the old mail into the new accounts, because there's a lot of it. > > That means I've got two "legacy" accounts for two addresses, which only > exist locally, and two "new" accounts for the same two addresses, which > only exist on my remote server. At some point I'll explain to my local > Dovecot that these are actually four separate imap stores, and start > syncing the two new accounts locally, as well. > > For the time being the two "legacy" accounts are still working just fine > with the local Dovecot arrangement, and I should say are much easier to > search than the new remote accounts. I want to move back mostly because > the connections are still too slow/unstable for my taste. It's not Gnus' > fault. This is really good to hear. Your "legacy" situation closely parallels the archive I need for a work account that I am loosing. >> ... which I was following & hit the "plain" auth issue you discussed >> ~1yr ago on the isync list. > > Ugh, I went through a dark period of confusion and despair for a bit > there, when I was trying to learn too many new things all at the same > time. In fact, I believe the problem was partially solved by upgrading > isync (see the later patch posted to that isync thread). I'm now using > 1.3.0, what are you using? isync 1.3.0 built from git://git.code.sf.net/p/isync/isync master 46e792c > I need to update the blog post: the ~/.mbsyncrc file syntax changed for > the 1.3 version. There's another possibly important difference: > > 1) /etc/dovecot/dovecot.conf: In the userdb clause, on the "args" line, > I've added at the end: > > username_format=%u Thanks, I had that from your reply on a later thread (quoted below) showing your more recent dovecot config ... *** From: Eric Abrahamsen Subject: Re: mail vs news Newsgroups: gmane.emacs.gnus.general To: ding@gnus.org Date: Thu, 17 Dec 2015 19:13:40 +0800 Here's my output of "doveconf -n". This is all the configuration I've got, apart from /etc/dovecot/passwd. # 2.2.21 (5345f22): /etc/dovecot/dovecot.conf # OS: Linux 4.2.5-1-ARCH i686 auth_verbose = yes disable_plaintext_auth = no info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log mail_plugins = "fts fts_lucene" passdb { args = username_format=%u /etc/dovecot/passwd driver = passwd-file } plugin { fts = lucene fts_autoindex = yes fts_lucene = whitespace_chars=@. } protocols = imap ssl = no userdb { args = uid=eric gid=users home=/home/eric/.mail/%d/%n username_format=%u default_fields = mail=maildir:/home/eric/.mail/%d/%n/mail driver = static } *** That "doveconf -n" command is a beautiful thing! This also work for me on dovecot 2.2.13 installed on debian 8 this way: apt-get install dovecot-core dovecot-imapd dovecot-lucene > 2) /etc/dovecot/passwd: The lines that used to look like > > eric@ericabrahamsen.net:{PLAIN}passwurd > > Now look like > > eric@ericabrahamsen.net:{PLAIN}passwurd:eric@ericabrahamsen.net Nice. This is the puzzle piece I was missing. Now it works! > I think the crux of the problem is that _authentication account_ and > _user account_ are actually separate concerns. Either the previous > version of isync was doing it wrong, or my dovecot config had to be > fixed to separate the two things correctly, or maybe both. > > To be honest I've forgotten how it works, a bit, and that's the main > reason I haven't synced my two new accounts to the local dovecot. > > I'll try to do that this weekend, and update that blog post! In the > meantime, I hope something in here is helpful to you. A huge help. Thank You. FWIW, My goal is to sweep multiple gmail accounts into bullet-proof archives with tools for searching and clustering several decades of work. To get a handle on what is doable, I am experimenting with gnus backends and search schemes, mu/mu4e, dovecot, and mbsync. I would love to hear suggestions of other emacs-compatible solutions I should try. George