From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/88567 Path: news.gmane.org!.POSTED.blaine.gmane.org!not-for-mail From: James Cloos Newsgroups: gmane.emacs.gnus.general Subject: Re: is nnmaildir very slow? Date: Thu, 16 May 2019 13:27:48 -0400 Message-ID: References: <87v9yb6k1z.fsf@ucl.ac.uk> Mime-Version: 1.0 Content-Type: text/plain Injection-Info: blaine.gmane.org; posting-host="blaine.gmane.org:195.159.176.226"; logging-data="268833"; mail-complaints-to="usenet@blaine.gmane.org" User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.0.50 (gnu/linux) Cc: ding@gnus.org To: Eric S Fraga Original-X-From: ding-owner+M36770@lists.math.uh.edu Thu May 16 19:28:46 2019 Return-path: Envelope-to: ding-account@gmane.org Original-Received: from lists1.math.uh.edu ([129.7.128.208]) by blaine.gmane.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.89) (envelope-from ) id 1hRKBQ-0017in-D0 for ding-account@gmane.org; Thu, 16 May 2019 19:28:44 +0200 Original-Received: from localhost ([127.0.0.1] helo=lists.math.uh.edu) by lists1.math.uh.edu with smtp (Exim 4.92) (envelope-from ) id 1hRKAr-00070G-I5; Thu, 16 May 2019 12:28:09 -0500 Original-Received: from mx1.math.uh.edu ([129.7.128.32]) by lists1.math.uh.edu with esmtps (TLSv1.3:TLS_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1hRKAl-0006xP-2T for ding@lists.math.uh.edu; Thu, 16 May 2019 12:28:03 -0500 Original-Received: from quimby.gnus.org ([80.91.231.51]) by mx1.math.uh.edu with esmtps (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.92) (envelope-from ) id 1hRKAj-0008H4-Kx for ding@lists.math.uh.edu; Thu, 16 May 2019 12:28:02 -0500 Original-Received: from ore.jhcloos.com ([192.40.56.151]) by quimby.gnus.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.89) (envelope-from ) id 1hRKAf-0000cF-HA for ding@gnus.org; Thu, 16 May 2019 19:27:59 +0200 Original-Received: by ore.jhcloos.com (Postfix, from userid 10) id 90A2A1E253; Thu, 16 May 2019 17:27:54 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jhcloos.com; s=ore17; t=1558027674; bh=BUMz4RJm5OP/t+TfawY9z3H2/zAwAImy3jQrPxRh4q8=; h=From:To:Cc:Subject:In-Reply-To:References:Date:From; b=xaM1LWnA7/agnks6wRKGzMiUDiJvBZX1ft3DWV3w6ZOKNamKxzZJL6fNkrftSo5hu /ViBgg7AAKPXY/jJnfQ99VxzT2hgodYKNSnhQ/Ja7n3sskFwxuN0dq7PSctXBh3LE+ rC7KvcPqkXu3yD4Mwlcbmzkrdw0eQ8dUSewLZNbb1hLUyNzsPwTwk92xbSF324EgKa G1Wh02C6q9a7vUwE//RP3PWkXexhgDqOJP32FGTZqAICWYBKy0MidY+vwnRSmgJc4Y NK+GnGyNl8OoqepBdvH8xcy8tdTqymzFI+xlQH1V2/Cc0sUFyV0p1iyUcTeNLSzLZW iOR5AhgpBeD1Q== Original-Received: by carbon.jhcloos.org (Postfix, from userid 500) id 1A4C724F66; Thu, 16 May 2019 17:27:48 +0000 (UTC) In-Reply-To: <87v9yb6k1z.fsf@ucl.ac.uk> (Eric S. Fraga's message of "Thu, 16 May 2019 06:32:40 +0100") Face: iVBORw0KGgoAAAANSUhEUgAAABAAAAAQAgMAAABinRfyAAAACVBMVEX///8ZGXBQKKnCrDQ3 AAAAJElEQVQImWNgQAAXzwQg4SKASgAlXIEEiwsSIYBEcLaAtMEAADJnB+kKcKioAAAAAElFTkSu QmCC Copyright: Copyright 2019 James Cloos OpenPGP: 0x997A9F17ED7DAEA6; url=https://jhcloos.com/public_key/0x997A9F17ED7DAEA6.asc OpenPGP-Fingerprint: E9E9 F828 61A4 6EA9 0F2B 63E7 997A 9F17 ED7D AEA6 Original-Lines: 30 List-ID: Precedence: bulk Xref: news.gmane.org gmane.emacs.gnus.general:88567 Archived-At: >>>>> "EF" == Eric S Fraga writes: EF> server. Unfortunately, however, [nnmaildir] seems to be very slow EF> at the initial scan, taking up to several minutes within the EF> gnus-request-scan function (I added some gnus-message lines in EF> gnus-int.el). I haven't figured out yet why it is so slow. I switched some years back to nnimap on a sql-backed imap daemon for that very reason. I don't know whether it still does, but it used to scan through the groups three times every time I started. Which took *horribly* long back on that laptop's ide drive and shared ram/io bus. On top of that bug, part of the issue is using the filesystem as a database. Anything using that style of storage suffers a superlinear delay as the size grows. I'd start by watching emacs with something like strace -e open to see whether it still loops through all of the groups multiple times. That bug still requires a fix if so. Otherwise a general profile of a startup probably would help. -JimC -- James Cloos OpenPGP: 0x997A9F17ED7DAEA6