Gnus development mailing list
 help / color / mirror / Atom feed
* Slowdowns with big nnmaildir groups
@ 2008-02-01  8:35 Tassilo Horn
  2008-02-01 11:22 ` David
  2008-02-01 21:00 ` Ted Zlatanov
  0 siblings, 2 replies; 14+ messages in thread
From: Tassilo Horn @ 2008-02-01  8:35 UTC (permalink / raw)
  To: ding

Hi,

I recently switched from nnimap to OfflineIMAP [1] and nnmaildir, mainly
to increase the speed for fetching mail and entering groups.

One of my nnmaildir groups holds the emacs-devel list and it contains
about 10000 mails right now.  If there're let's say 5 new messages in it
and I press RET on it to read them, it takes at least 10 seconds to open
the *Summary* buffer.  When I use C-u RET RET to view all 10000
messages, it takes about 50 seconds to open *Summary*.

50 seconds sounds ok because of scoring, threading, sorting and stuff,
but 10 seconds for 5 messages is far too much IMO.

This slowdown happens only with groups holding many messages.  With
groups with articlecounts below 1000 entering *Summary* (even with all
articles) takes about 2 seconds.

Additionally Gnus startup is very slow.  Here's some output from
*Messages*.

,----[ *Messages* ]
| 20080201T085036.482> Reading active file from Fastmail via nnmaildir...
| 20080201T085036.502> Opening nnmaildir server on Fastmail...
| 20080201T085036.503> Opening nnmaildir server on Fastmail...done
| 20080201T085127.386> Reading active file from Popmail via nnml...
`----

As you can see, it takes about a minute for the next operation to start
after the server Fastmail holding emacs-devel (and other large groups)
was opened.

In each of those slowdowns the emacs process uses 100% of cpu time.

Can anyone provide some tips how I can profile gnus to see what function
causes the slowdowns?

Bye,
Tassilo
__________
[1] http://software.complete.org/offlineimap



^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Slowdowns with big nnmaildir groups
  2008-02-01  8:35 Slowdowns with big nnmaildir groups Tassilo Horn
@ 2008-02-01 11:22 ` David
  2008-02-01 12:02   ` Tassilo Horn
  2008-02-01 21:00 ` Ted Zlatanov
  1 sibling, 1 reply; 14+ messages in thread
From: David @ 2008-02-01 11:22 UTC (permalink / raw)
  To: ding

Tassilo Horn <tassilo@member.fsf.org> writes:
> Can anyone provide some tips how I can profile gnus to see what function
> causes the slowdowns?

Use the elisp profiler (ELP)

M-x elp-instrument-package RET gnus
... perform slow operations ...
M-x elp-results

-David




^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Slowdowns with big nnmaildir groups
  2008-02-01 11:22 ` David
@ 2008-02-01 12:02   ` Tassilo Horn
  2008-02-01 12:29     ` David
  2008-02-01 12:35     ` Daniel Pittman
  0 siblings, 2 replies; 14+ messages in thread
From: Tassilo Horn @ 2008-02-01 12:02 UTC (permalink / raw)
  To: ding

[-- Attachment #1: Type: text/plain, Size: 979 bytes --]

David <de_bb@arcor.de> writes:

Hi David,

> Use the elisp profiler (ELP)
>
> M-x elp-instrument-package RET gnus
> ... perform slow operations ...
> M-x elp-results

Hey, cool.  I didn't know it's included in emacs.  Before your post I
downloaded a elp.el from emacswiki but that didn't work with emacs 23.

Attached are 3 files showing the results of profiling when entering my
emacs-devel group and selecting to view 20, 2000 or 6000 messages.  But
the measured times are not really correct.  In the example with 20
messages it says that the function `gnus-retrieve-headers' was active
for 37 seconds, but in reality *Summary* was there after ~17 seconds.

But I guess the relations between function times are correct.  In all
examples `gnus-retrieve-headers' (called two times) is a huge factor in
the overall time.  Only with 6000 messages scoring, sorting and
threading needs more time.  So I think, this is the function that causes
the slowdown.

So here are the results:

[-- Attachment #2: elp-results-20.txt --]
[-- Type: text/plain, Size: 24888 bytes --]

gnus-retrieve-headers                                                         2           37.269011     18.6345055
gnus-topic-select-group                                                       1           18.904125     18.904125
gnus-group-select-group                                                       1           18.904076     18.904076
gnus-group-read-group                                                         1           18.904067     18.904067
gnus-summary-read-group                                                       1           18.904033     18.904033
gnus-summary-read-group-1                                                     1           18.904021     18.904021
gnus-select-newsgroup                                                         1           18.828951     18.828951
gnus-fetch-headers                                                            1           18.724761     18.724761
gnus-cache-retrieve-headers                                                   1           18.634646     18.634646
gnus-group-find-parameter                                                     10647       10.898423000  0.0010236144
gnus-group-fast-parameter                                                     10644       10.453216000  0.0009820759
gnus-group-topic-parameters                                                   10647       8.4156960000  0.0007904288
gnus-topic-hierarchical-parameters                                            10647       7.6888939999  0.0007221653
gnus-topic-parent-topic                                                       298144      7.1616460000  2.402...e-05
gnus-topic-find-topology                                                      202312      5.0840660000  2.512...e-05
gnus-current-topics                                                           10647       3.6906550000  0.0003466380
gnus-topic-parameters                                                         31941       3.1366629999  9.820...e-05
gnus-replace-in-string                                                        10630       0.2547039999  2.396...e-05
gnus-current-topic                                                            10647       0.1835909999  1.724...e-05
gnus-group-parameter-value                                                    53226       0.1810130000  3.400...e-06
gnus-group-goto-group                                                         10647       0.1164609999  1.093...e-05
gnus-get-newsgroup-headers-xover                                              1           0.088958      0.088958
gnus-build-old-threads                                                        1           0.087785      0.087785
gnus-build-get-header                                                         33          0.087241      0.0026436666
gnus-group-get-parameter                                                      10653       0.0357780000  3.358...e-06
gnus-summary-prepare                                                          1           0.026601      0.026601
gnus-possibly-score-headers                                                   1           0.023326      0.023326
gnus-summary-prepare-threads                                                  1           0.018188      0.018188
gnus-score-headers                                                            1           0.014513      0.014513
gnus-mode-line-buffer-identification                                          3           0.012903      0.004301
gnus-user-format-function-b                                                   26          0.011576      0.0004452307
gnus-score-string                                                             4           0.01117       0.0027925
gnus-group-update-group                                                       1           0.010129      0.010129
gnus-articles-to-read                                                         1           0.00991       0.00991
gnus-all-score-files                                                          1           0.008797      0.008797
gnus-group-set-mode-line                                                      2           0.008459      0.0042295
gnus-score-find-bnews                                                         1           0.00759       0.00759
gnus-run-hooks                                                                35          0.006586      0.0001881714
gnus-killed-articles                                                          1           0.006275      0.006275
gnus-thread-total-score                                                       169         0.0052520000  3.107...e-05
gnus-sort-threads-recursive                                                   12          0.005157      0.00042975
gnus-sort-threads                                                             1           0.004936      0.004936
gnus-set-mode-line                                                            1           0.00473       0.00473
gnus-dribble-enter                                                            1           0.00424       0.00424
gnus-thread-total-score-1                                                     169         0.0042349999  2.505...e-05
gnus-summary-setup-buffer                                                     1           0.004131      0.004131
gnus-thread-sort-by-total-score                                               36          0.0033429999  9.286...e-05
gnus-summary-mode                                                             1           0.002958      0.002958
gnus-uncompress-range                                                         1           0.002909      0.002909
gnus-message                                                                  10          0.002892      0.0002892
gnus-message-with-timestamp                                                   8           0.0028020000  0.0003502500
gnus-summary-hide-all-threads                                                 2           0.002477      0.0012385
gnus-summary-hide-thread                                                      20          0.001921      9.605e-05
gnus-score-string<                                                            791         0.0018190000  2.299...e-06
gnus-summary-setup-default-charset                                            1           0.001736      0.001736
gnus-score-load-files                                                         1           0.001729      0.001729
gnus-summary-limit-children                                                   48          0.0017229999  3.589...e-05
gnus-score-load-file                                                          3           0.001712      0.0005706666
gnus-article-setup-buffer                                                     1           0.001688      0.001688
gnus-topic-update-topic-line                                                  3           0.001621      0.0005403333
gnus-summary-set-local-parameters                                             2           0.001369      0.0006845
gnus-score-load-score-alist                                                   1           0.001351      0.001351
gnus-summary-maybe-hide-threads                                               1           0.001347      0.001347
gnus-parameter-ham-marks                                                      2           0.001118      0.000559
gnus-parameter-spam-marks                                                     2           0.001065      0.0005325
gnus-summary-from-or-to-or-newsgroups                                         26          0.0010440000  4.015...e-05
gnus-map-function                                                             24          0.00101       4.208...e-05
gnus-update-summary-mark-positions                                            1           0.001         0.001
gnus-summary-highlight-line                                                   26          0.0009809999  3.773...e-05
gnus-summary-goto-subject                                                     20          0.0009759999  4.879...e-05
gnus-topic-update-topics-containing-group                                     1           0.000954      0.000954
gnus-summary-insert-line                                                      2           0.000892      0.000446
gnus-parameter-charset                                                        1           0.000881      0.000881
gnus-group-decoded-name                                                       7           0.0008439999  0.0001205714
gnus-parameter-ignored-charsets                                               1           0.000833      0.000833
gnus-agent-find-parameter                                                     1           0.000827      0.000827
gnus-thread-sort-by-most-recent-date                                          3           0.00082       0.0002733333
gnus-thread-latest-date                                                       6           0.000786      0.000131
gnus-summary-next-thread                                                      40          0.000679      1.6975e-05
gnus-parameter-spam-autodetect                                                1           0.000616      0.000616
gnus-group-auto-expirable-p                                                   1           0.000592      0.000592
gnus-group-name-decode                                                        9           0.0005799999  6.444...e-05
gnus-update-format-specifications                                             3           0.000559      0.0001863333
gnus-article-setup-highlight-words                                            1           0.000554      0.000554
gnus-extract-address-components                                               26          0.0005370000  2.065...e-05
gnus-summary-position-point                                                   25          0.000534      2.136e-05
gnus-parameter-spam-contents                                                  1           0.000511      0.000511
gnus-run-mode-hooks                                                           2           0.000492      0.000246
gnus-parameter-spam-autodetect-methods                                        1           0.000491      0.000491
gnus-make-sort-function                                                       1           0.000486      0.000486
gnus-byte-compile                                                             1           0.000456      0.000456
gnus-id-to-thread                                                             191         0.0004549999  2.382...e-06
gnus-configure-windows                                                        1           0.000452      0.000452
gnus-parameters-get-parameter                                                 3           0.0004469999  0.000149
gnus-group-insert-group-line-info                                             1           0.000418      0.000418
gnus-summary-initial-limit                                                    1           0.00041       0.00041
gnus-summary-go-to-next-thread                                                40          0.000403      1.0075e-05
gnus-group-insert-group-line                                                  1           0.000401      0.000401
gnus-simplify-subject-re                                                      24          0.0003960000  1.65e-05
gnus-put-text-property                                                        83          0.0003939999  4.746...e-06
gnus-put-text-property-excluding-characters-with-faces                        27          0.0003919999  1.451...e-05
gnus-goto-colon                                                               25          0.0003919999  1.568e-05
gnus-simplify-buffer-fuzzy                                                    1           0.000366      0.000366
gnus-continuum-version                                                        6           0.0003549999  5.916...e-05
gnus-summary-auto-select-subject                                              1           0.000336      0.000336
gnus-summary-first-unread-subject                                             1           0.000329      0.000329
gnus-make-threads                                                             1           0.000324      0.000324
gnus-simplify-whitespace                                                      24          0.000319      1.329...e-05
gnus-summary-buffer-name                                                      3           0.000312      0.000104
gnus-score-check-syntax                                                       1           0.000301      0.000301
gnus-summary-first-subject                                                    1           0.0003        0.0003
gnus-article-mode                                                             1           0.000295      0.000295
gnus-cache-articles-in-group                                                  1           0.00029       0.00029
gnus-group-name-charset                                                       9           0.000262      2.911...e-05
gnus-set-global-variables                                                     4           0.000246      6.15e-05
gnus-summary-set-article-display-arrow                                        20          0.000245      1.225e-05
gnus-gather-threads-by-references                                             1           0.000244      0.000244
gnus-apply-kill-file                                                          1           0.000228      0.000228
gnus-find-method-for-group                                                    16          0.000223      1.39375e-05
gnus-update-read-articles                                                     1           0.000217      0.000217
gnus-correct-length                                                           52          0.0002099999  4.038...e-06
gnus-topic-insert-topic-line                                                  3           0.000197      6.566...e-05
gnus-cache-file-name                                                          1           0.000179      0.000179
gnus-score-score-files                                                        1           0.00017       0.00017
gnus-sort-score-files                                                         1           0.000165      0.000165
gnus-add-text-properties                                                      33          0.0001619999  4.909...e-06
gnus-get-buffer-create                                                        6           0.000137      2.283...e-05
gnus-undo-boundary                                                            37          0.0001290000  3.486...e-06
gnus-summary-make-local-variables                                             2           0.0001180000  5.900...e-05
gnus-newsgroup-kill-file                                                      2           0.000116      5.8e-05
gnus-thread-loop-p                                                            38          0.0001130000  2.973...e-06
gnus-topic-goto-topic                                                         4           0.000111      2.775e-05
gnus-score-set                                                                31          9.800...e-05  3.161...e-06
gnus-configure-frame                                                          2           9.5e-05       4.75e-05
gnus-topic-find-groups                                                        3           9.3e-05       3.1e-05
gnus-summary-set-display-table                                                1           9.3e-05       9.3e-05
gnus-group-highlight-line                                                     1           8.8e-05       8.8e-05
gnus-score-file-name                                                          1           8.8e-05       8.8e-05
gnus-agent-mode                                                               1           8.7e-05       8.7e-05
gnus-adjust-marked-articles                                                   1           7.3e-05       7.3e-05
gnus-request-group                                                            1           7.1e-05       7.1e-05
gnus-buffer-live-p                                                            9           7e-05         7.777...e-06
gnus-agent-possibly-alter-active                                              2           6.400...e-05  3.200...e-05
gnus-summary-highlight-line-0                                                 26          5.800...e-05  2.230...e-06
gnus-expand-group-parameters                                                  12          5.8e-05       4.833...e-06
gnus-prin1-to-string                                                          1           5.6e-05       5.6e-05
gnus-remove-from-range                                                        2           5.4e-05       2.7e-05
gnus-all-windows-visible-p                                                    1           5.4e-05       5.4e-05
gnus-make-hashtable                                                           3           5.1e-05       1.7e-05
gnus-get-unread-articles-in-group                                             1           5e-05         5e-05
gnus-check-server                                                             1           4.9e-05       4.9e-05
gnus-emacs-version                                                            3           4.8e-05       1.6e-05
gnus-file-newer-than                                                          1           4.8e-05       4.8e-05
gnus-group-quit-config                                                        2           4.700...e-05  2.350...e-05
gnus-agent-get-undownloaded-list                                              1           4.7e-05       4.7e-05
gnus-cut-threads                                                              1           4.5e-05       4.5e-05
gnus-turn-off-edit-menu                                                       2           4.3e-05       2.15e-05
gnus-server-opened                                                            1           3.8e-05       3.8e-05
gnus-copy-sequence                                                            5           3.5e-05       6.999...e-06
gnus-get-buffer-window                                                        1           3.3e-05       3.3e-05
gnus-summary-make-menu-bar                                                    1           3.3e-05       3.3e-05
gnus-ephemeral-group-p                                                        2           3.2e-05       1.6e-05
gnus-short-group-name                                                         1           3.1e-05       3.1e-05
gnus-compute-unseen-list                                                      1           3.1e-05       3.1e-05
gnus-decay-scores                                                             1           3.1e-05       3.1e-05
gnus-newsgroup-savable-name                                                   2           2.8e-05       1.4e-05
gnus-article-make-menu-bar                                                    1           2.8e-05       2.8e-05
gnus-make-sort-function-1                                                     3           2.7e-05       9e-06
gnus-virtual-group-p                                                          1           2.5e-05       2.5e-05
gnus-group-topic-p                                                            1           2.5e-05       2.5e-05
gnus-group-timestamp-delta                                                    1           2.5e-05       2.5e-05
gnus-inverse-list-range-intersection                                          1           2.4e-05       2.4e-05
gnus-group-topic-unread                                                       8           2.299...e-05  2.874...e-06
gnus-mode-string-quote                                                        1           2e-05         2e-05
gnus-set-work-buffer                                                          1           2e-05         2e-05
gnus-visual-p                                                                 6           1.9e-05       3.166...e-06
gnus-simplify-mode-line                                                       2           1.8e-05       9e-06
gnus-list-range-difference                                                    1           1.8e-05       1.8e-05
gnus-undo-register                                                            1           1.8e-05       1.8e-05
gnus-get-function                                                             1           1.5e-05       1.5e-05
gnus-online                                                                   4           1.5e-05       3.75e-06
gnus-create-hash-size                                                         3           1.300...e-05  4.333...e-06
gnus-group-topic-name                                                         1           1.3e-05       1.3e-05
gnus-group-group-name                                                         2           1.2e-05       6e-06
gnus-sorted-difference                                                        2           1.2e-05       6e-06
gnus-use-long-file-name                                                       4           1.1e-05       2.75e-06
gnus-agent-method-p                                                           4           1.1e-05       2.75e-06
gnus-list-of-unread-articles                                                  1           1.1e-05       1.1e-05
gnus-topic-update-unreads                                                     3           9.999...e-06  3.333...e-06
gnus-last-element                                                             1           9e-06         9e-06
gnus-server-add-address                                                       1           8e-06         8e-06
gnus-group-topic-level                                                        3           8e-06         2.666...e-06
gnus-undo-register-1                                                          1           8e-06         8e-06
gnus-cache-decoded-group-name                                                 1           8e-06         8e-06
gnus-frames-on-display-list                                                   1           7e-06         7e-06
gnus-summary-make-tool-bar                                                    1           7e-06         7e-06
gnus-article-mark-to-type                                                     2           7e-06         3.5e-06
gnus-server-to-method                                                         2           7e-06         3.5e-06
gnus-set-default-directory                                                    2           7e-06         3.5e-06
gnus-topic-visible-p                                                          3           6.999...e-06  2.333...e-06
gnus-score-find-alist                                                         1           6e-06         6e-06
gnus-sorted-ndifference                                                       2           6e-06         3e-06
gnus-group-category                                                           1           5e-06         5e-06
gnus-server-status                                                            1           5e-06         5e-06
gnus-window-to-buffer-helper                                                  2           4.999...e-06  2.499...e-06
gnus-home-score-file                                                          2           4.999...e-06  2.499...e-06
gnus-group-group-indentation                                                  2           4.999...e-06  2.499...e-06
gnus-windows-old-to-new                                                       1           4e-06         4e-06
gnus-score-file-regexp                                                        1           4e-06         4e-06
gnus-sorted-nintersection                                                     1           4e-06         4e-06
gnus-agent-summary-make-menu-bar                                              1           3e-06         3e-06
gnus-make-local-hook                                                          1           3e-06         3e-06
gnus-update-missing-marks                                                     1           3e-06         3e-06
gnus-sort-gathered-threads                                                    1           3e-06         3e-06
gnus-range-length                                                             1           3e-06         3e-06
gnus-remove-if                                                                1           3e-06         3e-06
gnus-make-thread-indent-array                                                 1           3e-06         3e-06
gnus-group-remove-excess-properties                                           1           2e-06         2e-06
gnus-extent-start-open                                                        1           1e-06         1e-06

[-- Attachment #3: elp-results-2000.txt --]
[-- Type: text/plain, Size: 22784 bytes --]

gnus-retrieve-headers                                                         2           34.977468     17.488734
gnus-topic-select-group                                                       1           29.053594     29.053594
gnus-group-select-group                                                       1           29.05354      29.05354
gnus-group-read-group                                                         1           29.053527     29.053527
gnus-summary-read-group                                                       1           29.053495     29.053495
gnus-summary-read-group-1                                                     1           29.053481     29.053481
gnus-select-newsgroup                                                         1           18.921889     18.921889
gnus-fetch-headers                                                            1           18.223882     18.223882
gnus-cache-retrieve-headers                                                   1           17.488884     17.488884
gnus-sort-threads-recursive                                                   1346        12.367377000  0.0091882444
gnus-thread-total-score                                                       61635       11.432711000  0.0001854905
gnus-thread-total-score-1                                                     61635       10.758156999  0.0001745462
gnus-group-find-parameter                                                     10643       9.9299050000  0.0009329986
gnus-group-fast-parameter                                                     10642       9.6298230000  0.0009048884
gnus-summary-prepare                                                          1           8.901423      8.901423
gnus-group-topic-parameters                                                   10643       7.7369009999  0.0007269473
gnus-topic-hierarchical-parameters                                            10643       6.7090129999  0.0006303685
gnus-topic-parent-topic                                                       298032      6.3724260000  2.138...e-05
gnus-sort-threads                                                             1           6.368639      6.368639
gnus-topic-find-topology                                                      202236      5.7280700000  2.832...e-05
gnus-thread-sort-by-most-recent-date                                          3158        3.9135050000  0.0012392352
gnus-thread-latest-date                                                       6316        3.8728149999  0.0006131752
gnus-current-topics                                                           10643       3.2874550000  0.0003088842
gnus-topic-parameters                                                         31929       3.0489659999  9.549...e-05
gnus-summary-prepare-threads                                                  1           2.418517      2.418517
gnus-thread-sort-by-total-score                                               5033        2.4017040000  0.0004771913
gnus-summary-limit-children                                                   2230        1.7111560000  0.0007673345
gnus-user-format-function-b                                                   2077        1.3445089999  0.0006473322
gnus-possibly-score-headers                                                   1           0.821729      0.821729
gnus-score-headers                                                            1           0.812969      0.812969
gnus-score-string                                                             4           0.79973       0.1999325
gnus-get-newsgroup-headers-xover                                              1           0.73385       0.73385
gnus-build-old-threads                                                        1           0.680023      0.680023
gnus-build-get-header                                                         273         0.6744750000  0.0024706043
gnus-group-parameter-value                                                    53215       0.3404519999  6.397...e-06
gnus-current-topic                                                            10643       0.3295689999  3.096...e-05
gnus-run-hooks                                                                2085        0.2641640000  0.0001266973
gnus-summary-from-or-to-or-newsgroups                                         2077        0.2234420000  0.0001075792
gnus-summary-hide-all-threads                                                 2           0.2047379999  0.1023689999
gnus-id-to-thread                                                             61827       0.1892470000  3.060...e-06
gnus-summary-initial-limit                                                    1           0.1835210000  0.1835210000
gnus-summary-hide-thread                                                      650         0.1589839999  0.0002445907
gnus-score-string<                                                            55644       0.1390100000  2.498...e-06
gnus-summary-maybe-hide-threads                                               1           0.1280329999  0.1280329999
gnus-replace-in-string                                                        10630       0.1229929999  1.157...e-05
gnus-summary-next-thread                                                      1300        0.120014      9.231...e-05
gnus-summary-go-to-next-thread                                                1300        0.1104469999  8.495...e-05
gnus-group-goto-group                                                         10643       0.1072719999  1.007...e-05
gnus-summary-highlight-line                                                   2077        0.0865719999  4.168...e-05
gnus-map-function                                                             2077        0.0853009999  4.106...e-05
gnus-summary-goto-subject                                                     650         0.0523299999  8.050...e-05
gnus-extract-address-components                                               2077        0.0434429999  2.091...e-05
gnus-group-get-parameter                                                      10648       0.0356650000  3.349...e-06
gnus-simplify-subject-re                                                      2077        0.0332089999  1.598...e-05
gnus-put-text-property                                                        6236        0.0294610000  4.724...e-06
gnus-put-text-property-excluding-characters-with-faces                        2078        0.0290029999  1.395...e-05
gnus-simplify-whitespace                                                      2077        0.0264200000  1.272...e-05
gnus-summary-position-point                                                   655         0.0223729999  3.415...e-05
gnus-make-threads                                                             1           0.019751      0.019751
gnus-goto-colon                                                               655         0.0184699999  2.819...e-05
gnus-correct-length                                                           4154        0.0175460000  4.223...e-06
gnus-mode-line-buffer-identification                                          3           0.012886      0.0042953333
gnus-add-text-properties                                                      2084        0.0116599999  5.595...e-06
gnus-group-update-group                                                       1           0.010177      0.010177
gnus-articles-to-read                                                         1           0.009942      0.009942
gnus-all-score-files                                                          1           0.008746      0.008746
gnus-group-set-mode-line                                                      2           0.0084529999  0.0042264999
gnus-summary-set-article-display-arrow                                        650         0.0083259999  1.280...e-05
gnus-simplify-buffer-fuzzy                                                    1           0.007694      0.007694
gnus-score-find-bnews                                                         1           0.007503      0.007503
gnus-cut-threads                                                              1           0.007075      0.007075
gnus-thread-loop-p                                                            1904        0.0069050000  3.626...e-06
gnus-killed-articles                                                          1           0.006165      0.006165
gnus-set-mode-line                                                            1           0.004769      0.004769
gnus-dribble-enter                                                            1           0.004314      0.004314
gnus-summary-highlight-line-0                                                 2077        0.0040629999  1.956...e-06
gnus-message                                                                  10          0.003608      0.0003608
gnus-message-with-timestamp                                                   8           0.00348       0.000435
gnus-uncompress-range                                                         1           0.002982      0.002982
gnus-correct-substring                                                        182         0.0023709999  1.302...e-05
gnus-gather-threads-by-references                                             1           0.002055      0.002055
gnus-summary-auto-select-subject                                              1           0.001945      0.001945
gnus-summary-first-unread-subject                                             1           0.001936      0.001936
gnus-summary-first-subject                                                    1           0.001646      0.001646
gnus-summary-setup-default-charset                                            1           0.001619      0.001619
gnus-topic-update-topic-line                                                  3           0.001602      0.000534
gnus-compute-unseen-list                                                      1           0.001351      0.001351
gnus-inverse-list-range-intersection                                          1           0.001344      0.001344
gnus-list-range-difference                                                    1           0.001337      0.001337
gnus-parameter-ham-marks                                                      2           0.001128      0.000564
gnus-parameter-spam-marks                                                     2           0.001083      0.0005415
gnus-topic-update-topics-containing-group                                     1           0.000957      0.000957
gnus-agent-find-parameter                                                     1           0.000878      0.000878
gnus-parameter-charset                                                        1           0.000873      0.000873
gnus-group-auto-expirable-p                                                   1           0.000777      0.000777
gnus-group-decoded-name                                                       6           0.0007419999  0.0001236666
gnus-parameter-ignored-charsets                                               1           0.000725      0.000725
gnus-parameter-spam-autodetect                                                1           0.000612      0.000612
gnus-make-sort-function                                                       1           0.000601      0.000601
gnus-parameter-spam-contents                                                  1           0.000584      0.000584
gnus-byte-compile                                                             1           0.000562      0.000562
gnus-group-name-decode                                                        8           0.000518      6.475e-05
gnus-sorted-difference                                                        2           0.000495      0.0002475
gnus-parameter-spam-autodetect-methods                                        1           0.000486      0.000486
gnus-group-insert-group-line-info                                             1           0.000459      0.000459
gnus-group-insert-group-line                                                  1           0.000442      0.000442
gnus-last-element                                                             1           0.000392      0.000392
gnus-score-set                                                                109         0.0003819999  3.504...e-06
gnus-parameters-get-parameter                                                 1           0.000314      0.000314
gnus-cache-articles-in-group                                                  1           0.000304      0.000304
gnus-summary-setup-buffer                                                     1           0.000267      0.000267
gnus-score-load-files                                                         1           0.00026       0.00026
gnus-group-name-charset                                                       8           0.000256      3.2e-05
gnus-apply-kill-file                                                          1           0.000238      0.000238
gnus-score-load-file                                                          3           0.000238      7.933...e-05
gnus-set-global-variables                                                     4           0.0002330000  5.825...e-05
gnus-update-read-articles                                                     1           0.000232      0.000232
gnus-find-method-for-group                                                    15          0.0002179999  1.453...e-05
gnus-update-format-specifications                                             1           0.000207      0.000207
gnus-topic-insert-topic-line                                                  3           0.000207      6.9e-05
gnus-cache-file-name                                                          1           0.000192      0.000192
gnus-summary-buffer-name                                                      2           0.000187      9.35e-05
gnus-score-score-files                                                        1           0.000185      0.000185
gnus-sort-score-files                                                         1           0.000185      0.000185
gnus-configure-windows                                                        1           0.000169      0.000169
gnus-update-missing-marks                                                     1           0.00015       0.00015
gnus-continuum-version                                                        2           0.000128      6.4e-05
gnus-article-setup-buffer                                                     1           0.000125      0.000125
gnus-newsgroup-kill-file                                                      2           0.000118      5.9e-05
gnus-topic-goto-topic                                                         4           0.000111      2.775e-05
gnus-configure-frame                                                          2           0.0001030000  5.150...e-05
gnus-topic-find-groups                                                        3           9.800...e-05  3.266...e-05
gnus-group-highlight-line                                                     1           9.4e-05       9.4e-05
gnus-score-file-name                                                          1           8.6e-05       8.6e-05
gnus-request-group                                                            1           8.3e-05       8.3e-05
gnus-buffer-live-p                                                            9           8.3e-05       9.222...e-06
gnus-adjust-marked-articles                                                   1           7.6e-05       7.6e-05
gnus-get-buffer-create                                                        4           7.299...e-05  1.824...e-05
gnus-prin1-to-string                                                          1           6.8e-05       6.8e-05
gnus-agent-possibly-alter-active                                              2           6.7e-05       3.35e-05
gnus-all-windows-visible-p                                                    1           6.4e-05       6.4e-05
gnus-make-hashtable                                                           3           6.3e-05       2.1e-05
gnus-sort-gathered-threads                                                    1           5.8e-05       5.8e-05
gnus-emacs-version                                                            3           5.3e-05       1.766...e-05
gnus-remove-from-range                                                        2           5.3e-05       2.65e-05
gnus-get-unread-articles-in-group                                             1           5.3e-05       5.3e-05
gnus-check-server                                                             1           5e-05         5e-05
gnus-file-newer-than                                                          1           4.9e-05       4.9e-05
gnus-agent-get-undownloaded-list                                              1           4.8e-05       4.8e-05
gnus-server-opened                                                            1           3.8e-05       3.8e-05
gnus-article-mark-to-type                                                     16          3.500...e-05  2.187...e-06
gnus-get-buffer-window                                                        1           3.5e-05       3.5e-05
gnus-copy-sequence                                                            5           3.5e-05       6.999...e-06
gnus-short-group-name                                                         1           3.1e-05       3.1e-05
gnus-ephemeral-group-p                                                        2           3.1e-05       1.55e-05
gnus-make-sort-function-1                                                     3           3.1e-05       1.033...e-05
gnus-decay-scores                                                             1           2.9e-05       2.9e-05
gnus-newsgroup-savable-name                                                   2           2.8e-05       1.4e-05
gnus-group-quit-config                                                        1           2.7e-05       2.7e-05
gnus-virtual-group-p                                                          1           2.5e-05       2.5e-05
gnus-group-timestamp-delta                                                    1           2.5e-05       2.5e-05
gnus-undo-boundary                                                            7           2.499...e-05  3.571...e-06
gnus-group-topic-p                                                            1           2.4e-05       2.4e-05
gnus-group-topic-unread                                                       8           2.299...e-05  2.874...e-06
gnus-mode-string-quote                                                        1           2.2e-05       2.2e-05
gnus-undo-register                                                            1           1.8e-05       1.8e-05
gnus-expand-group-parameters                                                  4           1.8e-05       4.5e-06
gnus-cache-decoded-group-name                                                 1           1.8e-05       1.8e-05
gnus-get-function                                                             1           1.5e-05       1.5e-05
gnus-online                                                                   4           1.5e-05       3.75e-06
gnus-create-hash-size                                                         3           1.499...e-05  4.999...e-06
gnus-group-topic-name                                                         1           1.4e-05       1.4e-05
gnus-topic-update-unreads                                                     3           1.4e-05       4.666...e-06
gnus-use-long-file-name                                                       4           1.3e-05       3.25e-06
gnus-agent-method-p                                                           4           1.3e-05       3.25e-06
gnus-group-group-name                                                         2           1.2e-05       6e-06
gnus-list-of-unread-articles                                                  1           1.1e-05       1.1e-05
gnus-server-add-address                                                       1           9e-06         9e-06
gnus-undo-register-1                                                          1           9e-06         9e-06
gnus-topic-visible-p                                                          3           9e-06         3e-06
gnus-group-topic-level                                                        3           8e-06         2.666...e-06
gnus-server-to-method                                                         2           8e-06         4e-06
gnus-frames-on-display-list                                                   1           7e-06         7e-06
gnus-home-score-file                                                          2           7e-06         3.5e-06
gnus-sorted-ndifference                                                       2           7e-06         3.5e-06
gnus-window-to-buffer-helper                                                  2           6e-06         3e-06
gnus-score-find-alist                                                         1           6e-06         6e-06
gnus-group-group-indentation                                                  2           6e-06         3e-06
gnus-group-category                                                           1           5e-06         5e-06
gnus-server-status                                                            1           5e-06         5e-06
gnus-score-file-regexp                                                        1           4e-06         4e-06
gnus-sorted-nintersection                                                     1           4e-06         4e-06
gnus-remove-if                                                                1           4e-06         4e-06
gnus-visual-p                                                                 1           3e-06         3e-06
gnus-windows-old-to-new                                                       1           3e-06         3e-06
gnus-article-setup-highlight-words                                            1           3e-06         3e-06
gnus-thread-sort-by-number                                                    1           3e-06         3e-06
gnus-extent-start-open                                                        1           2e-06         2e-06
gnus-range-length                                                             1           2e-06         2e-06
gnus-group-remove-excess-properties                                           1           2e-06         2e-06

[-- Attachment #4: elp-results-6000.txt --]
[-- Type: text/plain, Size: 22928 bytes --]

gnus-thread-total-score                                                       245577      75.621260999  0.0003079329
gnus-thread-total-score-1                                                     245577      71.409552000  0.0002907827
gnus-topic-select-group                                                       1           69.436461     69.436461
gnus-group-select-group                                                       1           69.436407     69.436407
gnus-group-read-group                                                         1           69.436397     69.436397
gnus-summary-read-group                                                       1           69.436346     69.436346
gnus-summary-read-group-1                                                     1           69.436333     69.436333
gnus-sort-threads-recursive                                                   3982        51.406341999  0.0129096790
gnus-summary-prepare                                                          1           39.572546     39.572546
gnus-retrieve-headers                                                         2           34.742282     17.371141
gnus-sort-threads                                                             1           30.214375     30.214375
gnus-select-newsgroup                                                         1           24.331741     24.331741
gnus-fetch-headers                                                            1           19.675013     19.675013
gnus-cache-retrieve-headers                                                   1           17.371276     17.371276
gnus-thread-sort-by-most-recent-date                                          11919       16.994137999  0.0014258023
gnus-thread-latest-date                                                       23838       16.837037999  0.0007063108
gnus-thread-sort-by-total-score                                               16899       12.673111000  0.0007499325
gnus-group-find-parameter                                                     10646       10.545858000  0.0009905934
gnus-group-fast-parameter                                                     10645       10.397823000  0.0009767799
gnus-group-topic-parameters                                                   10646       8.2585889999  0.0007757457
gnus-summary-prepare-threads                                                  1           7.792385      7.792385
gnus-topic-parent-topic                                                       298116      6.9513990000  2.331...e-05
gnus-topic-hierarchical-parameters                                            10646       6.9305129999  0.0006509969
gnus-topic-find-topology                                                      202293      5.1034370000  2.522...e-05
gnus-user-format-function-b                                                   6049        4.2709599999  0.0007060605
gnus-current-topics                                                           10646       3.8378070000  0.0003604928
gnus-possibly-score-headers                                                   1           3.438857      3.438857
gnus-score-headers                                                            1           3.427816      3.427816
gnus-articles-to-read                                                         1           3.427529      3.427529
gnus-score-string                                                             4           3.3810029999  0.8452507499
gnus-topic-parameters                                                         31938       2.6740879999  8.372...e-05
gnus-run-hooks                                                                6057        2.4735610000  0.0004083805
gnus-get-newsgroup-headers-xover                                              1           2.3023759999  2.3023759999
gnus-summary-hide-all-threads                                                 2           1.775569      0.8877845
gnus-id-to-thread                                                             245867      1.3871669999  5.641...e-06
gnus-summary-next-thread                                                      3444        1.3612770000  0.0003952604
gnus-summary-hide-thread                                                      1722        1.3499579999  0.0007839477
gnus-summary-go-to-next-thread                                                3444        1.3323169999  0.0003868516
gnus-summary-maybe-hide-threads                                               1           1.2364009999  1.2364009999
gnus-build-old-threads                                                        1           1.215171      1.215171
gnus-build-get-header                                                         479         1.2034930000  0.0025125114
gnus-score-string<                                                            240987      1.0363429999  4.300...e-06
gnus-summary-limit-children                                                   6338        0.7654740000  0.0001207753
gnus-map-function                                                             6049        0.4438940000  7.338...e-05
gnus-summary-highlight-line                                                   6049        0.4410349999  7.291...e-05
gnus-summary-goto-subject                                                     1722        0.3080209999  0.0001788739
gnus-simplify-subject-re                                                      6049        0.2814160000  4.652...e-05
gnus-summary-from-or-to-or-newsgroups                                         6049        0.2621410000  4.333...e-05
gnus-put-text-property                                                        18152       0.2585969999  1.424...e-05
gnus-make-threads                                                             1           0.2421320000  0.2421320000
gnus-add-text-properties                                                      6056        0.1912970000  3.158...e-05
gnus-mode-line-buffer-identification                                          3           0.1831829999  0.061061
gnus-group-update-group                                                       1           0.180642      0.180642
gnus-group-set-mode-line                                                      2           0.1787770000  0.0893885000
gnus-current-topic                                                            10646       0.1772389999  1.664...e-05
gnus-dribble-enter                                                            1           0.174676      0.174676
gnus-group-parameter-value                                                    53230       0.1745520000  3.279...e-06
gnus-extract-address-components                                               6049        0.1360600000  2.249...e-05
gnus-summary-initial-limit                                                    1           0.124527      0.124527
gnus-replace-in-string                                                        10630       0.1213609999  1.141...e-05
gnus-group-goto-group                                                         10646       0.1063199999  9.986...e-06
gnus-put-text-property-excluding-characters-with-faces                        6050        0.0943450000  1.559...e-05
gnus-simplify-whitespace                                                      6049        0.0831469999  1.374...e-05
gnus-summary-position-point                                                   1727        0.0674870000  3.907...e-05
gnus-goto-colon                                                               1727        0.0561210000  3.249...e-05
gnus-correct-length                                                           12098       0.0555199999  4.589...e-06
gnus-cut-threads                                                              1           0.041248      0.041248
gnus-group-get-parameter                                                      10651       0.0346530000  3.253...e-06
gnus-simplify-buffer-fuzzy                                                    1           0.029971      0.029971
gnus-summary-set-article-display-arrow                                        1722        0.0278089999  1.614...e-05
gnus-thread-loop-p                                                            5458        0.0198530000  3.637...e-06
gnus-summary-highlight-line-0                                                 6049        0.0125590000  2.076...e-06
gnus-all-score-files                                                          1           0.011026      0.011026
gnus-score-find-bnews                                                         1           0.009542      0.009542
gnus-gather-threads-by-references                                             1           0.007302      0.007302
gnus-correct-substring                                                        472         0.0067290000  1.425...e-05
gnus-killed-articles                                                          1           0.0062        0.0062
gnus-set-mode-line                                                            1           0.004759      0.004759
gnus-summary-auto-select-subject                                              1           0.004147      0.004147
gnus-summary-first-unread-subject                                             1           0.004138      0.004138
gnus-message                                                                  10          0.0039        0.00039
gnus-message-with-timestamp                                                   8           0.0037909999  0.0004738749
gnus-compute-unseen-list                                                      1           0.003787      0.003787
gnus-inverse-list-range-intersection                                          1           0.003779      0.003779
gnus-list-range-difference                                                    1           0.003773      0.003773
gnus-summary-first-subject                                                    1           0.003763      0.003763
gnus-uncompress-range                                                         1           0.003051      0.003051
gnus-parameter-spam-marks                                                     3           0.0022760000  0.0007586666
gnus-parameter-ham-marks                                                      3           0.0020410000  0.0006803333
gnus-summary-setup-default-charset                                            1           0.00167       0.00167
gnus-topic-update-topic-line                                                  3           0.001609      0.0005363333
gnus-sorted-difference                                                        2           0.0014889999  0.0007444999
gnus-last-element                                                             1           0.001044      0.001044
gnus-group-auto-expirable-p                                                   1           0.00102       0.00102
gnus-group-decoded-name                                                       7           0.0009760000  0.0001394285
gnus-agent-find-parameter                                                     1           0.000968      0.000968
gnus-topic-update-topics-containing-group                                     1           0.000962      0.000962
gnus-parameter-charset                                                        1           0.000887      0.000887
gnus-parameter-large-newsgroup-initial                                        1           0.000807      0.000807
gnus-parameter-ignored-charsets                                               1           0.000754      0.000754
gnus-group-name-decode                                                        9           0.0006630000  7.366...e-05
gnus-parameter-spam-contents                                                  1           0.000621      0.000621
gnus-parameter-spam-autodetect                                                1           0.00062       0.00062
gnus-make-sort-function                                                       1           0.000594      0.000594
gnus-byte-compile                                                             1           0.000557      0.000557
gnus-parameter-spam-autodetect-methods                                        1           0.000507      0.000507
gnus-group-insert-group-line-info                                             1           0.000507      0.000507
gnus-group-insert-group-line                                                  1           0.000488      0.000488
gnus-parameters-get-parameter                                                 1           0.000474      0.000474
gnus-score-set                                                                114         0.0003770000  3.307...e-06
gnus-group-name-charset                                                       9           0.000317      3.522...e-05
gnus-score-load-files                                                         1           0.000314      0.000314
gnus-score-load-file                                                          3           0.0002940000  9.800...e-05
gnus-sort-gathered-threads                                                    1           0.000288      0.000288
gnus-cache-articles-in-group                                                  1           0.000277      0.000277
gnus-summary-setup-buffer                                                     1           0.000272      0.000272
gnus-sort-score-files                                                         1           0.000269      0.000269
gnus-set-global-variables                                                     4           0.000266      6.65e-05
gnus-apply-kill-file                                                          1           0.000264      0.000264
gnus-find-method-for-group                                                    16          0.000258      1.6125e-05
gnus-update-format-specifications                                             1           0.000248      0.000248
gnus-update-read-articles                                                     1           0.000226      0.000226
gnus-score-score-files                                                        1           0.00022       0.00022
gnus-topic-insert-topic-line                                                  3           0.0002089999  6.966...e-05
gnus-summary-buffer-name                                                      2           0.000198      9.9e-05
gnus-configure-windows                                                        1           0.00017       0.00017
gnus-cache-file-name                                                          1           0.000169      0.000169
gnus-continuum-version                                                        2           0.0001599999  7.999...e-05
gnus-article-setup-buffer                                                     1           0.000158      0.000158
gnus-update-missing-marks                                                     1           0.000146      0.000146
gnus-newsgroup-kill-file                                                      2           0.000122      6.1e-05
gnus-topic-goto-topic                                                         4           0.000115      2.875e-05
gnus-score-file-name                                                          1           0.000112      0.000112
gnus-configure-frame                                                          2           0.0001040000  5.200...e-05
gnus-group-highlight-line                                                     1           9.6e-05       9.6e-05
gnus-topic-find-groups                                                        3           9.400...e-05  3.133...e-05
gnus-get-buffer-create                                                        4           9.400...e-05  2.350...e-05
gnus-buffer-live-p                                                            9           9.200...e-05  1.022...e-05
gnus-make-hashtable                                                           3           8.2e-05       2.733...e-05
gnus-request-group                                                            1           8e-05         8e-05
gnus-adjust-marked-articles                                                   1           7.8e-05       7.8e-05
gnus-prin1-to-string                                                          1           7.1e-05       7.1e-05
gnus-agent-possibly-alter-active                                              2           6.9e-05       3.45e-05
gnus-file-newer-than                                                          1           6e-05         6e-05
gnus-emacs-version                                                            3           5.9e-05       1.966...e-05
gnus-all-windows-visible-p                                                    1           5.8e-05       5.8e-05
gnus-remove-from-range                                                        2           5.3e-05       2.65e-05
gnus-get-unread-articles-in-group                                             1           5.3e-05       5.3e-05
gnus-thread-sort-by-number                                                    21          5e-05         2.380...e-06
gnus-check-server                                                             1           4.5e-05       4.5e-05
gnus-agent-get-undownloaded-list                                              1           4.3e-05       4.3e-05
gnus-copy-sequence                                                            5           3.6e-05       7.200...e-06
gnus-get-buffer-window                                                        1           3.5e-05       3.5e-05
gnus-server-opened                                                            1           3.4e-05       3.4e-05
gnus-decay-scores                                                             1           3.3e-05       3.3e-05
gnus-article-mark-to-type                                                     16          3.200...e-05  2.000...e-06
gnus-ephemeral-group-p                                                        2           3.2e-05       1.6e-05
gnus-make-sort-function-1                                                     3           3.2e-05       1.066...e-05
gnus-short-group-name                                                         1           3.1e-05       3.1e-05
gnus-newsgroup-savable-name                                                   2           3.1e-05       1.55e-05
gnus-group-quit-config                                                        1           2.7e-05       2.7e-05
gnus-group-topic-p                                                            1           2.6e-05       2.6e-05
gnus-group-timestamp-delta                                                    1           2.6e-05       2.6e-05
gnus-virtual-group-p                                                          1           2.5e-05       2.5e-05
gnus-group-topic-unread                                                       8           2.2e-05       2.75e-06
gnus-mode-string-quote                                                        1           2.2e-05       2.2e-05
gnus-expand-group-parameters                                                  4           2.100...e-05  5.250...e-06
gnus-undo-register                                                            1           2e-05         2e-05
gnus-get-function                                                             1           1.9e-05       1.9e-05
gnus-online                                                                   4           1.8e-05       4.5e-06
gnus-create-hash-size                                                         3           1.499...e-05  4.999...e-06
gnus-group-topic-name                                                         1           1.4e-05       1.4e-05
gnus-agent-method-p                                                           4           1.300...e-05  3.250...e-06
gnus-group-group-name                                                         2           1.2e-05       6e-06
gnus-topic-update-unreads                                                     3           1.100...e-05  3.666...e-06
gnus-use-long-file-name                                                       4           1.1e-05       2.75e-06
gnus-undo-register-1                                                          1           1e-05         1e-05
gnus-list-of-unread-articles                                                  1           1e-05         1e-05
gnus-server-add-address                                                       1           9e-06         9e-06
gnus-server-to-method                                                         2           9e-06         4.5e-06
gnus-range-length                                                             3           9e-06         3e-06
gnus-topic-visible-p                                                          3           9e-06         3e-06
gnus-group-topic-level                                                        3           8e-06         2.666...e-06
gnus-group-group-indentation                                                  2           8e-06         4e-06
gnus-cache-decoded-group-name                                                 1           8e-06         8e-06
gnus-frames-on-display-list                                                   1           7e-06         7e-06
gnus-score-find-alist                                                         1           7e-06         7e-06
gnus-home-score-file                                                          2           7e-06         3.5e-06
gnus-sorted-ndifference                                                       2           7e-06         3.5e-06
gnus-sorted-nintersection                                                     1           6e-06         6e-06
gnus-group-category                                                           1           5e-06         5e-06
gnus-score-file-regexp                                                        1           5e-06         5e-06
gnus-server-status                                                            1           5e-06         5e-06
gnus-window-to-buffer-helper                                                  2           4e-06         2e-06
gnus-visual-p                                                                 1           4e-06         4e-06
gnus-windows-old-to-new                                                       1           4e-06         4e-06
gnus-undo-boundary                                                            1           4e-06         4e-06
gnus-remove-if                                                                1           4e-06         4e-06
gnus-article-setup-highlight-words                                            1           3e-06         3e-06
gnus-extent-start-open                                                        1           2e-06         2e-06
gnus-group-remove-excess-properties                                           1           2e-06         2e-06

[-- Attachment #5: Type: text/plain, Size: 14 bytes --]


Bye,
Tassilo

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Slowdowns with big nnmaildir groups
  2008-02-01 12:02   ` Tassilo Horn
@ 2008-02-01 12:29     ` David
  2008-02-01 13:04       ` Tassilo Horn
  2008-02-01 12:35     ` Daniel Pittman
  1 sibling, 1 reply; 14+ messages in thread
From: David @ 2008-02-01 12:29 UTC (permalink / raw)
  To: ding

Tassilo Horn <tassilo@member.fsf.org> writes:
> But I guess the relations between function times are correct.  In all
> examples `gnus-retrieve-headers' (called two times) is a huge factor in
> the overall time.
>
> gnus-retrieve-headers                                                         2           37.269011     18.6345055

You should do the same with elp-instrument-package for the nnmaildir
functions to see what happens in the maildir backend.

-David




^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Slowdowns with big nnmaildir groups
  2008-02-01 12:02   ` Tassilo Horn
  2008-02-01 12:29     ` David
@ 2008-02-01 12:35     ` Daniel Pittman
  2008-02-01 13:57       ` Tassilo Horn
  1 sibling, 1 reply; 14+ messages in thread
From: Daniel Pittman @ 2008-02-01 12:35 UTC (permalink / raw)
  To: ding

Tassilo Horn <tassilo@member.fsf.org> writes:
> David <de_bb@arcor.de> writes:
>
> Hi David,
>
>> Use the elisp profiler (ELP)
>>
>> M-x elp-instrument-package RET gnus
>> ... perform slow operations ...
>> M-x elp-results
>
> Hey, cool.  I didn't know it's included in emacs.  Before your post I
> downloaded a elp.el from emacswiki but that didn't work with emacs 23.

You probably want to instrument nnmaildir, or possibly nn, as well as gnus.

[...]

> But I guess the relations between function times are correct.  In all
> examples `gnus-retrieve-headers' (called two times) is a huge factor
> in the overall time.  Only with 6000 messages scoring, sorting and
> threading needs more time.  So I think, this is the function that
> causes the slowdown.

IIRC the nnmaildir code tries to play nice with other Maildir clients,
which means reading all the (giant) filenames from disk, which probably
works the poor kernel quite hard, especially with such a large
directory.

Worse, this sort of thing has been known to trigger other bugs.  
I suspect that you will find this is a design feature of the Maildir
system, and that nothing much can be done about it.

(Also, remember that reading messages extends the length of the name, so
expect the directory space to be fairly fragmented as well.)

Ensuring your Maildir is on a filesystem that handles large directories
well is probably the best bet for improving performance.

Regards,
        Daniel
-- 
Daniel Pittman <daniel@cybersource.com.au>           Phone: 03 9428 6922
1/130-132 Stawell St, Richmond              Web: http://www.cyber.com.au
Cybersource: Australia's Leading Linux and Open Source Solutions Company




^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Slowdowns with big nnmaildir groups
  2008-02-01 12:29     ` David
@ 2008-02-01 13:04       ` Tassilo Horn
  0 siblings, 0 replies; 14+ messages in thread
From: Tassilo Horn @ 2008-02-01 13:04 UTC (permalink / raw)
  To: ding

[-- Attachment #1: Type: text/plain, Size: 243 bytes --]

David <de_bb@arcor.de> writes:

Hi David,

> You should do the same with elp-instrument-package for the nnmaildir
> functions to see what happens in the maildir backend.

Ok, here're the results with M-x elp-instrument-package nnmaildir RET:


[-- Attachment #2: elp-nnmaildir-20.txt --]
[-- Type: text/plain, Size: 26292 bytes --]

gnus-retrieve-headers                                                         2           37.863376     18.931688
gnus-topic-select-group                                                       1           20.927041     20.927041
gnus-group-select-group                                                       1           20.926985     20.926985
gnus-group-read-group                                                         1           20.926974     20.926974
gnus-summary-read-group                                                       1           20.926923     20.926923
gnus-summary-read-group-1                                                     1           20.92691      20.92691
gnus-select-newsgroup                                                         1           20.845893     20.845893
gnus-fetch-headers                                                            1           19.022137     19.022137
gnus-cache-retrieve-headers                                                   1           18.931854     18.931854
nnmaildir-retrieve-headers                                                    1           18.931382     18.931382
nnmaildir--nlist-iterate                                                      1           18.537378     18.537378
nnmaildir--update-nov                                                         10631       17.809189999  0.0016752130
nnmaildir--param                                                              10631       10.424497999  0.0009805754
gnus-group-find-parameter                                                     10650       10.358925999  0.0009726691
gnus-group-fast-parameter                                                     10647       10.072201000  0.0009460130
gnus-group-topic-parameters                                                   10650       8.2081119999  0.0007707147
gnus-topic-hierarchical-parameters                                            10650       7.5311539999  0.0007071506
gnus-topic-parent-topic                                                       298228      6.4312580000  2.156...e-05
gnus-topic-find-topology                                                      202369      5.6624630000  2.798...e-05
gnus-current-topics                                                           10650       3.5802470000  0.0003361734
gnus-topic-parameters                                                         31950       3.2490499999  0.0001016917
gnus-articles-to-read                                                         1           1.719824      1.719824
gnus-replace-in-string                                                        10632       0.2568030000  2.415...e-05
gnus-group-parameter-value                                                    53241       0.1781950000  3.346...e-06
nnmaildir--pgname                                                             10631       0.1665640000  1.566...e-05
gnus-current-topic                                                            10651       0.1319999999  1.239...e-05
gnus-group-goto-group                                                         10650       0.1087519999  1.021...e-05
gnus-build-old-threads                                                        1           0.09747       0.09747
gnus-build-get-header                                                         35          0.0968160000  0.0027661714
gnus-get-newsgroup-headers-xover                                              1           0.088958      0.088958
nnmaildir--cache-nov                                                          10631       0.0474279999  4.461...e-06
gnus-group-get-parameter                                                      10656       0.0380150000  3.567...e-06
gnus-possibly-score-headers                                                   1           0.028958      0.028958
gnus-summary-prepare                                                          1           0.027124      0.027124
gnus-summary-prepare-threads                                                  1           0.018602      0.018602
gnus-score-headers                                                            1           0.015902      0.015902
gnus-all-score-files                                                          1           0.013043      0.013043
gnus-mode-line-buffer-identification                                          3           0.0128829999  0.0042943333
gnus-score-string                                                             4           0.0125480000  0.0031370000
gnus-score-find-bnews                                                         1           0.01186       0.01186
gnus-user-format-function-b                                                   27          0.011626      0.0004305925
gnus-group-update-group                                                       1           0.010045      0.010045
gnus-group-set-mode-line                                                      2           0.00847       0.004235
gnus-run-hooks                                                                36          0.0066770000  0.0001854722
gnus-killed-articles                                                          1           0.006273      0.006273
gnus-sort-threads-recursive                                                   12          0.005644      0.0004703333
gnus-thread-total-score                                                       174         0.0053830000  3.093...e-05
gnus-sort-threads                                                             1           0.004975      0.004975
gnus-set-mode-line                                                            1           0.0047        0.0047
gnus-score-score-files                                                        1           0.004436      0.004436
gnus-thread-total-score-1                                                     174         0.0043249999  2.485...e-05
gnus-dribble-enter                                                            1           0.004198      0.004198
gnus-summary-setup-buffer                                                     1           0.004185      0.004185
gnus-thread-sort-by-total-score                                               39          0.0034720000  8.902...e-05
gnus-message                                                                  10          0.00335       0.000335
gnus-message-with-timestamp                                                   8           0.003249      0.000406125
gnus-uncompress-range                                                         1           0.003067      0.003067
gnus-summary-mode                                                             1           0.003001      0.003001
gnus-summary-hide-all-threads                                                 2           0.00243       0.001215
gnus-score-string<                                                            836         0.0019570000  2.340...e-06
gnus-summary-hide-thread                                                      20          0.00187       9.35e-05
gnus-summary-limit-children                                                   50          0.0017520000  3.504e-05
gnus-score-load-files                                                         1           0.001662      0.001662
gnus-article-setup-buffer                                                     1           0.001647      0.001647
gnus-score-load-file                                                          3           0.0016359999  0.0005453333
gnus-summary-setup-default-charset                                            1           0.001611      0.001611
gnus-topic-update-topic-line                                                  3           0.001523      0.0005076666
gnus-summary-set-local-parameters                                             2           0.0013709999  0.0006854999
gnus-score-load-score-alist                                                   1           0.001337      0.001337
gnus-summary-maybe-hide-threads                                               1           0.001303      0.001303
gnus-parameter-spam-marks                                                     2           0.001128      0.000564
gnus-parameter-ham-marks                                                      2           0.001107      0.0005535
gnus-group-decoded-name                                                       8           0.001077      0.000134625
gnus-summary-from-or-to-or-newsgroups                                         27          0.001068      3.955...e-05
gnus-map-function                                                             25          0.001059      4.236e-05
gnus-summary-highlight-line                                                   27          0.001025      3.796...e-05
gnus-update-summary-mark-positions                                            1           0.001012      0.001012
gnus-summary-goto-subject                                                     20          0.0009869999  4.934...e-05
gnus-summary-insert-line                                                      2           0.0009        0.00045
gnus-topic-update-topics-containing-group                                     1           0.000884      0.000884
gnus-parameter-charset                                                        1           0.000862      0.000862
gnus-agent-find-parameter                                                     1           0.000822      0.000822
gnus-parameter-large-newsgroup-initial                                        1           0.0008        0.0008
gnus-group-name-decode                                                        10          0.000732      7.32e-05
gnus-parameter-ignored-charsets                                               1           0.000726      0.000726
gnus-thread-sort-by-most-recent-date                                          4           0.000723      0.00018075
gnus-summary-next-thread                                                      40          0.0006929999  1.732...e-05
gnus-thread-latest-date                                                       8           0.000677      8.4625e-05
gnus-group-auto-expirable-p                                                   1           0.000609      0.000609
gnus-update-format-specifications                                             3           0.0005679999  0.0001893333
gnus-summary-position-point                                                   25          0.0005490000  2.196...e-05
gnus-extract-address-components                                               27          0.0005470000  2.025...e-05
gnus-parameter-spam-autodetect                                                1           0.000544      0.000544
gnus-article-setup-highlight-words                                            1           0.000542      0.000542
gnus-parameter-spam-contents                                                  1           0.000504      0.000504
gnus-run-mode-hooks                                                           2           0.000489      0.0002445
gnus-parameters-get-parameter                                                 3           0.0004880000  0.0001626666
gnus-parameter-spam-autodetect-methods                                        1           0.000483      0.000483
gnus-make-sort-function                                                       1           0.000475      0.000475
gnus-id-to-thread                                                             197         0.0004679999  2.375...e-06
gnus-group-insert-group-line-info                                             1           0.000467      0.000467
gnus-byte-compile                                                             1           0.000443      0.000443
gnus-simplify-subject-re                                                      25          0.0004190000  1.676...e-05
gnus-summary-initial-limit                                                    1           0.000419      0.000419
gnus-summary-go-to-next-thread                                                40          0.0004170000  1.042...e-05
gnus-put-text-property-excluding-characters-with-faces                        28          0.000413      1.475...e-05
gnus-put-text-property                                                        86          0.0004109999  4.779...e-06
gnus-goto-colon                                                               25          0.000404      1.616e-05
gnus-group-insert-group-line                                                  1           0.000393      0.000393
gnus-summary-auto-select-subject                                              1           0.000385      0.000385
gnus-summary-first-unread-subject                                             1           0.000378      0.000378
gnus-simplify-buffer-fuzzy                                                    1           0.000376      0.000376
gnus-continuum-version                                                        6           0.000358      5.966...e-05
gnus-make-threads                                                             1           0.000353      0.000353
gnus-summary-first-subject                                                    1           0.000347      0.000347
gnus-simplify-whitespace                                                      25          0.0003299999  1.319...e-05
gnus-update-read-articles                                                     1           0.000326      0.000326
gnus-summary-buffer-name                                                      3           0.000319      0.0001063333
gnus-group-name-charset                                                       10          0.0003120000  3.120...e-05
gnus-score-check-syntax                                                       1           0.000311      0.000311
gnus-apply-kill-file                                                          1           0.000293      0.000293
gnus-cache-articles-in-group                                                  1           0.000274      0.000274
gnus-article-mode                                                             1           0.000265      0.000265
gnus-find-method-for-group                                                    17          0.0002499999  1.470...e-05
gnus-summary-set-article-display-arrow                                        20          0.0002429999  1.214...e-05
gnus-set-global-variables                                                     4           0.0002370000  5.925...e-05
gnus-gather-threads-by-references                                             1           0.000237      0.000237
gnus-correct-length                                                           54          0.0002199999  4.074...e-06
gnus-topic-insert-topic-line                                                  3           0.000194      6.466...e-05
gnus-cache-file-name                                                          1           0.000167      0.000167
gnus-add-text-properties                                                      34          0.0001669999  4.911...e-06
gnus-sort-score-files                                                         1           0.000163      0.000163
gnus-configure-windows                                                        1           0.000159      0.000159
gnus-get-buffer-create                                                        6           0.0001500000  2.5e-05
gnus-remove-from-range                                                        2           0.00014       7e-05
gnus-thread-loop-p                                                            40          0.0001190000  2.975...e-06
gnus-summary-make-local-variables                                             2           0.000119      5.95e-05
gnus-topic-find-groups                                                        3           0.000115      3.833...e-05
gnus-newsgroup-kill-file                                                      2           0.000115      5.75e-05
gnus-agent-mode                                                               1           9.8e-05       9.8e-05
gnus-score-set                                                                31          9.700...e-05  3.129...e-06
gnus-group-highlight-line                                                     1           9.5e-05       9.5e-05
gnus-configure-frame                                                          2           9.400...e-05  4.700...e-05
gnus-buffer-live-p                                                            9           9e-05         1e-05
gnus-score-file-name                                                          1           8.8e-05       8.8e-05
gnus-request-group                                                            1           8.8e-05       8.8e-05
gnus-summary-set-display-table                                                1           8.2e-05       8.2e-05
gnus-adjust-marked-articles                                                   1           7.3e-05       7.3e-05
gnus-expand-group-parameters                                                  12          6.6e-05       5.500...e-06
gnus-topic-goto-topic                                                         5           6.599...e-05  1.319...e-05
gnus-group-group-indentation                                                  2           6.5e-05       3.25e-05
gnus-agent-possibly-alter-active                                              2           6.400...e-05  3.200...e-05
gnus-check-server                                                             1           5.7e-05       5.7e-05
gnus-make-hashtable                                                           3           5.5e-05       1.833...e-05
gnus-all-windows-visible-p                                                    1           5.5e-05       5.5e-05
gnus-prin1-to-string                                                          1           5.4e-05       5.4e-05
gnus-topic-group-indentation                                                  1           5.3e-05       5.3e-05
gnus-emacs-version                                                            3           5.200...e-05  1.733...e-05
gnus-summary-highlight-line-0                                                 27          5.100...e-05  1.888...e-06
gnus-get-unread-articles-in-group                                             1           5.1e-05       5.1e-05
gnus-cut-threads                                                              1           4.9e-05       4.9e-05
gnus-file-newer-than                                                          1           4.9e-05       4.9e-05
gnus-group-quit-config                                                        2           4.8e-05       2.4e-05
gnus-server-opened                                                            1           4.6e-05       4.6e-05
gnus-turn-off-edit-menu                                                       2           4.499...e-05  2.249...e-05
nnmaildir--tab-to-space                                                       12          4.299...e-05  3.583...e-06
gnus-agent-get-undownloaded-list                                              1           4e-05         4e-05
gnus-ephemeral-group-p                                                        2           3.6e-05       1.8e-05
gnus-undo-register                                                            1           3.5e-05       3.5e-05
gnus-summary-make-menu-bar                                                    1           3.4e-05       3.4e-05
gnus-copy-sequence                                                            5           3.4e-05       6.8e-06
gnus-get-buffer-window                                                        1           3.3e-05       3.3e-05
gnus-short-group-name                                                         1           3.1e-05       3.1e-05
gnus-group-timestamp-delta                                                    1           3.1e-05       3.1e-05
gnus-compute-unseen-list                                                      1           2.8e-05       2.8e-05
gnus-newsgroup-savable-name                                                   2           2.8e-05       1.4e-05
gnus-make-sort-function-1                                                     3           2.8e-05       9.333...e-06
gnus-group-topic-p                                                            1           2.8e-05       2.8e-05
gnus-article-make-menu-bar                                                    1           2.7e-05       2.7e-05
gnus-decay-scores                                                             1           2.6e-05       2.6e-05
gnus-virtual-group-p                                                          1           2.4e-05       2.4e-05
nnmaildir-request-group                                                       1           2.4e-05       2.4e-05
gnus-group-topic-unread                                                       8           2.2e-05       2.75e-06
gnus-set-work-buffer                                                          1           2.1e-05       2.1e-05
gnus-inverse-list-range-intersection                                          1           2.1e-05       2.1e-05
gnus-mode-string-quote                                                        1           2e-05         2e-05
gnus-visual-p                                                                 6           1.9e-05       3.166...e-06
nnmaildir--prepare                                                            2           1.9e-05       9.5e-06
gnus-simplify-mode-line                                                       2           1.8e-05       9e-06
gnus-get-function                                                             1           1.7e-05       1.7e-05
gnus-group-topic-name                                                         1           1.6e-05       1.6e-05
gnus-online                                                                   4           1.6e-05       4e-06
gnus-undo-register-1                                                          1           1.5e-05       1.5e-05
gnus-list-range-difference                                                    1           1.5e-05       1.5e-05
gnus-sorted-difference                                                        2           1.499...e-05  7.499...e-06
gnus-undo-boundary                                                            2           1.400...e-05  7.000...e-06
gnus-create-hash-size                                                         3           1.300...e-05  4.333...e-06
gnus-agent-method-p                                                           4           1.3e-05       3.25e-06
gnus-last-element                                                             1           1.1e-05       1.1e-05
gnus-group-group-name                                                         2           1.1e-05       5.5e-06
gnus-use-long-file-name                                                       4           1.1e-05       2.75e-06
gnus-sorted-ndifference                                                       2           1.1e-05       5.5e-06
gnus-list-of-unread-articles                                                  1           1.1e-05       1.1e-05
gnus-group-topic-level                                                        4           9.999...e-06  2.499...e-06
gnus-topic-update-unreads                                                     3           9.999...e-06  3.333...e-06
gnus-score-file-regexp                                                        2           9e-06         4.5e-06
gnus-range-length                                                             3           9e-06         3e-06
gnus-server-status                                                            1           9e-06         9e-06
gnus-server-add-address                                                       1           8e-06         8e-06
gnus-cache-decoded-group-name                                                 1           8e-06         8e-06
gnus-summary-make-tool-bar                                                    1           7e-06         7e-06
gnus-score-find-alist                                                         1           7e-06         7e-06
gnus-server-to-method                                                         2           7e-06         3.5e-06
gnus-set-default-directory                                                    2           7e-06         3.5e-06
gnus-topic-visible-p                                                          3           6.999...e-06  2.333...e-06
gnus-frames-on-display-list                                                   1           6e-06         6e-06
gnus-home-score-file                                                          2           6e-06         3e-06
gnus-article-mark-to-type                                                     2           6e-06         3e-06
gnus-group-category                                                           1           5e-06         5e-06
nnmaildir-server-opened                                                       1           5e-06         5e-06
gnus-window-to-buffer-helper                                                  2           4.999...e-06  2.499...e-06
gnus-sort-gathered-threads                                                    1           4e-06         4e-06
gnus-make-thread-indent-array                                                 1           4e-06         4e-06
gnus-agent-summary-make-menu-bar                                              1           3e-06         3e-06
gnus-windows-old-to-new                                                       1           3e-06         3e-06
gnus-make-local-hook                                                          1           3e-06         3e-06
gnus-update-missing-marks                                                     1           3e-06         3e-06
gnus-sorted-nintersection                                                     1           3e-06         3e-06
gnus-remove-if                                                                1           3e-06         3e-06
gnus-extent-start-open                                                        1           2e-06         2e-06
gnus-group-remove-excess-properties                                           1           1e-06         1e-06

[-- Attachment #3: elp-nnmaildir-2000.txt --]
[-- Type: text/plain, Size: 26541 bytes --]

gnus-retrieve-headers                                                         2           37.011671     18.5058355
gnus-topic-select-group                                                       1           33.376981     33.376981
gnus-group-select-group                                                       1           33.376939     33.376939
gnus-group-read-group                                                         1           33.376931     33.376931
gnus-summary-read-group                                                       1           33.376891     33.376891
gnus-summary-read-group-1                                                     1           33.37688      33.37688
gnus-select-newsgroup                                                         1           23.082556     23.082556
gnus-thread-total-score                                                       61625       21.010621999  0.0003409431
gnus-thread-total-score-1                                                     61625       19.801496000  0.0003213224
gnus-fetch-headers                                                            1           19.347872     19.347872
gnus-cache-retrieve-headers                                                   1           18.505935     18.505935
nnmaildir-retrieve-headers                                                    1           18.505625     18.505625
nnmaildir--nlist-iterate                                                      1           18.144065     18.144065
nnmaildir--update-nov                                                         10631       17.299726999  0.0016272906
nnmaildir--param                                                              10631       10.574862000  0.0009947194
gnus-group-find-parameter                                                     10650       10.363398000  0.0009730890
gnus-group-fast-parameter                                                     10647       10.215765000  0.0009594970
gnus-sort-threads-recursive                                                   1346        9.8581319999  0.0073240208
gnus-summary-prepare                                                          1           8.756994      8.756994
gnus-group-topic-parameters                                                   10650       7.7798779999  0.0007305049
gnus-topic-hierarchical-parameters                                            10650       6.7273669999  0.0006316776
gnus-sort-threads                                                             1           6.086939      6.086939
gnus-topic-parent-topic                                                       298228      5.9633690000  1.999...e-05
gnus-topic-find-topology                                                      202369      4.9342679999  2.438...e-05
gnus-current-topics                                                           10650       3.6100520000  0.0003389720
gnus-thread-sort-by-most-recent-date                                          3157        3.0806839999  0.0009758264
gnus-articles-to-read                                                         1           2.970974      2.970974
gnus-thread-sort-by-total-score                                               5033        2.9564130000  0.0005874057
gnus-thread-latest-date                                                       6314        2.9051809999  0.0004601173
gnus-topic-parameters                                                         31950       2.7254369999  8.530...e-05
gnus-summary-prepare-threads                                                  1           2.559296      2.559296
gnus-user-format-function-b                                                   2078        1.5911120000  0.0007656939
gnus-possibly-score-headers                                                   1           1.287382      1.287382
gnus-score-headers                                                            1           1.271432      1.271432
gnus-score-string                                                             4           1.265044      0.316261
gnus-get-newsgroup-headers-xover                                              1           0.840666      0.840666
gnus-build-old-threads                                                        1           0.754461      0.754461
gnus-build-get-header                                                         272         0.7483420000  0.0027512573
gnus-id-to-thread                                                             61816       0.4795769999  7.758...e-06
gnus-group-parameter-value                                                    53241       0.3496449999  6.567...e-06
gnus-run-hooks                                                                2087        0.2661830000  0.0001275433
gnus-current-topic                                                            10651       0.2580280000  2.422...e-05
gnus-score-string<                                                            85784       0.2133100000  2.486...e-06
gnus-summary-hide-all-threads                                                 2           0.203973      0.1019865
nnmaildir--cache-nov                                                          10631       0.1806890000  1.699...e-05
gnus-group-get-parameter                                                      10656       0.1691500000  1.587...e-05
nnmaildir--pgname                                                             10631       0.1673510000  1.574...e-05
gnus-correct-length                                                           4156        0.1607400000  3.867...e-05
gnus-summary-hide-thread                                                      650         0.1580930000  0.0002432200
gnus-summary-limit-children                                                   2229        0.1301460000  5.838...e-05
gnus-summary-maybe-hide-threads                                               1           0.127939      0.127939
gnus-summary-next-thread                                                      1300        0.1209389999  9.302...e-05
gnus-replace-in-string                                                        10632       0.1200199999  1.128...e-05
gnus-summary-go-to-next-thread                                                1300        0.1114679999  8.574...e-05
gnus-group-goto-group                                                         10650       0.1064259999  9.993...e-06
gnus-map-function                                                             2076        0.0879319999  4.235...e-05
gnus-summary-highlight-line                                                   2078        0.0876449999  4.217...e-05
gnus-summary-from-or-to-or-newsgroups                                         2078        0.0867239999  4.173...e-05
gnus-summary-goto-subject                                                     650         0.0512819999  7.889...e-05
gnus-extract-address-components                                               2078        0.0448049999  2.156...e-05
gnus-simplify-subject-re                                                      2076        0.0343700000  1.655...e-05
gnus-put-text-property                                                        6239        0.0300000000  4.808...e-06
gnus-put-text-property-excluding-characters-with-faces                        2079        0.0298489999  1.435...e-05
gnus-simplify-whitespace                                                      2076        0.0274680000  1.323...e-05
gnus-summary-initial-limit                                                    1           0.023302      0.023302
gnus-summary-position-point                                                   655         0.0218209999  3.331...e-05
gnus-goto-colon                                                               655         0.0179539999  2.741...e-05
gnus-make-threads                                                             1           0.016262      0.016262
gnus-all-score-files                                                          1           0.015934      0.015934
gnus-score-find-bnews                                                         1           0.014495      0.014495
gnus-add-text-properties                                                      2085        0.0141850000  6.803...e-06
gnus-mode-line-buffer-identification                                          3           0.01281       0.00427
gnus-simplify-buffer-fuzzy                                                    1           0.011405      0.011405
gnus-group-update-group                                                       1           0.010042      0.010042
gnus-group-set-mode-line                                                      2           0.0083930000  0.0041965000
gnus-summary-set-article-display-arrow                                        650         0.0081429999  1.252...e-05
gnus-thread-loop-p                                                            1903        0.0058600000  3.079...e-06
gnus-cut-threads                                                              1           0.005517      0.005517
gnus-score-score-files                                                        1           0.005487      0.005487
gnus-set-mode-line                                                            1           0.004752      0.004752
gnus-dribble-enter                                                            1           0.004278      0.004278
gnus-summary-highlight-line-0                                                 2078        0.0041529999  1.998...e-06
gnus-message                                                                  10          0.003978      0.0003977999
gnus-message-with-timestamp                                                   8           0.003881      0.000485125
gnus-killed-articles                                                          1           0.00369       0.00369
gnus-summary-setup-buffer                                                     1           0.00271       0.00271
gnus-correct-substring                                                        182         0.0024379999  1.339...e-05
gnus-gather-threads-by-references                                             1           0.002226      0.002226
gnus-score-load-files                                                         1           0.002066      0.002066
gnus-score-load-file                                                          3           0.002043      0.0006810000
gnus-article-setup-buffer                                                     1           0.002007      0.002007
gnus-summary-auto-select-subject                                              1           0.001992      0.001992
gnus-summary-first-unread-subject                                             1           0.001984      0.001984
gnus-summary-mode                                                             1           0.001935      0.001935
gnus-uncompress-range                                                         1           0.001798      0.001798
gnus-compute-unseen-list                                                      1           0.0017        0.0017
gnus-summary-first-subject                                                    1           0.001693      0.001693
gnus-inverse-list-range-intersection                                          1           0.00169       0.00169
gnus-list-range-difference                                                    1           0.001681      0.001681
gnus-score-load-score-alist                                                   1           0.001663      0.001663
gnus-topic-update-topic-line                                                  3           0.001544      0.0005146666
gnus-summary-set-local-parameters                                             2           0.0012339999  0.0006169999
gnus-parameter-ham-marks                                                      2           0.00111       0.000555
gnus-parameter-spam-marks                                                     2           0.001057      0.0005285
gnus-summary-setup-default-charset                                            1           0.001053      0.001053
gnus-group-decoded-name                                                       8           0.0009289999  0.0001161249
gnus-topic-update-topics-containing-group                                     1           0.000889      0.000889
gnus-group-auto-expirable-p                                                   1           0.000823      0.000823
gnus-group-name-decode                                                        10          0.000686      6.86e-05
gnus-update-summary-mark-positions                                            1           0.000648      0.000648
gnus-article-setup-highlight-words                                            1           0.000644      0.000644
gnus-score-set                                                                186         0.0006349999  3.413...e-06
gnus-sorted-difference                                                        2           0.0006180000  0.0003090000
gnus-parameters-get-parameter                                                 3           0.000607      0.0002023333
gnus-parameter-spam-autodetect                                                1           0.000601      0.000601
gnus-summary-insert-line                                                      2           0.000574      0.000287
gnus-parameter-charset                                                        1           0.000565      0.000565
gnus-update-format-specifications                                             3           0.000537      0.0001790000
gnus-agent-find-parameter                                                     1           0.000526      0.000526
gnus-parameter-large-newsgroup-initial                                        1           0.000521      0.000521
gnus-group-insert-group-line-info                                             1           0.000521      0.000521
gnus-parameter-spam-contents                                                  1           0.000508      0.000508
gnus-configure-windows                                                        1           0.000496      0.000496
gnus-make-sort-function                                                       1           0.000482      0.000482
gnus-parameter-spam-autodetect-methods                                        1           0.000478      0.000478
gnus-parameter-ignored-charsets                                               1           0.000473      0.000473
gnus-byte-compile                                                             1           0.000451      0.000451
gnus-group-insert-group-line                                                  1           0.000438      0.000438
gnus-last-element                                                             1           0.000419      0.000419
gnus-score-check-syntax                                                       1           0.000377      0.000377
gnus-continuum-version                                                        6           0.0003450000  5.750...e-05
gnus-run-mode-hooks                                                           2           0.000331      0.0001655
gnus-article-mode                                                             1           0.000319      0.000319
gnus-summary-buffer-name                                                      3           0.0003039999  0.0001013333
gnus-group-name-charset                                                       10          0.000274      2.74e-05
gnus-make-hashtable                                                           3           0.0002600000  8.666...e-05
gnus-set-global-variables                                                     4           0.00025       6.25e-05
gnus-apply-kill-file                                                          1           0.000241      0.000241
gnus-sort-score-files                                                         1           0.000215      0.000215
gnus-cache-articles-in-group                                                  1           0.000209      0.000209
gnus-find-method-for-group                                                    17          0.000202      1.188...e-05
gnus-topic-insert-topic-line                                                  3           0.000192      6.4e-05
gnus-update-missing-marks                                                     1           0.000169      0.000169
gnus-get-buffer-create                                                        6           0.0001629999  2.716...e-05
gnus-update-read-articles                                                     1           0.000151      0.000151
gnus-cache-file-name                                                          1           0.000126      0.000126
gnus-newsgroup-kill-file                                                      2           0.000118      5.9e-05
gnus-score-file-name                                                          1           0.000109      0.000109
gnus-topic-find-groups                                                        3           0.0001080000  3.6e-05
gnus-configure-frame                                                          2           0.000102      5.1e-05
gnus-group-highlight-line                                                     1           8.9e-05       8.9e-05
gnus-buffer-live-p                                                            9           8.3e-05       9.222...e-06
gnus-summary-make-local-variables                                             2           7.3e-05       3.65e-05
gnus-group-group-indentation                                                  2           7.1e-05       3.55e-05
gnus-topic-goto-topic                                                         5           6.7e-05       1.34e-05
gnus-prin1-to-string                                                          1           6.6e-05       6.6e-05
gnus-agent-mode                                                               1           6.2e-05       6.2e-05
gnus-request-group                                                            1           6e-05         6e-05
gnus-file-newer-than                                                          1           6e-05         6e-05
gnus-topic-group-indentation                                                  1           6e-05         6e-05
gnus-sort-gathered-threads                                                    1           5.9e-05       5.9e-05
gnus-all-windows-visible-p                                                    1           5.9e-05       5.9e-05
gnus-expand-group-parameters                                                  12          5.7e-05       4.75e-06
gnus-summary-set-display-table                                                1           5.3e-05       5.3e-05
gnus-emacs-version                                                            3           5.099...e-05  1.699...e-05
gnus-adjust-marked-articles                                                   1           4.8e-05       4.8e-05
gnus-agent-get-undownloaded-list                                              1           4.5e-05       4.5e-05
gnus-article-mark-to-type                                                     16          4.300...e-05  2.687...e-06
gnus-agent-possibly-alter-active                                              2           4.3e-05       2.15e-05
gnus-turn-off-edit-menu                                                       2           4.200...e-05  2.100...e-05
nnmaildir--tab-to-space                                                       12          4.1e-05       3.416...e-06
gnus-check-server                                                             1           3.9e-05       3.9e-05
gnus-remove-from-range                                                        2           3.700...e-05  1.850...e-05
gnus-get-buffer-window                                                        1           3.5e-05       3.5e-05
gnus-article-make-menu-bar                                                    1           3.3e-05       3.3e-05
gnus-short-group-name                                                         1           3.2e-05       3.2e-05
gnus-newsgroup-savable-name                                                   2           3.2e-05       1.6e-05
gnus-ephemeral-group-p                                                        2           3.2e-05       1.6e-05
gnus-group-quit-config                                                        2           3.2e-05       1.6e-05
gnus-get-unread-articles-in-group                                             1           3.2e-05       3.2e-05
gnus-server-opened                                                            1           3.1e-05       3.1e-05
gnus-decay-scores                                                             1           3e-05         3e-05
gnus-copy-sequence                                                            5           2.900...e-05  5.8e-06
gnus-make-sort-function-1                                                     3           2.7e-05       9e-06
gnus-mode-string-quote                                                        1           2.5e-05       2.5e-05
gnus-group-timestamp-delta                                                    1           2.5e-05       2.5e-05
gnus-summary-make-menu-bar                                                    1           2.4e-05       2.4e-05
gnus-group-topic-unread                                                       8           2.100...e-05  2.625...e-06
gnus-group-topic-p                                                            1           2.1e-05       2.1e-05
gnus-undo-register                                                            1           1.8e-05       1.8e-05
gnus-visual-p                                                                 6           1.7e-05       2.833...e-06
gnus-simplify-mode-line                                                       2           1.6e-05       8e-06
nnmaildir-request-group                                                       1           1.6e-05       1.6e-05
gnus-virtual-group-p                                                          1           1.5e-05       1.5e-05
nnmaildir--prepare                                                            2           1.5e-05       7.5e-06
gnus-get-function                                                             1           1.4e-05       1.4e-05
gnus-undo-boundary                                                            3           1.300...e-05  4.333...e-06
gnus-set-work-buffer                                                          1           1.3e-05       1.3e-05
gnus-create-hash-size                                                         3           1.2e-05       4e-06
gnus-online                                                                   4           1.199...e-05  2.999...e-06
gnus-group-topic-name                                                         1           1.1e-05       1.1e-05
gnus-score-file-regexp                                                        2           1.1e-05       5.5e-06
gnus-undo-register-1                                                          1           1.1e-05       1.1e-05
gnus-group-topic-level                                                        4           9.999...e-06  2.499...e-06
gnus-agent-method-p                                                           4           9.999...e-06  2.499...e-06
gnus-group-group-name                                                         2           9e-06         4.5e-06
gnus-topic-update-unreads                                                     3           9e-06         3e-06
gnus-use-long-file-name                                                       4           8.999...e-06  2.249...e-06
gnus-server-to-method                                                         2           8.000...e-06  4.000...e-06
gnus-home-score-file                                                          2           8e-06         4e-06
gnus-topic-visible-p                                                          3           8e-06         2.666...e-06
gnus-frames-on-display-list                                                   1           7e-06         7e-06
gnus-cache-decoded-group-name                                                 1           7e-06         7e-06
gnus-list-of-unread-articles                                                  1           7e-06         7e-06
gnus-range-length                                                             3           6.999...e-06  2.333...e-06
gnus-score-find-alist                                                         1           6e-06         6e-06
gnus-sorted-ndifference                                                       2           6e-06         3e-06
gnus-set-default-directory                                                    2           6e-06         3e-06
gnus-server-add-address                                                       1           5e-06         5e-06
gnus-summary-make-tool-bar                                                    1           5e-06         5e-06
gnus-window-to-buffer-helper                                                  2           4.999...e-06  2.499...e-06
gnus-windows-old-to-new                                                       1           4e-06         4e-06
gnus-group-category                                                           1           4e-06         4e-06
gnus-sorted-nintersection                                                     1           4e-06         4e-06
gnus-server-status                                                            1           4e-06         4e-06
nnmaildir-server-opened                                                       1           4e-06         4e-06
gnus-make-local-hook                                                          1           3e-06         3e-06
gnus-thread-sort-by-number                                                    1           3e-06         3e-06
gnus-remove-if                                                                1           3e-06         3e-06
gnus-agent-summary-make-menu-bar                                              1           2e-06         2e-06
gnus-extent-start-open                                                        1           2e-06         2e-06
gnus-group-remove-excess-properties                                           1           2e-06         2e-06
gnus-make-thread-indent-array                                                 1           2e-06         2e-06

[-- Attachment #4: elp-nnmaildir-6000.txt --]
[-- Type: text/plain, Size: 26580 bytes --]

gnus-thread-total-score                                                       245600      72.489626999  0.0002951532
gnus-thread-total-score-1                                                     245600      69.480769999  0.0002829021
gnus-topic-select-group                                                       1           69.051448     69.051448
gnus-group-select-group                                                       1           69.051393     69.051393
gnus-group-read-group                                                         1           69.051384     69.051384
gnus-summary-read-group                                                       1           69.051326     69.051326
gnus-summary-read-group-1                                                     1           69.051314     69.051314
gnus-sort-threads-recursive                                                   3983        52.612328999  0.0132092214
gnus-retrieve-headers                                                         2           38.539451     19.2697255
gnus-summary-prepare                                                          1           38.364037     38.364037
gnus-sort-threads                                                             1           28.83634      28.83634
gnus-select-newsgroup                                                         1           24.847152     24.847152
gnus-fetch-headers                                                            1           21.320929     21.320929
gnus-cache-retrieve-headers                                                   1           19.269859     19.269859
nnmaildir-retrieve-headers                                                    1           19.269458     19.269458
nnmaildir--nlist-iterate                                                      1           18.895776     18.895776
nnmaildir--update-nov                                                         10631       17.794463999  0.0016738278
gnus-thread-sort-by-most-recent-date                                          11919       17.765842999  0.0014905481
gnus-thread-latest-date                                                       23838       17.612669999  0.0007388484
gnus-group-find-parameter                                                     10652       11.393500000  0.0010696113
nnmaildir--param                                                              10631       11.302893000  0.0010632012
gnus-group-fast-parameter                                                     10649       11.090468000  0.0010414562
gnus-thread-sort-by-total-score                                               16900       10.892333000  0.0006445167
gnus-topic-parent-topic                                                       298284      9.0676160000  3.039...e-05
gnus-group-topic-parameters                                                   10652       8.9237659999  0.0008377549
gnus-summary-prepare-threads                                                  1           8.268705      8.268705
gnus-topic-hierarchical-parameters                                            10652       8.1000329999  0.0007604236
gnus-current-topics                                                           10652       5.0677990000  0.0004757603
gnus-topic-find-topology                                                      202407      4.3455099999  2.146...e-05
gnus-user-format-function-b                                                   6052        4.1665639999  0.0006884606
gnus-possibly-score-headers                                                   1           3.792611      3.792611
gnus-score-headers                                                            1           3.77639       3.77639
gnus-score-string                                                             4           3.7669059999  0.9417264999
gnus-topic-parameters                                                         31956       2.6612469999  8.327...e-05
gnus-run-hooks                                                                6061        2.4067090000  0.0003970811
gnus-articles-to-read                                                         1           2.255135      2.255135
gnus-get-newsgroup-headers-xover                                              1           2.049357      2.049357
gnus-summary-hide-all-threads                                                 2           1.7814130000  0.8907065000
gnus-summary-next-thread                                                      3444        1.4079350000  0.0004088080
gnus-summary-maybe-hide-threads                                               1           1.228431      1.228431
gnus-summary-go-to-next-thread                                                3444        1.2099359999  0.0003513170
gnus-summary-hide-thread                                                      1722        1.2074840000  0.0007012102
gnus-build-old-threads                                                        1           1.092904      1.092904
gnus-build-get-header                                                         480         1.081814      0.0022537791
gnus-summary-limit-children                                                   6339        0.9487460000  0.0001496680
gnus-id-to-thread                                                             245891      0.8874889999  3.609...e-06
gnus-score-string<                                                            282380      0.8667499999  3.069...e-06
gnus-replace-in-string                                                        10632       0.4821669999  4.535...e-05
gnus-put-text-property                                                        18161       0.4641119999  2.555...e-05
nnmaildir--pgname                                                             10631       0.4586699999  4.314...e-05
gnus-summary-highlight-line                                                   6052        0.4478670000  7.400...e-05
gnus-summary-from-or-to-or-newsgroups                                         6052        0.4477509999  7.398...e-05
gnus-map-function                                                             6050        0.2809389999  4.643...e-05
gnus-summary-goto-subject                                                     1722        0.2794359999  0.0001622740
gnus-put-text-property-excluding-characters-with-faces                        6053        0.2530779999  4.181...e-05
gnus-correct-length                                                           12104       0.2471530000  2.041...e-05
gnus-summary-initial-limit                                                    1           0.2385380000  0.2385380000
gnus-group-parameter-value                                                    53251       0.1882850000  3.535...e-06
gnus-article-setup-buffer                                                     1           0.1564060000  0.1564060000
gnus-article-setup-highlight-words                                            1           0.1548580000  0.1548580000
gnus-extract-address-components                                               6052        0.1459679999  2.411...e-05
gnus-current-topic                                                            10653       0.1320949999  1.239...e-05
gnus-simplify-subject-re                                                      6050        0.1110810000  1.836...e-05
gnus-group-goto-group                                                         10652       0.1098709999  1.031...e-05
gnus-simplify-whitespace                                                      6050        0.0870909999  1.439...e-05
gnus-summary-position-point                                                   1727        0.0615280000  3.562...e-05
gnus-goto-colon                                                               1727        0.0508130000  2.942...e-05
nnmaildir--cache-nov                                                          10631       0.0482909999  4.542...e-06
gnus-make-threads                                                             1           0.047357      0.047357
gnus-add-text-properties                                                      6059        0.0381709999  6.299...e-06
gnus-group-get-parameter                                                      10658       0.0355760000  3.337...e-06
gnus-cut-threads                                                              1           0.029494      0.029494
gnus-simplify-buffer-fuzzy                                                    1           0.028194      0.028194
gnus-summary-set-article-display-arrow                                        1722        0.0246050000  1.428...e-05
gnus-thread-loop-p                                                            5459        0.0170089999  3.115...e-06
gnus-all-score-files                                                          1           0.016205      0.016205
gnus-score-find-bnews                                                         1           0.014767      0.014767
gnus-mode-line-buffer-identification                                          3           0.0128030000  0.0042676666
gnus-summary-highlight-line-0                                                 6052        0.0125760000  2.077...e-06
gnus-group-update-group                                                       1           0.010068      0.010068
gnus-group-set-mode-line                                                      2           0.008406      0.004203
gnus-correct-substring                                                        472         0.0069940000  1.481...e-05
gnus-killed-articles                                                          1           0.006212      0.006212
gnus-gather-threads-by-references                                             1           0.006053      0.006053
gnus-score-score-files                                                        1           0.005535      0.005535
gnus-summary-setup-buffer                                                     1           0.004861      0.004861
gnus-message                                                                  10          0.004833      0.0004833
gnus-set-mode-line                                                            1           0.004739      0.004739
gnus-message-with-timestamp                                                   8           0.004723      0.000590375
gnus-dribble-enter                                                            1           0.004296      0.004296
gnus-summary-auto-select-subject                                              1           0.004179      0.004179
gnus-summary-first-unread-subject                                             1           0.004159      0.004159
gnus-compute-unseen-list                                                      1           0.003926      0.003926
gnus-inverse-list-range-intersection                                          1           0.003918      0.003918
gnus-list-range-difference                                                    1           0.003911      0.003911
gnus-summary-first-subject                                                    1           0.003794      0.003794
gnus-summary-mode                                                             1           0.003492      0.003492
gnus-uncompress-range                                                         1           0.002981      0.002981
gnus-parameter-ham-marks                                                      3           0.002419      0.0008063333
gnus-score-load-files                                                         1           0.002067      0.002067
gnus-score-load-file                                                          3           0.002045      0.0006816666
gnus-parameter-spam-marks                                                     3           0.001751      0.0005836666
gnus-summary-set-local-parameters                                             2           0.001719      0.0008595
gnus-score-load-score-alist                                                   1           0.001676      0.001676
gnus-summary-setup-default-charset                                            1           0.001618      0.001618
gnus-topic-update-topic-line                                                  3           0.001539      0.000513
gnus-update-summary-mark-positions                                            1           0.001506      0.001506
gnus-sorted-difference                                                        2           0.001485      0.0007425
gnus-summary-insert-line                                                      2           0.001373      0.0006865
gnus-group-decoded-name                                                       8           0.001289      0.000161125
gnus-last-element                                                             1           0.001068      0.001068
gnus-group-name-decode                                                        10          0.000943      9.43e-05
gnus-topic-update-topics-containing-group                                     1           0.000891      0.000891
gnus-group-auto-expirable-p                                                   1           0.000884      0.000884
gnus-parameters-get-parameter                                                 3           0.000872      0.0002906666
gnus-parameter-charset                                                        1           0.000867      0.000867
gnus-update-format-specifications                                             3           0.0008619999  0.0002873333
gnus-agent-find-parameter                                                     1           0.000814      0.000814
gnus-parameter-large-newsgroup-initial                                        1           0.000803      0.000803
gnus-parameter-ignored-charsets                                               1           0.000722      0.000722
gnus-score-set                                                                186         0.0006399999  3.440...e-06
gnus-parameter-spam-autodetect                                                1           0.00062       0.00062
gnus-continuum-version                                                        6           0.000605      0.0001008333
gnus-parameter-spam-contents                                                  1           0.000569      0.000569
gnus-group-insert-group-line-info                                             1           0.000522      0.000522
gnus-make-sort-function                                                       1           0.000489      0.000489
gnus-run-mode-hooks                                                           2           0.000485      0.0002425
gnus-parameter-spam-autodetect-methods                                        1           0.000485      0.000485
gnus-configure-windows                                                        1           0.000471      0.000471
gnus-summary-buffer-name                                                      3           0.000461      0.0001536666
gnus-byte-compile                                                             1           0.000456      0.000456
gnus-group-insert-group-line                                                  1           0.000449      0.000449
gnus-score-check-syntax                                                       1           0.000392      0.000392
gnus-article-mode                                                             1           0.000356      0.000356
gnus-group-name-charset                                                       10          0.00034       3.4e-05
gnus-sort-gathered-threads                                                    1           0.000274      0.000274
gnus-find-method-for-group                                                    17          0.0002720000  1.600...e-05
gnus-cache-articles-in-group                                                  1           0.000269      0.000269
gnus-apply-kill-file                                                          1           0.000259      0.000259
gnus-set-global-variables                                                     4           0.0002510000  6.275...e-05
gnus-update-read-articles                                                     1           0.000235      0.000235
gnus-get-buffer-create                                                        6           0.0002029999  3.383...e-05
gnus-topic-insert-topic-line                                                  3           0.000198      6.599...e-05
gnus-sort-score-files                                                         1           0.000198      0.000198
gnus-cache-file-name                                                          1           0.000161      0.000161
gnus-update-missing-marks                                                     1           0.00015       0.00015
gnus-newsgroup-kill-file                                                      2           0.000126      6.3e-05
gnus-summary-make-local-variables                                             2           0.0001180000  5.900...e-05
gnus-topic-find-groups                                                        3           0.000109      3.633...e-05
gnus-score-file-name                                                          1           0.000107      0.000107
gnus-configure-frame                                                          2           0.000104      5.2e-05
gnus-buffer-live-p                                                            9           0.0001020000  1.133...e-05
gnus-group-highlight-line                                                     1           9.1e-05       9.1e-05
gnus-request-group                                                            1           9e-05         9e-05
gnus-agent-mode                                                               1           8.8e-05       8.8e-05
gnus-summary-set-display-table                                                1           8.1e-05       8.1e-05
gnus-adjust-marked-articles                                                   1           7.6e-05       7.6e-05
gnus-make-hashtable                                                           3           7.1e-05       2.366...e-05
gnus-expand-group-parameters                                                  12          6.8e-05       5.666...e-06
gnus-prin1-to-string                                                          1           6.7e-05       6.7e-05
gnus-topic-goto-topic                                                         5           6.5e-05       1.3e-05
gnus-remove-from-range                                                        2           6.4e-05       3.2e-05
gnus-group-group-indentation                                                  2           6.3e-05       3.15e-05
gnus-agent-possibly-alter-active                                              2           6.3e-05       3.15e-05
gnus-file-newer-than                                                          1           6.1e-05       6.1e-05
gnus-all-windows-visible-p                                                    1           6e-05         6e-05
gnus-turn-off-edit-menu                                                       2           5.499...e-05  2.749...e-05
gnus-check-server                                                             1           5.4e-05       5.4e-05
gnus-emacs-version                                                            3           5.3e-05       1.766...e-05
gnus-topic-group-indentation                                                  1           5.2e-05       5.2e-05
gnus-thread-sort-by-number                                                    21          5.100...e-05  2.428...e-06
gnus-get-unread-articles-in-group                                             1           5e-05         5e-05
gnus-group-quit-config                                                        2           4.999...e-05  2.499...e-05
gnus-server-opened                                                            1           4.2e-05       4.2e-05
gnus-article-make-menu-bar                                                    1           4.1e-05       4.1e-05
gnus-agent-get-undownloaded-list                                              1           4.1e-05       4.1e-05
gnus-get-buffer-window                                                        1           3.7e-05       3.7e-05
nnmaildir--tab-to-space                                                       12          3.7e-05       3.083...e-06
gnus-copy-sequence                                                            5           3.6e-05       7.200...e-06
gnus-article-mark-to-type                                                     16          3.400...e-05  2.125...e-06
gnus-summary-make-menu-bar                                                    1           3.4e-05       3.4e-05
gnus-short-group-name                                                         1           3.2e-05       3.2e-05
gnus-newsgroup-savable-name                                                   2           3.1e-05       1.55e-05
gnus-ephemeral-group-p                                                        2           3.1e-05       1.55e-05
gnus-make-sort-function-1                                                     3           3e-05         1e-05
gnus-decay-scores                                                             1           3e-05         3e-05
gnus-group-topic-p                                                            1           2.6e-05       2.6e-05
gnus-visual-p                                                                 6           2.499...e-05  4.166...e-06
gnus-virtual-group-p                                                          1           2.4e-05       2.4e-05
gnus-undo-register                                                            1           2.4e-05       2.4e-05
gnus-group-timestamp-delta                                                    1           2.4e-05       2.4e-05
nnmaildir-request-group                                                       1           2.4e-05       2.4e-05
gnus-group-topic-unread                                                       8           2.2e-05       2.75e-06
gnus-mode-string-quote                                                        1           2.2e-05       2.2e-05
gnus-set-work-buffer                                                          1           2.1e-05       2.1e-05
gnus-simplify-mode-line                                                       2           2e-05         1e-05
nnmaildir--prepare                                                            2           1.999...e-05  9.999...e-06
gnus-get-function                                                             1           1.7e-05       1.7e-05
gnus-online                                                                   4           1.7e-05       4.25e-06
gnus-create-hash-size                                                         3           1.499...e-05  4.999...e-06
gnus-group-topic-name                                                         1           1.4e-05       1.4e-05
gnus-undo-register-1                                                          1           1.4e-05       1.4e-05
gnus-score-file-regexp                                                        2           1.1e-05       5.5e-06
gnus-group-group-name                                                         2           1.1e-05       5.5e-06
gnus-use-long-file-name                                                       4           1.1e-05       2.75e-06
gnus-agent-method-p                                                           4           1.1e-05       2.75e-06
gnus-list-of-unread-articles                                                  1           1e-05         1e-05
gnus-group-topic-level                                                        4           9.999...e-06  2.499...e-06
gnus-topic-update-unreads                                                     3           9.999...e-06  3.333...e-06
gnus-range-length                                                             3           9.999...e-06  3.333...e-06
gnus-undo-boundary                                                            2           9e-06         4.5e-06
gnus-server-add-address                                                       1           8e-06         8e-06
gnus-summary-make-tool-bar                                                    1           8e-06         8e-06
gnus-server-to-method                                                         2           8e-06         4e-06
gnus-cache-decoded-group-name                                                 1           8e-06         8e-06
gnus-set-default-directory                                                    2           8e-06         4e-06
gnus-frames-on-display-list                                                   1           7e-06         7e-06
gnus-score-find-alist                                                         1           7e-06         7e-06
gnus-home-score-file                                                          2           7e-06         3.5e-06
gnus-topic-visible-p                                                          3           6.999...e-06  2.333...e-06
gnus-sorted-ndifference                                                       2           6e-06         3e-06
gnus-sorted-nintersection                                                     1           6e-06         6e-06
gnus-group-category                                                           1           5e-06         5e-06
gnus-server-status                                                            1           5e-06         5e-06
nnmaildir-server-opened                                                       1           5e-06         5e-06
gnus-window-to-buffer-helper                                                  2           4e-06         2e-06
gnus-windows-old-to-new                                                       1           4e-06         4e-06
gnus-remove-if                                                                1           4e-06         4e-06
gnus-make-local-hook                                                          1           3e-06         3e-06
gnus-make-thread-indent-array                                                 1           3e-06         3e-06
gnus-agent-summary-make-menu-bar                                              1           2e-06         2e-06
gnus-extent-start-open                                                        1           2e-06         2e-06
gnus-group-remove-excess-properties                                           1           2e-06         2e-06

[-- Attachment #5: Type: text/plain, Size: 14 bytes --]


Bye,
Tassilo

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Slowdowns with big nnmaildir groups
  2008-02-01 12:35     ` Daniel Pittman
@ 2008-02-01 13:57       ` Tassilo Horn
  2008-02-01 18:25         ` David
  2008-02-01 23:42         ` Daniel Pittman
  0 siblings, 2 replies; 14+ messages in thread
From: Tassilo Horn @ 2008-02-01 13:57 UTC (permalink / raw)
  To: ding

Daniel Pittman <daniel@rimspace.net> writes:

Hi Daniel,

> You probably want to instrument nnmaildir, or possibly nn, as well as
> gnus.

I did that (with nnmaildir) and the results are in
<87abmk3k1f.fsf@member.fsf.org>.

> IIRC the nnmaildir code tries to play nice with other Maildir clients,
> which means reading all the (giant) filenames from disk, which
> probably works the poor kernel quite hard, especially with such a
> large directory.

Indeed, the filenames are quite big, like:

  1201848492_1.4393.baldur,U=10600,FMD5=72a62f382d4bdeb4a771c2d3ea493c5d:2,:2,

> Ensuring your Maildir is on a filesystem that handles large
> directories well is probably the best bet for improving performance.

Hm, it's on a ext3 filesystem.  Maybe I can improve speed with the
dir_index option...

OfflineIMAP has the possibility to sync an IMAP group to a mbox instead
of a maildir, but I guess that wouldn't improve the situation.
Currently the emacs-devel folder is about 140M big, which would exceed
the buffer size limit on my 30Bit machine.

Bye,
Tassilo



^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Slowdowns with big nnmaildir groups
  2008-02-01 13:57       ` Tassilo Horn
@ 2008-02-01 18:25         ` David
  2008-02-01 18:48           ` Tassilo Horn
  2008-02-01 23:42         ` Daniel Pittman
  1 sibling, 1 reply; 14+ messages in thread
From: David @ 2008-02-01 18:25 UTC (permalink / raw)
  To: ding

Tassilo Horn <tassilo@member.fsf.org> writes:
>> Ensuring your Maildir is on a filesystem that handles large
>> directories well is probably the best bet for improving performance.
>
> Hm, it's on a ext3 filesystem.  Maybe I can improve speed with the
> dir_index option...

You should definitely enable directory indexing.

> OfflineIMAP has the possibility to sync an IMAP group to a mbox instead
> of a maildir, but I guess that wouldn't improve the situation.

Surely not. :-)

> Currently the emacs-devel folder is about 140M big, which would exceed
> the buffer size limit on my 30Bit machine.

I can't really help you with your nnmaildir problems, but maybe it would
be faster if you'd access your maildir folders through a local IMAP
server and nnimap? (I'd recommend Dovecot since it is pretty fast and
easy to set up.)

-David




^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Slowdowns with big nnmaildir groups
  2008-02-01 18:25         ` David
@ 2008-02-01 18:48           ` Tassilo Horn
  2008-02-01 23:43             ` Daniel Pittman
  0 siblings, 1 reply; 14+ messages in thread
From: Tassilo Horn @ 2008-02-01 18:48 UTC (permalink / raw)
  To: ding

David <de_bb@arcor.de> writes:

Hi David,

> I can't really help you with your nnmaildir problems, but maybe it
> would be faster if you'd access your maildir folders through a local
> IMAP server and nnimap? (I'd recommend Dovecot since it is pretty fast
> and easy to set up.)

Till now I didn't try that because I didn't want to add more complexity
to my configuration than needed.  But now I think I'll look into that.

But how do you synchronize your IMAP account with the local dovecot?
I've searched the documentation wiki, but didn't get helpful results.

Bye,
Tassilo



^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Slowdowns with big nnmaildir groups
  2008-02-01  8:35 Slowdowns with big nnmaildir groups Tassilo Horn
  2008-02-01 11:22 ` David
@ 2008-02-01 21:00 ` Ted Zlatanov
  2008-02-01 22:28   ` Tassilo Horn
  1 sibling, 1 reply; 14+ messages in thread
From: Ted Zlatanov @ 2008-02-01 21:00 UTC (permalink / raw)
  To: ding

On Fri, 01 Feb 2008 09:35:00 +0100 Tassilo Horn <tassilo@member.fsf.org> wrote: 

TH> I recently switched from nnimap to OfflineIMAP [1] and nnmaildir, mainly
TH> to increase the speed for fetching mail and entering groups.

TH> One of my nnmaildir groups holds the emacs-devel list[...]

A little unrelated, but I use GMane for this and about 30 other mailing
lists.  It's much, much easier than managing subscriptions, daemons, and
disk space.

Ted



^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Slowdowns with big nnmaildir groups
  2008-02-01 21:00 ` Ted Zlatanov
@ 2008-02-01 22:28   ` Tassilo Horn
  0 siblings, 0 replies; 14+ messages in thread
From: Tassilo Horn @ 2008-02-01 22:28 UTC (permalink / raw)
  To: ding

Ted Zlatanov <tzz@lifelogs.com> writes:

He Ted,

> TH> One of my nnmaildir groups holds the emacs-devel list[...]
>
> A little unrelated, but I use GMane for this and about 30 other
> mailing lists.  It's much, much easier than managing subscriptions,
> daemons, and disk space.

Yeah, I use gmane for most lists, too.  But sometimes I experienced some
annoying delay when using gmane, so I subscribed to my top-priority
lists.

Bye,
Tassilo



^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Slowdowns with big nnmaildir groups
  2008-02-01 13:57       ` Tassilo Horn
  2008-02-01 18:25         ` David
@ 2008-02-01 23:42         ` Daniel Pittman
  2008-02-02  0:33           ` Tassilo Horn
  1 sibling, 1 reply; 14+ messages in thread
From: Daniel Pittman @ 2008-02-01 23:42 UTC (permalink / raw)
  To: ding

Tassilo Horn <tassilo@member.fsf.org> writes:
> Daniel Pittman <daniel@rimspace.net> writes:
>
>> You probably want to instrument nnmaildir, or possibly nn, as well as
>> gnus.
>
> I did that (with nnmaildir) and the results are in
> <87abmk3k1f.fsf@member.fsf.org>.
>
>> IIRC the nnmaildir code tries to play nice with other Maildir clients,
>> which means reading all the (giant) filenames from disk, which
>> probably works the poor kernel quite hard, especially with such a
>> large directory.
>
> Indeed, the filenames are quite big, like:
>
>   1201848492_1.4393.baldur,U=10600,FMD5=72a62f382d4bdeb4a771c2d3ea493c5d:2,:2,
>
>> Ensuring your Maildir is on a filesystem that handles large
>> directories well is probably the best bet for improving performance.
>
> Hm, it's on a ext3 filesystem.  Maybe I can improve speed with the
> dir_index option...

It certainly won't hurt.  Renewing the directory on a semi-regular
basis, by creating a new one, moving all content to it, then replacing
the original, will also help.

> OfflineIMAP has the possibility to sync an IMAP group to a mbox
> instead of a maildir, but I guess that wouldn't improve the situation.
> Currently the emacs-devel folder is about 140M big, which would exceed
> the buffer size limit on my 30Bit machine.

Yes, it wouldn't do much good if it was bigger than your Emacs can read.

For performance I would suggest one of two paths:

1. Use OfflineIMAP to sync IMAP to IMAP, and run a local IMAP server.
   This doesn't fix any performance problem with nnimap proper, but does
   insulate you from the performance hit of Maildir.
   (I recommend Dovecot for this purpose, if you must.)

2. Write an nnml (better) or nnmh (easier) back-end for OfflineIMAP,
   contribute it upstream, and use that.  nnml with NOV support would be
   the best option, but there may be significant complexity in getting
   this to work coupled with renaming and moving messages between
   folders.

It looks like their code is reasonably well structured and the basics of
adding a new back-end will be easy.

I don't think you will find the improvements you are looking for with
the nnmaildir back-end, though I can't say that with absolute certainty.

Regards,
        Daniel
-- 
Daniel Pittman <daniel@cybersource.com.au>           Phone: 03 9428 6922
1/130-132 Stawell St, Richmond              Web: http://www.cyber.com.au
Cybersource: Australia's Leading Linux and Open Source Solutions Company




^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Slowdowns with big nnmaildir groups
  2008-02-01 18:48           ` Tassilo Horn
@ 2008-02-01 23:43             ` Daniel Pittman
  0 siblings, 0 replies; 14+ messages in thread
From: Daniel Pittman @ 2008-02-01 23:43 UTC (permalink / raw)
  To: ding

Tassilo Horn <tassilo@member.fsf.org> writes:
> David <de_bb@arcor.de> writes:
>
> Hi David,
>
>> I can't really help you with your nnmaildir problems, but maybe it
>> would be faster if you'd access your maildir folders through a local
>> IMAP server and nnimap? (I'd recommend Dovecot since it is pretty fast
>> and easy to set up.)
>
> Till now I didn't try that because I didn't want to add more complexity
> to my configuration than needed.  But now I think I'll look into that.
>
> But how do you synchronize your IMAP account with the local dovecot?

OfflineIMAP?

Regards,
        Daniel
-- 
Daniel Pittman <daniel@cybersource.com.au>           Phone: 03 9428 6922
1/130-132 Stawell St, Richmond              Web: http://www.cyber.com.au
Cybersource: Australia's Leading Linux and Open Source Solutions Company




^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Slowdowns with big nnmaildir groups
  2008-02-01 23:42         ` Daniel Pittman
@ 2008-02-02  0:33           ` Tassilo Horn
  0 siblings, 0 replies; 14+ messages in thread
From: Tassilo Horn @ 2008-02-02  0:33 UTC (permalink / raw)
  To: ding

Daniel Pittman <daniel@rimspace.net> writes:

Hi Daniel,

> For performance I would suggest one of two paths:
>
> 1. Use OfflineIMAP to sync IMAP to IMAP, and run a local IMAP server.
>    This doesn't fix any performance problem with nnimap proper, but does
>    insulate you from the performance hit of Maildir.
>    (I recommend Dovecot for this purpose, if you must.)

Now I run a local dovecot server and sync it with OfflineIMAP.  It seems
to work well and preformance is brilliant.  So thanks for the tip. :-)

Bye,
Tassilo



^ permalink raw reply	[flat|nested] 14+ messages in thread

end of thread, other threads:[~2008-02-02  0:33 UTC | newest]

Thread overview: 14+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2008-02-01  8:35 Slowdowns with big nnmaildir groups Tassilo Horn
2008-02-01 11:22 ` David
2008-02-01 12:02   ` Tassilo Horn
2008-02-01 12:29     ` David
2008-02-01 13:04       ` Tassilo Horn
2008-02-01 12:35     ` Daniel Pittman
2008-02-01 13:57       ` Tassilo Horn
2008-02-01 18:25         ` David
2008-02-01 18:48           ` Tassilo Horn
2008-02-01 23:43             ` Daniel Pittman
2008-02-01 23:42         ` Daniel Pittman
2008-02-02  0:33           ` Tassilo Horn
2008-02-01 21:00 ` Ted Zlatanov
2008-02-01 22:28   ` Tassilo Horn

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).