[Howm-eng 167] Slow searches

[Howm-eng 167] Slow searches

[yacinechaouche]

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain, Size: 2148 bytes --]

Dear howm users,
I wanted to take the opportunity of the recent Kenneth Wyatt's post on the mailing list to bring the subject of howm searches (C-c , g). 
In the beginning, the searches were pretty fast, but as time went by, I was getting more and more impatient to get the results. It's not very slow, but slow enough to discourage me from using howm as a note taking tool anymore.
First, let me show you the howm-search-path and the size of each directory in that path (du -sh output) :

ychaouche#ychaouche-PC 12:36:54 ~ $ grep howm .emacs.d/init.el
[...]
;; search other directories in addition to `howm-directory'.
(setq howm-search-path '("~/NOTES/LOG/" "~/DATA/WIKIPAGES/" "~/.kde/share/apps/konversation/logs/" "~/.xchat2/xchatlogs/" "~/NOTES/TXT/" "~/DATA/BACKUPS/NEWWIKI/data/pages"))
[...]ychaouche#ychaouche-PC 12:37:45 ~ $ du -sh ~/NOTES/LOG/ ~/DATA/WIKIPAGES/ ~/.kde/share/apps/konversation/logs/ ~/.xchat2/xchatlogs/ ~/NOTES/TXT/ ~/DATA/BACKUPS/NEWWIKI/data/pages
3.8M    /home/ychaouche/NOTES/LOG/
2.3M    /home/ychaouche/DATA/WIKIPAGES/
33M     /home/ychaouche/.kde/share/apps/konversation/logs/
9.4M    /home/ychaouche/.xchat2/xchatlogs/
1.6M    /home/ychaouche/NOTES/TXT/
1.1M    /home/ychaouche/DATA/BACKUPS/NEWWIKI/data/pages
ychaouche#ychaouche-PC 12:37:50 ~ $


Approximately 50 Megs of text to search, plus the howm directroy itself which is less than 5 megs

ychaouche#ychaouche-PC 12:39:49 ~/howm $ dush
8.0K    ./2020
296K    ./2019
1.7M    ./2018
2.2M    ./2017
4.1M    .
ychaouche#ychaouche-PC 12:39:50 ~/howm $
So 55 Megs in all.


For example, a search on "dnssec" has taken approximatively 27 seconds (this was measured very poorly with eyesight on the desktop clock, from 12:42:09 PM to 12:41:36 PM). This is a little bit discouraging.
My questions : 
1/ Is this expected ? 
2/ If the search is time proportionnal to the size of the data that howm is parsing, can I do anything to help it ? 


Yassine.


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.osdn.me/mailman/archives/howm-eng/attachments/20200913/176be1c5/attachment.html>

[Howm-eng 169] Re: Slow searches

[khi]

Hi, Yassine san.

74MB within 1 sec in my case (except for the first run).

Though I've not read your post carefully yet,
I'd like to confirm this first of all:
Have you tried (setq howm-view-use-grep t) ?
It is almost necessary for serious use.

You can find it at the bottom of
M-x customize-group RET howm-efficiency RET .
See also M-x customize-group RET howm-efficiency RET
for further customization.

(I'm afraid their descriptions are too unkind. Do they make sense?)

-- 
khi at users.osdn.me

[Howm-eng 170] Re: Slow searches

[yacinechaouche]

 Dear Kazuyuki San,
Thank you for your answere. I have added  (setq howm-view-use-grep t) to my emacs init file (it wasn't there), but reading your mail I realize that first search is longer, then other subsequent searches are faster. On my case, subsequent searches took approximately 5 seconds, which is way faster !
Thank you for looking into my problem. Props :)

Yassine.

    On Sunday, September 13, 2020, 1:31:15 PM GMT+1, khi at users.sourceforge.jp <khi at users.sourceforge.jp> wrote:  
 
 Hi, Yassine san.

74MB within 1 sec in my case (except for the first run).

Though I've not read your post carefully yet,
I'd like to confirm this first of all:
Have you tried (setq howm-view-use-grep t) ?
It is almost necessary for serious use.

You can find it at the bottom of
M-x customize-group RET howm-efficiency RET .
See also M-x customize-group RET howm-efficiency RET
for further customization.

(I'm afraid their descriptions are too unkind. Do they make sense?)

-- 
khi at users.osdn.me

_______________________________________________
Howm-eng mailing list
Howm-eng at lists.osdn.me
https://lists.osdn.me/mailman/listinfo/howm-eng
  
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.osdn.me/mailman/archives/howm-eng/attachments/20200914/f1eaad3a/attachment.html>

[Howm-eng 171] Re: Slow searches

[khi]

If grep is still slow, I found some articles on howm + ripgrep
for faster search (in Japanese). But I've not tried it by myself.

http://www.google.com/search?q="howm"+"ripgrep"

-- 
khi at users.osdn.me

[Howm-eng 172] Re: Slow searches

[yacinechaouche]

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain, Size: 1236 bytes --]

 Thank you so much ! I thought maybe other people searching this mailing list archive would find this snippet useful : 
(setq howm-view-use-grep t)
(setq howm-view-grep-command "rg")
(setq howm-view-grep-option "-nH --no-heading --color never")
(setq howm-view-grep-extended-option nil)
(setq howm-view-grep-fixed-option "-F")
(setq howm-view-grep-expr-option nil)
(setq howm-view-grep-file-stdin-option nil)From reddit

| 
| 
| 
|  |  |

 |

 |
| 
|  | 
r/emacs - Comment by u/jamcha-aa on ”Any howm user here ?”

9 votes and 5 comments so far on Reddit
 |

 |

 |


Yassine.




    On Monday, September 14, 2020, 1:29:06 PM GMT+1, khi at users.sourceforge.jp <khi at users.sourceforge.jp> wrote:  
 
 If grep is still slow, I found some articles on howm + ripgrep
for faster search (in Japanese). But I've not tried it by myself.

http://www.google.com/search?q="howm"+"ripgrep"

-- 
khi at users.osdn.me

_______________________________________________
Howm-eng mailing list
Howm-eng at lists.osdn.me
https://lists.osdn.me/mailman/listinfo/howm-eng
  
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.osdn.me/mailman/archives/howm-eng/attachments/20200915/ad773189/attachment.html>