From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/87551 Path: news.gmane.org!.POSTED!not-for-mail From: Harry Putnam Newsgroups: gmane.emacs.gnus.general Subject: Re: any partial or rudamentary documentation of new nnselect work somewhere? Date: Thu, 11 May 2017 09:07:51 -0400 Organization: Still searching... Message-ID: <86o9uzwnh4.fsf@local.lan> References: <86r301wqx2.fsf@local.lan> <87y3u9bk86.fsf@hanan> <867f1oxwsb.fsf@local.lan> <87fugcz2fu.fsf@hanan> NNTP-Posting-Host: blaine.gmane.org Mime-Version: 1.0 Content-Type: text/plain X-Trace: blaine.gmane.org 1494508163 18391 195.159.176.226 (11 May 2017 13:09:23 GMT) X-Complaints-To: usenet@blaine.gmane.org NNTP-Posting-Date: Thu, 11 May 2017 13:09:23 +0000 (UTC) User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.0.50 (gnu/linux) To: ding@gnus.org Original-X-From: ding-owner+m35766@lists.math.uh.edu Thu May 11 15:09:16 2017 Return-path: Envelope-to: ding-account@gmane.org Original-Received: from mxfilter-048034.atla03.us.yomura.com ([107.189.48.34]) by blaine.gmane.org with esmtp (Exim 4.84_2) (envelope-from ) id 1d8nqF-0004Yv-Gm for ding-account@gmane.org; Thu, 11 May 2017 15:09:15 +0200 X-Yomura-MXScrub: 1.0 Original-Received: from lists1.math.uh.edu (unknown [129.7.128.208]) by mxfilter-048034.atla03.us.yomura.com (Halon) with ESMTPS id 09c67bc9-364b-11e7-8ed1-b499baa2b07a; Thu, 11 May 2017 13:09:18 +0000 (UTC) Original-Received: from localhost ([127.0.0.1] helo=lists.math.uh.edu) by lists1.math.uh.edu with smtp (Exim 4.87) (envelope-from ) id 1d8npV-00010H-TB; Thu, 11 May 2017 08:08:30 -0500 Original-Received: from mx2.math.uh.edu ([129.7.128.33]) by lists1.math.uh.edu with esmtps (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.87) (envelope-from ) id 1d8npR-0000zb-SV for ding@lists.math.uh.edu; Thu, 11 May 2017 08:08:25 -0500 Original-Received: from quimby.gnus.org ([80.91.231.51]) by mx2.math.uh.edu with esmtps (TLSv1.2:DHE-RSA-AES128-SHA:128) (Exim 4.87) (envelope-from ) id 1d8npD-0001ZV-4y for ding@lists.math.uh.edu; Thu, 11 May 2017 08:08:25 -0500 Original-Received: from [195.159.176.226] (helo=blaine.gmane.org) by quimby.gnus.org with esmtps (TLS1.2:RSA_AES_128_CBC_SHA1:128) (Exim 4.80) (envelope-from ) id 1d8npB-00066E-OD for ding@gnus.org; Thu, 11 May 2017 15:08:09 +0200 Original-Received: from list by blaine.gmane.org with local (Exim 4.84_2) (envelope-from ) id 1d8np1-00030w-Jp for ding@gnus.org; Thu, 11 May 2017 15:07:59 +0200 X-Injected-Via-Gmane: http://gmane.org/ Original-Lines: 52 Original-X-Complaints-To: usenet@blaine.gmane.org Cancel-Lock: sha1:nAhXM1DVAfX7kJGP6GjPd2qCt3M= List-ID: Precedence: bulk Xref: news.gmane.org gmane.emacs.gnus.general:87551 Archived-At: Andrew Cohen writes: [...] > Sorry, I hadn't realized that you weren't using search previously. First > there are two "kinds" of searching---in a summary buffer you can search > (in a variety of ways, including the regex search you were trying); or > you can query servers to find articles matching certain search terms. In > this thread we are only talking about the latter search facility. It is > usually referred to as "nnir" searching. It is documented in the gnus > manual under "Searching" (go to info, select gnus, and select the > searching node). This should give you the information you need to start > searching (you might have to do some configuration depending on what > backends you are using). [...] Sorry, I should have explained the massive holes in my knowledge of gnus. Some yrs ago now, I wrote my own search engine in perl... I mean just a perl script that searched for regex thru thousands of gmane messages that I had downloaded with the agent. So much downloading that I was kicked off gmane a few times... probably looked like something sinister. I could search on exact code in perl groups for example ... and return exact bits of code with careful use of perl regex. Later on I added more (perl) code that created a directory and filled it with symlinks to the actual messages where my regex found hits. I could then pull that directory into gnus as an ephemeral group or nndoc inside gnus. All very clunky and probably duplicating functionality already in gnus but in a primitive and homeboy way. Also very slow. Hardcore regex searching of that many messages is rather slow. And I'm not a good enough perl coder to know how to speed it up. The only upside is that it is very exact. At the high point I had used the agent to collect well over 200,000 messages ... no longer remember how many, but the slowness of searches eventually led me to fade out on all that search activity. Not to mention that I quit getting barred on gmane too. So haven't really worked at it for several years. And never really learned the gnus capabilities in nnir, namzu, swish, and etc. All the new efforts are pretty exciting and has gotten me interested once again. Many thanks for the nice summaries and big picture guidance.