From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/61930 Path: news.gmane.org!not-for-mail From: Olly Betts Newsgroups: gmane.emacs.gnus.general Subject: Re: nnweb + Gmane search Date: Thu, 9 Feb 2006 10:41:54 +0000 (UTC) Message-ID: References: <877j9lob4v.fsf@gate450.dyndns.org> <87hd8pmtjf.fsf@gate450.dyndns.org> <87u0bqf4pn.fsf@gate450.dyndns.org> <87acdduewd.fsf@gate450.dyndns.org> <87vevqcs10.fsf_-_@gate450.dyndns.org> <871wyd9m04.fsf@gate450.dyndns.org> NNTP-Posting-Host: main.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Trace: sea.gmane.org 1139481872 25400 80.91.229.2 (9 Feb 2006 10:44:32 GMT) X-Complaints-To: usenet@sea.gmane.org NNTP-Posting-Date: Thu, 9 Feb 2006 10:44:32 +0000 (UTC) Original-X-From: ding-owner+m10457@lists.math.uh.edu Thu Feb 09 11:44:30 2006 Return-path: Envelope-to: ding-account@gmane.org Original-Received: from malifon.math.uh.edu ([129.7.128.13]) by ciao.gmane.org with esmtp (Exim 4.43) id 1F79Hg-0004R5-4U for ding-account@gmane.org; Thu, 09 Feb 2006 11:44:20 +0100 Original-Received: from localhost ([127.0.0.1] helo=lists.math.uh.edu ident=lists) by malifon.math.uh.edu with smtp (Exim 3.20 #1) id 1F79Hb-0004Rk-00; Thu, 09 Feb 2006 04:44:15 -0600 Original-Received: from nas02.math.uh.edu ([129.7.128.40]) by malifon.math.uh.edu with esmtp (Exim 3.20 #1) id 1F79G5-0004Re-00 for ding@lists.math.uh.edu; Thu, 09 Feb 2006 04:42:41 -0600 Original-Received: from quimby.gnus.org ([80.91.224.244]) by nas02.math.uh.edu with esmtp (Exim 4.52) id 1F79Fy-0002Nh-OI for ding@lists.math.uh.edu; Thu, 09 Feb 2006 04:42:38 -0600 Original-Received: from main.gmane.org ([80.91.229.2] helo=ciao.gmane.org) by quimby.gnus.org with esmtp (Exim 3.35 #1 (Debian)) id 1F79Fx-0002gx-00 for ; Thu, 09 Feb 2006 11:42:33 +0100 Original-Received: from list by ciao.gmane.org with local (Exim 4.43) id 1F79Fq-00043L-2y for ding@gnus.org; Thu, 09 Feb 2006 11:42:26 +0100 Original-Received: from host-84-9-199-206.bulldogdsl.com ([84.9.199.206]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Thu, 09 Feb 2006 11:42:26 +0100 Original-Received: from olly by host-84-9-199-206.bulldogdsl.com with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Thu, 09 Feb 2006 11:42:26 +0100 X-Injected-Via-Gmane: http://gmane.org/ Original-To: ding@gnus.org Original-Lines: 50 Original-X-Complaints-To: usenet@sea.gmane.org X-Gmane-NNTP-Posting-Host: main.gmane.org User-Agent: Loom/3.14 (http://gmane.org/) X-Loom-IP: 84.9.199.206 (Mozilla/5.0 (X11; U; Linux x86_64; en-GB; rv:1.7.12) Gecko/20051010 Firefox/1.0.4 (Ubuntu package 1.0.7)) X-Spam-Score: -2.6 (--) Precedence: bulk Original-Sender: ding-owner@lists.math.uh.edu Xref: news.gmane.org gmane.emacs.gnus.general:61930 Archived-At: Andreas Seltenreich writes: > Great, would it be okay to just set HITSPERPAGE to nnweb-max-hits and > doing a single request per search? One could also decrease the default > upper bound of 999 articles, but if this really is an issue, it would > be better to hardcode a limit for the Gmane part of nnweb, since > nnweb-max-hits is a user-customizable variable. I've just tried fetching 1000 matches, and it typically takes several seconds (note that the "search time" is printed before the records are read so it under-reports in this case). If this proves to be a problem I can easily impose a lower limit on the server though. > It wouldn't have to be complete, just enough to present the hits to > the user plus something in the xref header one can construct links to > the raw articles from. Currently, nnweb parses the html output and > generates nov-lines like the following: Anything you can produce from the HTML output I can produce on the server of course. > > Other output formats aren't hard to add, but require me to update > > two places if anything changes so are a bit more work to support. So > > I'd prefer something more generic than S-exps. > > Now, does "more generic than S-exps" apply to nov-lines ? I think so. NOV is really just tab-separated fields. dd Just don't be tempted to work around by running more searches to fetch 999 if I do... How does this first attempt look: http://search.gmane.org/cgi-bin/omega.cgi?FMT=nov&query=gnus+nnweb The first line is either an error, or: OK Beware the extra blank line at the end (which is hard to avoid right now). And note that encrypted addresses will be missing the "@public.gmane.org" (because that's how they're stored internally to save space). Beware the URL and format may not be stable, so don't build it into anything just yet. Cheers, Olly