From mboxrd@z Thu Jan  1 00:00:00 1970
X-Msuck: nntp://news.gmane.io/gmane.emacs.gnus.general/43095
Path: main.gmane.org!not-for-mail
From: Hrvoje Niksic <hniksic@arsdigita.com>
Newsgroups: gmane.emacs.gnus.general
Subject: Using `links' to process HTML
Date: Thu, 14 Feb 2002 08:08:53 +0100
Sender: owner-ding@hpc.uh.edu
Message-ID: <sxsu1skr14q.fsf@florida.arsdigita.de>
NNTP-Posting-Host: coloc-standby.netfonds.no
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
X-Trace: main.gmane.org 1035178245 15737 80.91.224.250 (21 Oct 2002 05:30:45 GMT)
X-Complaints-To: usenet@main.gmane.org
NNTP-Posting-Date: Mon, 21 Oct 2002 05:30:45 +0000 (UTC)
Return-Path: <owner-ding@hpc.uh.edu>
Original-Received: (qmail 14376 invoked from network); 14 Feb 2002 07:10:06 -0000
Original-Received: from malifon.math.uh.edu (mail@129.7.128.13)
  by mastaler.com with SMTP; 14 Feb 2002 07:10:06 -0000
Original-Received: from sina.hpc.uh.edu ([129.7.128.10] ident=lists)
	by malifon.math.uh.edu with esmtp (Exim 3.20 #1)
	id 16bG1G-0005zY-00; Thu, 14 Feb 2002 01:09:26 -0600
Original-Received: by sina.hpc.uh.edu (TLB v0.09a (1.20 tibbs 1996/10/09 22:03:07)); Thu, 14 Feb 2002 01:09:24 -0600 (CST)
Original-Received: from sclp3.sclp.com (qmailr@sclp3.sclp.com [209.196.61.66])
	by sina.hpc.uh.edu (8.9.3/8.9.3) with SMTP id BAA11648
	for <ding@hpc.uh.edu>; Thu, 14 Feb 2002 01:09:13 -0600 (CST)
Original-Received: (qmail 14367 invoked by alias); 14 Feb 2002 07:09:08 -0000
Original-Received: (qmail 14362 invoked from network); 14 Feb 2002 07:09:08 -0000
Original-Received: from dragon.arsdigita.de (HELO florida.arsdigita.de) (@212.84.246.66)
  by gnus.org with SMTP; 14 Feb 2002 07:09:08 -0000
Original-Received: from hniksic by florida.arsdigita.de with local (Exim 3.34 #1 (Debian))
	id 16bG0j-00051Q-00
	for <ding@gnus.org>; Thu, 14 Feb 2002 08:08:53 +0100
Original-To: ding@gnus.org
X-Attribution: Hrvoje
X-Face: &{dT~)Pu6V<0y?>3p$;@vh\`C7xB~A0T-J%Og)J,@-1%q6Q+,
        gs<-9M#&`I8cJp2b1{vPE|~+JE+gx;a7%BG{}nY^ehK1"q#rG
        O,Rn1A_Cy%t]V=Brv7h<L@)<XGh#XroV6xQg$VA8K
Original-Lines: 52
User-Agent: Gnus/5.090006 (Oort Gnus v0.06) XEmacs/21.4 (Copyleft,
 i686-pc-linux)
Precedence: list
X-Majordomo: 1.94.jlt7
Xref: main.gmane.org gmane.emacs.gnus.general:43095
X-Report-Spam: http://spam.gmane.org/gmane.emacs.gnus.general:43095

[ Note: I'm not on the list.  If you want me to see your replies, add Cc. ]

I've been using this for some time now and want to share it with
others.  It hooks into the processing of "text/html" and renders it by
noninteractively calling the textual browser `links'.  Although this
doesn't support images, colors, forms and whatnot, those are the
things I turn off anyway.  It does support tables, however.

Overall it does a much better job of rendering HTML than w3 does.  My
spams finally come out right before I ignore them.

Here is what I put in `.gnus'.  It relies on the program `links' being
somewhere on the PATH.  If you try it, please let me know if it works
for you.

(eval-after-load "mm-decode"
  '(push '("text/html"
	   my-html-handler
	   (lambda (handle) t))
	 mm-inline-media-tests))

;; If you're not running under XEmacs...
(unless (fboundp 'temp-directory)
  (defun temp-directory ()
    (or (getenv "TMPDIR") "/tmp")))

(defun my-html-handler (handle)
  (let ((source (mm-get-part handle))
	(tmpfile (make-temp-name (expand-file-name
				  "www" (temp-directory))))
	text)
    (with-temp-buffer
      (insert source)
      (write-region (point-min) (point-max) tmpfile nil 'silent)
      (delete-region (point-min) (point-max))
      (unwind-protect
	  ;; It would be nice if we could use `call-process-region' to
	  ;; feed the HTML to links's stdin thus avoiding the tmpfile.
	  ;; But `links -dump /dev/stdin' doesn't work when stdin is a
	  ;; pipe.
	  (call-process "links" nil t nil "-dump" tmpfile)
	(delete-file tmpfile))

      ;; Delete the annoying three spaces preceding each line of links
      ;; output.
      (goto-char (point-min))
      (while (re-search-forward "^   " nil t)
	(delete-region (match-beginning 0) (match-end 0)))

      (setq text (buffer-string)))

    (mm-insert-inline handle text)))