apply TeX-to-char-paragraph-or-region to an article

apply TeX-to-char-paragraph-or-region to an article

[Uwe Brauer]

Hello

In GNU Emacs and Xemacs it is possible to set the input
method to TeX, that is: 
when typing \int ∫
appears.

Now in Xemacs there exists a function, written by Aidan
Kohoe, which replaces in a region or paragraph already
written TeX constructs by its symbols (the inverse function
exists as well.)

I use this function very often when I write email with math
but I would find it extremely helpful to apply the function
also to emails which I received by others (article)

For example the function gnus-article-fill-cited-article runs
on an article. How could I write a function based on 
TeX-to-char-paragraph-or-region
which does what I want.

Thanks


Uwe Brauer 

Re: apply TeX-to-char-paragraph-or-region to an article

[Lars Magne Ingebrigtsen]

Uwe Brauer <oub@mat.ucm.es> writes:

> For example the function gnus-article-fill-cited-article runs on an
> article. How could I write a function based on
> TeX-to-char-paragraph-or-region which does what I want.

Start with a simpler function, like

(defun article-treat-ansi-sequences ()
  "Translate ANSI SGR control sequences into overlays or extents."
  (interactive)
  (save-excursion
    (when (article-goto-body)
      (let ((inhibit-read-only t))
	(ansi-color-apply-on-region (point) (point-max))))))

And just replace the ansi stuff with the function you want to call.

-- 
(domestic pets only, the antidote for overdose, milk.)
  bloggy blog http://lars.ingebrigtsen.no/

Re: apply TeX-to-char-paragraph-or-region to an article

[Uwe Brauer]

[-- Attachment #1: Type: text/plain, Size: 2376 bytes --]

>> On Thu, 22 Mar 2012 20:58:17 +0100, Lars Magne Ingebrigtsen <larsi@gnus.org> wrote:

   > Uwe Brauer <oub@mat.ucm.es> writes:
   >> For example the function gnus-article-fill-cited-article runs on an
   >> article. How could I write a function based on
   >> TeX-to-char-paragraph-or-region which does what I want.

   > Start with a simpler function, like

   > (defun article-treat-ansi-sequences ()
   >   "Translate ANSI SGR control sequences into overlays or extents."
   >   (interactive)
   >   (save-excursion
   >     (when (article-goto-body)
   >       (let ((inhibit-read-only t))
   > 	(ansi-color-apply-on-region (point) (point-max))))))

   > And just replace the ansi stuff with the function you want to call.
Cool! 

That works nicely for the
TeX-to-char-paragraph-or-region function.

However for the org-preview function it does not!
Here is the code 

(defun article-treat-org-preview ()
  "Translate ANSI SGR control sequences into overlays or extents."
  (interactive)
  (save-excursion
    (when (article-goto-body)
      (let ((inhibit-read-only t))
		(org-preview-latex-fragment nil)))))

And the documentation of org-preview-latex-fragment 

,----
| `org-preview-latex-fragment' is an interactive Lisp function
|   -- loaded from "org"
| (org-preview-latex-fragment &optional SUBTREE)
| 
| Documentation:
| Preview the LaTeX fragment at point, or all locally or globally.
| If the cursor is in a LaTeX fragment, create the image and overlay
| it over the source code.  If there is no fragment at point, display
| all fragments in the current text, from one headline to the next.  With
| prefix SUBTREE, display all fragments in the current subtree.  With a
| double prefix arg C-u C-u, or when the cursor is before the first headline,
| display all fragments in the buffer.
`----


I obtain an error whose bug trace I attach.

I had the following trivial function 

(defun org-preview-article ()
  "Saves the article to temporary buffer and apply
`org-preview-latex-fragment'."
  (interactive)
  (let* ((tempfile "/tmp/texfile"))
	(shell-command (format "touch %s" tempfile))
				   (delete-file tempfile)
				   (with-current-buffer gnus-article-buffer
					 (write-region (point-min) (point-max) tempfile nil nil nil 'utf-8-unix)
					 (find-file tempfile)
					 (org-preview-latex-fragment nil))))

which sort of works but is not what I want.


[-- Attachment #2: bugtrace --]
[-- Type: text/plain, Size: 6993 bytes --]

  # bind (standard-output stack-trace-on-signal debug-on-signal stack-trace-on-error debug-on-error)
  # (unwind-protect ...)
  file-name-nondirectory(nil)
  (file-name-sans-extension (file-name-nondirectory buffer-file-name))
  (concat "ltxpng/" (file-name-sans-extension (file-name-nondirectory buffer-file-name)))
  (org-format-latex (concat "ltxpng/" (file-name-sans-extension (file-name-nondirectory buffer-file-name))) default-directory (quote overlays) msg at (quote forbuffer) (quote dvipng))
  # bind (msg at end beg)
  (let (beg end at msg) (cond ((or (equal subtree (quote (16))) (not (save-excursion (re-search-backward org-outline-regexp-bol nil t)))) (setq beg (point-min) end (point-max) msg "Creating images for buffer...%s")) ((equal subtree (quote (4))) (org-back-to-heading) (setq beg (point) end (org-end-of-subtree t) msg "Creating images for subtree...%s")) (t (if (setq at (org-inside-LaTeX-fragment-p)) (goto-char (max (point-min) (- (cdr at) 2))) (org-back-to-heading)) (setq beg (point) end (progn (outline-next-heading) (point)) msg (if at "Creating image...%s" "Creating images for entry...%s")))) (message msg "") (narrow-to-region beg end) (goto-char beg) (org-format-latex (concat "ltxpng/" (file-name-sans-extension (file-name-nondirectory buffer-file-name))) default-directory (quote overlays) 
 msg at (quote forbuffer) (quote dvipng)) (message msg "done.  Use `C-c C-c' to remove images."))
  # (unwind-protect ...)
  (save-restriction (let (beg end at msg) (cond ((or (equal subtree (quote (16))) (not (save-excursion (re-search-backward org-outline-regexp-bol nil t)))) (setq beg (point-min) end (point-max) msg "Creating images for buffer...%s")) ((equal subtree (quote (4))) (org-back-to-heading) (setq beg (point) end (org-end-of-subtree t) msg "Creating images for subtree...%s")) (t (if (setq at (org-inside-LaTeX-fragment-p)) (goto-char (max (point-min) (- (cdr at) 2))) (org-back-to-heading)) (setq beg (point) end (progn (outline-next-heading) (point)) msg (if at "Creating image...%s" "Creating images for entry...%s")))) (message msg "") (narrow-to-region beg end) (goto-char beg) (org-format-latex (concat "ltxpng/" (file-name-sans-extension (file-name-nondirectory buffer-file-name))) default-directory
  (quote overlays) msg at (quote forbuffer) (quote dvipng)) (message msg "done.  Use `C-c C-c' to remove images.")))
  # (unwind-protect ...)
  (save-excursion (save-restriction (let (beg end at msg) (cond ((or (equal subtree (quote (16))) (not (save-excursion (re-search-backward org-outline-regexp-bol nil t)))) (setq beg (point-min) end (point-max) msg "Creating images for buffer...%s")) ((equal subtree (quote (4))) (org-back-to-heading) (setq beg (point) end (org-end-of-subtree t) msg "Creating images for subtree...%s")) (t (if (setq at (org-inside-LaTeX-fragment-p)) (goto-char (max (point-min) (- (cdr at) 2))) (org-back-to-heading)) (setq beg (point) end (progn (outline-next-heading) (point)) msg (if at "Creating image...%s" "Creating images for entry...%s")))) (message msg "") (narrow-to-region beg end) (goto-char beg) (org-format-latex (concat "ltxpng/" (file-name-sans-extension (file-name-nondirectory buffer-file-name))) d
 efault-directory (quote overlays) msg at (quote forbuffer) (quote dvipng)) (message msg "done.  Use `C-c C-c' to remove images."))))
  # bind (subtree)
  org-preview-latex-fragment(nil)
  (edebug-after (edebug-before 5) 6 (org-preview-latex-fragment nil))
  # bind (inhibit-read-only)
  (let ((inhibit-read-only t)) (edebug-after (edebug-before 5) 6 (org-preview-latex-fragment nil)))
  (edebug-after (edebug-before 4) 7 (let ((inhibit-read-only t)) (edebug-after (edebug-before 5) 6 (org-preview-latex-fragment nil))))
  (if (edebug-after (edebug-before 2) 3 (article-goto-body)) (edebug-after (edebug-before 4) 7 (let ((inhibit-read-only t)) (edebug-after (edebug-before 5) 6 (org-preview-latex-fragment nil)))))
  (when (edebug-after (edebug-before 2) 3 (article-goto-body)) (edebug-after (edebug-before 4) 7 (let ((inhibit-read-only t)) (edebug-after (edebug-before 5) 6 (org-preview-latex-fragment nil)))))
  (edebug-after (edebug-before 1) 8 (when (edebug-after (edebug-before 2) 3 (article-goto-body)) (edebug-after (edebug-before 4) 7 (let ((inhibit-read-only t)) (edebug-after (edebug-before 5) 6 (org-preview-latex-fragment nil))))))
  # (unwind-protect ...)
  (save-excursion (edebug-after (edebug-before 1) 8 (when (edebug-after (edebug-before 2) 3 (article-goto-body)) (edebug-after (edebug-before 4) 7 (let ((inhibit-read-only t)) (edebug-after (edebug-before 5) 6 (org-preview-latex-fragment nil)))))))
  (edebug-after (edebug-before 0) 9 (save-excursion (edebug-after (edebug-before 1) 8 (when (edebug-after (edebug-before 2) 3 (article-goto-body)) (edebug-after (edebug-before 4) 7 (let ((inhibit-read-only t)) (edebug-after (edebug-before 5) 6 (org-preview-latex-fragment nil))))))))
  (lambda nil (edebug-after (edebug-before 0) 9 (save-excursion (edebug-after (edebug-before 1) 8 (when (edebug-after (edebug-before 2) 3 (article-goto-body)) (edebug-after (edebug-before 4) 7 (let ((inhibit-read-only t)) (edebug-after (edebug-before 5) 6 (org-preview-latex-fragment nil)))))))))()
  # bind (edebug-offset-indices edebug-stack edebug-buffer edebug-coverage edebug-freq-count edebug-def-mark edebug-data edebug-body edebug-args edebug-function)
  edebug-enter(article-treat-org-preview nil (lambda nil (edebug-after (edebug-before 0) 9 (save-excursion (edebug-after (edebug-before 1) 8 (when (edebug-after (edebug-before 2) 3 (article-goto-body)) (edebug-after (edebug-before 4) 7 (let ((inhibit-read-only t)) (edebug-after (edebug-before 5) 6 (org-preview-latex-fragment nil))))))))))
  # bind (executing-kbd-macro overriding-local-map overriding-terminal-local-map signal-hook-function pre-command-hook post-command-hook)
  # (unwind-protect ...)
  # bind (edebug-entered max-lisp-eval-depth max-specpdl-size debugger edebug-outside-debug-on-error edebug-outside-debug-on-quit debug-on-error debug-on-quit cl-lexical-debug edebug-outside-overriding-local-map edebug-outside-overriding-terminal-local-map edebug-outside-executing-macro edebug-outside-pre-command-hook edebug-outside-post-command-hook edebug-body edebug-args edebug-function)
  edebug-enter(article-treat-org-preview nil (lambda nil (edebug-after (edebug-before 0) 9 (save-excursion (edebug-after (edebug-before 1) 8 (when (edebug-after (edebug-before 2) 3 (article-goto-body)) (edebug-after (edebug-before 4) 7 (let ((inhibit-read-only t)) (edebug-after (edebug-before 5) 6 (org-preview-latex-fragment nil))))))))))
  article-treat-org-preview()
  eval((article-treat-org-preview))
  # bind (form history form prompt)
  edit-and-eval-command("Redo: " (switch-to-buffer "*Article nndraft:drafts*") (command-history . 1))
  # bind (print-level arg)
  repeat-complex-command(1)
  # bind (command-debug-status)
  call-interactively(repeat-complex-command)
  # (condition-case ... . error)
  # (catch top-level ...)

Re: apply TeX-to-char-paragraph-or-region to an article

[Lars Magne Ingebrigtsen]

Uwe Brauer <oub@mat.ucm.es> writes:

[...]

>   (concat "ltxpng/" (file-name-sans-extension (file-name-nondirectory
> buffer-file-name)))

Org mode assumes that the buffer has a file associated with it.  Which
it doesn't.  But you can just bind `buffer-file-name' to something.
Probably anything will work.  "", for instance.

-- 
(domestic pets only, the antidote for overdose, milk.)
  bloggy blog http://lars.ingebrigtsen.no/

html email, math formulas (was: apply TeX-to-char-paragraph-or-region to an article)

[Uwe Brauer]

>> On Thu, 22 Mar 2012 22:37:10 +0100, Lars Magne Ingebrigtsen <larsi@gnus.org> wrote:

   > Uwe Brauer <oub@mat.ucm.es> writes:
   > [...]

   >> (concat "ltxpng/" (file-name-sans-extension (file-name-nondirectory
   >> buffer-file-name)))

   > Org mode assumes that the buffer has a file associated with it.  Which
   > it doesn't.  But you can just bind `buffer-file-name' to something.
   > Probably anything will work.  "", for instance.
Right!!! That it was, many thanks, I recommend including
that code in gnus, but maybe I am really the only one
interested.


Another thing which is related but concerns sending email.
While I can of course use (and in fact I do very often) the
TeX-to-char function for outgoing email which allows to send
converted symbols such-as and then can be read by other
email programs, the same is not true of
org-preview-latex-fragments, since it saves the png in a
subdirectory. 


I wrote a relative simple function which attaches all the
relevant png, but the result looks ugly. The reason is that
the mail is sent in principle as plain text, with embedded
png.

Now I learnt about 2 extensions for Thunderbird, which rely
on the same idea however their result looks much nicer since
they use htmlized email (which I normally dislike) so in
short will gnus at some point allow and support html email.

Re: html email, math formulas

[Dan Christensen]

Uwe Brauer <oub@mat.ucm.es> writes:

> Right!!! That it was, many thanks, I recommend including
> that code in gnus, but maybe I am really the only one
> interested.

Can you share your final working code?

Thanks,

Dan

Re: html email, math formulas

[Uwe Brauer]

>> On Sat, 24 Mar 2012 10:43:40 -0400, Dan Christensen <jdc@uwo.ca> wrote:

   > Uwe Brauer <oub@mat.ucm.es> writes:
   >> Right!!! That it was, many thanks, I recommend including
   >> that code in gnus, but maybe I am really the only one
   >> interested.

   > Can you share your final working code?
Sure:

(defun article-treat-TeX-to-chars ()
  "Translate TeX commands to chars."
  (interactive)
  (save-excursion
    (when (article-goto-body)
      (let ((inhibit-read-only t))
		(TeX-to-char-region (point-min) (point-max))))))



(defun article-treat-org-preview () 
  "Translate TeX commands to png generated by org-preview-latex-fragment
into overlays or extents." 
  (interactive)
  (save-excursion
    (when (article-goto-body)
      (let ((inhibit-read-only t))
		(let ((buffer-file-name ""))
		(org-preview-latex-fragment nil))))))


For the first one you will need Aidain TeX-to-char. I am not
sure whether it is part of mainstream xemacs. I can send it
to you.

Uwe 

Re: html email, math formulas

[Philipp Haselwarter]

[-- Attachment #1: Type: text/plain, Size: 2352 bytes --]

On Thu, Mar 22 2012 22:56 (@1332453399), Uwe Brauer wrote:

>>> On Thu, 22 Mar 2012 22:37:10 +0100, Lars Magne Ingebrigtsen <larsi@gnus.org>
> wrote:
>
>    > Uwe Brauer <oub@mat.ucm.es> writes:
>    > [...]
>
>    >> (concat "ltxpng/" (file-name-sans-extension (file-name-nondirectory
>    >> buffer-file-name)))
>
>    > Org mode assumes that the buffer has a file associated with it.  Which
>    > it doesn't.  But you can just bind `buffer-file-name' to something.
>    > Probably anything will work.  "", for instance.
> Right!!! That it was, many thanks, I recommend including
> that code in gnus, but maybe I am really the only one
> interested.
>
As in plain-text mail with TeX support? *want*
>
> Another thing which is related but concerns sending email.
> While I can of course use (and in fact I do very often) the
> TeX-to-char function for outgoing email which allows to send
> converted symbols such-as and then can be read by other
> email programs, the same is not true of
> org-preview-latex-fragments, since it saves the png in a
> subdirectory. 
>
>
> I wrote a relative simple function which attaches all the
> relevant png, but the result looks ugly. The reason is that
> the mail is sent in principle as plain text, with embedded
> png.
>
> Now I learnt about 2 extensions for Thunderbird, which rely
> on the same idea however their result looks much nicer since
> they use htmlized email (which I normally dislike) so in
> short will gnus at some point allow and support html email.


I think `org-mime-org-buffer-htmlize' and `org-mime-htmlize' from
org-mode/contrib/org-mime.el by Eric Schulte are able to handle
composing rich html mail.

From a quick test, it seems to /almost/ work:

- images get attached, depending on the mail client they may or may not
  get displayed inline (Gnus shows them inline, roundcube below the
  message body)

- /css/ and /js/ appears to be missing, which breaks pretty formatting
  of code-blocks and mathjax for TeX.
  Setting #+OPTIONS: LaTeX:dvipng  as suggested by the Org info manual
  causes an error about a missing temp-file.

The file used for this test is attached.

Maybe these are just configuration quirks and could easily be dealt with
by setting the right options in org, or someone familiar with `org-mime'
could take a look at what's going wrong?


-- 
Philipp Haselwarter

[-- Attachment #2: dm7_-_linear_regression.org --]
[-- Type: application/vnd.lotus-organizer, Size: 1174 bytes --]

Re: html email, math formulas

[Uwe Brauer]

>> On Sun, 25 Mar 2012 15:00:19 +0200, Philipp Haselwarter
>> <philipp.haselwarter@gmx.de> wrote: 



   > I think `org-mime-org-buffer-htmlize' and `org-mime-htmlize' from
   > org-mode/contrib/org-mime.el by Eric Schulte are able to handle
   > composing rich html mail.
There was a bug in Eric's code which was fixed a couple of
days ago in the org mailing list


The original code was 
;	 (org-export-with-LaTeX-fragments "dvipng")
but it should be:
	 (org-export-with-LaTeX-fragments 'dvipng)


Yes you are right this is very nice. However the way the
attachments are inserted in the text is ugly at best. I just
tested in thunderbird an extension called latex-it and it
looks much nicer, but it is not emacs :'(

I think the reason for this ugliness is that *mml* does not
support something like floating elements. I wrote a small
rant in the org mailing list but nobody replied. I think
will post it here.

Uwe 

Re: html email, math formulas

[Uwe Brauer]

[-- Attachment #1: Type: text/plain, Size: 849 bytes --]

Hello

Now that the bug in org-mime-htmlize is fixed, I would like
to comment on the visual representation. Most likely this
has to do with the mml package.

When I write the following message 
Integral


$$\int fdx=0$$
And


\begin{equation} 
\sum_{\alpha} 
\end{equation}

and apply org-preview-latex-fragment and then
org-mime-htmlize and send this message to gmail. 
The 'gmail-reader' displays them fine.

However thunderbird does not and I apply the resulting eml 
file below (I presume a screenshot is not appropriated)

Now tunderbird itself has an extension (latex-it) which does
something similar to org-mime-htmlize, it sends latex math
as png. However there are "better* displayed, I attach the
relevant eml file below.

Could org-mime-htmlize use the structure of latex-it?

Thanks 

Uwe Brauer 

Attachments: first org, then latex-it


[-- Attachment #2: test-org-mime.eml --]
[-- Type: message/rfc822, Size: 3110 bytes --]

[-- Attachment #2.1.1.1: Type: text/plain, Size: 77 bytes --]

Integral 

$$\int fdx=0$$ 
And

\begin{equation}
\sum_{\alpha}
\end{equation}

[-- Attachment #2.1.1.2: Type: text/html, Size: 369 bytes --]

[-- Attachment #2.1.2: org-GPEs_h_2696bae90081ac8f178e62db0820e52dd36d4691.png --]
[-- Type: image/png, Size: 438 bytes --]

[-- Attachment #2.1.3: org-GPEs_h_baef2fd9f63b971ab4ebc763e998857ceda7aeab.png --]
[-- Type: image/png, Size: 450 bytes --]

[-- Attachment #3: test-org-mime.eml --]
[-- Type: message/rfc822, Size: 3110 bytes --]

[-- Attachment #3.1.1.1: Type: text/plain, Size: 77 bytes --]

Integral 

$$\int fdx=0$$ 
And

\begin{equation}
\sum_{\alpha}
\end{equation}

[-- Attachment #3.1.1.2: Type: text/html, Size: 369 bytes --]

[-- Attachment #3.1.2: org-GPEs_h_2696bae90081ac8f178e62db0820e52dd36d4691.png --]
[-- Type: image/png, Size: 438 bytes --]

[-- Attachment #3.1.3: org-GPEs_h_baef2fd9f63b971ab4ebc763e998857ceda7aeab.png --]
[-- Type: image/png, Size: 450 bytes --]

Re: html email, math formulas

[Eric S Fraga]

Uwe Brauer <oub@mat.ucm.es> writes:

[...]

> Another thing which is related but concerns sending email.
> While I can of course use (and in fact I do very often) the
> TeX-to-char function for outgoing email which allows to send
> converted symbols such-as and then can be read by other
> email programs, the same is not true of
> org-preview-latex-fragments, since it saves the png in a
> subdirectory. 
>
>
> I wrote a relative simple function which attaches all the
> relevant png, but the result looks ugly. The reason is that
> the mail is sent in principle as plain text, with embedded
> png.
>
> Now I learnt about 2 extensions for Thunderbird, which rely
> on the same idea however their result looks much nicer since
> they use htmlized email (which I normally dislike) so in
> short will gnus at some point allow and support html email.

Check out

,----[ C-h f org-mime-htmlize RET ]
| org-mime-htmlize is an interactive Lisp function in `org-mime.el'.
| 
| (org-mime-htmlize ARG)
| 
| Export a portion of an email body composed using `mml-mode' to
| html using `org-mode'.  If called with an active region only
| export that region, otherwise export the entire body.
| 
| [back]
`----

-- 
: Eric S Fraga (GnuPG: 0xC89193D8FFFCF67D) in Emacs 24.1.50.1 + Ma Gnus v0.6