Sugesstions for dealing with malformed LaTeX documents automatically?

Sugesstions for dealing with malformed LaTeX documents automatically?

[Grady D]

[-- Attachment #1.1: Type: text/plain, Size: 1196 bytes --]

I am trying to convert many LaTeX documents using Pandoc. However, some of 
the documents have syntax errors or are poorly formatted, and cause Pandoc 
to crash. Is there anything I could use, through Pandoc or otherwise, to 
make these documents usable/convertable? I intend to convert them to 
plaintext preserving only the content, so I do not need full blown syntax 
repair as much as I just need a way to eliminate malformed statements. At 
the bottom of this post, I have attached some of the errors I'm talking 
about. 

Thanks for any suggestions you guys have. 

Error examples: https://hastebin.com/raw/womufuxoko

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/496e4ff7-b62a-47f8-8813-f699f56ae541%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 1706 bytes --]

Re: Sugesstions for dealing with malformed LaTeX documents automatically?

[Václav Haisman]

[-- Attachment #1: Type: text/plain, Size: 1511 bytes --]

On 6 January 2017 at 03:30, Grady D <gsmail4231-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:

> I am trying to convert many LaTeX documents using Pandoc. However, some of
> the documents have syntax errors or are poorly formatted, and cause Pandoc
> to crash. Is there anything I could use, through Pandoc or otherwise, to
> make these documents usable/convertable? I intend to convert them to
> plaintext preserving only the content, so I do not need full blown syntax
> repair as much as I just need a way to eliminate malformed statements. At
> the bottom of this post, I have attached some of the errors I'm talking
> about.
>
> Thanks for any suggestions you guys have.
>
> Error examples: https://hastebin.com/raw/womufuxoko
>
>
​Well, you will have to fix the math sooner or later anyway, if you want to
make any sense out of it. Why not try and fix it before the conversion?


-- 
VH

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/CAKw7uViJOSH3rkjaqMTrbWJsN6Lf_m9H1DjcrxjuqpKEJ6Pzmw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #2: Type: text/html, Size: 2651 bytes --]

Re: Sugesstions for dealing with malformed LaTeX documents automatically?

[John MacFarlane]

Note that things pandoc stumbles on are not necessary tex
errors.  They may reflect limitations in pandoc's ability to
understand tex.

I've made the tex reader fail when it gets confused, rather
than (e.g.) silently skipping things, partly so that it can
be improved more rapidly.

In pandoc 2.0 we'll have better warnings about places where
information is lost, and perhaps we could add options to
"plow ahead" when pandoc gets confused.

+++ Václav Haisman [Jan 06 17 11:17 ]:
>   On 6 January 2017 at 03:30, Grady D <[1]gsmail4231-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
>
>   I am trying to convert many LaTeX documents using Pandoc. However, some
>   of the documents have syntax errors or are poorly formatted, and cause
>   Pandoc to crash. Is there anything I could use, through Pandoc or
>   otherwise, to make these documents usable/convertable? I intend to
>   convert them to plaintext preserving only the content, so I do not need
>   full blown syntax repair as much as I just need a way to eliminate
>   malformed statements. At the bottom of this post, I have attached some
>   of the errors I'm talking about.
>   Thanks for any suggestions you guys have.
>   Error examples: [2]https://hastebin.com/raw/womufuxoko
>
>   ​Well, you will have to fix the math sooner or later anyway, if you
>   want to make any sense out of it. Why not try and fix it before the
>   conversion?
>   --
>   VH
>
>   --
>   You received this message because you are subscribed to the Google
>   Groups "pandoc-discuss" group.
>   To unsubscribe from this group and stop receiving emails from it, send
>   an email to [3]pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
>   To post to this group, send email to
>   [4]pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
>   To view this discussion on the web visit
>   [5]https://groups.google.com/d/msgid/pandoc-discuss/CAKw7uViJOSH3rkjaqM
>   TrbWJsN6Lf_m9H1DjcrxjuqpKEJ6Pzmw%40mail.gmail.com.
>   For more options, visit [6]https://groups.google.com/d/optout.
>
>References
>
>   1. mailto:gsmail4231-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
>   2. https://hastebin.com/raw/womufuxoko
>   3. mailto:pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org
>   4. mailto:pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org
>   5. https://groups.google.com/d/msgid/pandoc-discuss/CAKw7uViJOSH3rkjaqMTrbWJsN6Lf_m9H1DjcrxjuqpKEJ6Pzmw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org?utm_medium=email&utm_source=footer
>   6. https://groups.google.com/d/optout

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/20170106114852.GH791%40Administrateurs-iMac-3.local.
For more options, visit https://groups.google.com/d/optout.

Re: Sugesstions for dealing with malformed LaTeX documents automatically?

[Grady D]

[-- Attachment #1.1: Type: text/plain, Size: 3793 bytes --]

I am sorry to hear that. Looking forward to the updates, though.

@Vaclav I am actually only interested in the documents' text, and I can do 
without the math. I have been using a filter to remove math expressions 
from the documents, but that only works if I can get the documents 
processed first. 

On Friday, January 6, 2017 at 6:49:40 AM UTC-5, John MacFarlane wrote:
>
> Note that things pandoc stumbles on are not necessary tex 
> errors.  They may reflect limitations in pandoc's ability to 
> understand tex. 
>
> I've made the tex reader fail when it gets confused, rather 
> than (e.g.) silently skipping things, partly so that it can 
> be improved more rapidly. 
>
> In pandoc 2.0 we'll have better warnings about places where 
> information is lost, and perhaps we could add options to 
> "plow ahead" when pandoc gets confused. 
>
> +++ Václav Haisman [Jan 06 17 11:17 ]: 
> >   On 6 January 2017 at 03:30, Grady D <[1]gsmai...-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org 
> <javascript:>> wrote: 
> > 
> >   I am trying to convert many LaTeX documents using Pandoc. However, 
> some 
> >   of the documents have syntax errors or are poorly formatted, and cause 
> >   Pandoc to crash. Is there anything I could use, through Pandoc or 
> >   otherwise, to make these documents usable/convertable? I intend to 
> >   convert them to plaintext preserving only the content, so I do not 
> need 
> >   full blown syntax repair as much as I just need a way to eliminate 
> >   malformed statements. At the bottom of this post, I have attached some 
> >   of the errors I'm talking about. 
> >   Thanks for any suggestions you guys have. 
> >   Error examples: [2]https://hastebin.com/raw/womufuxoko 
> > 
> >   ​Well, you will have to fix the math sooner or later anyway, if you 
> >   want to make any sense out of it. Why not try and fix it before the 
> >   conversion? 
> >   -- 
> >   VH 
> > 
> >   -- 
> >   You received this message because you are subscribed to the Google 
> >   Groups "pandoc-discuss" group. 
> >   To unsubscribe from this group and stop receiving emails from it, send 
> >   an email to [3]pandoc-discus...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org <javascript:>. 
> >   To post to this group, send email to 
> >   [4]pandoc-...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org <javascript:>. 
> >   To view this discussion on the web visit 
> >   [5]
> https://groups.google.com/d/msgid/pandoc-discuss/CAKw7uViJOSH3rkjaqM 
> >   TrbWJsN6Lf_m9H1DjcrxjuqpKEJ6Pzmw%40mail.gmail.com. 
> >   For more options, visit [6]https://groups.google.com/d/optout. 
> > 
> >References 
> > 
> >   1. mailto:gsmai...-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <javascript:> 
> >   2. https://hastebin.com/raw/womufuxoko 
> >   3. mailto:pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org <javascript:> 
> >   4. mailto:pandoc-...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org <javascript:> 
> >   5. 
> https://groups.google.com/d/msgid/pandoc-discuss/CAKw7uViJOSH3rkjaqMTrbWJsN6Lf_m9H1DjcrxjuqpKEJ6Pzmw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org?utm_medium=email&utm_source=footer 
> >   6. https://groups.google.com/d/optout 
>

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/7273d03a-a741-41e0-9752-8f16cd033178%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 8386 bytes --]

Re: Sugesstions for dealing with malformed LaTeX documents automatically?

['Jason Seeley' via pandoc-discuss]

[-- Attachment #1.1: Type: text/plain, Size: 1582 bytes --]

You might try DeTeX (or OpenDetex, which is easier to find). It strips all 
LaTeX commands, just leaving the text.

(Old version with Windows executable 
here: https://code.google.com/archive/p/opendetex/
Newer version, but source only, 
here: https://github.com/pkubowicz/opendetex )

- Jason

On Thursday, January 5, 2017 at 8:30:46 PM UTC-6, Grady D wrote:
>
> I am trying to convert many LaTeX documents using Pandoc. However, some of 
> the documents have syntax errors or are poorly formatted, and cause Pandoc 
> to crash. Is there anything I could use, through Pandoc or otherwise, to 
> make these documents usable/convertable? I intend to convert them to 
> plaintext preserving only the content, so I do not need full blown syntax 
> repair as much as I just need a way to eliminate malformed statements. At 
> the bottom of this post, I have attached some of the errors I'm talking 
> about. 
>
> Thanks for any suggestions you guys have. 
>
> Error examples: https://hastebin.com/raw/womufuxoko
>

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/caa79c5c-db77-497b-a1ed-c573bedbcf41%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 2698 bytes --]

Re: Sugesstions for dealing with malformed LaTeX documents automatically?

[Grady D]

[-- Attachment #1: Type: text/plain, Size: 2453 bytes --]

I will check that out.

Thanks

On Jan 6, 2017, 9:17 AM -0500, 'Jason Seeley' via pandoc-discuss <pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org>, wrote:
> You might try DeTeX (or OpenDetex, which is easier to find). It strips all LaTeX commands, just leaving the text.
>
> (Old version with Windows executable here: https://code.google.com/archive/p/opendetex/
> Newer version, but source only, here: https://github.com/pkubowicz/opendetex )
>
> - Jason
>
> On Thursday, January 5, 2017 at 8:30:46 PM UTC-6, Grady D wrote:
> > I am trying to convert many LaTeX documents using Pandoc. However, some of the documents have syntax errors or are poorly formatted, and cause Pandoc to crash. Is there anything I could use, through Pandoc or otherwise, to make these documents usable/convertable? I intend to convert them to plaintext preserving only the content, so I do not need full blown syntax repair as much as I just need a way to eliminate malformed statements. At the bottom of this post, I have attached some of the errors I'm talking about.
> >
> > Thanks for any suggestions you guys have.
> >
> > Error examples: https://hastebin.com/raw/womufuxoko
> --
> You received this message because you are subscribed to a topic in the Google Groups "pandoc-discuss" group.
> To unsubscribe from this topic, visit https://groups.google.com/d/topic/pandoc-discuss/R_86WLQc1kc/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
> To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
> To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/caa79c5c-db77-497b-a1ed-c573bedbcf41%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/83a141c0-cddb-497b-a857-24c2bc4d51bd%40Spark.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #2: Type: text/html, Size: 4552 bytes --]

Re: Sugesstions for dealing with malformed LaTeX documents automatically?

[Grady D]

[-- Attachment #1.1: Type: text/plain, Size: 3182 bytes --]

I have been going for a while using a much slower (but successful) method, 
which I will describe below for anyone with the same problem that I have.

I identified a tool which can convert LaTeX to HTML 
<http://dlmf.nist.gov/LaTeXML/>, which is a bit more 
forgiving/understandable to Pandoc. Right now, for any file which Pandoc 
can't understand, I run it through this tool and then run the output 
through pandoc.

Thanks again for everyone's input and advice.

On Friday, January 6, 2017 at 6:48:39 PM UTC-5, Grady D wrote:
>
> I will check that out.  
>
> Thanks
>
> On Jan 6, 2017, 9:17 AM -0500, 'Jason Seeley' via pandoc-discuss <
> pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org>, wrote:
>
> You might try DeTeX (or OpenDetex, which is easier to find). It strips all 
> LaTeX commands, just leaving the text. 
>
> (Old version with Windows executable here: 
> https://code.google.com/archive/p/opendetex/
> Newer version, but source only, here: 
> https://github.com/pkubowicz/opendetex )
>
> - Jason
>
> On Thursday, January 5, 2017 at 8:30:46 PM UTC-6, Grady D wrote: 
>>
>> I am trying to convert many LaTeX documents using Pandoc. However, some 
>> of the documents have syntax errors or are poorly formatted, and cause 
>> Pandoc to crash. Is there anything I could use, through Pandoc or 
>> otherwise, to make these documents usable/convertable? I intend to convert 
>> them to plaintext preserving only the content, so I do not need full blown 
>> syntax repair as much as I just need a way to eliminate malformed 
>> statements. At the bottom of this post, I have attached some of the errors 
>> I'm talking about.  
>>
>> Thanks for any suggestions you guys have. 
>>
>> Error examples: https://hastebin.com/raw/womufuxoko
>>
> --
> You received this message because you are subscribed to a topic in the 
> Google Groups "pandoc-discuss" group.
> To unsubscribe from this topic, visit 
> https://groups.google.com/d/topic/pandoc-discuss/R_86WLQc1kc/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to 
> pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
> To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
> To view this discussion on the web visit 
> https://groups.google.com/d/msgid/pandoc-discuss/caa79c5c-db77-497b-a1ed-c573bedbcf41%40googlegroups.com 
> <https://groups.google.com/d/msgid/pandoc-discuss/caa79c5c-db77-497b-a1ed-c573bedbcf41%40googlegroups.com?utm_medium=email&utm_source=footer>
> .
> For more options, visit https://groups.google.com/d/optout.
>
>

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/5586c4c9-0210-4895-90fd-a909a0ddbb8d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 7618 bytes --]