Hyphenation

Hyphenation

[Jürgen Schulze]

[-- Attachment #1.1: Type: text/plain, Size: 838 bytes --]

Hello, I would like the hyphenation abilities of pandoc when generating PDF 
documents to use for simple text/html files where the hyphenation is 
inserted with entity "­".

Something like

pandoc --smart --wrap=none text.txt -o text2.txt

How can this be done?

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/60d24566-f642-4d47-9d47-1a6f91a7d562%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 2361 bytes --]

Re: Hyphenation

[Albert Krewinkel]

Jürgen Schulze <1manfactory-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> writes:

> Hello, I would like the hyphenation abilities of pandoc when generating PDF
> documents to use for simple text/html files where the hyphenation is inserted
> with entity "&shy;".
>
> Something like
>
> pandoc --smart --wrap=none text.txt -o text2.txt
>
> How can this be done?

One method would be to rely on the CSS `hyphens` property. Unforunately,
that property is not supported by Chrome/Webkit, so an additional
polyfill library like [Hyphenator](https://github.com/mnater/Hyphenator)
would be required.

Alternatively, a pandoc filters can insert soft hyphens directly.
You'll need to install the python libraries `panflute` and `pyphen`.
Put the following code into a file and call it as a pandoc filter.


    #!/usr/bin/env python3
    from panflute import *
    import pyphen

    dic = pyphen.Pyphen(lang='en_US')

    def hyphenate(inline, doc):
        if type(inline) == Str:
            hyphenated = dic.inserted(inline.text, hyphen='­')
            return Str(hyphenated)

    if __name__ == "__main__":
        toJSONFilter(hyphenate)


The above code uses the unicode soft hyphen instead of the HTML entity,
which helps keeping the filesize low.  Just change the `hyphen`
parameter if that's not what you want.

-- 
Albert Krewinkel
GPG: 8eed e3e2 e8c5 6f18 81fe  e836 388d c0b2 1f63 1124

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/877f80h9x3.fsf%40espresso.zeitkraut.de.
For more options, visit https://groups.google.com/d/optout.

Re: Hyphenation

[Jürgen Schulze]

[-- Attachment #1.1: Type: text/plain, Size: 2382 bytes --]

Hello, Albert Krewinkel 
thanks for providing me this solution.
But I decided to move on with a PHP "compiler" to speed up a php 
hyphenation script
Juergen

Am Freitag, 18. November 2016 20:20:51 UTC+1 schrieb Albert Krewinkel:
>
> Jürgen Schulze <1manf...-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <javascript:>> writes: 
>
> > Hello, I would like the hyphenation abilities of pandoc when generating 
> PDF 
> > documents to use for simple text/html files where the hyphenation is 
> inserted 
> > with entity "&shy;". 
> > 
> > Something like 
> > 
> > pandoc --smart --wrap=none text.txt -o text2.txt 
> > 
> > How can this be done? 
>
> One method would be to rely on the CSS `hyphens` property. Unforunately, 
> that property is not supported by Chrome/Webkit, so an additional 
> polyfill library like [Hyphenator](https://github.com/mnater/Hyphenator) 
> would be required. 
>
> Alternatively, a pandoc filters can insert soft hyphens directly. 
> You'll need to install the python libraries `panflute` and `pyphen`. 
> Put the following code into a file and call it as a pandoc filter. 
>
>
>     #!/usr/bin/env python3 
>     from panflute import * 
>     import pyphen 
>
>     dic = pyphen.Pyphen(lang='en_US') 
>
>     def hyphenate(inline, doc): 
>         if type(inline) == Str: 
>             hyphenated = dic.inserted(inline.text, hyphen='­') 
>             return Str(hyphenated) 
>
>     if __name__ == "__main__": 
>         toJSONFilter(hyphenate) 
>
>
> The above code uses the unicode soft hyphen instead of the HTML entity, 
> which helps keeping the filesize low.  Just change the `hyphen` 
> parameter if that's not what you want. 
>
> -- 
> Albert Krewinkel 
> GPG: 8eed e3e2 e8c5 6f18 81fe  e836 388d c0b2 1f63 1124 
>

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/b514ade1-a211-4989-8712-07ebe9842b6f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 3790 bytes --]

Re: Hyphenation

[BP Jonsson]

[-- Attachment #1: Type: text/plain, Size: 2891 bytes --]

Albert, would this python solution insert a soft hyphen in every Str
element?

/bpj

Den 18 nov 2016 20:20 skrev "Albert Krewinkel" <albert+pandoc-9EawChwDxG8hFhg+JK9F0w@public.gmane.org>:

> Jürgen Schulze <1manfactory-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> writes:
>
> > Hello, I would like the hyphenation abilities of pandoc when generating
> PDF
> > documents to use for simple text/html files where the hyphenation is
> inserted
> > with entity "&shy;".
> >
> > Something like
> >
> > pandoc --smart --wrap=none text.txt -o text2.txt
> >
> > How can this be done?
>
> One method would be to rely on the CSS `hyphens` property. Unforunately,
> that property is not supported by Chrome/Webkit, so an additional
> polyfill library like [Hyphenator](https://github.com/mnater/Hyphenator)
> would be required.
>
> Alternatively, a pandoc filters can insert soft hyphens directly.
> You'll need to install the python libraries `panflute` and `pyphen`.
> Put the following code into a file and call it as a pandoc filter.
>
>
>     #!/usr/bin/env python3
>     from panflute import *
>     import pyphen
>
>     dic = pyphen.Pyphen(lang='en_US')
>
>     def hyphenate(inline, doc):
>         if type(inline) == Str:
>             hyphenated = dic.inserted(inline.text, hyphen='­')
>             return Str(hyphenated)
>
>     if __name__ == "__main__":
>         toJSONFilter(hyphenate)
>
>
> The above code uses the unicode soft hyphen instead of the HTML entity,
> which helps keeping the filesize low.  Just change the `hyphen`
> parameter if that's not what you want.
>
> --
> Albert Krewinkel
> GPG: 8eed e3e2 e8c5 6f18 81fe  e836 388d c0b2 1f63 1124
>
> --
> You received this message because you are subscribed to the Google Groups
> "pandoc-discuss" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
> To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/pandoc-discuss/877f80h9x3.fsf%40espresso.zeitkraut.de.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/CAFC_yuTXVxsc0uUk2RjdDLG4tqGGK09GCZroNf_UFAdiyjr22A%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #2: Type: text/html, Size: 4319 bytes --]

Re: Hyphenation

[Albert Krewinkel]

BP Jonsson <bpjonsson-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> writes:

> Albert, would this python solution insert a soft hyphen in every Str element?

Yes, the filter inserts soft hyphens in every Str element that has more
than one syllable. Font-family, font-size, container width, etc. are
usually not known beforehand or could vary dependent on the device used
for viewing, making it difficult to produce LaTeX-quality hyphenation.
I'm not aware of any simpler, less size-bloating method (except for the
CSS/polyfill alternative I mentioned).

> Den 18 nov 2016 20:20 skrev "Albert Krewinkel" <albert+pandoc@zeitkraut.de>:
>
>     Jürgen Schulze <1manfactory-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> writes:
>     
>     > Hello, I would like the hyphenation abilities of pandoc when generating
>     PDF
>     > documents to use for simple text/html files where the hyphenation is
>     inserted
>     > with entity "&shy;".
>     >
>     > Something like
>     >
>     > pandoc --smart --wrap=none text.txt -o text2.txt
>     >
>     > How can this be done?
>     
>     One method would be to rely on the CSS `hyphens` property. Unforunately,
>     that property is not supported by Chrome/Webkit, so an additional
>     polyfill library like [Hyphenator](https://github.com/mnater/Hyphenator)
>     would be required.
>     
>     Alternatively, a pandoc filters can insert soft hyphens directly.
>     You'll need to install the python libraries `panflute` and `pyphen`.
>     Put the following code into a file and call it as a pandoc filter.
>     
>     
>     #!/usr/bin/env python3
>     from panflute import *
>     import pyphen
>     
>     dic = pyphen.Pyphen(lang='en_US')
>     
>     def hyphenate(inline, doc):
>     if type(inline) == Str:
>     hyphenated = dic.inserted(inline.text, hyphen='')
>     return Str(hyphenated)
>     
>     if __name__ == "__main__":
>     toJSONFilter(hyphenate)
>     
>     
>     The above code uses the unicode soft hyphen instead of the HTML entity,
>     which helps keeping the filesize low. Just change the `hyphen`
>     parameter if that's not what you want.
>     
>     --
>     Albert Krewinkel
>     GPG: 8eed e3e2 e8c5 6f18 81fe e836 388d c0b2 1f63 1124
>     
>     --
>     You received this message because you are subscribed to the Google Groups
>     "pandoc-discuss" group.
>     To unsubscribe from this group and stop receiving emails from it, send an
>     email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
>     To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
>     To view this discussion on the web visit
>     https://groups.google.com/d/msgid/pandoc-discuss/877f80h9x3.fsf%40espresso.zeitkraut.de
>    .
>     For more options, visit https://groups.google.com/d/optout.

-- 
Albert Krewinkel
GPG: 8eed e3e2 e8c5 6f18 81fe  e836 388d c0b2 1f63 1124

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/877f7wg0ok.fsf%40espresso.zeitkraut.de.
For more options, visit https://groups.google.com/d/optout.

Re: Hyphenation

[Jürgen Schulze]

[-- Attachment #1.1: Type: text/plain, Size: 2573 bytes --]

Hello, I decided to give your soulution a try.
When running
pandoc -s in.txt --filter hyphfilter.py -o out.txt
I get this:

> pandoc: Error running filter hyphfilter.py
> hyphfilter.py: createProcess: runInteractiveProcess: exec: does not exist 
> (No such file or directory)

What am I doing wrong?
I have no clue about Python.

Juergen


Am Freitag, 18. November 2016 20:20:51 UTC+1 schrieb Albert Krewinkel:
>
> Jürgen Schulze <1manf...-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <javascript:>> writes: 
>
> > Hello, I would like the hyphenation abilities of pandoc when generating 
> PDF 
> > documents to use for simple text/html files where the hyphenation is 
> inserted 
> > with entity "&shy;". 
> > 
> > Something like 
> > 
> > pandoc --smart --wrap=none text.txt -o text2.txt 
> > 
> > How can this be done? 
>
> One method would be to rely on the CSS `hyphens` property. Unforunately, 
> that property is not supported by Chrome/Webkit, so an additional 
> polyfill library like [Hyphenator](https://github.com/mnater/Hyphenator) 
> would be required. 
>
> Alternatively, a pandoc filters can insert soft hyphens directly. 
> You'll need to install the python libraries `panflute` and `pyphen`. 
> Put the following code into a file and call it as a pandoc filter. 
>
>
>     #!/usr/bin/env python3 
>     from panflute import * 
>     import pyphen 
>
>     dic = pyphen.Pyphen(lang='en_US') 
>
>     def hyphenate(inline, doc): 
>         if type(inline) == Str: 
>             hyphenated = dic.inserted(inline.text, hyphen='­') 
>             return Str(hyphenated) 
>
>     if __name__ == "__main__": 
>         toJSONFilter(hyphenate) 
>
>
> The above code uses the unicode soft hyphen instead of the HTML entity, 
> which helps keeping the filesize low.  Just change the `hyphen` 
> parameter if that's not what you want. 
>
> -- 
> Albert Krewinkel 
> GPG: 8eed e3e2 e8c5 6f18 81fe  e836 388d c0b2 1f63 1124 
>

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/112f7607-4771-4672-924d-98850eba8616%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 5289 bytes --]

Re: Hyphenation

[Albert Krewinkel]

Jürgen Schulze <1manfactory-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> writes:

> Hello, I decided to give your soulution a try.
> When running
> pandoc -s in.txt --filter hyphfilter.py -o out.txt
> I get this:
>
>     pandoc: Error running filter hyphfilter.py
>     hyphfilter.py: createProcess: runInteractiveProcess: exec: does not exist
>     (No such file or directory)
>
> What am I doing wrong?
> I have no clue about Python.

I'm not entirely sure what's happening, but I guess python is either not
installed or not in your PATH. Did you install python, panflute and
pyphen?  Which OS are you on?


-- 
Albert Krewinkel
GPG: 8eed e3e2 e8c5 6f18 81fe  e836 388d c0b2 1f63 1124

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/87y3zdobul.fsf%40espresso.zeitkraut.de.
For more options, visit https://groups.google.com/d/optout.

Re: Hyphenation

[Sergio Correia]

[-- Attachment #1.1: Type: text/plain, Size: 1631 bytes --]

YMMV but I used to get that error when running older versions of Pandoc on 
Windows; I think either Pandoc 1.8 or 1.9 fixed this so if you are running 
windows try the latest release.



On Sunday, December 18, 2016 at 3:55:40 AM UTC-5, Albert Krewinkel wrote:
>
> Jürgen Schulze <1manf...-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <javascript:>> writes: 
>
> > Hello, I decided to give your soulution a try. 
> > When running 
> > pandoc -s in.txt --filter hyphfilter.py -o out.txt 
> > I get this: 
> > 
> >     pandoc: Error running filter hyphfilter.py 
> >     hyphfilter.py: createProcess: runInteractiveProcess: exec: does not 
> exist 
> >     (No such file or directory) 
> > 
> > What am I doing wrong? 
> > I have no clue about Python. 
>
> I'm not entirely sure what's happening, but I guess python is either not 
> installed or not in your PATH. Did you install python, panflute and 
> pyphen?  Which OS are you on? 
>
>
> -- 
> Albert Krewinkel 
> GPG: 8eed e3e2 e8c5 6f18 81fe  e836 388d c0b2 1f63 1124 
>

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/e3d60c91-0e95-4e34-85f0-b35342394302%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 2426 bytes --]