Graphviz python filter without using pygraphviz

Graphviz python filter without using pygraphviz

[Mohammed Haris Minai]

[-- Attachment #1.1: Type: text/plain, Size: 1176 bytes --]

Hello,

I am interested in using the graphviz filter in pandocfilters. However, 
currently it uses pygraphviz which unfortunately does not have a windows 
binary. Unfortunately I am constrained to use a windows system for now. 
Would it be a simple task to make a python graphviz filter for pandoc 
without using pygraphviz?

I had a look at the filter and it does use "os." and "sys." calls. I guess 
there should be an easy way to simply issue the dot command on the enclosed 
code. graphviz (dot command) does take STDIN as input and output can be 
redirected to a file.

Thanks.
Mohammad Haris Minai

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/229bfb34-a5bd-4b31-8511-ef9573585990%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 1606 bytes --]

Re: Graphviz python filter without using pygraphviz

[Ivan Lazar Miljenovic]

What does the graphviz filter do?  Just take the raw Dot code and run
it through dot/neato?

I would beware of using the STDIN for dot though: unless osmething has
changed in recent versions it can chew up a _lot_ of memory doing so,
so it's better to use a temporary file.

Maybe have a look at my Haskell graphviz library:
http://hackage.haskell.org/package/graphviz  (though using this would
require parsing the Dot code just to immediately print it again, so
I'm not sure how helpful it would be).

On 20 January 2015 at 22:47, Mohammed Haris Minai <mhminai-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
> Hello,
>
> I am interested in using the graphviz filter in pandocfilters. However,
> currently it uses pygraphviz which unfortunately does not have a windows
> binary. Unfortunately I am constrained to use a windows system for now.
> Would it be a simple task to make a python graphviz filter for pandoc
> without using pygraphviz?
>
> I had a look at the filter and it does use "os." and "sys." calls. I guess
> there should be an easy way to simply issue the dot command on the enclosed
> code. graphviz (dot command) does take STDIN as input and output can be
> redirected to a file.
>
> Thanks.
> Mohammad Haris Minai
>
> --
> You received this message because you are subscribed to the Google Groups
> "pandoc-discuss" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
> To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/pandoc-discuss/229bfb34-a5bd-4b31-8511-ef9573585990%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.



-- 
Ivan Lazar Miljenovic
Ivan.Miljenovic-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
http://IvanMiljenovic.wordpress.com

Re: Graphviz python filter without using pygraphviz

[Mohammed Haris Minai]

[-- Attachment #1.1: Type: text/plain, Size: 1586 bytes --]


The code is here 
<https://github.com/jgm/pandocfilters/blob/master/examples/graphviz.py>. 
From what I could understand:

   1. It creates an object of type pygraphviz.AGraph feeling it the 
   enclosed code from the code block marked as .graphviz
   2. Creates the file name that needs to be written to by reading other 
   arguments from the code block
   3. Writes the "png/pdf" file via pygraphviz to this file.
   4. Modifies the markdown to be an image link pointing to this new file

I would like to get rid of the dependency on pygraphviz, so instead if the 
filter could replace step 3 with a run on "dot" program, something like 
"dot -T{filetype} -o{src} < {code}"
everything should work without depending upon pygraphviz. Note that all 
text delimited by {} is already being formed by the filter.

On Tuesday, January 20, 2015 at 5:35:52 PM UTC+5:30, Ivan Miljenovic wrote:
>
> What does the graphviz filter do?  Just take the raw Dot code and run 
> it through dot/neato? 
>
> (clipped for brevity)

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/03f2dced-9b1e-4a37-ac4b-52d2c7727b8e%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 2360 bytes --]

Re: Graphviz python filter without using pygraphviz

[Mohammed Haris Minai]

[-- Attachment #1.1: Type: text/plain, Size: 1458 bytes --]

I had a look at this, and this could definitely work within a haskell 
filter I believe. There is a has haskell filter (written from within gitit) 
here <http://gitit.net/Dot.hs>.

I am guessing this could be modified to use your graphviz library to 
generate the png/pdf file. If you could provide some examples of how to use 
the library to simply read in some text and then run the dot tool to 
generate a png/pdf file at the specified IO. I can try and modify the 
mentioned haskel filter for my needs?

Thanks again.

On Tuesday, January 20, 2015 at 5:35:52 PM UTC+5:30, Ivan Miljenovic wrote:

(clipped for brevity)

Maybe have a look at my Haskell graphviz library: 
> http://hackage.haskell.org/package/graphviz  (though using this would 
> require parsing the Dot code just to immediately print it again, so 
> I'm not sure how helpful it would be). 
>

(clipped for brevity) 

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/1b3951ec-ae53-4943-a4a9-ed5362dc9434%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 2603 bytes --]

Re: Graphviz python filter without using pygraphviz

[Ivan Lazar Miljenovic]

Is there any reason you can't use that gitit filter directly?

As I said in my previous email, using my library would probably be
overkill due to the need to parse the Dot code and then immediately
print it again (which would only really be useful for a sanity check).

On 21 January 2015 at 23:00, Mohammed Haris Minai <mhminai-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
> I had a look at this, and this could definitely work within a haskell filter
> I believe. There is a has haskell filter (written from within gitit) here.
>
> I am guessing this could be modified to use your graphviz library to
> generate the png/pdf file. If you could provide some examples of how to use
> the library to simply read in some text and then run the dot tool to
> generate a png/pdf file at the specified IO. I can try and modify the
> mentioned haskel filter for my needs?
>
> Thanks again.
>
> On Tuesday, January 20, 2015 at 5:35:52 PM UTC+5:30, Ivan Miljenovic wrote:
>
> (clipped for brevity)
>
>> Maybe have a look at my Haskell graphviz library:
>> http://hackage.haskell.org/package/graphviz  (though using this would
>> require parsing the Dot code just to immediately print it again, so
>> I'm not sure how helpful it would be).
>
>
> (clipped for brevity)
>
> --
> You received this message because you are subscribed to the Google Groups
> "pandoc-discuss" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
> To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/pandoc-discuss/1b3951ec-ae53-4943-a4a9-ed5362dc9434%40googlegroups.com.
>
> For more options, visit https://groups.google.com/d/optout.



-- 
Ivan Lazar Miljenovic
Ivan.Miljenovic-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
http://IvanMiljenovic.wordpress.com

Re: Graphviz python filter without using pygraphviz

[Mohammed Haris Minai]

[-- Attachment #1.1: Type: text/plain, Size: 1573 bytes --]


Well, I am simply completely uncomfortable with Haskell (and python as 
well). Anyway having seen the gitit and the examples john has given I gave 
it a shot.

Am attching the filter (Example.hs), a sample pdc file(input.pdc) and the 
markdown output I get when I use the filter (output.pdc). Somehow my first 
code block is not transformed whereas the second one is. Could someone 
please help me out here.

I compiled Example.hs file using "ghc --make Example.hs" then used:

pandoc --filter ./Example -t markdown input.pdc > output.pdc

This is the first time I have touched haskell code, so please forgive any 
blunders I have made, I have simply tried to combine the gitit plugin with 
some code pointed out earlier to me by jon + some understanding from what 
the pandoc page says about scripting. I almost have no idea how it is even 
working.

On Wednesday, January 21, 2015 at 5:42:33 PM UTC+5:30, Ivan Miljenovic 
wrote:
>
> Is there any reason you can't use that gitit filter directly? 
>

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/b96d2e46-4be0-4725-9276-ed1790ea8c6c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 2138 bytes --]

[-- Attachment #2: input.pdc --]
[-- Type: application/octet-stream, Size: 1044 bytes --]

% Title
% Mohd. Haris Minai
% 25th December, 2015

# This is a level 1 header


~~~ {.dot, name=diagram}

digraph finite_state_machine {
    rankdir=LR;
    size="8,5"
    node [shape = doublecircle]; LR_0 LR_3 LR_4 LR_8;
    node [shape = circle];
    LR_0 -> LR_2 [ label = "SS(B)" ];
    LR_0 -> LR_1 [ label = "SS(S)" ];
    LR_1 -> LR_3 [ label = "S($end)" ];
    LR_2 -> LR_6 [ label = "SS(b)" ];
    LR_2 -> LR_5 [ label = "SS(a)" ];
    LR_2 -> LR_4 [ label = "S(A)" ];
    LR_5 -> LR_7 [ label = "S(b)" ];
    LR_5 -> LR_5 [ label = "S(a)" ];
    LR_6 -> LR_6 [ label = "S(b)" ];
    LR_6 -> LR_5 [ label = "S(a)" ];
    LR_7 -> LR_8 [ label = "S(b)" ];
    LR_7 -> LR_5 [ label = "S(a)" ];
    LR_8 -> LR_6 [ label = "S(b)" ];
    LR_8 -> LR_5a [ label = "S(a)" ];
}

~~~

Some other text in between

~~~ {.dot name=hello}
graph hello2 {

// Hello World with nice colors and big fonts

Node1 [label="Hello, World!", color=Blue, fontcolor=Red,
    fontsize=24, shape=box]
 
}
~~~

~~~{.c name=hello.c}

main () {
print "hello";
}
~~~


[-- Attachment #3: output.pdc --]
[-- Type: application/octet-stream, Size: 842 bytes --]

This is a level 1 header
========================

~\~~ {.dot, name=diagram}

digraph finite\_state\_machine { rankdir=LR; size="8,5" node [shape =
doublecircle]; LR\_0 LR\_3 LR\_4 LR\_8; node [shape = circle]; LR\_0 -\>
LR\_2 [ label = "SS(B)" ]; LR\_0 -\> LR\_1 [ label = "SS(S)" ];
LR\_1 -\> LR\_3 [ label = "S(\$end)" ]; LR\_2 -\> LR\_6 [ label =
"SS(b)" ]; LR\_2 -\> LR\_5 [ label = "SS(a)" ]; LR\_2 -\> LR\_4 [ label
= "S(A)" ]; LR\_5 -\> LR\_7 [ label = "S(b)" ]; LR\_5 -\> LR\_5 [ label
= "S(a)" ]; LR\_6 -\> LR\_6 [ label = "S(b)" ]; LR\_6 -\> LR\_5 [ label
= "S(a)" ]; LR\_7 -\> LR\_8 [ label = "S(b)" ]; LR\_7 -\> LR\_5 [ label
= "S(a)" ]; LR\_8 -\> LR\_6 [ label = "S(b)" ]; LR\_8 -\> LR\_5a [ label
= "S(a)" ]; }

~\~~

Some other text in between

![hello](img/hello.png)

``` {.c name="hello.c"}

main () {
print "hello";
}
```

[-- Attachment #4: Example.hs --]
[-- Type: text/x-haskell, Size: 1121 bytes --]

#!/usr/bin/env haskell

import System.Process (readProcessWithExitCode)
import System.Exit (ExitCode(ExitSuccess))
import Data.ByteString.Lazy.UTF8 (fromString)
-- from the SHA package on HackageDB:
import Data.Digest.Pure.SHA (sha1, showDigest)
import System.FilePath ((</>))
import Control.Monad.Trans (liftIO)
import Text.Pandoc.JSON

transform :: Block -> IO Block
transform (CodeBlock (id, classes, namevals) contents) | "dot" `elem` classes = do
  let (name, outfile) =  case lookup "name" namevals of
                                Just fn   -> ([Str fn], fn ++ ".png")
                                Nothing   -> ([], uniqueName contents ++ ".png")
  liftIO $ do
    (ec, _out, err) <- readProcessWithExitCode "dot" ["-Tpng", "-o", "img/" ++ outfile] contents
    if ec == ExitSuccess
       then return $ Para [Image name ("img/" ++ outfile, "")]
       else error $ "dot returned an error status: " ++ err
transform x = return x

-- | Generate a unique filename given the file's contents.
uniqueName :: String -> String
uniqueName = showDigest . sha1 . fromString

main :: IO ()
main = toJSONFilter transform

Re: Graphviz python filter without using pygraphviz

[Mohammed Haris Minai]

[-- Attachment #1.1: Type: text/plain, Size: 1877 bytes --]

I figured out my mistake. The first codeblock has a comma separating the 
attributes. This somehow causes pandoc to assume this is not a codeblock.

So now the filter works!

On Wednesday, January 21, 2015 at 8:28:39 PM UTC+5:30, Mohammed Haris Minai 
wrote:
>
>
> Well, I am simply completely uncomfortable with Haskell (and python as 
> well). Anyway having seen the gitit and the examples john has given I gave 
> it a shot.
>
> Am attching the filter (Example.hs), a sample pdc file(input.pdc) and the 
> markdown output I get when I use the filter (output.pdc). Somehow my first 
> code block is not transformed whereas the second one is. Could someone 
> please help me out here.
>
> I compiled Example.hs file using "ghc --make Example.hs" then used:
>
> pandoc --filter ./Example -t markdown input.pdc > output.pdc
>
> This is the first time I have touched haskell code, so please forgive any 
> blunders I have made, I have simply tried to combine the gitit plugin with 
> some code pointed out earlier to me by jon + some understanding from what 
> the pandoc page says about scripting. I almost have no idea how it is even 
> working.
>
> On Wednesday, January 21, 2015 at 5:42:33 PM UTC+5:30, Ivan Miljenovic 
> wrote:
>>
>> Is there any reason you can't use that gitit filter directly? 
>>
>

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/ff78de30-d031-4b5b-9021-be32c111db2b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 2551 bytes --]

Re: Graphviz python filter without using pygraphviz

[Ivan Lazar Miljenovic]

Good, especially since I didn't get around to playing with it to see
if I could get it to work :p

On 22 January 2015 at 20:49, Mohammed Haris Minai <mhminai-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
> I figured out my mistake. The first codeblock has a comma separating the
> attributes. This somehow causes pandoc to assume this is not a codeblock.
>
> So now the filter works!
>
>
> On Wednesday, January 21, 2015 at 8:28:39 PM UTC+5:30, Mohammed Haris Minai
> wrote:
>>
>>
>> Well, I am simply completely uncomfortable with Haskell (and python as
>> well). Anyway having seen the gitit and the examples john has given I gave
>> it a shot.
>>
>> Am attching the filter (Example.hs), a sample pdc file(input.pdc) and the
>> markdown output I get when I use the filter (output.pdc). Somehow my first
>> code block is not transformed whereas the second one is. Could someone
>> please help me out here.
>>
>> I compiled Example.hs file using "ghc --make Example.hs" then used:
>>
>> pandoc --filter ./Example -t markdown input.pdc > output.pdc
>>
>> This is the first time I have touched haskell code, so please forgive any
>> blunders I have made, I have simply tried to combine the gitit plugin with
>> some code pointed out earlier to me by jon + some understanding from what
>> the pandoc page says about scripting. I almost have no idea how it is even
>> working.
>>
>> On Wednesday, January 21, 2015 at 5:42:33 PM UTC+5:30, Ivan Miljenovic
>> wrote:
>>>
>>> Is there any reason you can't use that gitit filter directly?
>
> --
> You received this message because you are subscribed to the Google Groups
> "pandoc-discuss" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
> To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/pandoc-discuss/ff78de30-d031-4b5b-9021-be32c111db2b%40googlegroups.com.
>
> For more options, visit https://groups.google.com/d/optout.



-- 
Ivan Lazar Miljenovic
Ivan.Miljenovic-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
http://IvanMiljenovic.wordpress.com