Pandoc + TWiki (writer) output

Pandoc + TWiki (writer) output

[ss infod]

[-- Attachment #1.1: Type: text/plain, Size: 965 bytes --]

Hello, 

I have a small question about Pandoc.

Is there any plan to add the "Twiki Markup" language as an output (writer) 
option ?

If not, do you think it is a big job to add it ?
Is there some kind of dictionnary or script to create if I want to add a 
new output format ?

Would it be a big task to modify dokuwiki format to Twiki ? (both seems 
rather similar..)

Thanks for your input.

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/976a9019-374b-4cc9-b9cf-c2e98e04fed9%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 2260 bytes --]

Re: Pandoc + TWiki (writer) output

[John MacFarlane]

+++ ss infod [Feb 25 17 12:29 ]:
>   Hello,
>   I have a small question about Pandoc.
>   Is there any plan to add the "Twiki Markup" language as an output
>   (writer) option ?

No, not by me anyway.

>   If not, do you think it is a big job to add it ?

Not so big.  You'd probably want to modify the MediaWiki
or ZimWiki or DokuWiki writer (whichever is closer to TWiki
formatting).

The writers live in src/Text/Pandoc/Writers/ if you want to
see what they look like.

You'd need to add a new module here, and also modify
Text.Pandoc accordingly.  Then there'd need to be some
tests and revisions to the manual.

Re: Pandoc + TWiki (writer) output

[John MacFarlane]

PS.  Another approach would be to use a lua custom writer.
See the manual, and see the example in the source
repository, data/sample.lua.

This would probably be quite a bit easier.

+++ John MacFarlane [Feb 25 17 22:38 ]:
>+++ ss infod [Feb 25 17 12:29 ]:
>>  Hello,
>>  I have a small question about Pandoc.
>>  Is there any plan to add the "Twiki Markup" language as an output
>>  (writer) option ?
>
>No, not by me anyway.
>
>>  If not, do you think it is a big job to add it ?
>
>Not so big.  You'd probably want to modify the MediaWiki
>or ZimWiki or DokuWiki writer (whichever is closer to TWiki
>formatting).
>
>The writers live in src/Text/Pandoc/Writers/ if you want to
>see what they look like.
>
>You'd need to add a new module here, and also modify
>Text.Pandoc accordingly.  Then there'd need to be some
>tests and revisions to the manual.
>
>-- 
>You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
>To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
>To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
>To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/20170225213832.GA24756%40Johns-MBP.home.
>For more options, visit https://groups.google.com/d/optout.

Re: Pandoc + TWiki (writer) output

[Joey Dumont]

[-- Attachment #1.1: Type: text/plain, Size: 2410 bytes --]

I'd also be interested in a TWiki writer. I'm clueless about Haskell 
though, so I'd probably go the lua way. 

ss infod, if by any chance you're still subscribed to this thread, let me 
know if you have done any work on this.

Cheers,

On Sunday, February 26, 2017 at 7:45:32 AM UTC-5, John MacFarlane wrote:
>
> PS.  Another approach would be to use a lua custom writer. 
> See the manual, and see the example in the source 
> repository, data/sample.lua. 
>
> This would probably be quite a bit easier. 
>
> +++ John MacFarlane [Feb 25 17 22:38 ]: 
> >+++ ss infod [Feb 25 17 12:29 ]: 
> >>  Hello, 
> >>  I have a small question about Pandoc. 
> >>  Is there any plan to add the "Twiki Markup" language as an output 
> >>  (writer) option ? 
> > 
> >No, not by me anyway. 
> > 
> >>  If not, do you think it is a big job to add it ? 
> > 
> >Not so big.  You'd probably want to modify the MediaWiki 
> >or ZimWiki or DokuWiki writer (whichever is closer to TWiki 
> >formatting). 
> > 
> >The writers live in src/Text/Pandoc/Writers/ if you want to 
> >see what they look like. 
> > 
> >You'd need to add a new module here, and also modify 
> >Text.Pandoc accordingly.  Then there'd need to be some 
> >tests and revisions to the manual. 
> > 
> >-- 
> >You received this message because you are subscribed to the Google Groups 
> "pandoc-discuss" group. 
> >To unsubscribe from this group and stop receiving emails from it, send an 
> email to pandoc-discus...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org <javascript:>. 
> >To post to this group, send email to pandoc-...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org 
> <javascript:>. 
> >To view this discussion on the web visit 
> https://groups.google.com/d/msgid/pandoc-discuss/20170225213832.GA24756%40Johns-MBP.home. 
>
> >For more options, visit https://groups.google.com/d/optout. 
>

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/0dcc0aff-1e6c-4299-a99a-bacdf9535db1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 4225 bytes --]

Re: Pandoc + TWiki (writer) output

[Joey Dumont]

[-- Attachment #1.1: Type: text/plain, Size: 12687 bytes --]

Here's a first version of a custom writer. It doesn't support the whole 
Twiki markup, but it does what I need for the time being. Posted here for 
the Googling dev who wants a simple way to convert from Pandoc to Twiki.

-- 
------------------------------------------------------------------------- --
-- Author:          Joey Dumont         <joey.dumont-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>            
  --
-- Date created:    Dec. 7th, 2018                                          
 --
-- Description:     Custom Lua writer for Pandoc. Outputs TWiki markup.    
  --
-- License:         CC BY-SA 4.0                                            
 --
--                  <http://creativecommons.org/licenses/by-sa/4.0>        
  --
--                                                                          
 --
-- Taken from data/sample.lua in the pandoc GitHub repo.                    
 --
-- 
------------------------------------------------------------------------- --

local pipe = pandoc.pipe
local stringify = (require "pandoc.utils").stringify

-- The global variable PANDOC_DOCUMENT contains the full AST of
-- the document which is going to be written. It can be used to
-- configure the writer.
local meta = PANDOC_DOCUMENT.meta

-- Chose the image format based on the value of the
-- `image_format` meta value.
local image_format = meta.image_format
  and stringify(meta.image_format)
  or "png"
local image_mime_type = ({
    jpeg = "image/jpeg",
    jpg = "image/jpeg",
    gif = "image/gif",
    png = "image/png",
    svg = "image/svg+xml",
  })[image_format]
  or error("unsupported image format `" .. img_format .. "`")

-- Character escaping
local function escape(s, in_attribute)
  return s:gsub("[<>&\"']",
    function(x)
      if x == '<' then
        return '&lt;'
      elseif x == '>' then
        return '&gt;'
      elseif x == '&' then
        return '&amp;'
      elseif x == '"' then
        return '&quot;'
      elseif x == "'" then
        return '&#39;'
      else
        return x
      end
    end)
end

--- Pads str to length len with char from right
local function lpad(str, len, char)
    if char == nil then char = ' ' end
    return str .. string.rep(char, len - #str)
end

-- Replace line breaks with line breaks + 3 spaces.
local function IndentLineBreaks(str)
  str = string.gsub(str, "\n\n","\n")
  str = string.gsub(str, "\n",  "\n    ")
  return str
end

-- Helper function to convert an attributes table into
-- a string that can be put into HTML tags.
local function attributes(attr)
  local attr_table = {}
  for x,y in pairs(attr) do
    if y and y ~= "" then
      table.insert(attr_table, ' ' .. x .. '="' .. escape(y,true) .. '"')
    end
  end
  return table.concat(attr_table)
end

-- Table to store footnotes, so they can be included at the end.
local notes = {}

-- Blocksep is used to separate block elements.
function Blocksep()
  return "\n\n"
end

-- This function is called once for the whole document. Parameters:
-- body is a string, metadata is a table, variables is a table.
-- This gives you a fragment.  You could use the metadata table to
-- fill variables in a custom lua template.  Or, pass `--template=...`
-- to pandoc, and pandoc will add do the template processing as
-- usual.
function Doc(body, metadata, variables)
  local buffer = {}
  local function add(s)
    table.insert(buffer, s)
  end
  add(body)
  if #notes > 0 then
    add('<ol class="footnotes">')
    for _,note in pairs(notes) do
      add(note)
    end
    add('</ol>')
  end
  return table.concat(buffer,'\n') .. '\n'
end

-- The functions that follow render corresponding pandoc elements.
-- s is always a string, attr is always a table of attributes, and
-- items is always an array of strings (the items in a list).
-- Comments indicate the types of other variables.

function Str(s)
  return escape(s)
end

function Space()
  return " "
end

function SoftBreak()
  return " "
end

function LineBreak()
  return "<br/>"
end

function Emph(s)
  return "_" .. s .. "_"
end

function Strong(s)
  return "*" .. s .. "*"
end

function Subscript(s)
  return "<sub>" .. s .. "</sub>"
end

function Superscript(s)
  return "<sup>" .. s .. "</sup>"
end

function SmallCaps(s)
  return '<span style="font-variant: small-caps;">' .. s .. '</span>'
end

function Strikeout(s)
  return '<del>' .. s .. '</del>'
end

function Link(s, src, tit, attr)
  return "[[" .. escape(src,true) .. "][" .. s .. "]]"
end

function Image(s, src, tit, attr)
  return "<img src='" .. escape(src,true) .. "' title='" ..
         escape(tit,true) .. "'/>"
end

function Code(s, attr)
  return "<verbatim>" .. escape(s) .. "</verbatim>"
end

function InlineMath(s)
  return "\\(" .. escape(s) .. "\\)"
end

function DisplayMath(s)
  return "\\[" .. escape(s) .. "\\]"
end

function SingleQuoted(s)
  return "&lsquo;" .. s .. "&rsquo;"
end

function DoubleQuoted(s)
  return "&ldquo;" .. s .. "&rdquo;"
end

function Note(s)
  local num = #notes + 1
  -- insert the back reference right before the final closing tag.
  s = string.gsub(s,
          '(.*)</', '%1 <a href="#fnref' .. num ..  '">&#8617;</a></')
  -- add a list item with the note to the note table.
  table.insert(notes, '<li id="fn' .. num .. '">' .. s .. '</li>')
  -- return the footnote reference, linked to the note.
  return '<a id="fnref' .. num .. '" href="#fn' .. num ..
            '"><sup>' .. num .. '</sup></a>'
end

function Span(s, attr)
  for x,y in pairs(attr) do
    local first = 1
    local last = 1
    if (x == 'class') then
      -- Extract the relevant Twiki macro.
      first,last = string.find(y, 'twiki%-macro ')
      macro_substring = string.sub(y, last+1,string.len(y))

      if (macro_substring == "USERSIG") then
        return '%' .. escape(macro_substring,true) .. '{' .. s .. '}%'
      else
        return '%' .. escape(macro_substring,true) .. '%'
      end
    end
  end
  return "<span" .. attributes(attr) .. ">" .. s .. "</span>"
end

function RawInline(format, str)
  if format == "html" then
    return str
  else
    return ''
  end
end

function Cite(s, cs)
  local ids = {}
  for _,cit in ipairs(cs) do
    table.insert(ids, cit.citationId)
  end
  return "<span class=\"cite\" data-citation-ids=\"" .. table.concat(ids, 
",") ..
    "\">" .. s .. "</span>"
end

function Plain(s)
  return s
end

function Para(s)
  return s
end

-- lev is an integer, the header level.
function Header(lev, s, attr)
  return "---" .. string.rep("+",lev) .. " " .. s
end

function BlockQuote(s)
  return "<blockquote>\n" .. s .. "\n</blockquote>"
end

function HorizontalRule()
  return "<hr/>"
end

function LineBlock(ls)
  return '<div style="white-space: pre-line;">' .. table.concat(ls, '\n') ..
         '</div>'
end

function CodeBlock(s, attr)
  return "<verbatim>" .. escape(s) .. "</verbatim>"
end

function BulletList(items)
  local buffer = {}
  for _, item in pairs(items) do
    table.insert(buffer, "   * " .. IndentLineBreaks(item))
  end
  return table.concat(buffer, "\n")
end

function OrderedList(items)
  local buffer = {}
  for _, item in pairs(items) do
    table.insert(buffer, "   1. " .. IndentLineBreaks(item))
  end
  return table.concat(buffer, "\n")
end

function DefinitionList(items)
  local buffer = {}
  for _,item in pairs(items) do
    local k, v = next(item)
    table.insert(buffer, "   $ " .. k .. ": " .. v)
  end
  return table.concat(buffer, "\n")
end

-- Convert pandoc alignment to something HTML can use.
-- align is AlignLeft, AlignRight, AlignCenter, or AlignDefault.
function html_align(align)
  if align == 'AlignLeft' then
    return 'left'
  elseif align == 'AlignRight' then
    return 'right'
  elseif align == 'AlignCenter' then
    return 'center'
  else
    return 'left'
  end
end

function CaptionedImage(src, tit, caption, attr)
   return '<div class="figure">\n<img src="' .. escape(src,true) ..
      '" title="' .. escape(tit,true) .. '"/>\n' ..
      '<p class="caption">' .. caption .. '</p>\n</div>'
end

-- Caption is a string, aligns is an array of strings,
-- widths is an array of floats, headers is an array of
-- strings, rows is an array of arrays of strings.
-- TODO: Deal with alignment.
function Table(caption, aligns, widths, headers, rows)
  -- Buffer to hold the table, and function to tadd to the buffer.
  local buffer = {}
  local function add(s)
    table.insert(buffer,s)
  end

  -- Determine the longest string in the table, per column.
  local function tablelength(T)
    local count = 0
    for _ in pairs(T) do count = count + 1 end
    return count
  end

  local max_length = {}

  for i,h in pairs(headers) do
    table.insert(max_length,string.len(h))
  end

  for _,row in pairs(rows) do
    for i,c in pairs(row) do
      max_length[i] = string.len(c) > max_length[i] and string.len(c) or 
max_length[i]
    end
  end

  local header_row = {}
  local empty_header = true
  for i, h in pairs(headers) do
    local align = html_align(aligns[i])
    if (align == 'center') then
      table.insert(header_row, "|  *" .. lpad(h,max_length[i]) .. "*  ")
    elseif (align == 'right') then
      table.insert(header_row, "|   *" .. lpad(h,max_length[i]) .. "* ")
    else
      table.insert(header_row, "| *" .. lpad(h,max_length[i]) .. "*  ")
    end
    empty_header = empty_header and h == ""
  end
  table.insert(header_row, " |\n")

  for _,h in pairs(header_row) do
    add(h)
  end

  for _, row in pairs(rows) do
    for i,c in pairs(row) do
      add("| " .. lpad(c,max_length[i]) .. "    ")
    end
    add(" |\n")
  end

  return table.concat(buffer)

end

function RawBlock(format, str)
  if format == "html" then
    return str
  else
    return ''
  end
end

function Div(s, attr)
  return "<div" .. attributes(attr) .. ">\n" .. s .. "</div>"
end

-- The following code will produce runtime warnings when you haven't defined
-- all of the functions you need for the custom writer, so it's useful
-- to include when you're working on a writer.
local meta = {}
meta.__index =
  function(_, key)
    io.stderr:write(string.format("WARNING: Undefined function '%s'\n",key))
    return function() return "" end
  end
setmetatable(_G, meta)





On Thursday, November 29, 2018 at 10:00:50 AM UTC-5, Joey Dumont wrote:
>
> I'd also be interested in a TWiki writer. I'm clueless about Haskell 
> though, so I'd probably go the lua way. 
>
> ss infod, if by any chance you're still subscribed to this thread, let me 
> know if you have done any work on this.
>
> Cheers,
>
> On Sunday, February 26, 2017 at 7:45:32 AM UTC-5, John MacFarlane wrote:
>>
>> PS.  Another approach would be to use a lua custom writer. 
>> See the manual, and see the example in the source 
>> repository, data/sample.lua. 
>>
>> This would probably be quite a bit easier. 
>>
>> +++ John MacFarlane [Feb 25 17 22:38 ]: 
>> >+++ ss infod [Feb 25 17 12:29 ]: 
>> >>  Hello, 
>> >>  I have a small question about Pandoc. 
>> >>  Is there any plan to add the "Twiki Markup" language as an output 
>> >>  (writer) option ? 
>> > 
>> >No, not by me anyway. 
>> > 
>> >>  If not, do you think it is a big job to add it ? 
>> > 
>> >Not so big.  You'd probably want to modify the MediaWiki 
>> >or ZimWiki or DokuWiki writer (whichever is closer to TWiki 
>> >formatting). 
>> > 
>> >The writers live in src/Text/Pandoc/Writers/ if you want to 
>> >see what they look like. 
>> > 
>> >You'd need to add a new module here, and also modify 
>> >Text.Pandoc accordingly.  Then there'd need to be some 
>> >tests and revisions to the manual. 
>> > 
>> >-- 
>> >You received this message because you are subscribed to the Google 
>> Groups "pandoc-discuss" group. 
>> >To unsubscribe from this group and stop receiving emails from it, send 
>> an email to pandoc-discus...-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org 
>> >To post to this group, send email to pandoc-...-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org 
>> >To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/pandoc-discuss/20170225213832.GA24756%40Johns-MBP.home. 
>>
>> >For more options, visit https://groups.google.com/d/optout. 
>>
>

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/8fe99fea-224d-4bb0-ad59-66d04d82324c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 40987 bytes --]

Re: Pandoc + TWiki (writer) output

[Joey Dumont]

[-- Attachment #1.1: Type: text/plain, Size: 1781 bytes --]

I'm having trouble with quotes and what I believe are thin spaces, however. 

For instance, writing "he'll test something" in Markdown, then converting 
to TWiki yields an HTML curly quote instead of a plain ' quote. TWiki then 
freaks and renders that as "he’ll test something"*.*

The string "Dec. 5th" seems to yield a thin space between the period and 
the decimal, but TWiki renders it as "Dec. 5th"

Not sure how to fix this. Tried escaping with escape(s) in multiple places, 
such as Str, Plain and Para, but that didn't work. Tried modifying 
SingleQuoted to return "\'" .. s .. "\'", but that also didn't work. Not 
sure what to do about the thin space either.

On Saturday, February 25, 2017 at 3:29:07 PM UTC-5, ss infod wrote:
>
> Hello, 
>
> I have a small question about Pandoc.
>
> Is there any plan to add the "Twiki Markup" language as an output (writer) 
> option ?
>
> If not, do you think it is a big job to add it ?
> Is there some kind of dictionnary or script to create if I want to add a 
> new output format ?
>
> Would it be a big task to modify dokuwiki format to Twiki ? (both seems 
> rather similar..)
>
> Thanks for your input.
>

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/2ba0d474-f0db-456e-922a-bb7282e60bf5%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 3974 bytes --]

Re: Pandoc + TWiki (writer) output

[John MacFarlane]

This is an encoding issue. It looks like twiki is
generating the right UTF-8 encoded output, but your
browser isn't displaying it as UTF-8.  You should
be able to fix this by ensuring that twiki produces
HTML containing a meta tag that sets the charset to
UTF-8.

Joey Dumont <joey.dumont-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> writes:

> I'm having trouble with quotes and what I believe are thin spaces, however. 
>
> For instance, writing "he'll test something" in Markdown, then converting 
> to TWiki yields an HTML curly quote instead of a plain ' quote. TWiki then 
> freaks and renders that as "he’ll test something"*.*
>
> The string "Dec. 5th" seems to yield a thin space between the period and 
> the decimal, but TWiki renders it as "Dec. 5th"
>
> Not sure how to fix this. Tried escaping with escape(s) in multiple places, 
> such as Str, Plain and Para, but that didn't work. Tried modifying 
> SingleQuoted to return "\'" .. s .. "\'", but that also didn't work. Not 
> sure what to do about the thin space either.
>
> On Saturday, February 25, 2017 at 3:29:07 PM UTC-5, ss infod wrote:
>>
>> Hello, 
>>
>> I have a small question about Pandoc.
>>
>> Is there any plan to add the "Twiki Markup" language as an output (writer) 
>> option ?
>>
>> If not, do you think it is a big job to add it ?
>> Is there some kind of dictionnary or script to create if I want to add a 
>> new output format ?
>>
>> Would it be a big task to modify dokuwiki format to Twiki ? (both seems 
>> rather similar..)
>>
>> Thanks for your input.
>>
>
> -- 
> You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
> To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
> To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/2ba0d474-f0db-456e-922a-bb7282e60bf5%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/yh480kmupdqi08.fsf%40johnmacfarlane.net.
For more options, visit https://groups.google.com/d/optout.

Re: Pandoc + TWiki (writer) output

[Joey Dumont]

[-- Attachment #1.1: Type: text/plain, Size: 3146 bytes --]

Oh. 

It might be my TWiki installation then. Nothing I can really do about that 
though. 

Thanks for the help!

On Monday, December 10, 2018 at 2:49:58 PM UTC-5, John MacFarlane wrote:
>
>
> This is an encoding issue. It looks like twiki is 
> generating the right UTF-8 encoded output, but your 
> browser isn't displaying it as UTF-8.  You should 
> be able to fix this by ensuring that twiki produces 
> HTML containing a meta tag that sets the charset to 
> UTF-8. 
>
> Joey Dumont <joey....-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <javascript:>> writes: 
>
> > I'm having trouble with quotes and what I believe are thin spaces, 
> however. 
> > 
> > For instance, writing "he'll test something" in Markdown, then 
> converting 
> > to TWiki yields an HTML curly quote instead of a plain ' quote. TWiki 
> then 
> > freaks and renders that as "he’ll test something"*.* 
> > 
> > The string "Dec. 5th" seems to yield a thin space between the period and 
> > the decimal, but TWiki renders it as "Dec. 5th" 
> > 
> > Not sure how to fix this. Tried escaping with escape(s) in multiple 
> places, 
> > such as Str, Plain and Para, but that didn't work. Tried modifying 
> > SingleQuoted to return "\'" .. s .. "\'", but that also didn't work. Not 
> > sure what to do about the thin space either. 
> > 
> > On Saturday, February 25, 2017 at 3:29:07 PM UTC-5, ss infod wrote: 
> >> 
> >> Hello, 
> >> 
> >> I have a small question about Pandoc. 
> >> 
> >> Is there any plan to add the "Twiki Markup" language as an output 
> (writer) 
> >> option ? 
> >> 
> >> If not, do you think it is a big job to add it ? 
> >> Is there some kind of dictionnary or script to create if I want to add 
> a 
> >> new output format ? 
> >> 
> >> Would it be a big task to modify dokuwiki format to Twiki ? (both seems 
> >> rather similar..) 
> >> 
> >> Thanks for your input. 
> >> 
> > 
> > -- 
> > You received this message because you are subscribed to the Google 
> Groups "pandoc-discuss" group. 
> > To unsubscribe from this group and stop receiving emails from it, send 
> an email to pandoc-discus...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org <javascript:>. 
> > To post to this group, send email to pandoc-...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org 
> <javascript:>. 
> > To view this discussion on the web visit 
> https://groups.google.com/d/msgid/pandoc-discuss/2ba0d474-f0db-456e-922a-bb7282e60bf5%40googlegroups.com. 
>
> > For more options, visit https://groups.google.com/d/optout. 
>

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/5bffbda3-8281-4247-99c2-3826011ec9ca%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 5288 bytes --]

Re: Pandoc + TWiki (writer) output

[John MacFarlane]

You can always change the 'escape' function in your
custom writer so it outputs ASCII entities instead of
UTF-8 characters.

Joey Dumont <joey.dumont-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> writes:

> Oh. 
>
> It might be my TWiki installation then. Nothing I can really do about that 
> though. 
>
> Thanks for the help!
>
> On Monday, December 10, 2018 at 2:49:58 PM UTC-5, John MacFarlane wrote:
>>
>>
>> This is an encoding issue. It looks like twiki is 
>> generating the right UTF-8 encoded output, but your 
>> browser isn't displaying it as UTF-8.  You should 
>> be able to fix this by ensuring that twiki produces 
>> HTML containing a meta tag that sets the charset to 
>> UTF-8. 
>>
>> Joey Dumont <joey....-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <javascript:>> writes: 
>>
>> > I'm having trouble with quotes and what I believe are thin spaces, 
>> however. 
>> > 
>> > For instance, writing "he'll test something" in Markdown, then 
>> converting 
>> > to TWiki yields an HTML curly quote instead of a plain ' quote. TWiki 
>> then 
>> > freaks and renders that as "he’ll test something"*.* 
>> > 
>> > The string "Dec. 5th" seems to yield a thin space between the period and 
>> > the decimal, but TWiki renders it as "Dec. 5th" 
>> > 
>> > Not sure how to fix this. Tried escaping with escape(s) in multiple 
>> places, 
>> > such as Str, Plain and Para, but that didn't work. Tried modifying 
>> > SingleQuoted to return "\'" .. s .. "\'", but that also didn't work. Not 
>> > sure what to do about the thin space either. 
>> > 
>> > On Saturday, February 25, 2017 at 3:29:07 PM UTC-5, ss infod wrote: 
>> >> 
>> >> Hello, 
>> >> 
>> >> I have a small question about Pandoc. 
>> >> 
>> >> Is there any plan to add the "Twiki Markup" language as an output 
>> (writer) 
>> >> option ? 
>> >> 
>> >> If not, do you think it is a big job to add it ? 
>> >> Is there some kind of dictionnary or script to create if I want to add 
>> a 
>> >> new output format ? 
>> >> 
>> >> Would it be a big task to modify dokuwiki format to Twiki ? (both seems 
>> >> rather similar..) 
>> >> 
>> >> Thanks for your input. 
>> >> 
>> > 
>> > -- 
>> > You received this message because you are subscribed to the Google 
>> Groups "pandoc-discuss" group. 
>> > To unsubscribe from this group and stop receiving emails from it, send 
>> an email to pandoc-discus...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org <javascript:>. 
>> > To post to this group, send email to pandoc-...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org 
>> <javascript:>. 
>> > To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/pandoc-discuss/2ba0d474-f0db-456e-922a-bb7282e60bf5%40googlegroups.com. 
>>
>> > For more options, visit https://groups.google.com/d/optout. 
>>
>
> -- 
> You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
> To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
> To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/5bffbda3-8281-4247-99c2-3826011ec9ca%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/yh480kbm5rj3vq.fsf%40johnmacfarlane.net.
For more options, visit https://groups.google.com/d/optout.

Re: Pandoc + TWiki (writer) output

[Joey Dumont]

[-- Attachment #1.1: Type: text/plain, Size: 4901 bytes --]

I tried that already. My escape function is probably bad then. 

-- Character escaping
local function escape(s, in_attribute)
  return s:gsub("[<>&\"']",
    function(x)
      if x == '<' then
        return '&lt;'
      elseif x == '>' then
        return '&gt;'
      elseif x == '&' then
        return '&amp;'
      elseif x == '"' then
        return ''
      elseif x == "'" then
        return "'"
      else
        return x
      end
    end)
end

Should I put something more specific in the x == "'" and x == '"' fields?

On Tuesday, December 11, 2018 at 1:49:13 PM UTC-5, John MacFarlane wrote:
>
>
> You can always change the 'escape' function in your 
> custom writer so it outputs ASCII entities instead of 
> UTF-8 characters. 
>
> Joey Dumont <joey....-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <javascript:>> writes: 
>
> > Oh. 
> > 
> > It might be my TWiki installation then. Nothing I can really do about 
> that 
> > though. 
> > 
> > Thanks for the help! 
> > 
> > On Monday, December 10, 2018 at 2:49:58 PM UTC-5, John MacFarlane wrote: 
> >> 
> >> 
> >> This is an encoding issue. It looks like twiki is 
> >> generating the right UTF-8 encoded output, but your 
> >> browser isn't displaying it as UTF-8.  You should 
> >> be able to fix this by ensuring that twiki produces 
> >> HTML containing a meta tag that sets the charset to 
> >> UTF-8. 
> >> 
> >> Joey Dumont <joey....-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <javascript:>> writes: 
> >> 
> >> > I'm having trouble with quotes and what I believe are thin spaces, 
> >> however. 
> >> > 
> >> > For instance, writing "he'll test something" in Markdown, then 
> >> converting 
> >> > to TWiki yields an HTML curly quote instead of a plain ' quote. TWiki 
> >> then 
> >> > freaks and renders that as "he’ll test something"*.* 
> >> > 
> >> > The string "Dec. 5th" seems to yield a thin space between the period 
> and 
> >> > the decimal, but TWiki renders it as "Dec. 5th" 
> >> > 
> >> > Not sure how to fix this. Tried escaping with escape(s) in multiple 
> >> places, 
> >> > such as Str, Plain and Para, but that didn't work. Tried modifying 
> >> > SingleQuoted to return "\'" .. s .. "\'", but that also didn't work. 
> Not 
> >> > sure what to do about the thin space either. 
> >> > 
> >> > On Saturday, February 25, 2017 at 3:29:07 PM UTC-5, ss infod wrote: 
> >> >> 
> >> >> Hello, 
> >> >> 
> >> >> I have a small question about Pandoc. 
> >> >> 
> >> >> Is there any plan to add the "Twiki Markup" language as an output 
> >> (writer) 
> >> >> option ? 
> >> >> 
> >> >> If not, do you think it is a big job to add it ? 
> >> >> Is there some kind of dictionnary or script to create if I want to 
> add 
> >> a 
> >> >> new output format ? 
> >> >> 
> >> >> Would it be a big task to modify dokuwiki format to Twiki ? (both 
> seems 
> >> >> rather similar..) 
> >> >> 
> >> >> Thanks for your input. 
> >> >> 
> >> > 
> >> > -- 
> >> > You received this message because you are subscribed to the Google 
> >> Groups "pandoc-discuss" group. 
> >> > To unsubscribe from this group and stop receiving emails from it, 
> send 
> >> an email to pandoc-discus...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org <javascript:>. 
> >> > To post to this group, send email to pandoc-...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org 
> >> <javascript:>. 
> >> > To view this discussion on the web visit 
> >> 
> https://groups.google.com/d/msgid/pandoc-discuss/2ba0d474-f0db-456e-922a-bb7282e60bf5%40googlegroups.com. 
>
> >> 
> >> > For more options, visit https://groups.google.com/d/optout. 
> >> 
> > 
> > -- 
> > You received this message because you are subscribed to the Google 
> Groups "pandoc-discuss" group. 
> > To unsubscribe from this group and stop receiving emails from it, send 
> an email to pandoc-discus...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org <javascript:>. 
> > To post to this group, send email to pandoc-...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org 
> <javascript:>. 
> > To view this discussion on the web visit 
> https://groups.google.com/d/msgid/pandoc-discuss/5bffbda3-8281-4247-99c2-3826011ec9ca%40googlegroups.com. 
>
> > For more options, visit https://groups.google.com/d/optout. 
>

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/8631e4f1-8744-40b4-a3ce-a8d8e1bb0202%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 9341 bytes --]

Re: Pandoc + TWiki (writer) output

[John MacFarlane]

The problem is that lua's gsub is not really UTF-8
aware.  [<>^\"'] will match a single BYTE, but the
quote characters are multibyte.

You can use the functions documented in sec 6.5
here: https://www.lua.org/manual/5.3/manual.html#6.5.

These allow you to iterate over the characters in a
string.

for p, c in utf8.codes(s) do
  -- c is the code point (integer) of the character
end

You can use this to build up a new string, escaping
each code point appropriately.


Joey Dumont <joey.dumont-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> writes:

> I tried that already. My escape function is probably bad then. 
>
> -- Character escaping
> local function escape(s, in_attribute)
>   return s:gsub("[<>&\"']",
>     function(x)
>       if x == '<' then
>         return '&lt;'
>       elseif x == '>' then
>         return '&gt;'
>       elseif x == '&' then
>         return '&amp;'
>       elseif x == '"' then
>         return ''
>       elseif x == "'" then
>         return "'"
>       else
>         return x
>       end
>     end)
> end
>
> Should I put something more specific in the x == "'" and x == '"' fields?
>
> On Tuesday, December 11, 2018 at 1:49:13 PM UTC-5, John MacFarlane wrote:
>>
>>
>> You can always change the 'escape' function in your 
>> custom writer so it outputs ASCII entities instead of 
>> UTF-8 characters. 
>>
>> Joey Dumont <joey....-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <javascript:>> writes: 
>>
>> > Oh. 
>> > 
>> > It might be my TWiki installation then. Nothing I can really do about 
>> that 
>> > though. 
>> > 
>> > Thanks for the help! 
>> > 
>> > On Monday, December 10, 2018 at 2:49:58 PM UTC-5, John MacFarlane wrote: 
>> >> 
>> >> 
>> >> This is an encoding issue. It looks like twiki is 
>> >> generating the right UTF-8 encoded output, but your 
>> >> browser isn't displaying it as UTF-8.  You should 
>> >> be able to fix this by ensuring that twiki produces 
>> >> HTML containing a meta tag that sets the charset to 
>> >> UTF-8. 
>> >> 
>> >> Joey Dumont <joey....-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <javascript:>> writes: 
>> >> 
>> >> > I'm having trouble with quotes and what I believe are thin spaces, 
>> >> however. 
>> >> > 
>> >> > For instance, writing "he'll test something" in Markdown, then 
>> >> converting 
>> >> > to TWiki yields an HTML curly quote instead of a plain ' quote. TWiki 
>> >> then 
>> >> > freaks and renders that as "he’ll test something"*.* 
>> >> > 
>> >> > The string "Dec. 5th" seems to yield a thin space between the period 
>> and 
>> >> > the decimal, but TWiki renders it as "Dec. 5th" 
>> >> > 
>> >> > Not sure how to fix this. Tried escaping with escape(s) in multiple 
>> >> places, 
>> >> > such as Str, Plain and Para, but that didn't work. Tried modifying 
>> >> > SingleQuoted to return "\'" .. s .. "\'", but that also didn't work. 
>> Not 
>> >> > sure what to do about the thin space either. 
>> >> > 
>> >> > On Saturday, February 25, 2017 at 3:29:07 PM UTC-5, ss infod wrote: 
>> >> >> 
>> >> >> Hello, 
>> >> >> 
>> >> >> I have a small question about Pandoc. 
>> >> >> 
>> >> >> Is there any plan to add the "Twiki Markup" language as an output 
>> >> (writer) 
>> >> >> option ? 
>> >> >> 
>> >> >> If not, do you think it is a big job to add it ? 
>> >> >> Is there some kind of dictionnary or script to create if I want to 
>> add 
>> >> a 
>> >> >> new output format ? 
>> >> >> 
>> >> >> Would it be a big task to modify dokuwiki format to Twiki ? (both 
>> seems 
>> >> >> rather similar..) 
>> >> >> 
>> >> >> Thanks for your input. 
>> >> >> 
>> >> > 
>> >> > -- 
>> >> > You received this message because you are subscribed to the Google 
>> >> Groups "pandoc-discuss" group. 
>> >> > To unsubscribe from this group and stop receiving emails from it, 
>> send 
>> >> an email to pandoc-discus...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org <javascript:>. 
>> >> > To post to this group, send email to pandoc-...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org 
>> >> <javascript:>. 
>> >> > To view this discussion on the web visit 
>> >> 
>> https://groups.google.com/d/msgid/pandoc-discuss/2ba0d474-f0db-456e-922a-bb7282e60bf5%40googlegroups.com. 
>>
>> >> 
>> >> > For more options, visit https://groups.google.com/d/optout. 
>> >> 
>> > 
>> > -- 
>> > You received this message because you are subscribed to the Google 
>> Groups "pandoc-discuss" group. 
>> > To unsubscribe from this group and stop receiving emails from it, send 
>> an email to pandoc-discus...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org <javascript:>. 
>> > To post to this group, send email to pandoc-...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org 
>> <javascript:>. 
>> > To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/pandoc-discuss/5bffbda3-8281-4247-99c2-3826011ec9ca%40googlegroups.com. 
>>
>> > For more options, visit https://groups.google.com/d/optout. 
>>
>
> -- 
> You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
> To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
> To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/8631e4f1-8744-40b4-a3ce-a8d8e1bb0202%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/yh480k5zvzj352.fsf%40johnmacfarlane.net.
For more options, visit https://groups.google.com/d/optout.

Re: Pandoc + TWiki (writer) output

[Joey Dumont]

[-- Attachment #1.1: Type: text/plain, Size: 7511 bytes --]

Nice! I added this section to escape(), 

  -- For TWiki installations that don't support Unicode.
  -- We replace some common Unicode-only symbols by their closest ASCII
  -- counterpart.
  for p, c in utf8.codes(s) do
    if (c == 0x2019 or c == 0x2018) then
      new_string = new_string .. "'"
    elseif (c == 0x201C or c == 0x201D) then
      new_string = new_string .. '"'
    elseif (c == 0x00A0) then
      new_string = new_string .. ' '
    else
      new_string = new_string .. utf8.char(c)
    end
  end
  return new_string
end

I haven't gone and fixed accents and stuff, I'll probably add to this as I 
need more.

Thanks John for all the help, it is appreciated. I've attached the full 
custom writer in case somebody wants to build on it. 

Cheers,

On Tuesday, December 11, 2018 at 2:05:12 PM UTC-5, John MacFarlane wrote:
>
>
> The problem is that lua's gsub is not really UTF-8 
> aware.  [<>^\"'] will match a single BYTE, but the 
> quote characters are multibyte. 
>
> You can use the functions documented in sec 6.5 
> here: https://www.lua.org/manual/5.3/manual.html#6.5. 
>
> These allow you to iterate over the characters in a 
> string. 
>
> for p, c in utf8.codes(s) do 
>   -- c is the code point (integer) of the character 
> end 
>
> You can use this to build up a new string, escaping 
> each code point appropriately. 
>
>
> Joey Dumont <joey....-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <javascript:>> writes: 
>
> > I tried that already. My escape function is probably bad then. 
> > 
> > -- Character escaping 
> > local function escape(s, in_attribute) 
> >   return s:gsub("[<>&\"']", 
> >     function(x) 
> >       if x == '<' then 
> >         return '&lt;' 
> >       elseif x == '>' then 
> >         return '&gt;' 
> >       elseif x == '&' then 
> >         return '&amp;' 
> >       elseif x == '"' then 
> >         return '' 
> >       elseif x == "'" then 
> >         return "'" 
> >       else 
> >         return x 
> >       end 
> >     end) 
> > end 
> > 
> > Should I put something more specific in the x == "'" and x == '"' 
> fields? 
> > 
> > On Tuesday, December 11, 2018 at 1:49:13 PM UTC-5, John MacFarlane 
> wrote: 
> >> 
> >> 
> >> You can always change the 'escape' function in your 
> >> custom writer so it outputs ASCII entities instead of 
> >> UTF-8 characters. 
> >> 
> >> Joey Dumont <joey....-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <javascript:>> writes: 
> >> 
> >> > Oh. 
> >> > 
> >> > It might be my TWiki installation then. Nothing I can really do about 
> >> that 
> >> > though. 
> >> > 
> >> > Thanks for the help! 
> >> > 
> >> > On Monday, December 10, 2018 at 2:49:58 PM UTC-5, John MacFarlane 
> wrote: 
> >> >> 
> >> >> 
> >> >> This is an encoding issue. It looks like twiki is 
> >> >> generating the right UTF-8 encoded output, but your 
> >> >> browser isn't displaying it as UTF-8.  You should 
> >> >> be able to fix this by ensuring that twiki produces 
> >> >> HTML containing a meta tag that sets the charset to 
> >> >> UTF-8. 
> >> >> 
> >> >> Joey Dumont <joey....-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <javascript:>> writes: 
> >> >> 
> >> >> > I'm having trouble with quotes and what I believe are thin spaces, 
> >> >> however. 
> >> >> > 
> >> >> > For instance, writing "he'll test something" in Markdown, then 
> >> >> converting 
> >> >> > to TWiki yields an HTML curly quote instead of a plain ' quote. 
> TWiki 
> >> >> then 
> >> >> > freaks and renders that as "he’ll test something"*.* 
> >> >> > 
> >> >> > The string "Dec. 5th" seems to yield a thin space between the 
> period 
> >> and 
> >> >> > the decimal, but TWiki renders it as "Dec. 5th" 
> >> >> > 
> >> >> > Not sure how to fix this. Tried escaping with escape(s) in 
> multiple 
> >> >> places, 
> >> >> > such as Str, Plain and Para, but that didn't work. Tried modifying 
> >> >> > SingleQuoted to return "\'" .. s .. "\'", but that also didn't 
> work. 
> >> Not 
> >> >> > sure what to do about the thin space either. 
> >> >> > 
> >> >> > On Saturday, February 25, 2017 at 3:29:07 PM UTC-5, ss infod 
> wrote: 
> >> >> >> 
> >> >> >> Hello, 
> >> >> >> 
> >> >> >> I have a small question about Pandoc. 
> >> >> >> 
> >> >> >> Is there any plan to add the "Twiki Markup" language as an output 
> >> >> (writer) 
> >> >> >> option ? 
> >> >> >> 
> >> >> >> If not, do you think it is a big job to add it ? 
> >> >> >> Is there some kind of dictionnary or script to create if I want 
> to 
> >> add 
> >> >> a 
> >> >> >> new output format ? 
> >> >> >> 
> >> >> >> Would it be a big task to modify dokuwiki format to Twiki ? (both 
> >> seems 
> >> >> >> rather similar..) 
> >> >> >> 
> >> >> >> Thanks for your input. 
> >> >> >> 
> >> >> > 
> >> >> > -- 
> >> >> > You received this message because you are subscribed to the Google 
> >> >> Groups "pandoc-discuss" group. 
> >> >> > To unsubscribe from this group and stop receiving emails from it, 
> >> send 
> >> >> an email to pandoc-discus...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org <javascript:>. 
> >> >> > To post to this group, send email to pandoc-...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org 
> >> >> <javascript:>. 
> >> >> > To view this discussion on the web visit 
> >> >> 
> >> 
> https://groups.google.com/d/msgid/pandoc-discuss/2ba0d474-f0db-456e-922a-bb7282e60bf5%40googlegroups.com. 
>
> >> 
> >> >> 
> >> >> > For more options, visit https://groups.google.com/d/optout. 
> >> >> 
> >> > 
> >> > -- 
> >> > You received this message because you are subscribed to the Google 
> >> Groups "pandoc-discuss" group. 
> >> > To unsubscribe from this group and stop receiving emails from it, 
> send 
> >> an email to pandoc-discus...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org <javascript:>. 
> >> > To post to this group, send email to pandoc-...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org 
> >> <javascript:>. 
> >> > To view this discussion on the web visit 
> >> 
> https://groups.google.com/d/msgid/pandoc-discuss/5bffbda3-8281-4247-99c2-3826011ec9ca%40googlegroups.com. 
>
> >> 
> >> > For more options, visit https://groups.google.com/d/optout. 
> >> 
> > 
> > -- 
> > You received this message because you are subscribed to the Google 
> Groups "pandoc-discuss" group. 
> > To unsubscribe from this group and stop receiving emails from it, send 
> an email to pandoc-discus...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org <javascript:>. 
> > To post to this group, send email to pandoc-...-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org 
> <javascript:>. 
> > To view this discussion on the web visit 
> https://groups.google.com/d/msgid/pandoc-discuss/8631e4f1-8744-40b4-a3ce-a8d8e1bb0202%40googlegroups.com. 
>
> > For more options, visit https://groups.google.com/d/optout. 
>

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/6a8f82dc-1d9a-473e-ab21-c6ab413a75ba%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[-- Attachment #1.2: Type: text/html, Size: 14007 bytes --]

[-- Attachment #2: PandocTWikiWriter.lua --]
[-- Type: application/octet-stream, Size: 10510 bytes --]

-- ------------------------------------------------------------------------- --
-- Author:          Joey Dumont         <joey.dumont-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>              --
-- Date created:    Dec. 7th, 2018                                           --
-- Description:     Custom Lua writer for Pandoc. Outputs TWiki markup.      --
-- License:         CC BY-SA 4.0                                             --
--                  <http://creativecommons.org/licenses/by-sa/4.0>          --
--                                                                           --
-- Taken from data/sample.lua in the pandoc GitHub repo.                     --
-- ------------------------------------------------------------------------- --

local pipe = pandoc.pipe
local stringify = (require "pandoc.utils").stringify

-- The global variable PANDOC_DOCUMENT contains the full AST of
-- the document which is going to be written. It can be used to
-- configure the writer.
local meta = PANDOC_DOCUMENT.meta

-- Chose the image format based on the value of the
-- `image_format` meta value.
local image_format = meta.image_format
  and stringify(meta.image_format)
  or "png"
local image_mime_type = ({
    jpeg = "image/jpeg",
    jpg = "image/jpeg",
    gif = "image/gif",
    png = "image/png",
    svg = "image/svg+xml",
  })[image_format]
  or error("unsupported image format `" .. img_format .. "`")

-- Character escaping (now with utf-8)
local function escape(s, in_attribute)

  -- We escape home common HTML symbols.
  new_string = ""
  new_string = new_string:gsub("[<>&]",
    function(x)
      if x == '<' then
        return '&lt;'
      elseif x == '>' then
        return '&gt;'
      elseif x == '&' then
        return '&amp;'
      elseif x == '"' then
        return '&quot;'
      elseif x == "'" then
        return '&#39;'
      else
        return x
      end
    end)

  -- For TWiki installations that don't support Unicode.
  -- We replace some common Unicode-only symbols by their closest ASCII
  -- counterpart.
  for p, c in utf8.codes(s) do
    if (c == 0x2019 or c == 0x2018) then
      new_string = new_string .. "'"
    elseif (c == 0x201C or c == 0x201D) then
      new_string = new_string .. '"'
    elseif (c == 0x00A0) then
      new_string = new_string .. '&nbsp;'
    else
      new_string = new_string .. utf8.char(c)
    end
  end
  return new_string
end

--- Pads str to length len with char from right
local function lpad(str, len, char)
    if char == nil then char = ' ' end
    return str .. string.rep(char, len - #str)
end

-- Replace line breaks with line breaks + 3 spaces.
local function IndentLineBreaks(str)
  str = string.gsub(str, "\n\n","\n")
  str = string.gsub(str, "\n",  "\n    ")
  return str
end

-- Helper function to convert an attributes table into
-- a string that can be put into HTML tags.
local function attributes(attr)
  local attr_table = {}
  for x,y in pairs(attr) do
    if y and y ~= "" then
      table.insert(attr_table, ' ' .. x .. '="' .. escape(y,true) .. '"')
    end
  end
  return table.concat(attr_table)
end

-- Table to store footnotes, so they can be included at the end.
local notes = {}

-- Blocksep is used to separate block elements.
function Blocksep()
  return "\n\n"
end

-- This function is called once for the whole document. Parameters:
-- body is a string, metadata is a table, variables is a table.
-- This gives you a fragment.  You could use the metadata table to
-- fill variables in a custom lua template.  Or, pass `--template=...`
-- to pandoc, and pandoc will add do the template processing as
-- usual.
function Doc(body, metadata, variables)
  local buffer = {}
  local function add(s)
    table.insert(buffer, s)
  end
  add(body)
  if #notes > 0 then
    add('<ol class="footnotes">')
    for _,note in pairs(notes) do
      add(note)
    end
    add('</ol>')
  end
  return table.concat(buffer,'\n') .. '\n'
end

-- The functions that follow render corresponding pandoc elements.
-- s is always a string, attr is always a table of attributes, and
-- items is always an array of strings (the items in a list).
-- Comments indicate the types of other variables.

function Str(s)
  return escape(s)
end

function Space()
  return " "
end

function SoftBreak()
  return " "
end

function LineBreak()
  return "<br/>"
end

function Emph(s)
  return "_" .. s .. "_"
end

function Strong(s)
  return "*" .. s .. "*"
end

function Subscript(s)
  return "<sub>" .. s .. "</sub>"
end

function Superscript(s)
  return "<sup>" .. s .. "</sup>"
end

function SmallCaps(s)
  return '<span style="font-variant: small-caps;">' .. s .. '</span>'
end

function Strikeout(s)
  return '<del>' .. s .. '</del>'
end

function Link(s, src, tit, attr)
  return "[[" .. escape(src,true) .. "][" .. s .. "]]"
end

function Image(s, src, tit, attr)
  return "<img src='" .. escape(src,true) .. "' title='" ..
         escape(tit,true) .. "'/>"
end

function Code(s, attr)
  return "<verbatim>" .. escape(s) .. "</verbatim>"
end

function InlineMath(s)
  return "\\(" .. escape(s) .. "\\)"
end

function DisplayMath(s)
  return "\\[" .. escape(s) .. "\\]"
end

function SingleQuoted(s)
  return "&lsquo;" .. s .. "&rsquo;"
end

function DoubleQuoted(s)
  return "&ldquo;" .. s .. "&rdquo;"
end

function Note(s)
  local num = #notes + 1
  -- insert the back reference right before the final closing tag.
  s = string.gsub(s,
          '(.*)</', '%1 <a href="#fnref' .. num ..  '">&#8617;</a></')
  -- add a list item with the note to the note table.
  table.insert(notes, '<li id="fn' .. num .. '">' .. s .. '</li>')
  -- return the footnote reference, linked to the note.
  return '<a id="fnref' .. num .. '" href="#fn' .. num ..
            '"><sup>' .. num .. '</sup></a>'
end

function Span(s, attr)
  for x,y in pairs(attr) do
    local first = 1
    local last = 1
    if (x == 'class') then
      -- Extract the relevant Twiki macro.
      first,last = string.find(y, 'twiki%-macro ')
      macro_substring = string.sub(y, last+1,string.len(y))

      if (macro_substring == "USERSIG") then
        return '%' .. escape(macro_substring,true) .. '{' .. s .. '}%'
      else
        return '%' .. escape(macro_substring,true) .. '%'
      end
    end
  end
  return "<span" .. attributes(attr) .. ">" .. s .. "</span>"
end

function RawInline(format, str)
  if format == "html" then
    return str
  else
    return ''
  end
end

function Cite(s, cs)
  local ids = {}
  for _,cit in ipairs(cs) do
    table.insert(ids, cit.citationId)
  end
  return "<span class=\"cite\" data-citation-ids=\"" .. table.concat(ids, ",") ..
    "\">" .. s .. "</span>"
end

function Plain(s)
  return s
end

function Para(s)
  return s
end

-- lev is an integer, the header level.
function Header(lev, s, attr)
  return "---" .. string.rep("+",lev) .. " " .. s
end

function BlockQuote(s)
  return "<blockquote>\n" .. s .. "\n</blockquote>"
end

function HorizontalRule()
  return "<hr/>"
end

function LineBlock(ls)
  return '<div style="white-space: pre-line;">' .. table.concat(ls, '\n') ..
         '</div>'
end

function CodeBlock(s, attr)
  return "<verbatim>" .. escape(s) .. "</verbatim>"
end

function BulletList(items)
  local buffer = {}
  for _, item in pairs(items) do
    table.insert(buffer, "   * " .. IndentLineBreaks(item))
  end
  return table.concat(buffer, "\n")
end

function OrderedList(items)
  local buffer = {}
  for _, item in pairs(items) do
    table.insert(buffer, "   1. " .. IndentLineBreaks(item))
  end
  return table.concat(buffer, "\n")
end

function DefinitionList(items)
  local buffer = {}
  for _,item in pairs(items) do
    local k, v = next(item)
    table.insert(buffer, "   $ " .. k .. ": " .. v)
  end
  return table.concat(buffer, "\n")
end

-- Convert pandoc alignment to something HTML can use.
-- align is AlignLeft, AlignRight, AlignCenter, or AlignDefault.
function html_align(align)
  if align == 'AlignLeft' then
    return 'left'
  elseif align == 'AlignRight' then
    return 'right'
  elseif align == 'AlignCenter' then
    return 'center'
  else
    return 'left'
  end
end

function CaptionedImage(src, tit, caption, attr)
   return '<div class="figure">\n<img src="' .. escape(src,true) ..
      '" title="' .. escape(tit,true) .. '"/>\n' ..
      '<p class="caption">' .. caption .. '</p>\n</div>'
end

-- Caption is a string, aligns is an array of strings,
-- widths is an array of floats, headers is an array of
-- strings, rows is an array of arrays of strings.
-- TODO: Deal with alignment.
function Table(caption, aligns, widths, headers, rows)
  -- Buffer to hold the table, and function to tadd to the buffer.
  local buffer = {}
  local function add(s)
    table.insert(buffer,s)
  end

  -- Determine the longest string in the table, per column.
  local function tablelength(T)
    local count = 0
    for _ in pairs(T) do count = count + 1 end
    return count
  end

  local max_length = {}

  for i,h in pairs(headers) do
    table.insert(max_length,string.len(h))
  end

  for _,row in pairs(rows) do
    for i,c in pairs(row) do
      max_length[i] = string.len(c) > max_length[i] and string.len(c) or max_length[i]
    end
  end

  local header_row = {}
  local empty_header = true
  for i, h in pairs(headers) do
    local align = html_align(aligns[i])
    if (align == 'center') then
      table.insert(header_row, "|  *" .. lpad(h,max_length[i]) .. "*  ")
    elseif (align == 'right') then
      table.insert(header_row, "|   *" .. lpad(h,max_length[i]) .. "* ")
    else
      table.insert(header_row, "| *" .. lpad(h,max_length[i]) .. "*  ")
    end
    empty_header = empty_header and h == ""
  end
  table.insert(header_row, " |\n")

  for _,h in pairs(header_row) do
    add(h)
  end

  for _, row in pairs(rows) do
    for i,c in pairs(row) do
      add("| " .. lpad(c,max_length[i]) .. "    ")
    end
    add(" |\n")
  end

  return table.concat(buffer)

end

function RawBlock(format, str)
  if format == "html" then
    return str
  else
    return ''
  end
end

function Div(s, attr)
  return "<div" .. attributes(attr) .. ">\n" .. s .. "</div>"
end

-- The following code will produce runtime warnings when you haven't defined
-- all of the functions you need for the custom writer, so it's useful
-- to include when you're working on a writer.
local meta = {}
meta.__index =
  function(_, key)
    io.stderr:write(string.format("WARNING: Undefined function '%s'\n",key))
    return function() return "" end
  end
setmetatable(_G, meta)