From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.text.pandoc/16017 Path: news.gmane.org!.POSTED!not-for-mail From: Kolen Cheung Newsgroups: gmane.text.pandoc Subject: Re: Markdown, tables and CSV Date: Mon, 14 Nov 2016 15:32:16 -0800 (PST) Message-ID: <620ebba4-4753-4909-a0a2-cc3f2218cc26@googlegroups.com> References: <047d7b86ebe83c062b05332eab9b@google.com> <20BF19CB-A2B0-4B19-A749-D750CDD89736@martinfenner.org> <14b8fa54-dc04-4874-bf47-fb268fc9f298@googlegroups.com> Reply-To: pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org NNTP-Posting-Host: blaine.gmane.org Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_3148_1315429414.1479166336521" X-Trace: blaine.gmane.org 1479166358 26544 195.159.176.226 (14 Nov 2016 23:32:38 GMT) X-Complaints-To: usenet@blaine.gmane.org NNTP-Posting-Date: Mon, 14 Nov 2016 23:32:38 +0000 (UTC) To: pandoc-discuss Original-X-From: pandoc-discuss+bncBCS252WXTEIBBAMTVHAQKGQEPMZQSMA-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org Tue Nov 15 00:32:34 2016 Return-path: Envelope-to: gtp-pandoc-discuss@m.gmane.org Original-Received: from mail-pa0-f60.google.com ([209.85.220.60]) by blaine.gmane.org with esmtp (Exim 4.84_2) (envelope-from ) id 1c6QjW-000427-N1 for gtp-pandoc-discuss@m.gmane.org; Tue, 15 Nov 2016 00:32:14 +0100 Original-Received: by mail-pa0-f60.google.com with SMTP id ha6sf16757439pac.1 for ; Mon, 14 Nov 2016 15:32:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20120806; h=sender:date:from:to:message-id:in-reply-to:references:subject :mime-version:x-original-sender:reply-to:precedence:mailing-list :list-id:x-spam-checked-in-group:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=38/73F5ZON0RJkSz1K0J2rwD3XFLpSoO5FehFJcOTAs=; b=Guq8A2FSyj0l7ewNgVEfaSoQhniZt9fc5a6QfT5dYgs7QF1oEdw1Bv/32RiLnlAi+d FmjPBFfok4uryeIuXZE16y5nOxIR1RuKsdTUvKdjOwrfuI8SSA7v7k/4YjHLyRD4+5Xb yKo1yJnob8n4lZVezElS8QqZCxSTTtrxU2bJa5w1R3NqpIXYZPfu+qH62ua4ScMzgraM kNYX2ofLtV74DS3l9HqAJ7Ut9J+aMHJ3F67oMhxAVzFv1//uHFo7YgH9ZPNNkO9aGPWC yl/sCS7Gr7WUPOkrbYamfK9v6qnk98SJitBwg/l+W9EBxPCgoNSkngGpsnfjf0eF0fl9 hMUg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:message-id:in-reply-to:references:subject:mime-version :x-original-sender:reply-to:precedence:mailing-list:list-id :x-spam-checked-in-group:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=38/73F5ZON0RJkSz1K0J2rwD3XFLpSoO5FehFJcOTAs=; b=DqEbfYQFRpz/i4+U3zOR9rAo6D8EyJA88NliJC7E82LmZlAVhWN/izm3oRWy+IZZyk oKz8bJ61gOaevH8Rlw5fkEuxlAze7voHy8yppcj+IGupH1juOqHAGClxZ/Rcqs1RFWOL anednBv9iweG27dFAsqSqNWNKNZcfykhzQIlUp1w3+qUQjgiJVgg4byLMMbwc/30o8S+ tzMuOPnFPcKpruPJmjFXrla+yEu7Qo4CsZaa0sNZrdFiHdJAHV6MjSVs3jk7M7ZnKVN9 fqfbXzprWs3lfiWpG44Jlz6JY2YV8yjlXdJL72QveUYB7JhsaIBR4nu9YlGfE9BsmV6D 4twQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=sender:x-gm-message-state:date:from:to:message-id:in-reply-to :references:subject:mime-version:x-original-sender:reply-to :precedence:mailing-list:list-id:x-spam-checked-in-group:list-post :list-help:list-archive:list-subscribe:list-unsubscribe; bh=38/73F5ZON0RJkSz1K0J2rwD3XFLpSoO5FehFJcOTAs=; b=Ag/5qUOZefk7kILqJkzmL/VTide3vS9pYwJnY3ucBbWySkDaSlWwBxi8cjTeiMTK+L qqnYFFGniIiu6b99XT2VI3WU2eptRIrU7l606L5myFiTnjX1BTxcLoH75tC2j7oE9l5z AQtlYBT6eS6I+T9JPLisbBXGE9mwfePRart2H+8GMQcIH3ljPS/0TCvQ8l1TahtoIMRS YdSnGEdqSenkX7Xv+N7KqrY9+3sf2JDBGhsJ8gUM5EzU3OxsxdGjkAlYhYhR54Qsow8r R8qIfJd3ckmGvJ9FzqIxjPJGmZZRZ8SuVXLx7oJmXmX9CMuLw5UbbH0aLbr0OhCM1Ctp CEyg== Original-Sender: pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org X-Gm-Message-State: ABUngvc2G+b9Aro9DWzFlAAqLSBL/xPrrq+j/YcjTjLl9obESxgglSQpqCitnpjF2pxGIg== X-Received: by 10.157.39.129 with SMTP id c1mr1267803otb.15.1479166337720; Mon, 14 Nov 2016 15:32:17 -0800 (PST) X-BeenThere: pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org Original-Received: by 10.157.4.76 with SMTP id 70ls2421518otc.32.gmail; Mon, 14 Nov 2016 15:32:17 -0800 (PST) X-Received: by 10.157.60.235 with SMTP id t40mr1269117otf.0.1479166337223; Mon, 14 Nov 2016 15:32:17 -0800 (PST) In-Reply-To: X-Original-Sender: christian.kolen-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org Precedence: list Mailing-list: list pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org; contact pandoc-discuss+owners-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org List-ID: X-Google-Group-Id: 1007024079513 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , Xref: news.gmane.org gmane.text.pandoc:16017 Archived-At: ------=_Part_3148_1315429414.1479166336521 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Great insight. This is the disadvantage of the easiness or writing filters,= together with the fact that they are decentralized. The result is the desi= gn of filters usually only go through a brief period and not a lot of input= from the others. While syntaxes and features in pandoc took a long time to= discuss and settle, it focuses on the big picture (both in terms of syntax= and generality). I find it difficult to find a solution to the problem, here's my thought: First, consider only CSV tables, I think it is actually more natural to wri= te a CSV reader rather than a filter, hence it will read a csv file and con= vert it to AST on cli. I suggested it to pandoc-placetable and I think I sh= ould do the same to mine. Whether or not it will make into pandoc is irrele= vant (but I very much hope so!), the important point is it becomes a reader= that turns CSV into AST. Then the second part would be most useful: define= a standard syntax that *everyone* will be happy with, that includes arbitr= ary raw formats in the markdown source. (There were already efforts on, say= , raw TeX because sometimes pandoc will accidentally parsed the TeX. )The p= oint here is to provide a syntax such that it is clear that the following c= odeblock will be included (HTML, LaTeX, rst, even docx with a file name, et= c.) and optionally parsed by the reader pandoc/filter knows (for binary for= mat, parsing will be mandatory). Second, that's why I suggested here and there (#2 misc idea on panflute) th= at there should be a centralized filter gallery. The point is not all filte= rs should go to there (you can't force them anyway), but that for people ca= re enough to share filters for reuse together will go through the design *t= ogether*. People can have their own repo for testing or even distributing o= ver standard channel like cabal/pip, but when they submitted to the gallery= , it will be santinized (for security/quality). It doesn't mean it will be = very rigorous either (who has the time to do that?), but as long as it is c= entralized, the awareness of the other filters in the repo will also remind= them to think about the big picture (currently it is very difficult to hav= e a big picture of the current filters, which is why I started to catalog c= urrent filters and hopes to analyze them). And then the issue tracker there= may also serves as a discussion on creating fitlers (or may be just here). Lastly, this is most difficult but exciting. Bringing a analogy from LaTeX:= something like the memoir class will be awesome. i.e. a certain guy knows = the existing filters and use cases enough, and has good taste and the skill= s, and have enough time and will to do it: a big filter that is general eno= ugh to do most of the things and has a syntax clear and general enough to b= uild compatible filters to use with it. (by the way, currently the compatib= ility between filters is not known, at least not well documented.) To summaries, the ability to use filters (on internal AST) is what sets apa= rt pandoc. But it has a lot of potential than currently realized. To bring = the analogy from TeX and LaTeX again, filter+pandoc can be like La+TeX. P.S. I realized I digressed, only the 1st point belongs to this thread, the= others should probably belongs to the "ecosystem" thread. --=20 You received this message because you are subscribed to the Google Groups "= pandoc-discuss" group. To unsubscribe from this group and stop receiving emails from it, send an e= mail to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org To post to this group, send email to pandoc-discuss-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org To view this discussion on the web visit https://groups.google.com/d/msgid/= pandoc-discuss/620ebba4-4753-4909-a0a2-cc3f2218cc26%40googlegroups.com. For more options, visit https://groups.google.com/d/optout. ------=_Part_3148_1315429414.1479166336521--