From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.text.pandoc/26994 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Ivan Kochurkin Newsgroups: gmane.text.pandoc Subject: Re: Binary version of native AST instead of JSON Date: Tue, 24 Nov 2020 11:52:07 -0800 (PST) Message-ID: <640f505c-39a8-4d2e-92e8-6d485b2cf41en@googlegroups.com> References: <1eb0d4b6-0500-4cf2-a3d0-d5442bb31afan@googlegroups.com> Reply-To: pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_30_381221076.1606247527374" Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="29218"; mail-complaints-to="usenet@ciao.gmane.io" To: pandoc-discuss Original-X-From: pandoc-discuss+bncBDK5HEWTRQARB2GI6X6QKGQEH224TSQ-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org Tue Nov 24 20:52:11 2020 Return-path: Envelope-to: gtp-pandoc-discuss@m.gmane-mx.org Original-Received: from mail-oi1-f183.google.com ([209.85.167.183]) by ciao.gmane.io with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1kheMF-0007SP-Q5 for gtp-pandoc-discuss@m.gmane-mx.org; Tue, 24 Nov 2020 20:52:11 +0100 Original-Received: by mail-oi1-f183.google.com with SMTP id t185sf8423375oif.20 for ; Tue, 24 Nov 2020 11:52:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=sender:date:from:to:message-id:in-reply-to:references:subject :mime-version:x-original-sender:reply-to:precedence:mailing-list :list-id:list-post:list-help:list-archive:list-subscribe :list-unsubscribe; bh=944yaAhpptEMBEWsW0QPX1BOsmWWNsJGCm4W871XwDI=; b=dEg1Yc2LBAlNQHwCQ+nVIiFS62/06fPhrUOgkAYs238bLZ+ymM8o3CkkVwIOIE11zw R4IRaHnfuYrG6iJ8rxCHvmEGrkZf/6syeHaCgfqgX4QHw5Px1AmTBrY4KLiSoNen3pRV eddqVwvDpvIR1pnncLzA15b/wWgr/QKLB8QFk5m1oTEHHrPki9K/p85phwH8DhWJ0hDC eflrjYcLMg7LLUyXO3VwZ7Hhnsemi9Cu6UHYKsUnHZXKq7qUgRRAV36DwF1buXA3QNQH jHoOOMi/AOW969rJ1z6ZYKXGdPTD2vqxrLFlmmjUeTNxYmORImOMJsIwyUlS6hRWxf9n XO9w== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:message-id:in-reply-to:references:subject:mime-version :x-original-sender:reply-to:precedence:mailing-list:list-id :list-post:list-help:list-archive:list-subscribe:list-unsubscribe; bh=944yaAhpptEMBEWsW0QPX1BOsmWWNsJGCm4W871XwDI=; b=EQwCd82q82HENaZzYfikvxtwYc/ObVGnD60KrL4wwSJ0JphgEQqsogedMoQgWx8bUU TFiACoZrs506ULPoVhFOvOpQK6bw8Tra5gZgjTK743UdiTETt9PHyNRrYJOAUCTU1S/W 3orI0EJbF8+Y1cGK6Fr3LbhHR2WIykj18OFu9MnUb24Tm1UluEv4V8/cYyWBGkcc0dP+ 8E+Wkbs3kr8c7HA2NsW0gW3wlwG/Uts7bjCVGL5zDI7YmcpoVNChcT6bw3xzcjd3vtAH 2xAQiQwGbh3adSubECH+kuCGTk18GoHvXjp6W6SpeWLwm3m1kVo5HqysenIUpcsbhWI7 Vf3A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=sender:x-gm-message-state:date:from:to:message-id:in-reply-to :references:subject:mime-version:x-original-sender:reply-to :precedence:mailing-list:list-id:x-spam-checked-in-group:list-post :list-help:list-archive:list-subscribe:list-unsubscribe; bh=944yaAhpptEMBEWsW0QPX1BOsmWWNsJGCm4W871XwDI=; b=SZq+/Az9UYV8wU4BaaRmvsQeGkOqrKRfKIKEYSrHwUnYzyb4BeH++ZJi7er+3TOI+H CQ9snLcYhdoAwNUMeKQ3ByA3/fIv2jZFhURskTKDSA96Nji0W0tZyIkxVeABEUqfwp6g LEJAWdEV9xCyaxdwKa/r7UVSgGCq0XuT+V7REcd7YsXxNDlPDqtlM4T929856EuGj2cp aPIZGo5PRN974Pw+/GafwQYk2nbFJ8bocgbLvhZJFrYvD4H48To50n9U1Y1kG1CyGVrF M+ucYL9fDBlgwf0wdlry8D/FlQAWc4Qd0jpAoRshKdTPsDiyEheS0LlOHdc/NQ0LxH5E upsg== Original-Sender: pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org X-Gm-Message-State: AOAM530kDRTS/VbLVsg//8JjRdi31otNnWRBK5aUDwSmlFcdeiYGoEHf gJsyiktcVHktCo6QYG/PtH8= X-Google-Smtp-Source: ABdhPJwy2FMbeqnAnOSTZ7hQVSTWXuZA7ijmd+fcGJZHSwDONoNVjRsKkHKRzje+0cY5Pj4xyhT/JQ== X-Received: by 2002:aca:ab93:: with SMTP id u141mr145984oie.19.1606247530791; Tue, 24 Nov 2020 11:52:10 -0800 (PST) X-BeenThere: pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org Original-Received: by 2002:a4a:3558:: with SMTP id w24ls1159651oog.5.gmail; Tue, 24 Nov 2020 11:52:08 -0800 (PST) X-Received: by 2002:a4a:cf08:: with SMTP id l8mr67407oos.29.1606247528041; Tue, 24 Nov 2020 11:52:08 -0800 (PST) In-Reply-To: X-Original-Sender: ivan.kochurkin-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org Precedence: list Mailing-list: list pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org; contact pandoc-discuss+owners-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org List-ID: X-Google-Group-Id: 1007024079513 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , Xref: news.gmane.io gmane.text.pandoc:26994 Archived-At: ------=_Part_30_381221076.1606247527374 Content-Type: multipart/alternative; boundary="----=_Part_31_1906167106.1606247527374" ------=_Part_31_1906167106.1606247527374 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Where did you find information about proprietary? Wikipedia says it's=20 licensed under Apache , Protobuf= =20 is licensed under BSD . =D0=B2=D1=82=D0=BE=D1=80=D0=BD=D0=B8=D0=BA, 24 =D0=BD=D0=BE=D1=8F=D0=B1=D1= =80=D1=8F 2020 =D0=B3. =D0=B2 22:24:27 UTC+3, Leonard Rosenthol:=20 > A binary serialization of the AST would only really be useful in the=20 > context of storing it away for some reason - and you'd be better served= =20 > saving something like (compressed) pandoc markdown instead. > > Also, be aware that protobuf and messagepack are both proprietary=20 > specifications. If you are looking for an open standard in this area, tr= y=20 > CBOR (https://tools.ietf.org/html/rfc7049). > > Leonard > > > On Tue, Nov 24, 2020 at 1:07 PM John MacFarlane wrote= : > >> >> Ivan Kochurkin writes: >> >> > Maybe it makes sense to use Protobuf=20 >> > or MessagePack=20 >> > format. >> > >> > It can be important in cases where performance is critical. >> >> We could do this, but my guess is that it's not worth the >> effort. The time it takes to serialize/deserialize JSON is >> generally dwarfed by the other parts of the pandoc pipeline >> (especially parsing). >> >> Note that if performance is an issue, lua filters (which >> avoid the JSON intermediate) will generally be quite a bit >> faster than regular filters. >> >> --=20 >> You received this message because you are subscribed to the Google Group= s=20 >> "pandoc-discuss" group. >> To unsubscribe from this group and stop receiving emails from it, send a= n=20 >> email to pandoc-discus...-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org >> To view this discussion on the web visit=20 >> https://groups.google.com/d/msgid/pandoc-discuss/m25z5ubpcq.fsf%40MacBoo= k-Pro.hsd1.ca.comcast.net >> . >> > --=20 You received this message because you are subscribed to the Google Groups "= pandoc-discuss" group. To unsubscribe from this group and stop receiving emails from it, send an e= mail to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org To view this discussion on the web visit https://groups.google.com/d/msgid/= pandoc-discuss/640f505c-39a8-4d2e-92e8-6d485b2cf41en%40googlegroups.com. ------=_Part_31_1906167106.1606247527374 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Where did you find information about proprietary? Wikipedia says it's licen= sed under Apache,= Protobuf is licensed under BSD.

=D0=B2=D1=82=D0=BE=D1=80=D0=BD=D0=B8=D0=BA, 24 =D0=BD=D0= =BE=D1=8F=D0=B1=D1=80=D1=8F 2020 =D0=B3. =D0=B2 22:24:27 UTC+3, Leonard Ros= enthol:
A binary serialization of the AST would only really be useful = in the context of storing it away for some reason - and you'd be better= served saving something like (compressed) pandoc markdown instead.
Also, be aware that protobuf and messagepack are both proprieta= ry specifications.=C2=A0 If you are looking for an open standard in this ar= ea, try CBOR (https://= tools.ietf.org/html/rfc7049).

Leonard


On Tue, Nov 24, 2020 at 1:07 P= M John MacFarlane <j...@berke= ley.edu> wrote:

Ivan Kochurkin <ivan.ko...@gm= ail.com> writes:

> Maybe it makes sense to use Protobuf
> <https://developers.google.com/protocol-buffers>o= r MessagePack
> <https://msgpack.org/>form= at.
>
> It can be important in cases where performance is critical.

We could do this, but my guess is that it's not worth the
effort. The time it takes to serialize/deserialize JSON is
generally dwarfed by the other parts of the pandoc pipeline
(especially parsing).

Note that if performance is an issue, lua filters (which
avoid the JSON intermediate) will generally be quite a bit
faster than regular filters.

--
You received this message because you are subscribed to the Google Groups &= quot;pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an e= mail to pandoc-discus...@googleg= roups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/m25z5ubpcq.fsf%40Ma= cBook-Pro.hsd1.ca.comcast.net.

--
You received this message because you are subscribed to the Google Groups &= quot;pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an e= mail to pand= oc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org.
To view this discussion on the web visit https://groups.google.com/d= /msgid/pandoc-discuss/640f505c-39a8-4d2e-92e8-6d485b2cf41en%40googlegroups.= com.
------=_Part_31_1906167106.1606247527374-- ------=_Part_30_381221076.1606247527374--