Re: WIP: better citation processing

[Joseph Reagle <joseph.2011-T1oY19WcHSwdnm+yROfE0A@public.gmane.org>]

On 8/21/20 3:06 PM, John MacFarlane wrote:
> The new library will speed up 2, but it won't affect 1, and I
> suspect 1 is the bottleneck for you.

I hadn't noticed the performance drop given I continued subsetting my readings.yaml into a document specific yaml file.

> Here's a workaround that should work right now.  Reading CSL JSON
> is fast, so you could try using pandoc-citeproc -j to convert
> your YAML bibliography to CSL, then refer to the CSL bibliography
> in your pandoc metadata.

It could help, but doesn't practically.

Creating a subset of my full bibliography for a document and building a single ref markdown to HTML takes 1 second, which is great for frequent edits/builds of my markdown.

Using the full YAML bibliography takes 90 seconds. 

Converting the full bibliography from YAML to JSON with pandoc-citeproc takes a similar 90 seconds and then running the simple single-ref document build with the resulting JSON never exits -- I killed it after four minutes. Perhaps this is because I typically include the bibliography file as a second input file. (I forget why I do this, there's probably something on this list's archives from years ago.)

Using the `--bibliography=FILE` approach has much better performance. My full YAML build takes 35 seconds, and the JSON takes 1 second -- similar to subsetting the YAML. However, adding 90 seconds to convert from YAML to JSON every time I edit my bibliography is a big hit. 

-- 
You received this message because you are subscribed to the Google Groups "pandoc-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/91c2cfed-7211-4194-72cf-5c01abf2315c%40reagle.org.