Re: Update on new citation processing -- please help test!

[John MacFarlane <jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org>]

Joseph Reagle <joseph.2011-T1oY19WcHSwdnm+yROfE0A@public.gmane.org> writes:

> On 10/4/20 11:42 AM, John MacFarlane wrote:
>> I think you'll notice quite a few improvements in citation
>> processing, both in accuracy and speed.
>
> In terms of speed, it's about 40% slower when run with my big YAML bibliography and typical parameters.

Hm, what version of pandoc are you running normally? I know that
our shift a little while back from the (C library) yaml to the
(pure Haskell) HsYAML for YAML metadata parsing had a big cost
for large bibliographies.  See

https://github.com/jgm/pandoc/issues/6084

My guess is that the slowdown you're seeing is from pandoc's YAML
metadata parsing (not part of the new library) and not the
library itself.  You could test this hyphothesis by trying both
versions with a CSL JSON bibliography.  (Conveniently, you can
use pandoc to convert the YAML to csljson.)

> Also, something is different with respect to locating the CSL file.

Yes. I should have mentioned this.  It now looks the csl
subdirectory of your pandoc user data directory (~/.pandoc or
~/.local/share/pandoc) instead of in ~/.csl.  You can just
symlink one to the other for now, so both versions will work.

    ln -s ~/.csl ~/.pandoc/csl