From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.text.pandoc/28618 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: John MacFarlane Newsgroups: gmane.text.pandoc Subject: Re: WIP: better citation processing Date: Wed, 16 Jun 2021 12:33:18 -0700 Message-ID: References: <30abf74d-df6f-4df8-aaee-a493331d4e92n@googlegroups.com> Reply-To: pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="36231"; mail-complaints-to="usenet@ciao.gmane.io" To: Joseph , pandoc-discuss Original-X-From: pandoc-discuss+bncBCJZJHG45QDBBC5EVGDAMGQECLP6MRQ-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org Wed Jun 16 21:33:34 2021 Return-path: Envelope-to: gtp-pandoc-discuss@m.gmane-mx.org Original-Received: from mail-pj1-f62.google.com ([209.85.216.62]) by ciao.gmane.io with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1ltbI5-0009FD-Lk for gtp-pandoc-discuss@m.gmane-mx.org; Wed, 16 Jun 2021 21:33:33 +0200 Original-Received: by mail-pj1-f62.google.com with SMTP id e12-20020a17090a630cb029016de1736f41sf4630262pjj.3 for ; Wed, 16 Jun 2021 12:33:33 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1623872012; cv=pass; d=google.com; s=arc-20160816; b=aZ0YVzTV4RnKScXSfaRP5oGdQzjU8Wd6N7AarirkTCrhH7FQeJZVLGU7cG8KA1xK+j sugMMkES3tAUVToMv+kgTCslgRZ76qdq+hdy6ezNtoMHScd1YLjhCoe6FkfmjK88TFyo TxxprGGF4dclxY8BgTVO3tBGk4A73a7IUK176EdboSzibMlDHd7zdbhA4D0ZmPsA6chC PIiGXVpWDJLavZDAXjOk/HW1wZqXm8oLJASFc6nd+KC8aJLxZH+v+4r2suHrfCCoibT0 R/oTxp5hTy6YT29I7OBZdyDAVQI1MxKDDimdUh97Vvq+tZK9Gxvp9pzTCf9n12oSw9i+ 5CvA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:content-transfer-encoding :mime-version:message-id:date:references:in-reply-to:subject:to:from :sender:dkim-signature; bh=h4OFqJU/jdA/eBpl1jP2dBZWGbRaLvUSJDT79SZEEqw=; b=ehfGlRKZNioFggzZaDaI2w26V7fx2A6fqicMgHLvCJApqgDIiWxXYPg9qN/EnZfjy1 7SuniYuURzRKzrh+Kbgg9vZONoLaV7MR//ZOrwa1O/lZI/GZYMjQrOuGqabNIZiLkR/y ba9+X8nB0dERMuDeHJHhV/LQhhdO9IEf31XbgyfWg9HfMR8Z4DKLy7FxRfvfiDrTpf5t ByWl0UymaFbamVVbyZIkDq3IwNGgbkh8UELJa0ydC8bIw+c9MZD+lE/k8e6jZHSOui+f iqWYBALNZMeo5hXHz0E123lS0GAEmCy6QNQMSpI+OiYo8KvBMaMueV4Wfei8djORx+oD Svww== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@berkeley-edu.20150623.gappssmtp.com header.s=20150623 header.b=g6K1mUSh; spf=pass (google.com: domain of jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org designates 2607:f8b0:4864:20::629 as permitted sender) smtp.mailfrom=jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=sender:from:to:subject:in-reply-to:references:date:message-id :mime-version:content-transfer-encoding:x-original-sender :x-original-authentication-results:reply-to:precedence:mailing-list :list-id:list-post:list-help:list-archive:list-subscribe :list-unsubscribe; bh=h4OFqJU/jdA/eBpl1jP2dBZWGbRaLvUSJDT79SZEEqw=; b=Zt3fltWx8lsQo4e1wvCAijVnv870oK7c543q1c7TWfG1mdtLesFiVgn4WUVPzgGlA/ /yDXrTp6/84D/D8rZ1ihoy+b1aQcUI+EuUzyTYFhv6mKdICRvkt6ATidEJJsh8YQQq1u G9EGJmdGOW1bEcsVcyUDOR1BA86b96dpjOGIKYW1qTp8T0mnEbsIRrhbAnxW6lMwoCZH gIpinTC+mlDEf4sM6JwO1v2H7r+Y1+hwcTC18HDZY/E0wLj3pZBBICiQZH3n5DMRwPwd v1tsl9WQquMsYP9r480bZQxcs+gpPdeluurlMS3u50ctZy6DfVodyMPG/vjLBBrzNVQz oGZQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=sender:x-gm-message-state:from:to:subject:in-reply-to:references :date:message-id:mime-version:content-transfer-encoding :x-original-sender:x-original-authentication-results:reply-to :precedence:mailing-list:list-id:x-spam-checked-in-group:list-post :list-help:list-archive:list-subscribe:list-unsubscribe; bh=h4OFqJU/jdA/eBpl1jP2dBZWGbRaLvUSJDT79SZEEqw=; b=Nhfaa1/3TNb+vlnjmXQ+xUh7oUw/IYq0ExWqyRnOu53CvwNAICIztllI9Khqa6/MWQ xUqtigCg+Sv41ZQmCUWHKoIBCdYXN4GFD/tuhlHOwcNzsVgus+2lK8VTuPqgVFhMEIJ5 bd9CWo4MaO9BZB+p+h6n9esn+AmYfkKIXVQ7cH6WQtGi/e3Rx5c/HoOoA35OetQEATwn 2g3NJXCicb/oDrPWJj5bxPUidB4ylv2OwCFmmdxN3pBAoMseIp6AKDWziB0bp4ZX6COb nvypiBvFQ9dUD6d4utf2Pqs33uh5cUyeLW/PS592z7xHsZT5EIzXxFa0aNtcZqGjCfyt Original-Sender: pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org X-Gm-Message-State: AOAM53060IymZ/ZVQlgXczg4KjJuaa9eyJLu0+G5ukKgDfwbwLwZf3rA kHFTaBcDokLETyRSj32kz1Q= X-Google-Smtp-Source: ABdhPJxdP0Qo9/xHudiRi+eFcPTbXLAmXIKiJPLbgQFWyWSwTLoT8wcYZuIEfdE9aLT6tFutmy5p7A== X-Received: by 2002:a17:903:1243:b029:ed:8298:7628 with SMTP id u3-20020a1709031243b02900ed82987628mr1068452plh.11.1623872012543; Wed, 16 Jun 2021 12:33:32 -0700 (PDT) X-BeenThere: pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org Original-Received: by 2002:a17:903:20d4:: with SMTP id i20ls1667480plb.8.gmail; Wed, 16 Jun 2021 12:33:30 -0700 (PDT) X-Received: by 2002:a17:90a:e2d4:: with SMTP id fr20mr12631662pjb.92.1623872010657; Wed, 16 Jun 2021 12:33:30 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1623872010; cv=none; d=google.com; s=arc-20160816; b=gVYIMnPhA6Wu9BuFku9vP5Nwl7mA7uNjOfUiaxOpTEzpqhGqwpxpQO2nU6ox6S+Puv 21kVcReDxy5s8uCw9sST7c0nUo4ioleoEuD8VzylynPcWjJSJj5P7OBiPWEt2rpoD95U Ou1B0tw7jVodJcisruBIwvTHsS5cEUFNSzM3DwHRMHU7/QYJ9Q+MEFnFDyygvUxcJDnK u9U5Vr+ke1tkTiCxMNjJZK7PNh43TKSm0srX6SeE3ZrmKz5+UikZlyMIWxXYagsFAlwY YHt0GvR3PYOdcBY2zW6287UNcX2ihhSBrN0SkgFkept18MaLpkQqL6bygMoxjZGyw1T3 g+Ig== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:to:from:dkim-signature; bh=/DyZITdXCrLLQwoBH92lV8OvULV+n5E9PNdHTYKOPzs=; b=A5U9WGg/BntOXepTZJqvpB9IBY3WvYsjQtSv17ghyMgs83iEy/PvPlqdn9Zmn4IA7c +ZHLphMt15A5BDq4hVVo8GleLRyoKc4Jzg7cb+kDFc7Wd5YXxlVnHpTHkuySRmHZAUR0 zY3jlb0yLJjXw99fHYrKhSc6EGn718QR/QOohEkfFTFu+XMQsMYz0XY2Q28H4I/vdfjG 5sJGeeoAlyzOwc4t7OsncKjjEYmof0BkcP8lgcUbPczRnEYe4B0qQfsnX8YESU+tRmE8 r7AAZ5CbG/CUGUFRDxfua2MNer/ZUAC1uRcorgbVCmE9KRqFcNxQWv1aq3lNbCZKrGho 85Sg== ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@berkeley-edu.20150623.gappssmtp.com header.s=20150623 header.b=g6K1mUSh; spf=pass (google.com: domain of jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org designates 2607:f8b0:4864:20::629 as permitted sender) smtp.mailfrom=jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org Original-Received: from mail-pl1-x629.google.com (mail-pl1-x629.google.com. [2607:f8b0:4864:20::629]) by gmr-mx.google.com with ESMTPS id k78si243325pfd.5.2021.06.16.12.33.30 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 16 Jun 2021 12:33:30 -0700 (PDT) Received-SPF: pass (google.com: domain of jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org designates 2607:f8b0:4864:20::629 as permitted sender) client-ip=2607:f8b0:4864:20::629; Original-Received: by mail-pl1-x629.google.com with SMTP id u18so1665077plc.0 for ; Wed, 16 Jun 2021 12:33:30 -0700 (PDT) X-Received: by 2002:a17:902:c1d2:b029:101:656b:8c06 with SMTP id c18-20020a170902c1d2b0290101656b8c06mr1044253plc.77.1623872009657; Wed, 16 Jun 2021 12:33:29 -0700 (PDT) Original-Received: from johnmacfarlane.net (li55-134.members.linode.com. [74.82.3.134]) by smtp.gmail.com with ESMTPSA id c5sm3062468pfn.144.2021.06.16.12.33.28 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 16 Jun 2021 12:33:28 -0700 (PDT) Original-Received: by johnmacfarlane.net (Postfix, from userid 1000) id 11F27A23E; Wed, 16 Jun 2021 15:33:18 -0400 (EDT) In-Reply-To: <30abf74d-df6f-4df8-aaee-a493331d4e92n-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org> X-Original-Sender: jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@berkeley-edu.20150623.gappssmtp.com header.s=20150623 header.b=g6K1mUSh; spf=pass (google.com: domain of jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org designates 2607:f8b0:4864:20::629 as permitted sender) smtp.mailfrom=jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org Precedence: list Mailing-list: list pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org; contact pandoc-discuss+owners-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org List-ID: X-Google-Group-Id: 1007024079513 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , Xref: news.gmane.io gmane.text.pandoc:28618 Archived-At: See https://github.com/jgm/pandoc/issues/6084 You could try grabbing an old pandoc-citeproc binary (from before we started using HsYAML) and use it to convert your YAML to bibtex or csljson. Joseph writes: > I subset my YAML bibliography into document-specific bibliographies based= =20 > on keys used in the corresponding markdown file. Otherwise, it takes pand= oc=20 > too long to parse the ~6MB YAML bibliography.=20 > > Since I had to update my "find citation keys in markdown files" script, I= =20 > thought I'd look in on performance of the YAML and JSON parsing.=20 > `pandoc-citeproc` isn't around anymore, and pandoc itself chokes on=20 > converting from YAML to CSLJSON. Something killed it off after four=20 > minutes. Is there an alternative for creating CSLJSON? > > ``` > =E2=95=B0=E2=94=80=E2=9E=A4 time pandoc -f markdown --citeproc -t csljso= n readings.yaml=20 > [2] 28124 killed pandoc -f markdown --citeproc -t csljson=20 > readings.yaml > pandoc -f markdown --citeproc -t csljson readings.yaml 265.51s user 70.2= 3s=20 > system 48% cpu 11:31.15 total > ``` > > --=20 > You received this message because you are subscribed to the Google Groups= "pandoc-discuss" group. > To unsubscribe from this group and stop receiving emails from it, send an= email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org > To view this discussion on the web visit https://groups.google.com/d/msgi= d/pandoc-discuss/30abf74d-df6f-4df8-aaee-a493331d4e92n%40googlegroups.com. --=20 You received this message because you are subscribed to the Google Groups "= pandoc-discuss" group. To unsubscribe from this group and stop receiving emails from it, send an e= mail to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org To view this discussion on the web visit https://groups.google.com/d/msgid/= pandoc-discuss/m24kdx38qp.fsf%40MacBook-Pro-2.hsd1.ca.comcast.net.