From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.text.pandoc/26082 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: John MacFarlane Newsgroups: gmane.text.pandoc Subject: Re: WIP: better citation processing Date: Tue, 08 Sep 2020 11:15:53 -0700 Message-ID: References: <360dbe5b-f1ef-17f6-32e6-8c9f85204844@mailbox.org> <865f327e-d305-4409-dd6f-1659f6a884cc@mailbox.org> Reply-To: pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="11262"; mail-complaints-to="usenet@ciao.gmane.io" To: Denis Maier , pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org Original-X-From: pandoc-discuss+bncBCJZJHG45QDBBZUU375AKGQEK5PXYXQ-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org Tue Sep 08 20:16:12 2020 Return-path: Envelope-to: gtp-pandoc-discuss@m.gmane-mx.org Original-Received: from mail-il1-f187.google.com ([209.85.166.187]) by ciao.gmane.io with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1kFiA6-0002mj-R9 for gtp-pandoc-discuss@m.gmane-mx.org; Tue, 08 Sep 2020 20:16:10 +0200 Original-Received: by mail-il1-f187.google.com with SMTP id m1sf12770936iln.19 for ; Tue, 08 Sep 2020 11:16:10 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1599588969; cv=pass; d=google.com; s=arc-20160816; b=LuJHBIuADI7eYwLp1zplA4EyM5EktBPe6NuqFHbm9eoXlrJpYD7dPnqAeY0E1rIkmq AA6dJH9J7MTCLPWuPoVIGe24IXGyeIS8NEfrVb9kMTs8r0dhtA3JX9prTuTCx5ix0HhG PHat2Wat6384xAbpnmBsEEdeke6DSi8xxkEExWBkAk3oEAQa1q2hsCRcCrgVh9y+z7wB FbaPi+PBTaQxociu3P7fgXHFE1dlytpE86wNWX5u6KRQLCkvAHiZnjz0J4l7/D5k6Y0I cU7L1UuF4tGT3+w5m26Ta7qowXQONvBwSB144nHceu69aMx1LILnqTotfvbk+W0iVDBS M4YQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:mime-version:message-id :date:references:in-reply-to:subject:to:from:sender:dkim-signature; bh=3azBBrFcUx5CbFzJQczJBoDhBDF+jctw6z7jadF2eU4=; b=cWP2sFNMK0n9dKcZ627YBwuhGHmpg/K9sgMmHNZ2FQ7vOz4xKryOjWu5ZAXPIUyl0j uB4gqSN4Y2Iu87CArcujHuvinfqZDKYmqjb5C+zcdQP33FQZRWPYhW/dhsP5z+hRtsAj ThTDTO0iafG7LODFdX94vq4ts04nZ0HKqIxEVxqIBpXjOhWrvU++HjLyMFqffwmOaiNW UYZZZxELpjpsaPx1UPrcxBGLmRxiwZeO+dNFYbXJb+jSEs6ZLG7fMkJJEXbCEDP83poo fR9Y9lGO3PKE28kZcTVspGKOTGkopHsc3J8xj8YQDZoedAfffkVYCOexu2Wig0Z7IK6s H8uA== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@berkeley-edu.20150623.gappssmtp.com header.s=20150623 header.b=FOiDAX5S; spf=pass (google.com: domain of jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org designates 2607:f8b0:4864:20::42b as permitted sender) smtp.mailfrom=jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=sender:from:to:subject:in-reply-to:references:date:message-id :mime-version:x-original-sender:x-original-authentication-results :reply-to:precedence:mailing-list:list-id:list-post:list-help :list-archive:list-subscribe:list-unsubscribe; bh=3azBBrFcUx5CbFzJQczJBoDhBDF+jctw6z7jadF2eU4=; b=QEbwUAkZgNI+auXhQxJNzZUVysrtgGJLKvYXE0GMVxDT0gBxl/OTYHniJxPxqmR1IF Hhp1lsueSYQMJRPGyItCx6nwQGuJtbS2VH1gb07x1cc0s0U4ogKX9FeRgDMw8gpbYmLi zW0kIfb5kIO77DpKpsgYhziDf6NdU4ESjIOBXWaevcbUyFGUbWFof1sguihRAyoSn/YM up0QkkLy+D/849x3ofycZ2xmOf0ZSm2PvKIK00DysS5dxs7VGHarnnGMx/BBDxAJ4ts3 +97yoZQ3vdtm8YOT8OfzkxT9FJBH8Wb/Dg1GI5e2h3XNKwv8NIqV/Fbn6RlgHESZk3Uz Inyw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=sender:x-gm-message-state:from:to:subject:in-reply-to:references :date:message-id:mime-version:x-original-sender :x-original-authentication-results:reply-to:precedence:mailing-list :list-id:x-spam-checked-in-group:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=3azBBrFcUx5CbFzJQczJBoDhBDF+jctw6z7jadF2eU4=; b=SQrvU71X7Exrtv2PP97I0/nAcl4aa+IhFGB7CynPdft17MpdwEDsWITlmfL+nibklP /KTTa58kstsmhYbzq3rsmt+ii3mrHc+upGpDYsAebBoaNHiKL6hj3BWoC9w397NYKV8P tjInKfGhVVCp+p8jZvF6QD7j6YiUZaRvUonPnnZk2WE+DBBfT7HQNWFsk9ZbiQkqfOft dSWHXAi5IqRuHPyKWMLpBOHzSD8Au+bdLjzjYH2Ovl4M0c1lAlDfn41DlPsbRoiBxgei REmytKiQ0DZyZUCIP76+RgIWbMHcnQcIjcQPrIgfw4XlbQhHSWl+KZbye9jpQUQshUR/ D/Dg== Original-Sender: pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org X-Gm-Message-State: AOAM533EW0JrJyzwbZZg87DOSYObuvTQKgonkEKjtYnpXnGkh3FthyOn /FytcicAIc6YN3LrDyQAPqM= X-Google-Smtp-Source: ABdhPJzSF8B51X9BSv54EI1lrvLl5mVgZJMSElp0sGnI201uoyexfD3agIr+HwrrMb+jJmUkD2m38w== X-Received: by 2002:a05:6e02:e4e:: with SMTP id l14mr45127ilk.10.1599588969789; Tue, 08 Sep 2020 11:16:09 -0700 (PDT) X-BeenThere: pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org Original-Received: by 2002:a92:5bce:: with SMTP id c75ls30727ilg.8.gmail; Tue, 08 Sep 2020 11:16:06 -0700 (PDT) X-Received: by 2002:a92:85d7:: with SMTP id f206mr44567ilh.34.1599588966583; Tue, 08 Sep 2020 11:16:06 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1599588966; cv=none; d=google.com; s=arc-20160816; b=WzD+JDLGcNP8fkxi9Jsm0O0OE5AbnqzeqV1RqBfxPg0o+OYy6UCD+qqAqMGSKSQGfx OsC7LwAVeFEPkX6wiozRAe9xI4Dwzp9p31JAU+tuKo0dGY0tRB+WfQUrB50PqdYYOS99 L3dNahREoE4LR+XpJvSrmx9LOQLvttlirlt9cmBhx0sifX/gVprCwpQ/2qFUF0HP8TKF pHJvmu9J6kMX0826NwaNQASL3mL/id3ciqFn1MqYMlDv6JHy3SV5WVZQ3lE9vZqkSeRO OaGa+pKy/TB4r1hUsB2ZXnB2MZFDVh4we7G/tq8TWWsPSwWXLHVDVdqTpEY9yvonCCwK 5ntQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:message-id:date:references:in-reply-to:subject:to:from :dkim-signature; bh=YaA5VO7pjw2qYelfY8HJjHrwcEv/Y09SxFdEfkrV/3s=; b=Hw+a3aNCAVloEyr7/sjZuVknbkzyWxO/ByKNRzVQmVUZd6gjcVImRgL/rkWXSg0den 7oV4VaqGERY8k7rcrSPVIj/6d9VmzXnO55ZhSY+/Yh+kVyIeEdeCcPfpqtrbudjTv0SL MyjW7g/digatr7djFjfWRi1eqfzR7YUBk0J6gfaDu/LtC1HqzbcLQ5RayIk/EQsaal5l yuX0X6Mb5leHp8CE5hQwgM1bMHz6c49lAcu9U5M9EveX0ULGyB8b/+PfcMrm+40mju5V mWXvOlOdNmA+jydJE9rZwrArAwhocPTSxp9b46yZIMG44046Vb78b9GSj3dZAW0bLOT9 fRKw== ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@berkeley-edu.20150623.gappssmtp.com header.s=20150623 header.b=FOiDAX5S; spf=pass (google.com: domain of jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org designates 2607:f8b0:4864:20::42b as permitted sender) smtp.mailfrom=jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org Original-Received: from mail-pf1-x42b.google.com (mail-pf1-x42b.google.com. [2607:f8b0:4864:20::42b]) by gmr-mx.google.com with ESMTPS id e82si24689ill.2.2020.09.08.11.16.06 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 08 Sep 2020 11:16:06 -0700 (PDT) Received-SPF: pass (google.com: domain of jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org designates 2607:f8b0:4864:20::42b as permitted sender) client-ip=2607:f8b0:4864:20::42b; Original-Received: by mail-pf1-x42b.google.com with SMTP id f18so11634341pfa.10 for ; Tue, 08 Sep 2020 11:16:06 -0700 (PDT) X-Received: by 2002:a65:55c6:: with SMTP id k6mr11006pgs.49.1599588965493; Tue, 08 Sep 2020 11:16:05 -0700 (PDT) Original-Received: from johnmacfarlane.net (li55-134.members.linode.com. [74.82.3.134]) by smtp.gmail.com with ESMTPSA id z7sm116663pfj.75.2020.09.08.11.16.04 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 08 Sep 2020 11:16:04 -0700 (PDT) Original-Received: by johnmacfarlane.net (Postfix, from userid 1000) id CA3FCA2A1; Tue, 8 Sep 2020 14:15:53 -0400 (EDT) In-Reply-To: <865f327e-d305-4409-dd6f-1659f6a884cc-cl+VPiYnx/1AfugRpC6u6w@public.gmane.org> X-Original-Sender: jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@berkeley-edu.20150623.gappssmtp.com header.s=20150623 header.b=FOiDAX5S; spf=pass (google.com: domain of jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org designates 2607:f8b0:4864:20::42b as permitted sender) smtp.mailfrom=jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org Precedence: list Mailing-list: list pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org; contact pandoc-discuss+owners-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org List-ID: X-Google-Group-Id: 1007024079513 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , Xref: news.gmane.io gmane.text.pandoc:26082 Archived-At: Progress report: I have put the library at jgm/citeproc on GitHub. It still doesn't pass all the CSL tests, and it needs some work, but I think it's already quite a bit better than pandoc-citeproc. I've also been working on a version of pandoc that integrates the library (so that pandoc-citeproc won't be needed). That work is happening in the citeproc branch at jgm/pandoc. When I get a bit farther, I'll make a binary available so people can try it out. Citation processing will happen automatically if your document contains `bibliography` or `references` in the metadata, or if you use `--bibliography` on the command line. This is _much_ faster than using pandoc-citeproc. The pandoc-citeproc executable could also be used to convert between bibliographic formats. I'm planning to integrate that capability into pandoc, too. So, you can convert a bibtex bibliography to CSL json using `pandoc -f bibtex -t csljson`. You'll also be able to do, e.g., `pandoc -f bibtex -t html` to get a formatted HTML version of your bibliography. Denis Maier writes: > Am 21.08.2020 um 21:41 schrieb John MacFarlane: >>> That sounds amazing. As you know CSL 1.0.2 is about to appear soon, and >>> 1.1 is also already pretty advanced. It would be great if it were easy >>> to integrate the new features in your library. >> Is there a list of changes in CSL 1.0.2 somewhere, so I can see >> what will need to be supported when it comes out? >> > > Yeah, there's a summary of changes here: > https://docs.google.com/document/d/1wY1cOOamDYYh8VNW7h_uleqieBDGOa_LYsRiVdQy1RI/edit#heading=h.wsywjzy5t4j6 > > As you can see it's a terms, types and variables release. That should be > trivial to support. (There were some changes to that list due to > comments during the comments period so that's not the final list of > changes.) > > 1.1 will be more complex, but we plan to document the new features with > a detailled changelog and new tests in the test-suite.