From mboxrd@z Thu Jan 1 00:00:00 1970 X-Msuck: nntp://news.gmane.io/gmane.text.pandoc/29454 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: John MacFarlane Newsgroups: gmane.text.pandoc Subject: Re: problems with markdown to epub Date: Tue, 02 Nov 2021 19:35:22 -0700 Message-ID: References: <77fa1b8f-2ae4-4b15-afc2-22be2c4b0bc9n@googlegroups.com> Reply-To: pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="29004"; mail-complaints-to="usenet@ciao.gmane.io" To: David Peng , pandoc-discuss Original-X-From: pandoc-discuss+bncBCJZJHG45QDBB57KQ6GAMGQE5NEYYAY-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org Wed Nov 03 03:35:38 2021 Return-path: Envelope-to: gtp-pandoc-discuss@m.gmane-mx.org Original-Received: from mail-qv1-f56.google.com ([209.85.219.56]) by ciao.gmane.io with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1mi67l-0007Ko-QB for gtp-pandoc-discuss@m.gmane-mx.org; Wed, 03 Nov 2021 03:35:37 +0100 Original-Received: by mail-qv1-f56.google.com with SMTP id p10-20020a0cc3ca000000b0038559d56582sf1090014qvi.18 for ; Tue, 02 Nov 2021 19:35:37 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1635906937; cv=pass; d=google.com; s=arc-20160816; b=YaYDoIRqti/+XcQRMyCijUZVEaDfhq4CBTzkyf6SodYUklKvxGeiospgZILEy6f4tc ORK6w9cl4C1c31Flk9wfrG3c+mf2C4GBJOOiXqvirq/4fsxhcArcj5KnA4D4J+sqTI01 bpVhL9APlZWC+YKGBjUVMB7/PFScBHOzC8rCK4EPLqJvlc++22VyXuu6y8KZ2JzYYZLf TYtxc5VjMTLbkFudxJD75Vh9/LKghtkGxDoBhIUJxfweLOSvRjWhw4JwNIfmCE2STTwx Y+SpuKunks66Wl7+AK0ELTXbKyP8tlToLBMUqapBqwrp0//wVnoP6uxULhKDeTO+aack u08w== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:mime-version:message-id :date:references:in-reply-to:subject:to:from:sender:dkim-signature; bh=ZqN56oDeHdxFLEzEnN+klRNNccgF0kihIh1bUEyUark=; b=g1WfetQlkLQe7zrZkc/W/6Q8xYcUE41ht+4vznMn+qox9Jns+RiESUY63BC7Dal5Dk I2C477XrLy+jGteJGCuodN9hsrhzxf29kjD8son3yH0TnvBfcA7qqqFyp6Ww7FKmHna6 T1Iwc5KG7UPU4tp8U0iRdA99gyB+4ExxU6cefLea3mNkE2nB9hzqjKR+xhfb5JT0KhJ3 RZWYHCVlyP4zlHhWHTu9kpSYckNynSPYGZxTVLtUXWUzAut19cSRrNxHopuyJUhdHLPO Iy790jaFZzYaktSQSgQMICaf1HQ6b8PPvbF6UCWfWwmtNCckEnJQnfUHWU62YuYjrlV4 MBSQ== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@berkeley-edu.20210112.gappssmtp.com header.s=20210112 header.b=hr2x9qaM; spf=pass (google.com: domain of jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org designates 2607:f8b0:4864:20::42b as permitted sender) smtp.mailfrom=jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20210112; h=sender:from:to:subject:in-reply-to:references:date:message-id :mime-version:x-original-sender:x-original-authentication-results :reply-to:precedence:mailing-list:list-id:list-post:list-help :list-archive:list-subscribe:list-unsubscribe; bh=ZqN56oDeHdxFLEzEnN+klRNNccgF0kihIh1bUEyUark=; b=Ycj+YaUwp6zNfKfjB3bAGZizc1mpxH34zkBCJU2zyz4xE4fvegXRYXlyDWOnpvp3K/ 7mwfCP9Z0bY/ZAiOOziTpnSG7jniSC6BUEQ4LPAyZlUkgyfzDdm9cRWyhROJ6a4Dlrdn WEDaEdk/iqnlkNWWcZGdm8Nz/f+UapW7o7wAK8wrQE/49iF8sBvKB5pLchQz+W7zqjRL oZEPTvO9pkq/pEKBVv73Jj9w1PmQSYp3AZ3SwQiAO1n5UXPFeoNaw9HsdOOV+eUW2uiT vWBl6x+BtH3DvJO9Mwg9VYInUVg7XVCNkD/SOLTT41cTcMIYAQshL1Ndz+YDckts2IEU IUWw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=sender:x-gm-message-state:from:to:subject:in-reply-to:references :date:message-id:mime-version:x-original-sender :x-original-authentication-results:reply-to:precedence:mailing-list :list-id:x-spam-checked-in-group:list-post:list-help:list-archive :list-subscribe:list-unsubscribe; bh=ZqN56oDeHdxFLEzEnN+klRNNccgF0kihIh1bUEyUark=; b=aEH67xp611Xxi4aw85Ft/e/02moFHPUsA/Dr7WbIeIOss+SmY+5gC0aTh/VVmB8xiC N8SyR32KOvA6PhMxSJinfgzk6qKTQZu//vv3lV3xnu7w1i2W9w0GpIzDFgmNVODB3Bm2 zzg49hislGSfWoOby0LrFSWGINrT/QgT81ny05pq6HF1VnKcsw6OHe9+/00pDDSscd8P KSCBib9WqdZ256STUUtCFcXE6rBhhmZn1a1v2b/4+6AGDJSz1xisEEQyy1hKz3rcdF2E z5OwDT7KHL+lHDLWSKuOAkoJkojV21XZhKt3rM04sPHJ0YnTPSaYwJmiuaIOTpHSkrJ1 nOsg== Original-Sender: pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org X-Gm-Message-State: AOAM531feQe28lx+ACujg6njdD1pIVWlsb8r0WwHNQYot57nN5Tr8O6m cREn+pleyHDW42EVojSmdY0= X-Google-Smtp-Source: ABdhPJyz+A9QqhZY5xrZ5cJ4GGg6VFdXgVqfs6+XbwkaqUIXJIrCQ21sVW6lP4QTFECrXGApULQE2A== X-Received: by 2002:a05:620a:e06:: with SMTP id y6mr32965391qkm.163.1635906936876; Tue, 02 Nov 2021 19:35:36 -0700 (PDT) X-BeenThere: pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org Original-Received: by 2002:a0c:f00c:: with SMTP id z12ls270770qvk.9.gmail; Tue, 02 Nov 2021 19:35:35 -0700 (PDT) X-Received: by 2002:ad4:43e8:: with SMTP id f8mr40779906qvu.41.1635906935377; Tue, 02 Nov 2021 19:35:35 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1635906935; cv=none; d=google.com; s=arc-20160816; b=OXmplQ14EpGT4Qhqdu+vQ/hnEhT0/TKKXQEMoG0XAqXA6embSEaQ7ZwC4u8T1uvJlj vRgPYQSEUcrRJQUjIGnvKkRrYdd8EGcS2j7hwcbjJCWNxqRsa/hkz7kLGe8LMN1mzyjp KyKiZpUSr9m4dkE8fMdsQ1NUvaOa+uzT6qsn2eJ4sYPZ1SHj94cWGoprAQ4amZ1XFTjU cQ2BS1OFcD7nc9trLDF8qvUU7EbWCItKHZRmCVrM23xk2arJNlRpqYH1U7Z5bit1FCPx CtcycfycgK6cKE54wpwkAwRcXSAreIuPZ6vvlZWe35IwsByHdWWhVDeSAIzwaOsOQRMS KBAA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:message-id:date:references:in-reply-to:subject:to:from :dkim-signature; bh=e/7e/ABM0LfMgWEmMCTw7nQO1nJz0ITRghrwI8ZCv00=; b=GTlgSHAjTH8jOvVZ0RuqGZZTQiJjDkH+kn7JvHnHXxsExmRpRHjqQIgPujeDAzNYMH uIbjpLLmn5pyxGXQJ2GHQYAJ6I7j6NnWKjoFXEa2DuPmz5vc4p7srjLt3EUBr+Q5dp7t TgDAFsGEZ7M8jqr700Y9orYOfxiL8k1KvMyZZLNfVD3L8GO0ELZ7rRnsswo1DEy7xRpp ddOjs/XmsFbHEYfFTWiiGLHqdt1xi3ZoA+RWpyBxpxmtUMeEhSfUbGI083o7C0b8SGA4 9Vo8Vi41kJDWNW8gfdHCSFgHJpRCUutF3DiQm5kcbdv5OXZ71V8rRZDSAIjbYOHKe+Yv 98TQ== ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@berkeley-edu.20210112.gappssmtp.com header.s=20210112 header.b=hr2x9qaM; spf=pass (google.com: domain of jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org designates 2607:f8b0:4864:20::42b as permitted sender) smtp.mailfrom=jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org Original-Received: from mail-pf1-x42b.google.com (mail-pf1-x42b.google.com. [2607:f8b0:4864:20::42b]) by gmr-mx.google.com with ESMTPS id n20si108904qtl.1.2021.11.02.19.35.35 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 02 Nov 2021 19:35:35 -0700 (PDT) Received-SPF: pass (google.com: domain of jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org designates 2607:f8b0:4864:20::42b as permitted sender) client-ip=2607:f8b0:4864:20::42b; Original-Received: by mail-pf1-x42b.google.com with SMTP id s5so882821pfg.2 for ; Tue, 02 Nov 2021 19:35:35 -0700 (PDT) X-Received: by 2002:a62:384a:0:b0:481:2fd1:98ad with SMTP id f71-20020a62384a000000b004812fd198admr6197428pfa.29.1635906934352; Tue, 02 Nov 2021 19:35:34 -0700 (PDT) Original-Received: from johnmacfarlane.net (li55-134.members.linode.com. [74.82.3.134]) by smtp.gmail.com with ESMTPSA id u4sm3876211pjg.54.2021.11.02.19.35.33 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 02 Nov 2021 19:35:33 -0700 (PDT) Original-Received: by johnmacfarlane.net (Postfix, from userid 1000) id 6B5C6A24D; Tue, 2 Nov 2021 22:35:22 -0400 (EDT) In-Reply-To: <77fa1b8f-2ae4-4b15-afc2-22be2c4b0bc9n-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org> X-Original-Sender: jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@berkeley-edu.20210112.gappssmtp.com header.s=20210112 header.b=hr2x9qaM; spf=pass (google.com: domain of jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org designates 2607:f8b0:4864:20::42b as permitted sender) smtp.mailfrom=jgm-TVLZxgkOlNX2fBVCVOL8/A@public.gmane.org Precedence: list Mailing-list: list pandoc-discuss-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org; contact pandoc-discuss+owners-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org List-ID: X-Google-Group-Id: 1007024079513 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , Xref: news.gmane.io gmane.text.pandoc:29454 Archived-At: I'll look into it, but there are known performance issues with the standard markdown parser. For better performance, use the commonmark parser, e.g. pandoc -f commonmark h.md -o h.epub This finished in about 15 seconds on my system. David Peng writes: > Dear all, > > I am trying to use pandoc to convert a large markdown file (14M, English, > utf-8) to epub with several issues: > > 1. large memory consumption (more than 100GB) and exit with "killed:9". > 2. I try to divide the file into 2 or 4, but the first part still fails > with "killed: 9". > 3. For part that can be converted, some sections are missing. > > If help, I can upload my source markdown to the forum. > > I am using pandoc 2.16 mac os version. My OS has been just upgraded to > Monterey (12.0.1). > > Thanks, > > David > > -- > You received this message because you are subscribed to the Google Groups "pandoc-discuss" group. > To unsubscribe from this group and stop receiving emails from it, send an email to pandoc-discuss+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org > To view this discussion on the web visit https://groups.google.com/d/msgid/pandoc-discuss/77fa1b8f-2ae4-4b15-afc2-22be2c4b0bc9n%40googlegroups.com.