From mboxrd@z Thu Jan  1 00:00:00 1970
X-Msuck: nntp://news.gmane.io/gmane.comp.tex.context/111844
Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail
From: Rik Kabel <ConTeXt@rik.users.panix.com>
Newsgroups: gmane.comp.tex.context
Subject: LMTX, BIdi, full paragraph, and spurious empty line
Date: Mon, 21 Jun 2021 22:52:23 -0400
Message-ID: <1679cd6e-c263-a01b-d110-e5e2c215e579@rik.users.panix.com>
Reply-To: mailing list for ConTeXt users <ntg-context@ntg.nl>
Mime-Version: 1.0
Content-Type: multipart/mixed; boundary="===============0366578373897309899=="
Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214";
	logging-data="13414"; mail-complaints-to="usenet@ciao.gmane.io"
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101
 Firefox/78.0 Thunderbird/78.11.0
To: ntg-context@ntg.nl
Original-X-From: ntg-context-bounces@ntg.nl Tue Jun 22 04:53:02 2021
Return-path: <ntg-context-bounces@ntg.nl>
Envelope-to: gctc-ntg-context-518@m.gmane-mx.org
Original-Received: from zapf.boekplan.nl ([5.39.185.232] helo=zapf.ntg.nl)
	by ciao.gmane.io with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256)
	(Exim 4.92)
	(envelope-from <ntg-context-bounces@ntg.nl>)
	id 1lvWX8-0003I2-5E
	for gctc-ntg-context-518@m.gmane-mx.org; Tue, 22 Jun 2021 04:53:02 +0200
Original-Received: from localhost (localhost [127.0.0.1])
	by zapf.ntg.nl (Postfix) with ESMTP id 088AF2843CA;
	Tue, 22 Jun 2021 04:52:33 +0200 (CEST)
X-Virus-Scanned: Debian amavisd-new at zapf.boekplan.nl
Original-Received: from zapf.ntg.nl ([127.0.0.1])
	by localhost (zapf.ntg.nl [127.0.0.1]) (amavisd-new, port 10024)
	with ESMTP id OifYNP0dIxYH; Tue, 22 Jun 2021 04:52:31 +0200 (CEST)
Original-Received: from zapf.ntg.nl (localhost [127.0.0.1])
	by zapf.ntg.nl (Postfix) with ESMTP id 4389B2849F2;
	Tue, 22 Jun 2021 04:52:31 +0200 (CEST)
Original-Received: from localhost (localhost [127.0.0.1])
 by zapf.ntg.nl (Postfix) with ESMTP id 56FEF2849D4
 for <ntg-context@ntg.nl>; Tue, 22 Jun 2021 04:52:29 +0200 (CEST)
X-Virus-Scanned: Debian amavisd-new at zapf.boekplan.nl
Original-Received: from zapf.ntg.nl ([127.0.0.1])
 by localhost (zapf.ntg.nl [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id BCpjNmbhgZxq for <ntg-context@ntg.nl>;
 Tue, 22 Jun 2021 04:52:27 +0200 (CEST)
Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=166.84.1.89;
 helo=mailbackend.panix.com; envelope-from=context@rik.users.panix.com;
 receiver=<UNKNOWN> 
Original-Received: from mailbackend.panix.com (mailbackend.panix.com [166.84.1.89])
 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits))
 (No client certificate requested)
 by zapf.ntg.nl (Postfix) with ESMTPS id 2E6482843CA
 for <ntg-context@ntg.nl>; Tue, 22 Jun 2021 04:52:26 +0200 (CEST)
Original-Received: from [192.168.1.106] (cpe-69-204-137-117.nycap.res.rr.com
 [69.204.137.117])
 by mailbackend.panix.com (Postfix) with ESMTPSA id 4G89t05KBnz3kpZ
 for <ntg-context@ntg.nl>; Mon, 21 Jun 2021 22:52:24 -0400 (EDT)
Content-Language: en-US
X-BeenThere: ntg-context@ntg.nl
X-Mailman-Version: 2.1.26
Precedence: list
List-Id: mailing list for ConTeXt users <ntg-context.ntg.nl>
List-Unsubscribe: <https://mailman.ntg.nl/mailman/options/ntg-context>,
 <mailto:ntg-context-request@ntg.nl?subject=unsubscribe>
List-Archive: <http://mailman.ntg.nl/pipermail/ntg-context/>
List-Post: <mailto:ntg-context@ntg.nl>
List-Help: <mailto:ntg-context-request@ntg.nl?subject=help>
List-Subscribe: <https://mailman.ntg.nl/mailman/listinfo/ntg-context>,
 <mailto:ntg-context-request@ntg.nl?subject=subscribe>
Errors-To: ntg-context-bounces@ntg.nl
Original-Sender: "ntg-context" <ntg-context-bounces@ntg.nl>
Xref: news.gmane.io gmane.comp.tex.context:111844
Archived-At: <http://permalink.gmane.org/gmane.comp.tex.context/111844>

This is a multi-part message in MIME format.
--===============0366578373897309899==
Content-Type: multipart/alternative;
 boundary="------------446254EBB84352F656BEA664"
Content-Language: en-US

This is a multi-part message in MIME format.
--------------446254EBB84352F656BEA664
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit

Hello all,

Last October Denis Maier complained about a spurious empty line 
generated with protrusion and bidi active and a full paragraph. (See 
https://www.mail-archive.com/ntg-context@ntg.nl/msg95916.html 
<https://www.mail-archive.com/ntg-context@ntg.nl/msg95916.html> or 
similar on your favorite mail archive.)

I have recreated the issue without involving protrusion. When a 
paragraph is very full and bidi is on, an extra line seems to be 
generated. Without bidi there is no extra line. This is quite sensitive, 
of course, to line width. I have probably 30 instances of it occurring 
in a tightly-set bibliography. I would assume that it may occur in any 
text, but have not noticed it in the body of my book.

I have created an example document that shows it. The problem disappears 
if bidi is turned off (comment out the first non-comment line) but of 
course then the RTL text is mis-set. In this example, the spurious line 
appears after the Walt Kelly entry.

This was tested under ConTeXt  ver: 2021.06.18 23:37 LMTX  fmt: 
2021.6.21, but is not a new problem with this version. /The problem does 
not occur with MKIV from the same installation./

    %% Demonstration of spurious line insertion on full paragraph with
    bidi active

    \setupdirections  [bidi=on,method=unicode]

    \definepapersize  [Testing]
                       [width=6.69in]
    \setuppapersize   [Testing]

    \setuplayout      [width=fit,
                        backspace=1.4in,
                        cutspace=1in,
                        leftmargin=0.65in,
                        rightmargin=0.65in]

    \setupwhitespace  [small]

    \setupbodyfont    [libertinus,11pt]

    \define\SetupBib{
       \spaceskip 0.7\interwordspace plus .5\interwordstretch minus
    \interwordshrink
       \definedelimitedtext
         [Exdent]
         [leftmargin=1em,
          indenting={yes,-1em},
          indentnext=yes]}

    \starttext
       \input jojomayer

       \input klein

       \blank[2*line]

       \SetupBib
       \startExdent

         Kelly, Cynthia C., ed. 2005. {\em Oppenheimer and the Manhattan
         Project: Insights into J.~Robert Oppenheimer, ‘Father of the
         Atomic Bomb’}. Singapore: World Scientific.

         Kelly, Walt. 1953. {\em The Pogo Papers}. New York, NY: Simon
         & Schuster.

         Kuhn, Thomas S. 1962. {\em The Structure of Scientific
         Revolutions}. Chicago, IL: University of Chicago Press.

         Weinreich, Max. 1945. “Der YIVO un di problemen fun undzer
         tsayt (דער ייִוואָ און די פּראָבלעמען פֿון אונדזער צײַט).”
         {\em YIVO Bleter} 25 (1): 3--18. The title is translated as
         {\em The YIVO and the problems of our time}, and also as
         {\em The YIVO faces the post-war world}.

       \stopExdent
    \stoptext

Of course, there could be some other mechanism at work here than bidi, 
but changing that clears the problem in this instance. (It may be the 
adjustment to spaceskip that I use to tighten up the text in the 
bibliography, and if it is, I welcome an alternative way to do that.)

-- 
Rik


--------------446254EBB84352F656BEA664
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit

<html>
  <head>

    <meta http-equiv="content-type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p>Hello all,</p>
    <p>Last October Denis Maier complained about a spurious empty line
      generated with protrusion and bidi active and a full paragraph.
      (See <a moz-do-not-send="true"
        href="https://www.mail-archive.com/ntg-context@ntg.nl/msg95916.html">https://www.mail-archive.com/ntg-context@ntg.nl/msg95916.html</a>
      or similar on your favorite mail archive.)</p>
    <p>I have recreated the issue without involving protrusion. When a
      paragraph is very full and bidi is on, an extra line seems to be
      generated. Without bidi there is no extra line. This is quite
      sensitive, of course, to line width. I have probably 30 instances
      of it occurring in a tightly-set bibliography. I would assume that
      it may occur in any text, but have not noticed it in the body of
      my book.</p>
    <p>I have created an example document that shows it. The problem
      disappears if bidi is turned off (comment out the first
      non-comment line) but of course then the RTL text is mis-set. In
      this example, the spurious line appears after the Walt Kelly
      entry.</p>
    <p>This was tested under ConTeXt  ver: 2021.06.18 23:37 LMTX  fmt:
      2021.6.21, but is not a new problem with this version. <i>The
        problem does not occur with MKIV from the same installation.</i><br>
    </p>
    <blockquote>
      <p><font face="monospace">%% Demonstration of spurious line
          insertion on full paragraph with bidi active<br>
          <br>
          \setupdirections  [bidi=on,method=unicode]<br>
          <br>
          \definepapersize  [Testing]<br>
                            [width=6.69in]<br>
          \setuppapersize   [Testing]<br>
          <br>
          \setuplayout      [width=fit,<br>
                             backspace=1.4in,<br>
                             cutspace=1in,<br>
                             leftmargin=0.65in,<br>
                             rightmargin=0.65in]<br>
          <br>
          \setupwhitespace  [small]<br>
          <br>
          \setupbodyfont    [libertinus,11pt]<br>
          <br>
          \define\SetupBib{<br>
            \spaceskip 0.7\interwordspace plus .5\interwordstretch minus
          \interwordshrink<br>
            \definedelimitedtext<br>
              [Exdent]<br>
              [leftmargin=1em,<br>
               indenting={yes,-1em},<br>
               indentnext=yes]}<br>
          <br>
          \starttext<br>
            \input jojomayer<br>
          <br>
            \input klein<br>
          <br>
            \blank[2*line]<br>
          <br>
            \SetupBib<br>
            \startExdent<br>
          <br>
              Kelly, Cynthia C., ed. 2005. {\em Oppenheimer and the
          Manhattan<br>
              Project: Insights into J.~Robert Oppenheimer, ‘Father of
          the<br>
              Atomic Bomb’}. Singapore: World Scientific.<br>
          <br>
              Kelly, Walt. 1953. {\em The Pogo Papers}. New York, NY:
          Simon<br>
              &amp; Schuster.<br>
          <br>
              Kuhn, Thomas S. 1962. {\em The Structure of Scientific<br>
              Revolutions}. Chicago, IL: University of Chicago Press.<br>
          <br>
              Weinreich, Max. 1945. “Der YIVO un di problemen fun undzer<br>
              tsayt (דער ייִוואָ און די פּראָבלעמען פֿון אונדזער צײַט).”<br>
              {\em YIVO Bleter} 25 (1): 3--18. The title is translated
          as<br>
              {\em The YIVO and the problems of our time}, and also as<br>
              {\em The YIVO faces the post-war world}.<br>
          <br>
            \stopExdent<br>
          \stoptext</font><br>
      </p>
    </blockquote>
    <p> Of course, there could be some other mechanism at work here than
      bidi, but changing that clears the problem in this instance. (It
      may be the adjustment to spaceskip that I use to tighten up the
      text in the bibliography, and if it is, I welcome an alternative
      way to do that.)</p>
    <p>-- <br>
      Rik<br>
    </p>
  </body>
</html>

--------------446254EBB84352F656BEA664--

--===============0366578373897309899==
Content-Type: text/plain; charset="utf-8"
MIME-Version: 1.0
Content-Transfer-Encoding: base64
Content-Disposition: inline

X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f
X19fX19fX19fX19fX19fX19fX19fX19fX18KSWYgeW91ciBxdWVzdGlvbiBpcyBvZiBpbnRlcmVz
dCB0byBvdGhlcnMgYXMgd2VsbCwgcGxlYXNlIGFkZCBhbiBlbnRyeSB0byB0aGUgV2lraSEKCm1h
aWxsaXN0IDogbnRnLWNvbnRleHRAbnRnLm5sIC8gaHR0cDovL3d3dy5udGcubmwvbWFpbG1hbi9s
aXN0aW5mby9udGctY29udGV4dAp3ZWJwYWdlICA6IGh0dHA6Ly93d3cucHJhZ21hLWFkZS5ubCAv
IGh0dHA6Ly9jb250ZXh0LmFhbmhldC5uZXQKYXJjaGl2ZSAgOiBodHRwczovL2JpdGJ1Y2tldC5v
cmcvcGhnL2NvbnRleHQtbWlycm9yL2NvbW1pdHMvCndpa2kgICAgIDogaHR0cDovL2NvbnRleHRn
YXJkZW4ubmV0Cl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f
X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCg==

--===============0366578373897309899==--