From mboxrd@z Thu Jan 1 00:00:00 1970 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on inbox.vuxu.org X-Spam-Level: X-Spam-Status: No, score=-3.3 required=5.0 tests=DKIM_SIGNED,DKIM_VALID, MAILING_LIST_MULTI,RCVD_IN_DNSWL_MED,UNPARSEABLE_RELAY autolearn=ham autolearn_force=no version=3.4.4 Received: (qmail 12539 invoked from network); 27 Apr 2022 16:19:31 -0000 Received: from zero.zsh.org (2a02:898:31:0:48:4558:7a:7368) by inbox.vuxu.org with ESMTPUTF8; 27 Apr 2022 16:19:31 -0000 ARC-Seal: i=1; cv=none; a=rsa-sha256; d=zsh.org; s=rsa-20210803; t=1651076371; b=J/KvCwaZTBIe5hB8qaphld53MgE68eirRUo1FqrH93ksCkcLXrnnYOnjYeCWbv8f8GwGWuveCR 8uJzRULQTyTaIAW5gwzvTfPiLPt0A1r4KMieiKPIX2WDJZxz0PiUtNr8s4Xs52nN9RMm/Be9T/ LrNuY1YPbr0vrB0+xhaQ8SIPOhsHvQfSm0JA1K4idobRapQzHmrggNZ0Y5TBAcLqzYXB+BqPIl xnt873LglcAXcsduC6pknWPmd4qb7z/jBgqUdsk7IKGbISqMg4A00uqCne6q7aG0Gz72/o5X3Z 722TqLRhlPwXHiw6tNvd6VioCchfg9POBMeVyV4riRgLWw==; ARC-Authentication-Results: i=1; zsh.org; iprev=pass (snd00005-bg.im.kddi.ne.jp) smtp.remote-ip=27.86.113.5; dmarc=none header.from=kba.biglobe.ne.jp; arc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed; d=zsh.org; s=rsa-20210803; t=1651076371; bh=yRhb5JxBr3cXgbh+VjEJw/zBhuf5dBrhrccsxSH+rgY=; h=List-Archive:List-Owner:List-Post:List-Unsubscribe:List-Subscribe:List-Help: List-Id:Sender:Message-ID:In-Reply-To:To:References:Date:Subject: MIME-Version:Content-Transfer-Encoding:Content-Type:From:DKIM-Signature; b=WyGPxFtS0qteYsPzOKkoB9rpxjxCcsJfHXo/7u7iJBh0QYfnBto4gZTHdkM7Cj3B+mcwpAmzz9 ld1grRLj9cUAvbeEDE9YmA3bsfY30hDBT85QsdVs+0mq1trcF7d+hXeyHjpDdS36m+jZ9DDGQi TeRn5UbkZaEWrwEymfwCie07kZJR7mtlzGPeuBkp189rWcR+S8h+5/aQDv2K7by+Pm1ULEa5Y4 lEbDeD6t/Vp/uqvrC0iTSSI331V0sF8JiDJfV+G4JGLK8IRMq+izLen2cNIuT6AvFEan1dvNFT lQo0pzKbjCqeN7JTvyeLYxQlJBUaFvChAwauWrzbmhY7Lw==; DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=zsh.org; s=rsa-20210803; h=List-Archive:List-Owner:List-Post:List-Unsubscribe: List-Subscribe:List-Help:List-Id:Sender:Message-Id:In-Reply-To:To:References: Date:Subject:Mime-Version:Content-Transfer-Encoding:Content-Type:From: Reply-To:Cc:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID; bh=Z/teZex43PcJVUZ2hIsNA+CyhIaTwgk0sCieKmT6zt0=; b=iSPCwJR7aoSSEdz8T0n2aGes9U 5Y6r04qq/6xt8kNFZilY4pnyaC96QyocrnN78kx4xi6MQnF3AtIxNI1NPvel39I2H4YBBMx8RNfMX m6et3p+HFQUd35CvdJvrQ/WZ7X94h//Sd3FU/QDy9TszoVIqQFsmiOzhai+Cul+LVU/s8FZpiwI3j tnoLBf5dU03c5qN9qs18vn9tm5CEwqQy7X/gZtYyk1veRPAs9P6ZJUzrDsEtgBiacShuabFieAofK G0AhaXp6o3QvftQcaqIoJhjDbk+uJ4dfnkbRp+aMNkvGODttC6VkcsyN6m9rxB9A12leb/gXPI5MO UIb6SuDg==; Received: from authenticated user by zero.zsh.org with local id 1njkO2-000NF0-FU; Wed, 27 Apr 2022 16:19:30 +0000 Authentication-Results: zsh.org; iprev=pass (snd00005-bg.im.kddi.ne.jp) smtp.remote-ip=27.86.113.5; dmarc=none header.from=kba.biglobe.ne.jp; arc=none Received: from snd00005-bg.im.kddi.ne.jp ([27.86.113.5]:22690 helo=dfmta0009.biglobe.ne.jp) by zero.zsh.org with esmtps (TLS1.3:TLS_AES_256_GCM_SHA384:256) id 1njkNH-000Muc-Dg; Wed, 27 Apr 2022 16:18:45 +0000 Received: from mail.biglobe.ne.jp by omta0009.biglobe.ne.jp with ESMTP id <20220427161838440.WCQQ.128985.mail.biglobe.ne.jp@biglobe.ne.jp> for ; Thu, 28 Apr 2022 01:18:38 +0900 From: "Jun. T" Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Mac OS X Mail 15.0 \(3693.60.0.1.1\)) Subject: Re: ZSH performance regression in 5.8.1.2-test Date: Thu, 28 Apr 2022 01:18:37 +0900 References: <20220425192036.p6awbyro2a2lp7bq@chazelas.org> <7E5CB0D9-4740-486A-B55E-6EA0530532F9@kba.biglobe.ne.jp> <632293647.60210.1651052061990@mail2.virginmedia.com> <6AEDDA47-F8ED-4160-8FFF-8D3C70B12490@kba.biglobe.ne.jp> <779E1EC7-7AC8-4B3D-9D9E-C0089320D163@kba.biglobe.ne.jp> To: zsh-workers@zsh.org In-Reply-To: Message-Id: <05F08D90-85FB-4A92-BC57-B56EA4177EC6@kba.biglobe.ne.jp> X-Mailer: Apple Mail (2.3693.60.0.1.1) X-Biglobe-Sender: takimoto-j@kba.biglobe.ne.jp X-Seq: 50122 Archived-At: X-Loop: zsh-workers@zsh.org Errors-To: zsh-workers-owner@zsh.org Precedence: list Precedence: bulk Sender: zsh-workers-request@zsh.org X-no-archive: yes List-Id: List-Help: List-Subscribe: List-Unsubscribe: List-Post: List-Owner: List-Archive: > 2022/04/28 0:25, Bart Schaefer wrote: > > On Wed, Apr 27, 2022 at 7:00 AM Jun T wrote: >> >> (3) time zsh -f < tmp.txt > > Does it matter to (3) if "zsh -fs" ? No, no noticeable difference. >> With lseek() patch we get "reasonable" performance for (1)-(4). >> (3) is somewhat slower, because it is reading form stdin and >> need to call lseek() many times. > > I wonder if it would help to read less than SHINBUFSIZE when > SHINSTDIN. E.g., make some guess at the "average line length" and > read that many bytes. Might cause more calls to memchr() but less I/O > (and shorter lseek()s, if that matters). I tried setting SHINBUFSIZE to 80 for (3) (with lseek() patch): SHINBUFSIZE=8192 about 1.3 sec SHINBUFSIZE=80 about 1.2 sec (slight improvement) (I'm now using a different Mac from the one used in the previous post) I guess data is cached by the OS and read() is, in most cases, something like memcpy(). I was running the test on a internal SDD of my iMac, but running the test on a external HDD gives almost the same results. If the file is on a "much slower" filesystem then the difference may be somewhat larger.