From mboxrd@z Thu Jan 1 00:00:00 1970 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on inbox.vuxu.org X-Spam-Level: X-Spam-Status: No, score=-3.3 required=5.0 tests=DKIM_SIGNED,DKIM_VALID, FREEMAIL_FROM,MAILING_LIST_MULTI,RCVD_IN_DNSWL_MED, T_SCC_BODY_TEXT_LINE,UNPARSEABLE_RELAY autolearn=ham autolearn_force=no version=3.4.4 Received: (qmail 29551 invoked from network); 8 Jul 2022 20:59:47 -0000 Received: from zero.zsh.org (2a02:898:31:0:48:4558:7a:7368) by inbox.vuxu.org with ESMTPUTF8; 8 Jul 2022 20:59:47 -0000 ARC-Seal: i=1; cv=none; a=rsa-sha256; d=zsh.org; s=rsa-20210803; t=1657313987; b=dCscOsBr37UX0Bf+ta0nXNtvNm5qzREco+F8Bvm4bgxy1X8kKuOpJUoXqda2cwkYXsFKjaMyqG hFvD9MiCjOFYy24jX9Y3mUp42TvBjJQHPA/Wrp/M6tH4PlQX5yhlWIpAPCwOBrbzeLDaQF8ow1 dGYDiWJ6o3XYTGI/Z3jznrj5vGXjL+TvqgOY/epI0vm237CdDJliHzB6e//n0YTL3h7Ado3rRZ WMTdVcN6e1CPltqL+deBdgGmgrJ75ursLkIvS3Jhxck7Uks9BK1togX5kSj5NSLvgkAo+NPmHT w58W82tMh/DfzRe27uffrZKAJdjOnRDp1Er4xbnDKu21Rw==; ARC-Authentication-Results: i=1; zsh.org; iprev=pass (mout.gmx.net) smtp.remote-ip=212.227.15.18; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.a=rsa-sha256; dmarc=none header.from=gmx.de; arc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed; d=zsh.org; s=rsa-20210803; t=1657313987; bh=DrlyVeZB/dtsa1mnVcDcZ8vsSAYnlTGSasSRZLi28gI=; h=List-Archive:List-Owner:List-Post:List-Unsubscribe:List-Subscribe:List-Help: List-Id:Sender:Content-Transfer-Encoding:Content-Type:MIME-Version:Reply-To: Message-ID:Subject:To:From:Date:DKIM-Signature:DKIM-Signature; b=ljC/16aVISDDmQjitsBMR0yHIrDZ/Gzh82xY/ZU5XBrI7yePVjRrkn+lGmzVjIbxDNE2L0MNhq ZXlAY4xNpcYT2kn3oWZ9JGxgmyZ4iO/X9eZr53tbpCFomgIejb1IkY3VqUSRtPCoybxuzJs++e 5iVIlog2PhdnnBJdyHUzC1jsW9qSgYCAfSJL9AXP9qWYeZFerN/kvZNJh8JLawrFn3SdQqH8ub cItR/aT6LCkRSNvomKfCXyapF5UdFtGCgMrS2HvWPZVMEz0GRGsA/Ow6Bw7ljGRReYQ2Smhd/0 PD+7jDQBP0tnrzIPMW1TBVg9ahnmUA33h6rF66Otd19dMA==; DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=zsh.org; s=rsa-20210803; h=List-Archive:List-Owner:List-Post:List-Unsubscribe: List-Subscribe:List-Help:List-Id:Sender:Content-Transfer-Encoding: Content-Type:MIME-Version:Reply-To:Message-ID:Subject:To:From:Date:Cc: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:In-Reply-To:References; bh=T58SZCFzWE5cjUGFWLFU+UmRpOsYXiVeteLSwwP4kmg=; b=c3cBku4842OfOMvDrJQt7nyTKk kh94Qq3zvw5p/W2hL3jHiMe0C8/dFoK946z7KxSeTLPDB8YSohrcjPYD2aiwyIuqFtYI3lwOdjboh VrZYc6KewqpIvGUBFiPo4CHoOwl45XyZNbO0Rx+lZoq341F9OvdL8gu07426RuqQaJAYosNQqvDiR D3rA+KlngZvXGw3cLWUedbCkznhVfD1YZzUeeEqDpUgJprHqz+bYr2+tynpYhvMYGJttEsWc0TqDx wFxkUd15HJ8gssHmyBoEQHX1y5y8smf6vZPzks0wif4do5ucIXMNO4FC3EbMa0V0XVWSJ3B3XzQvd Hxt47S7Q==; Received: from authenticated user by zero.zsh.org with local id 1o9v4i-000EY4-8Z; Fri, 08 Jul 2022 20:59:44 +0000 Authentication-Results: zsh.org; iprev=pass (mout.gmx.net) smtp.remote-ip=212.227.15.18; dkim=pass header.d=gmx.net header.s=badeba3b8450 header.a=rsa-sha256; dmarc=none header.from=gmx.de; arc=none Received: from mout.gmx.net ([212.227.15.18]:40745) by zero.zsh.org with esmtps (TLS1.3:TLS_AES_256_GCM_SHA384:256) id 1o9v3W-000Drx-AV; Fri, 08 Jul 2022 20:58:30 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1657313909; bh=DrlyVeZB/dtsa1mnVcDcZ8vsSAYnlTGSasSRZLi28gI=; h=X-UI-Sender-Class:Date:From:To:Subject:Reply-To; b=fg3JCKI3Moc85p9BfvVgxIkO382Eaz0SARfjae/F0DC/ckV0DWJaG/YZrxvggZmDq RjBLAacBjchf+CNA9yzUpGBkpl4Y7cSkSXKfJPCgaYZYVk5WGLhNa0fCJeSMeM0jF5 WD0N++js4mtB66pejIG2Ugg9gvpKwlCU/Sb+Xnko= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from zitrone.obstwiese ([46.223.163.206]) by mail.gmx.net (mrgmx004 [212.227.17.190]) with ESMTPSA (Nemesis) id 1My36T-1nN9kg2FuZ-00zaZE for ; Fri, 08 Jul 2022 22:58:29 +0200 Received: from luthien by zitrone.obstwiese with local (Exim 4.94.2) (envelope-from ) id 1o9v3S-0001Sb-Co; Fri, 08 Jul 2022 21:58:26 +0100 Date: Fri, 8 Jul 2022 21:58:26 +0100 From: Dominik Vogt To: Zsh Users Subject: Using file lines as "input files" Message-ID: Reply-To: dominik.vogt@gmx.de Mail-Followup-To: Zsh Users MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Provags-ID: V03:K1:etJ47T0zXtWMvr/8rH5+qik9fS3fPOQbyRtRvkGrrT1cunrwUtF zwzPJ1OETAJDn8zZIFzcuTWK1k4rJebT2EcGdzRhy+zaIpgMEAFGZmTBK/TXDEEJgDgRSzy gUAIkxNF5Fo5MeiFQL+9+6NTs3Mtg0PPHGdvMJpj4xp0iXR8c/DUUK8KhrQHS/dRnc8rduu 6Njjx02szWNABLqZBHlBQ== X-UI-Out-Filterresults: notjunk:1;V03:K0:+H8Tn0svfkM=:RjzwuQlsD3FSeoxagRnIzo e7PpZzXu2N3A46yW75kBArzgjcslP37M0kBx4V3hJSa0AcKG8OjV7HQCYw9ktdyX9nT/qoEpE GYfpBfhhY0UvtQtw+N5kiA/75/36T3X+AT6xEzXPa6t5Bi0VSjD6Az7k2VRCP+ffHsdxihiQ4 cnBX2CzS047q/iNeddc2/2leZIagSay11Ebs48915lkFp/hYfT356ZymsUxsJjmPHWAGM9FvO bGve7YdvnCz4vRCRiDOWCZGeMVBQjStrywKa0DjLS4I5Gmr9AB8MKSciMLq9aHsL43hKSTI5O mcNZMhGG0CAF8qVerSRYPPTDpZ2NImbOZMl/a1LI6G+OMNpjokiEg2nFCmDi6tDDQePaECvaj K+mjAqr4AIYtB5hdOeuoGPpIHDbp5Y/WZDWW8fIrYZE0spWwJxa1DBzQCY3U8BxUKSWrXbANl C1YGMp1Db5X2ruL0EDVeZhqslg4uED+P8ajt3ROObqDeG1S0YolmR7ifl0dkLlx4T8M8dCvcF seNgqkjTMoTV6Q+uvPq101Gg+oLWbw+X2nmesfrH/bEcz9FcdvdyD7ZZJMEbhnKbqG4gQy4h0 fOsmmwjXjE56X9d3hD9omF4YXH44xC9zblrLPh1O+YDSByGfGQwYPubWmDSx3N7ifGhymprZJ m/eqLgrfJ8DQT6TKmQWgvRggXPtC4k+SZNjNXMCk8h3K3rfrGUEzLFW/9zMv82D8NePQpcB69 s755B9UY3MCA18ps2iMRe51f52szSSY7dkqX8vEUCQI3YJvoGBzW1ROy9JGIhbcqEsAhQSirz eykndSgRpQNgoNwOIG3UvXvVoUgNAoPUrtw5ms1lufli8GfrdNChuP0XgWr5TceABFcjKBFry Fg/ATZbH2OpK5DL30nGyd3bHbvPqw7nCcZ1DzYVrqq20b+4YgWRwOpC23c7DCUbmo4U7gNERd S/3J3JALLKvjelgC6t7LtYK0Sz1puD2tLzyTkxwUy4XrHxqXS6IuljJLtxwU9pfT+vEzfqdvZ ssMrStjf+h0UJq43GYbtvmj1WSjdjYoSPrpY87VHkh343X1oQlgr8cU5CE89T2vBV8tjNcTnF 1y6jdKG4XpRJb6B6BNhwH95sBHYEP2cfpKif1Ll1q/Z339pk1AJQBj/gw== Content-Transfer-Encoding: quoted-printable X-Seq: 27875 Archived-At: X-Loop: zsh-users@zsh.org Errors-To: zsh-users-owner@zsh.org Precedence: list Precedence: bulk Sender: zsh-users-request@zsh.org X-no-archive: yes List-Id: List-Help: List-Subscribe: List-Unsubscribe: List-Post: List-Owner: List-Archive: Okay, there's this script that calculates a checksum on each line of a file by reading each line and passing it to cksum/md5sum/shasum etc. cat "$INFILE" | while read LINE; do echo "$LINE" | cksum done This takes about four minutes on a file with 265,000 lines because of the program call overhead. =2D- Disclaimer: I _know_ this can be done in seconds with perl / python, but I like to not rely on scripting languages when the shell can do the job. =2D- So, would it be possible to pass each line in "$INFILE" as a file argument to "cksum", i.e. $ chksum Fline1 Fline2 Fline3 ... Fline265000 (Of course without actually splitting the input file - the point is to get rid of the four minute wait, not generating more bottlenecks.) And there's this open file escriptor limit of 1024 too. :-) Ciao Dominik ^_^ ^_^ =2D- Dominik Vogt