From mboxrd@z Thu Jan 1 00:00:00 1970 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on inbox.vuxu.org X-Spam-Level: X-Spam-Status: No, score=-1.0 required=5.0 tests=MAILING_LIST_MULTI, RCVD_IN_DNSWL_NONE autolearn=ham autolearn_force=no version=3.4.4 Received: (qmail 22426 invoked from network); 22 Feb 2021 06:07:45 -0000 Received: from minnie.tuhs.org (45.79.103.53) by inbox.vuxu.org with ESMTPUTF8; 22 Feb 2021 06:07:45 -0000 Received: by minnie.tuhs.org (Postfix, from userid 112) id F096A9CA98; Mon, 22 Feb 2021 16:07:42 +1000 (AEST) Received: from minnie.tuhs.org (localhost [127.0.0.1]) by minnie.tuhs.org (Postfix) with ESMTP id 0FFAF93D39; Mon, 22 Feb 2021 16:07:20 +1000 (AEST) Received: by minnie.tuhs.org (Postfix, from userid 112) id 4FB8D93D39; Mon, 22 Feb 2021 16:07:17 +1000 (AEST) X-Greylist: delayed 596 seconds by postgrey-1.36 at minnie.tuhs.org; Mon, 22 Feb 2021 16:07:16 AEST Received: from mailout7.ceti.pl (mailout7.ceti.pl [62.121.128.47]) by minnie.tuhs.org (Postfix) with ESMTPS id 5CA8F93D32 for ; Mon, 22 Feb 2021 16:07:16 +1000 (AEST) Received: from tau1.ceti.pl (tau.ceti.pl [62.121.128.11]) by mailout7.ceti.pl (Postfix) with ESMTP id 8AA3937811AC for ; Mon, 22 Feb 2021 06:57:17 +0100 (CET) Received: by tau1.ceti.pl (Postfix, from userid 3727) id 64D5E960B07; Mon, 22 Feb 2021 06:57:17 +0100 (CET) Date: Mon, 22 Feb 2021 06:57:17 +0100 From: Tomasz Rola To: The Eunuchs Hysterical Society Message-ID: <20210222055717.GA28147@tau1.ceti.pl> References: <26484818-2f05-37d3-adff-6e34d383e117@gmail.com> <399f2cdc-d790-c4fe-18e3-0cb6b4c76554@spamtrap.tnetconsulting.net> <55d60220-c22d-c99f-f40c-68a741183213@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <55d60220-c22d-c99f-f40c-68a741183213@gmail.com> User-Agent: Mutt/1.5.21 (2010-09-15) Subject: Re: [TUHS] cut, paste, join, etc. X-BeenThere: tuhs@minnie.tuhs.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: The Unix Heritage Society mailing list List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: tuhs-bounces@minnie.tuhs.org Sender: "TUHS" On Tue, Feb 16, 2021 at 08:26:11PM -0600, Will Senn wrote: [...] > Oops. That's right, no username & password, but you still need to > bring it up and interact with it... accept, as you say, you can > enter your sql as an argument to the executable. OK, I suppose ... > grump, grump... Not quite what I was thinking, but I'd be hard > pressed to argue the difference between creating a handful of files > in the filesystem (vs tables in sqlite) and then using some unix > filter utilities to access and combine the file relations (vs > passing sql to sqlite) other than, it'd be fun if there were select, > col, row (grep?), join (inner, outer, natural), utils that worked > with text without the need to worry about the finickiness of the > database (don't stone me as a database unbeliever, I've used plenty > in my day). I am not sure if this is what you are looking for, but sections 3 and 4 of "The AWK Programming Language" (by Aho, Kernighan and Weinberger) have a description of very nice data processing scripts written in AWK. Might even work in gawk. Might even work, actually - I had no time to write the code into files and give it a try. Personally, I would rather use awk for this rather than multiple command line utilities. Might be a bit nicer to modern system with process accounting enabled (I once wrote a shell script processing mailbox files, plenty of echos and greps, but since then have seen the light and I repented). On the other hand, on multiprocessor computer, each part of pipe runs in parallel, but I guess this had been said already. Also, found this in my notes - if you, or anybody from a future would like a quick glimpse on "what awk": :: Drinking coffee with AWK https://lobste.rs/s/hdljia/drinking_coffee_with_awk https://opensource.com/article/19/2/drinking-coffee-awk :: Using AWK and R to parse 25tb https://lobste.rs/s/kgah5l/using_awk_r_parse_25tb https://livefreeordichotomize.com/2019/06/04/using_awk_and_r_to_parse_25tb/ -- Regards, Tomasz Rola -- ** A C programmer asked whether computer had Buddha's nature. ** ** As the answer, master did "rm -rif" on the programmer's home ** ** directory. And then the C programmer became enlightened... ** ** ** ** Tomasz Rola mailto:tomasz_rola@bigfoot.com **