From mboxrd@z Thu Jan 1 00:00:00 1970 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on inbox.vuxu.org X-Spam-Level: * X-Spam-Status: No, score=1.7 required=5.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,FREEMAIL_FROM,HDRS_MISSP,T_SCC_BODY_TEXT_LINE autolearn=no autolearn_force=no version=3.4.4 Received: (qmail 1190 invoked from network); 9 Sep 2022 12:05:55 -0000 Received: from hurricane.the-brannons.com (2602:ff06:725:1:20::25) by inbox.vuxu.org with ESMTPUTF8; 9 Sep 2022 12:05:55 -0000 Received: from localhost.localdomain (localhost.localdomain [127.0.0.1]) by hurricane.the-brannons.com (OpenSMTPD) with ESMTP id 54cadc65 for ; Fri, 9 Sep 2022 05:05:48 -0700 (PDT) Received: from resqmta-c1p-023464.sys.comcast.net (resqmta-c1p-023464.sys.comcast.net [2001:558:fd00:56::b]) by hurricane.the-brannons.com (OpenSMTPD) with ESMTPS id 0b52b3b2 (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256:NO) for ; Fri, 9 Sep 2022 05:05:23 -0700 (PDT) Received: from resomta-c1p-023411.sys.comcast.net ([96.102.18.231]) by resqmta-c1p-023464.sys.comcast.net with ESMTP id WcRnoot5xNtPXWcl7oChDn; Fri, 09 Sep 2022 12:05:21 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=comcast.net; s=20190202a; t=1662725121; bh=DXIvhEQKBd1+uPWEZXbxXDf36zEWBKce95ibJ3KIdZE=; h=Received:Received:To:From:Reply-to:Subject:Date:Message-ID: Mime-Version:Content-Type; b=lH9rh7WkGPChI3C3PY0YZ9C49OtVjeHJOZlFbl00kgJjJodp9tW6OBXZk8sRRxdO1 K/mkstZzNcYoA1IfaSiUVlmNmqnXg/4XkyUvSZ94y7TDVq2nKkN5h4jPwf73hiDOiS SN95Y5KhVZI1/cglQXMhK+6K1re/LP6wbxVtJoRbHaUaQfX0mzCurW7sRpbilHB684 NQlJsE+h+XUgIRjjO8egZiMexEPda6I1wgUoIC5s1BqF/y0TLRdRFc8nZY9GuJhym7 15roesj4pz3tuxKTsA8yz85NiNQpish3NBooSPdVheddC1sPHB0ZbATuLP8CHDoha6 FPs2nSi1qZjWQ== Received: from unknown ([IPv6:2601:408:c000:2e40::c3b6]) by resomta-c1p-023411.sys.comcast.net with ESMTPSA id Wcl5oPkWu563TWcl6oYGuE; Fri, 09 Sep 2022 12:05:20 +0000 X-Xfinity-VMeta: sc=0.00;st=legit To:edbrowse-dev@edbrowse.org From: Karl Dahlke Reply-to: Karl Dahlke User-Agent: edbrowse/3.8.5 Subject: Architectural restructure Date: Fri, 09 Sep 2022 08:05:19 -0400 Message-ID: <20220809080519.eklhad@comcast.net> X-BeenThere: edbrowse-dev@edbrowse.org List-Id: Edbrowse Development List Mime-Version: 1.0 Content-Type: text/plain; format=flowed; delsp=no Content-Transfer-Encoding: 7bit A couple months ago I wrote an email about architecture, I think that was the subject. Nothing is more fundamental than the way we store the lines in the buffer. 20 years ago I picked a simple design that was fine relative to the computers of the day. Since then it has shown some inadequacies. Thus, for my birthday, I am trying to majorly restructure edbrowse so that lines are link list, not all stored in sequence in an array. No one part of this is hard, but it touches everything and is a lot of work and will be a lot of testing. But even on some medium files it will help performance, and perhaps memory. Example, g/7$/ .m-2 that would take weeks on one of those seq 1000000 files, and no amount of my mass operation fixup would help that one, but with link lists it would fly. Moving text about is just changing some link pointers, you see. And I can get rid of all those specialized mass delete mass join mass read mass substitute routines. So it's a lot of work, and testing, and probably chasing down some seg faults, you know pointers in c and such, and I greatly appreciate your patience when those appear, but will be worth it. Karl Dahlke