From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-wm0-f42.google.com (mail-wm0-f42.google.com [74.125.82.42]) by fantadrom.bsd.lv (OpenSMTPD) with ESMTP id 34b32ae9 for ; Sat, 9 Jul 2016 10:29:31 -0500 (EST) Received: by mail-wm0-f42.google.com with SMTP id n127so43835944wme.1 for ; Sat, 09 Jul 2016 08:29:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=CMGXmG7RIRB2KAsEQwSq+qeZLxlLZnh2ztTPYaqI6GA=; b=DuF2XS+j4rTTIsMkOeXK+1ZrlBMpkXRS/wo0ulk1BBTcQmqvwj0XFJ5Oep+R8rMZYH 49JSHNATyWsHImGnffFAc1aDKCr/EP6HnJ4Jtj0x1XYJ+X/Vfo/jgTJ9HnMbhX7aOPwY T2b28UDYfMfBnldJRcdU9StELREvDmgjnItdJebkXbIxpoIlgbWOH3Z179tZuA42yP6v eA29MiIksJxAJrFMokpNNbgAJv/0e15sr3WKDUKk1oDNK7TY/VmieSeYdgkndpt0CQyc ITIbE2lfbWzKxIofodlMcdd7uBhoF5SDY9rx9xFkvPGiWvx5syFfTS9geHzyl+fFc6QT aq+w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:sender:date:from:to:subject:message-id :references:mime-version:content-disposition:in-reply-to:user-agent; bh=CMGXmG7RIRB2KAsEQwSq+qeZLxlLZnh2ztTPYaqI6GA=; b=afLnk94ze2lXzM1c+u6J4poKUkTkNfH69gde8sh7I9g7DfNsjCWTqsO6WrV2/KLHVA /XuQ3RlvEeJOzGMl/km1gNEuJ/tb2OIxrqVQzxTyhpSkuzoHoOTq9sMQTCM1jpMQzYqi JNaF6vn9nSTAsfno2zt/AboVFMXfj2kGDj9bJ8Q0x+Nvkw3TxSRO2+7MkEPimwkHaQha HVxw9KBxTUmzpJpZtSOCVBB+FKlM6VUnQLTDk/IgJZobSZwm0pMzDV1f3NcpyamxN30T A13XDpRoAuTSObYjWpMqxsjnnxSsXQKRcIAQzBk1HD5z9f55jKsdO8B0LcjxXK83o4Ya Kknw== X-Gm-Message-State: ALyK8tLWX17E2yO4X1ia9fvm0ssXVx4+4qDbfa0RXqH6dT9pnbH1+A3Q2ziKIAjb4WPUQw== X-Received: by 10.194.87.42 with SMTP id u10mr11344969wjz.152.1468078168543; Sat, 09 Jul 2016 08:29:28 -0700 (PDT) Received: from ivaldir.etoilebsd.net ([2001:41d0:8:db4c::1]) by smtp.gmail.com with ESMTPSA id ur2sm1233152wjc.33.2016.07.09.08.29.27 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 09 Jul 2016 08:29:27 -0700 (PDT) Sender: Baptiste Daroussin Date: Sat, 9 Jul 2016 17:29:27 +0200 From: Baptiste Daroussin To: tech@mdocml.bsd.lv Subject: New db format (was Re: call for testing: mandoc-1.13.4 release candidate) Message-ID: <20160709152926.42bre6tittzmpm2g@ivaldir.etoilebsd.net> References: <20160709131158.GA6629@athene.usta.de> <20160709133936.tr4zsiekmrbfuav2@ivaldir.etoilebsd.net> <97865.1468074718@CATHET.us> X-Mailinglist: mdocml-tech Reply-To: tech@mdocml.bsd.lv MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="v245qtawtvvnrkme" Content-Disposition: inline In-Reply-To: <97865.1468074718@CATHET.us> User-Agent: Mutt/1.6.1-neo (2016-06-11) --v245qtawtvvnrkme Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Jul 09, 2016 at 08:31:58AM -0600, Anthony J. Bentley wrote: > Baptiste Daroussin FreeBSD writes: > > > P.S. > > > It seems likely that this will be the last release needing SQLite > > > for database support. I have started work on removing the dependency > > > on SQLite without loss of functionality and without needing any > > > replacement, relying on POSIX interfaces only. So it is likely > > > that we will have a 1.14.1 release this autumn that no longer needs > > > SQLite. > >=20 > > Tell me more, I'm really interestedin that, is there a place were we can > > look at this work in progress code? >=20 > Ingo sent an initial patch to the OpenBSD tech@ list a few days ago: >=20 > https://marc.info/?l=3Dopenbsd-tech&m=3D146734380814620&w=3D2 >=20 Thank you, Beside minor portability issues (that I will provide fixes for once this pa= tch is official) I can say it works fine on FreeBSD :) Tested on FreeBSD 12-CURRENT: The 3 main "bad" feedbacks I got about mandoc was: - time to create the db was long with sqlite with the new code it is longer: does from 4s to 11s in general for the base manpages but I do not consider that as a big issue given it is not run that often and the code is quite = new and there are probably room of improvements - size of the db (for embedded). With the new code: 3.8M /usr/share/man/mandoc.db 1.6M /usr/share/man/mandoc.new.db This is a big improvement - apropos can be very slow before showing anything, with the new code, it is instant! old 'apropos ls': 8.67 real 3.63 user 5.03 sys new 'apropos ls': 0.02 real 0.02 user 0.00 sys I notice some memory corruption in the ouput of apropos, I haven't dig into= it yet Great work, I'm eager to see that code in! Best regards, Bapt --v245qtawtvvnrkme Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBCAAGBQJXgRhWAAoJEGOJi9zxtz5ayHAQAKBVyhO7UGzHlEyHmfvLZEvk NITkdhAkc4w/lZChTmal4V5vag/stLnw9RFBLm8ZPnZrch0ApPh+kJPKzSIt36lt HAJUpnMp6nb1rZbDefV4kJOb9ZLuwwnXvIQrrsU8m8o/KfRxlPO5kvQKQW2uQ+5/ Adhy2BkuKZBPQ2uKV75qxsN/VCSo01uro9ncPPfkBVnvVtZ0J4uXtQkW3jBwvc2d nAKbbHdybryUE4o8sTAAxrh+GPlF5YHnjeN+5IvfhGMJcW79Ot1s4jInOtlyeOfd Uq7Qn0fF31iktjSppnjlU0E9gbV52Gn6O/20FxatoFebJfsnbB1ZBrZh860TbLv2 N+KlqD0zCraSdKcH6Ljg7W0Q4HKxp1nPoIbzfa7M3+oaxb3D7LxZQT2G4doz9udM oeuWov7Y80XIxnx0uMpjFJWEjzJ3FreVqeSrfr1FG9gSk6BlZoaanl1l4YrFa+DP O3edquFSM61hlLtWBNmqoP3vEBhxL1GlDGeD+TpYmDhWJU1i2pUshJcQMUn8TKjb OjZYfEryE2NQBAGWkhMBF8qAl7komLoSCmL/p+Yhvq/WtSg+20jIlrNxI8aKM2uh 7sSZeOPjhlEjONNfMS3tithCcfhZnNHR3LzUD1NtDUkbWELwIBg5wAZAa1Ol+G2B 0UrBzEZfc6ZyZIlxpb4/ =WZvK -----END PGP SIGNATURE----- --v245qtawtvvnrkme-- -- To unsubscribe send an email to tech+unsubscribe@mdocml.bsd.lv