From mboxrd@z Thu Jan 1 00:00:00 1970 Date: Mon, 13 Oct 2014 13:46:35 -0300 From: Eduardo Alvarez To: Fans of the OS Plan 9 from Bell Labs <9fans@9fans.net> Message-ID: <20141013164635.GB27251@hypnotoad> References: <3f0b54378d4d9670e206e0b6428ce886@ladd.quanstro.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="yVhtmJPUSI46BTXb" Content-Disposition: inline In-Reply-To: <3f0b54378d4d9670e206e0b6428ce886@ladd.quanstro.net> User-Agent: Mutt/1.5.23 (2014-03-12) Subject: Re: [9fans] Setting up Mail in Acme on the Raspberry Pi. Topicbox-Message-UUID: 1afb867c-ead9-11e9-9d60-3106f5b1d025 --yVhtmJPUSI46BTXb Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Oct 13, 2014 at 12:15:31PM -0400, erik quanstrom wrote: > On Sun Oct 12 14:37:47 EDT 2014, steve@quintile.net wrote: > > I am fairly sure the problem is to do with RAM size rather than the ras= pberry pi per-se. > > 4000 messages takes up a lot of space - and upas stores messages in RAM. >=20 > it's a little worse than this, actually. >=20 > since upas stores messages in mbox format, the whole file needs to be rea= d or written on > update. certainly one could optimize the read bit, but that would be dif= ficult this means > that the the whole mbox gets written to the dump every day, and you need = about 2x the > mailbox size ram for each upas/fs that is run. this does not work out we= ll for large mm > messages, or small ram boxes like the pi. >=20 > the solutions to this are straightforward > (1) store one message per file, > (2) cache important data in an index to avoid opening all files, > (3) avoid O(n=B2) startup time due to small hash table sizes and high loa= d factor, > (4) load message data on demand so ram required is MAX(largest mm hunk, 1= 0mb). Have you considered other mailbox formats, such as maildir, for instance? S= eems that it could solve at least some of the problem. --=20 Eduardo Alvarez "Stercus, Stercus, Stercus, moriturus sum" -- Rincewind The Wizzard --yVhtmJPUSI46BTXb Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBAgAGBQJUPAHrAAoJEN9gUI56ViHwySgP/26Jlsp8Nua/0f4LJxpdDCux dRKOhAHQzZspj0qgehhpvqa+Vf7FyePWt/sYWesvoh9ulnuTLJgtvtuidhvAGD11 Ett9tJ+5L3jRAQdwSFqzeCfJ08UPO4vlb5EgZnCe1rzXHrILECer+KEZlsUDaigI qzfsgK/bTd1sQNJCGnXESMqyIQAkQys6s0Xrbo6CJuRyT+VuFy51jtK22cnFh4Oz Ai2M5IwBmMBJZUCi14ijnFPEEBKlAMIKRW/AKjFHOntbagCpKDQAn1V7kOJlOHTi UeB0IKWAMyqx1QB1pydMMOJdOW86YV5bYEzvLwkRhjaAnQSZ8Ty0npp+n9KzzoV5 1OWWYj180noBJFjXzkycH/tEcIT1ZvnM1k8oh1Hy98X0EQ7MHqOgNVSyRqhlLHxJ SggQmIQaz+mxncSB9DM7KX5+AcjMQUdt2QOk+05QrTw4dhCtcuLA1rIS7R0m+3b7 ACDePz1OjkQxajZb6EH+qZj8nRHm4HbBTkqrKDtPNVEIGRaWmGrmY7a1/b4hzav5 wmyqRwCV0FbUUx9r+n4hbq0F7ehwusa5iNtfflB8/nIvvIBBZlNQA0CSvakyHgx+ 0qVt3sdjwAR8Pt1eAFEfh2LqbJmaYxA4MNwMgAF2sciPdgA001s9DqBw1M5jPDQe ogFJmU3PvYHUkdkqhlBO =kb5Y -----END PGP SIGNATURE----- --yVhtmJPUSI46BTXb--