From mboxrd@z Thu Jan 1 00:00:00 1970 From: erik quanstrom Date: Mon, 13 Oct 2014 12:15:31 -0400 To: 9fans@9fans.net Message-ID: <3f0b54378d4d9670e206e0b6428ce886@ladd.quanstro.net> In-Reply-To: References: MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Subject: Re: [9fans] Setting up Mail in Acme on the Raspberry Pi. Topicbox-Message-UUID: 1adce708-ead9-11e9-9d60-3106f5b1d025 On Sun Oct 12 14:37:47 EDT 2014, steve@quintile.net wrote: > I am fairly sure the problem is to do with RAM size rather than the ras= pberry pi per-se. > 4000 messages takes up a lot of space - and upas stores messages in RAM= . it's a little worse than this, actually. since upas stores messages in mbox format, the whole file needs to be rea= d or written on update. certainly one could optimize the read bit, but that would be dif= ficult this means that the the whole mbox gets written to the dump every day, and you need = about 2x the mailbox size ram for each upas/fs that is run. this does not work out we= ll for large mm messages, or small ram boxes like the pi. the solutions to this are straightforward (1) store one message per file, (2) cache important data in an index to avoid opening all files, (3) avoid O(n=C2=B2) startup time due to small hash table sizes and high = load factor, (4) load message data on demand so ram required is MAX(largest mm hunk, 1= 0mb). i currently have 1000 messages in my inbox, but i have used nupas with 45= 000 messages. some more work is necessary to handle a quarter million messages comforta= bly, as that's too many for one directory. nupas is just in /sys/src/cmd/upas on 9atom; the original is no more. - erik