From mboxrd@z Thu Jan 1 00:00:00 1970 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on inbox.vuxu.org X-Spam-Level: X-Spam-Status: No, score=0.2 required=5.0 tests=DKIM_INVALID,DKIM_SIGNED, FREEMAIL_FROM autolearn=no autolearn_force=no version=3.4.4 Received: (qmail 30873 invoked from network); 25 Mar 2021 18:22:33 -0000 Received: from 1ess.inri.net (216.126.196.35) by inbox.vuxu.org with ESMTPUTF8; 25 Mar 2021 18:22:33 -0000 Received: from mail-03.mail-europe.com ([91.134.188.129]) by 1ess; Thu Mar 25 14:08:05 -0400 2021 Date: Thu, 25 Mar 2021 18:07:35 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com; s=protonmail; t=1616695659; bh=gvqo0wOeH9ahqo3z+GwREvoMpmQ5a9p+kQ5GsSGMTuE=; h=Date:To:From:Reply-To:Subject:In-Reply-To:References:From; b=gokmRakWBRzEThzb9PnC/CeBDnyGyD9zSeXn+KYlF6n8k25QWntdRek2+2Jw/NvW2 dl59LhkopFJcSyRZFb6TIs2YtrT/azvAHFAz2P4uZK9EE/s65XhekO0qWMWBwwN7PI KHzHM7ciOCvzx02QwBF3zb82Pg9gD46/YSkbozXw= To: "9front@9front.org" <9front@9front.org> From: kemal Message-ID: <5L9dOv9PILwOg1dZG9BhO2HCJucjv_AjzL84cqY2e-nU7yDeKQ4hQ_T8iZdEf--f7Z_EKodQiYDgYrOj1JqYUX876PzfBRP29ByPHnCE7RA=@protonmail.com> In-Reply-To: References: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-ID: <9front.9front.org> List-Help: X-Glyph: ➈ X-Bullshit: content-addressed pipelining-oriented cloud-scale backend Subject: Re: [9front] issues with the mailing list Reply-To: 9front@9front.org Precedence: bulk your message got sent late but latest messages are coming much faster compa= red to older messages. =E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90 Original Me= ssage =E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90=E2=80=90 On Thursday, March 25, 2021 2:17 PM, Stanley Lieber = wrote: > On March 25, 2021 9:48:40 AM EDT, Stanley Lieber sl@stanleylieber.com wro= te: > > > 1ess; walk /mail/queue|wc -l 6906 > > divide this number roughly in three to get the number of presently unde= livered messages (to all lists; this machine serves all/only 9front/cat-v/w= erc lists). of those, the vast majority are transient dns lookup failures f= or good domains. we alleviated this somewhat already by extending the looku= p timeout, but clearly something else is going on. > > all of this started when I moved the server back to 9cloud from ramnode= . the first thing we noticed was the default setup hammered the now non-ssd= disk by launching runq every time it processed a message. this brought the= whole machine to a crawl (this machine also serves the websites -- people = complained). that was solved by parallelizing a limited number of runqs and= launching them periodically from cron. the side effect of this is exposing= all kinds of weirdness that was previously masked by the never-ending blas= t of runqs, which, in spite of transient failures, always eventually clears= out the queue. > > I'm not yet sure why the transient dns failures are happening. > > sl > > the server has now been configured to run its own resolver. we'll see if = this results in fewer transient lookup failures. > > sl