From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on inbox.vuxu.org X-Spam-Level: X-Spam-Status: No, score=-1.1 required=5.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,FREEMAIL_FROM,MAILING_LIST_MULTI,RCVD_IN_DNSWL_NONE autolearn=ham autolearn_force=no version=3.4.2 Received: from primenet.com.au (ns1.primenet.com.au [203.24.36.2]) by inbox.vuxu.org (OpenSMTPD) with ESMTP id e41e1200 for ; Mon, 20 May 2019 14:28:59 +0000 (UTC) Received: (qmail 9403 invoked by alias); 20 May 2019 14:28:45 -0000 Mailing-List: contact zsh-users-help@zsh.org; run by ezmlm Precedence: bulk X-No-Archive: yes List-Id: Zsh Users List List-Post: List-Help: List-Unsubscribe: X-Seq: 23949 Received: (qmail 23535 invoked by uid 1010); 20 May 2019 14:28:45 -0000 X-Qmail-Scanner-Diagnostics: from mail-wr1-f54.google.com by f.primenet.com.au (envelope-from , uid 7791) with qmail-scanner-2.11 (clamdscan: 0.101.2/25454. spamassassin: 3.4.2. Clear:RC:0(209.85.221.54):SA:0(-1.0/5.0):. Processed in 1.789681 secs); 20 May 2019 14:28:45 -0000 X-Envelope-From: stephane.chazelas@gmail.com X-Qmail-Scanner-Mime-Attachments: | X-Qmail-Scanner-Zip-Files: | Received-SPF: pass (ns1.primenet.com.au: SPF record at _netblocks.google.com designates 209.85.221.54 as permitted sender) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:cc:subject:message-id:mail-followup-to:references :mime-version:content-disposition:in-reply-to:user-agent; bh=MxQfNtGVngUlk4T4kqu2/rNa3dv0Da28U4Ej6AdXKYE=; b=oADzlLbk5lEqloGkZ7hhO5B9SpnRLOF1SPWoCVMU1LWZNWV+cumq/updcML4lLeooS AJfZ1ujHP1mlJ/uTUMGDqg+i1BMxwHVdnIgTb0ZAEL+g0XCyoHEvD2NkGDS+cZ0OGm4S GfQBAKnRZWQ91sxtn+4yFMRjN8II9sol39Md0DKH5wOR63OJThQUjixiao+oR6uAPshS ZQgeC/o+EimK4QwJ9ZRtPAQBd61Wtko7tfOh3Znv49cSXRiF6SFCbuk6RmNXDFZw4P8U /tSAFHx0wFm9nTW5n3NKdhnvHk58kQrVUlkPrGSHqijLUM/5NNdKaiXFpE5QON1g01pw m8Ig== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id :mail-followup-to:references:mime-version:content-disposition :in-reply-to:user-agent; bh=MxQfNtGVngUlk4T4kqu2/rNa3dv0Da28U4Ej6AdXKYE=; b=arq9PXakPmlun7gdzVsiYrYEMxCwhvEp5qJQSDtmzVp+0/PXPEVauzLJQviMVoS0Xa AnaQhSVg3DxO98VWh3VLZEnEqcIzi/vnInnivrYiF5PWNSktqjl8H3FuVMPgFJ+pGjuU q0cSH+RBGgssxi8eCAsVEUA7MdE1BfmaVm4xIbbceJ3r18PqtegomiNMOZdKN1+29jzB xLgEskmgn/2YH8QjgxYT3kmV5Zb/rtvcAPJeVwfcUK1Z6y5AXNQWhenLHWcxh0hPngp8 jCURsromaDn/P6K/vp74wDSxf1FDRzNRHrDJmv2j3KJgELv6NUpdwiptuOmkkI5vwdZN jVoQ== X-Gm-Message-State: APjAAAUVWc1Q/Qit6OerkIBbF4IyvJ6MUReI4D0sgf5gKfPQPtCFs0TZ a9SYuQD333pUJNjc1g9SXlCcm7unMg0= X-Google-Smtp-Source: APXvYqzcBMLARrusKmBCcB6AEsO4Ngz5cY+LhgxIOdWgsvxBDqxWKPSaivrdjkr7jrwr8TmNxjZqsA== X-Received: by 2002:adf:e90e:: with SMTP id f14mr8957834wrm.166.1558362489361; Mon, 20 May 2019 07:28:09 -0700 (PDT) Date: Mon, 20 May 2019 15:28:06 +0100 From: Stephane Chazelas To: Daniel Shahaf Cc: zsh-users@zsh.org Subject: Re: Why prevent the mailing list from being indexed? Message-ID: <20190520142806.l3lp7zti2mhvwddl@chaz.gmail.com> Mail-Followup-To: Daniel Shahaf , zsh-users@zsh.org References: <20190520102811.cird7ae4a3c4xhpo@chaz.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: NeoMutt/20171215 2019-05-20 11:04:09 +0000, Daniel Shahaf: > Stephane Chazelas wrote on Mon, 20 May 2019 10:30 +00:00: > > I was surprised when a google search on the zsh mailing list > > archives turned up nothing when I knew it should (site:zsh.org > > ZSH_XTRACEFD) and then saw: > > > > https://www.zsh.org/robots.txt [...] > > Disallow: /mla/zsh-workers/ [...] > Note that it only disallows the directories that contain the raw rfc822 > files. The rendered HTML indexes at /mla/workers/ aren't disallowed, > so they should be implicitly allowed, shouldn't they? [...] Sorry, my bad. I missed that. I can see now they are indexed indeed. Like enteiser@gmail.com says, it's probably just that they're recent. Cheers, Stephane