From mboxrd@z Thu Jan  1 00:00:00 1970
Received: from mail-wm1-f44.google.com ([209.85.128.44]) by ewsd; Tue Sep 18 15:31:29 EDT 2018
Received: by mail-wm1-f44.google.com with SMTP id c14-v6so3731300wmb.4
        for <9front@9front.org>; Tue, 18 Sep 2018 12:31:24 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=offblast-org.20150623.gappssmtp.com; s=20150623;
        h=mime-version:from:date:message-id:subject:to;
        bh=orpHbeUs6Hc7gTQEaIOqJXzmDihI3b6zXN7HnR2YmhM=;
        b=P1T5HQSw9ux3rDeqz+waIiPKx1J2EI8jCIXPgLEU6/0a93+YiGEnGFQH46ee1zZYUK
         sLke716b175LqB9k9pVQdEeGs1DYn2CWhuPyzBZt+sNycWfadfnlSflnrmEyM5jGbU1j
         OOShy5kNCN2AXHr+hlaN5JI23GayM/Yhbs4Z5QCWR23PCZYzm8r0MBLMFWepBF8EhGr1
         XXbIcYUI3bfRZ4XXCJ3ZDZseKId7aLwp6/zBx3ieCvagVI5/cqMdB9RJxtpOR4pA2chp
         zTP4QetQE6VEn2astNrRfKWWoTrQRP0U7iiH9XElv5bNNJ+u+bfeJpnZ7FRNNf/K1qp/
         XKzQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20161025;
        h=x-gm-message-state:mime-version:from:date:message-id:subject:to;
        bh=orpHbeUs6Hc7gTQEaIOqJXzmDihI3b6zXN7HnR2YmhM=;
        b=m/TRGT4FKtiv7jpaC40jfCav8AFNCDAmKZmUmhQYqmmcYN3QapDvWezgL6qP5saAf4
         PRWmwP/iW26AV2ucLYuu7eB3frfb96FvLnPpgutAPXHto43fgg5Gko3c0ToyhQGKfaRx
         gncAQOp+4WpwSdYHuzqqe+rNhP7j7vl4NaY90JTAhtpb19APxfZ3eZwdcuPPxsMOis/y
         YnX7Ng5/4hSW4s+iCrjtWHcdkbPn5hGREGRNPJTN1QSmeTv9Fs1jSkS02/nvXAdx3Mg3
         Fr/5f2d2ZgWUHSIS7wfl/h6FUDG24FooIUXGlCIrzLgT7BpW0GMBLO3cFgYtMJzC/E1R
         etOw==
X-Gm-Message-State: APzg51DdVBFX8sG/6jjsAKVdg/+dKZuiHpCPLKN8o8sIZ6undVo864YZ
	U9HOF0EwUQPwWaWP07hXFt9cwPXJ62vGuHxp/VbBDjVLjG0oog==
X-Google-Smtp-Source: ANB0VdbXmLNRYuiq+UTdknrPWC/DkFdT5FDs+m7d78BrbQ1wZveASUQ8Z6rtrI0kFfSjeVjP16YMhcrL2MdCXbm9T3o=
X-Received: by 2002:a1c:c44a:: with SMTP id u71-v6mr18100737wmf.43.1537299083705;
 Tue, 18 Sep 2018 12:31:23 -0700 (PDT)
MIME-Version: 1.0
From: Nick Owens <mischief@offblast.org>
Date: Tue, 18 Sep 2018 12:31:12 -0700
Message-ID: <CAH_zEu60G8Vav9XeRegHt2vcRTrn-mToyemO+x-Zi-wtcZ5uXg@mail.gmail.com>
Subject: bug: webfs can't download files from sourceforge.net
To: 9front@9front.org
Content-Type: text/plain; charset="UTF-8"
List-ID: <9front.9front.org>
List-Help: <http://lists.9front.org>
X-Glyph: ➈
X-Bullshit: service-aware scripting enhancement grid 

executing the following command:

echo useragent curl/7.28.1 > /mnt/web/ctl
hget https://download.sourceforge.net/tinyscheme/tinyscheme-1.41.tar.gz
> tinyscheme-1.41.tar.gz

will produce a html file.

using actual curl on unix works fine.

the problem appears to be the "Referer" header that webfs forced to be
attached to the request. removing the Referer header from the webfs
source and executing the request again produces the expected .tar.gz
file.

to me the correct solution seems to be to simply drop Referer headers
from webfs, and add them back to mothra if need be, but the comment
attached to the Referer-adding code makes me worried about making a
hasty change.

any thoughts?