From mboxrd@z Thu Jan  1 00:00:00 1970
From: erik quanstrom <quanstro@quanstro.net>
Date: Sun,  9 Jan 2011 22:57:29 -0500
To: 9fans@9fans.net
Message-ID: <43246aceee3ed5982fe990b8b4aade04@plug.quanstro.net>
MIME-Version: 1.0
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 8bit
Subject: Re: [9fans] fs performance
Topicbox-Message-UUID: 93433826-ead6-11e9-9d60-3106f5b1d025

> Peak Local file access bandwidth is typically 50 to 100 MBPs
> x number of disks; over the localnet it is about 80MBps. On
> my internet connection I barely get 1MBps download (& 0.2MBps
> upload) speeds.

interesting observation: when i first set up the diskless fileserver
at coraid, we had a mirror of the worm in another building across
an awful wireless connection.  we had no more than 1mbit.
at first i was a little worried about this, but then i realized that
128k/s * 86400s/day is 10.5gb/day.

btw, with aoe, you should saturate the network—125 mb/s/interface
for gbe so a typical el-cheepo computer these days can do 250mb/s
over aoe without breaking a sweat.  of course you'll get 10x that with
10gbe.

i agree with charles, network attached, or even internet-attached
storage seems like the way to go.  for internet-attached storage,
the amazing imbalances of very slow last-mile networks/very cheep
mass storage and the power of slow networks over time lead me
to think there are some very interesting engineering tradeoffs to
be made.

- erik