9fans - fans of the OS Plan 9 from Bell Labs
 help / color / mirror / Atom feed
From: rog@vitanuova.com
To: 9fans@cse.psu.edu
Subject: Re: [9fans] xcpu note
Date: Wed, 19 Oct 2005 19:21:22 +0100	[thread overview]
Message-ID: <c388345e924af16ea774a504bdc849fa@vitanuova.com> (raw)
In-Reply-To: <435480A0.80109@lanl.gov>

> Oh, wait, 12 nodes. Hmm. That's cheating!

unfortunately, we haven't been able to run the inferno grid stuff on
any more than about 300 nodes.  it works fairly quickly on that
number, but task takeup slows down considerably when it's pumping out
a lot of data (this is better now that nodes cache data).

things are slowed down quite a bit by logging constraints (it stores
much on-going data on disk, both to reduce memory consumption and so
that if the server crashes or is turned off, things can resume with
virtually nothing lost).  running on top of a ram disk can speed
things up by at least an order of magnitude. this probably makes
sense for short-lived jobs.

i'd love to try it out on a larger cluster (one could use an existing
scheduler to leverage the initial installation).



  reply	other threads:[~2005-10-19 18:21 UTC|newest]

Thread overview: 16+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2005-10-17 16:43 Ronald G Minnich
2005-10-17 21:41 ` David Leimbach
2005-10-18  2:38   ` Ronald G Minnich
2005-10-18  4:44     ` Scott Schwartz
2005-10-18  4:45       ` Ronald G Minnich
2005-10-18  7:35         ` Scott Schwartz
2005-10-18  4:57       ` andrey mirtchovski
2005-10-18  4:57         ` Ronald G Minnich
2005-10-19 18:21           ` rog [this message]
2005-10-18 10:25     ` leimy2k
2005-10-18 10:25     ` leimy2k
2005-10-18 10:25     ` leimy2k
2005-10-18 12:10     ` Brantley Coile
2005-10-18  3:04 ` Kenji Okamoto
2005-10-18  3:06   ` Ronald G Minnich
2005-10-18  3:23   ` Eric Van Hensbergen

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=c388345e924af16ea774a504bdc849fa@vitanuova.com \
    --to=rog@vitanuova.com \
    --cc=9fans@cse.psu.edu \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).