From mboxrd@z Thu Jan 1 00:00:00 1970 From: erik quanstrom Date: Fri, 17 Apr 2009 15:00:39 -0400 To: 9fans@9fans.net Message-ID: <27bb7c6f544c55cef0a4c40eab72a513@coraid.com> In-Reply-To: <20090417181848.GA3033@polynum.com> References: <21493d85b69b070fed0a4f864eb5325a@proxima.alt.za> <57928816a76e769327ca134d7e28bd06@bellsouth.net> <20090417171154.GA2029@polynum.com> <20090417181848.GA3033@polynum.com> MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 8bit Subject: Re: [9fans] VMs, etc. (was: Re: security questions) Topicbox-Message-UUID: e2bb9468-ead4-11e9-9d60-3106f5b1d025 On Fri Apr 17 14:21:03 EDT 2009, tlaronde@polynum.com wrote: > On Fri, Apr 17, 2009 at 01:29:09PM -0400, erik quanstrom wrote: > > > In some sense, logically (but not efficiently: read the caveats in the > > > Plan9 papers; a processor is nothing without tightly coupled memory, so > > > memory is not a remote pool sharable---Mach!), > > > > if you look closely enough, this kind of breaks down. numa > > machines are pretty popular these days (opteron, intel qpi-based > > processors). it's possible with a modest loss of performance to > > share memory across processors and not worry about it. > > NUMA are, from my point of view, "tightly" connected. > > By loosely, I mean a memory accessed by non dedicated processor > hardware means (if this makes sense). Moving data from different > memories via some IP based protocol or worse. But all in all, > finally a copy is put in the tightly connected memory, whether huge > caches, or dedicated main memory. why do you care what gives you the illusion of a large, flat address space? that is, what is special about having a quick path network instead of, say, infiniband or ethernet? why does networking imply ip networking? my point is that i think we need to recognize that there vast differences in performance between, say, local memory, memory across the quickpath bus, memory on the the next machine, and these differences may vary greatly between one set of machines and another. then, the 64ยข question is, how does one use this to one's advantage without assuming ahead of time what's faster than what. (one could easily imagine a 40gbps ethernet connection being competitive with a 3-hop numa connection.) - erik