From mboxrd@z Thu Jan 1 00:00:00 1970 Message-ID: <4E149BCA.7030207@0x6a.com> Date: Wed, 6 Jul 2011 12:30:50 -0500 From: Jack User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US; rv:1.9.2.18) Gecko/20110616 Thunderbird/3.1.11 MIME-Version: 1.0 To: Fans of the OS Plan 9 from Bell Labs <9fans@9fans.net> References: <4129bd2e772e6f2068f8cd02d61c28a3@quintile.net> In-Reply-To: <4129bd2e772e6f2068f8cd02d61c28a3@quintile.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: [9fans] pcie for inter machine comms Topicbox-Message-UUID: fb14d1da-ead6-11e9-9d60-3106f5b1d025 On 7/6/2011 4:06 AM, Steve Simon wrote: > Any of the HPC guys who read this list know of anyone using > pcie with a non-transparent bridge to send data between hosts > as a very fast, very local network? > > I seem to remember IBM did somthing like this with back-to-back DMAs in > RS6000 in the early 1990s, but does anyone do it now? or do we feel that > UDP over 40gE is fast enough for anything anyone needs (at present)? > > -Steve > It's funny, it's as if you have the exact opposite vision as I have. One of my " aha!" moments messing with Plan 9 was the thought that generic consumer physical layer networks are the "backplane" of hardware expansion in Plan 9. This is how I've since viewed Plan 9 and inferno. In fact my first thought was " damn, well now I don't need all of this pci[e] crap -- just a NIC". Ever since then I have been in the development stages of some 9p devices using microcontrollers of various capabilities. I had my arduino getting almost all the way with negotiating a styx session over ethernet (no auth). Then I got married..... :) in due time I will get there. I've dropped the arduino though, moving on to bigger and better things. I know this has nothing to do with your question, but I just wanted to share a point of view. -Jack