From mboxrd@z Thu Jan 1 00:00:00 1970 From: erik quanstrom Date: Wed, 23 Sep 2009 22:56:24 -0400 To: 9fans@9fans.net Message-ID: <353050cb05a3de49e8d78bd31494e3ee@brasstown.quanstro.net> MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 8bit Subject: [9fans] myricom 10gbe update Topicbox-Message-UUID: 76d75c90-ead5-11e9-9d60-3106f5b1d025 with the help of the great folks at myricom, we've been able to find a couple of performance limitations and fix a few bugs. we were able to transfer aoe at >1GB/s between two modest (3 year old) 1.86ghz intel 5000 xeons. contrib quanstro/etherm10g this patch uses the vmappat patch which is now out-of-date. a redo is available at /n/sources/contrib/quanstro/patredux. this patch is not required but helps if you are using "small" packets. by small, i mean < 8k. to remove, just turn vmappat to vmap without the 3d arg. since we are not using msi interrupts, the coal parameter (interrupt coalesing) is fairly sensitve. this is because the dance even mp interrupts need to do takes many cycles. it's amazing how many apics, i/o apics and other nonsense is involved on a modern pcie machine. i have used values from 15-50µs with the current code. ymmv. - erik