Jul 23, 2007

NetEffect 10Gb TOE

Brian Hausauer
Chief Architect / Neteffect
10Gb Ethernet Innovations For Data Center Deployment

Product Overview
NetEffect 10 Gigabit and 1 Gagabit iWARP Ethernet Adapters

NetEffect PCI-Express 10-Gigabit iWARP Ethernet: A Performance Study
Recently, NetEffect Inc. has introduced the first and only iWARP–enabled 10-Gigabit Ethernet Channel Adapter. This white paper presents the performance of the NetEffect PCIExpress 10-Gigabit iWARP Ethernet adapter at the NetEffect verbs layer and the MPI implementation. At the verbs layer, our evaluation includes the basic latency and bandwidth tests for both Send/Receive and RDMA write operations, as well as the cost of memory registration. At the MPI level, we present the basic latency and bandwidth, aggregate bandwidth, hotspot bandwidth, and the computation/communication overlap ability for the NetEffect MPI implementation.
A Performance Study

Initial Performance Evaluation of the NetEffect 10 Gigabit iWARP Adapter
Interconnect speeds currently surpass the abilities of today's processors to satisfy their demands. The throughput rate provided by the network simply generates too much protocol work for the processor to keep up with. Remote Direct Memory Access has long been studied as a way to alleviate the strain from the processors. The problem
is that until recently RDMA interconnects were limited to proprietary or specialty interconnects that are incompatible with existing networking hardware. iWARP, or RDMA over TCP/IP, changes this situation. iWARP brings all of the advantages of RDMA, but is compatible with existing network infrastructure, namely TCP/IP over Ethernet. The drawback to iWARP up to now has been the lack of availability of hardware capable of meeting the performance of specialty RDMA interconnects. Recently, however, 10 Gigabit iWARP adapters are beginning to appear on the market. This paper demonstrates the performance of one such 10 Gigabit iWARP implementation and compares it to a popular specialty RDMA interconnect, InfiniBand.
Initial Performance Evaluation of the NetEffect 10 Gigabit iWARP Adapter

Force10 Networks and NetEffect Performance Report
The test results in this document show MPI latency and throughput performance between Force10 Networks’ S-Series S2410 low latency data center switch and NetEffect’s NE010 10 Gigabit Ethernet PCI-X adapters.
NetEffect Performance Report