On Fri, 29 Apr 2011, Michael Holstein wrote:
Those two (thanks to Luca) can get you most of the way there, but to really hit the target you need dedicated kit like Endace (and a few others) make. They basically do what was represented in the CCC slides somebody else posted (FPGA with own logic), but on a PCIe card.
Once you've got the ethernet -> interface problem addressed, you need to examine bottlenecks in interface->bus and particularly bus->disk.
One good open source solution on the disk side is Gluster with 10 gig infiniband on the back end. Gluster allows you to build a distributed storage over many servers. You can find 10 gig infiniband cards on ebay for around $50 and a good 24 port topspin/cisco switch will cost you about $1K.
<> Nathan Stratton CTO, BlinkMind, Inc. nathan at robotics.net nathan at blinkmind.com http://www.robotics.net http://www.blinkmind.com