In spite of the challenges presented by 10 Gigabit Ethernet, Extreme and Foundry hit the ground running. But because architectural constraints limit each card to an 8-gigabit connection to the backplane, bandwidth was limited to 8 gigabits in each direction between the ports and backplanes. So, instead of having 10 times the bandwidth of Gigabit Ethernet, you'll see an eightfold increase. This is a little disappointing, but both vendors were very open about it, reasoning that eight times 1 gigabit is still a dramatic improvement for anyone who has exceeded the capacity of Gigabit Ethernet. We found it hard to argue with that line of reasoning, especially considering that the full 8 gigabits of bandwidth held up so well under our the worst-case scenarios in our tests.
Chances are, most of you don't need 10 Gigabit Ethernet, but if you've read this far you're probably considering taking the plunge or you're an aficionado of the biggest, latest and greatest. If your applications are mostly text-based, like databases and Web, however, your gigabit backbone is handling the load just fine.
Of course, when performance degrades, most users' immediate reaction is to blame the network. It's your job to be rational. If you think your backbone connections are the bottleneck, look at utilization. This isn't hard to do, and there's no excuse not to make the effort periodically. Even free software like MRTG SNMP can pull the octets-in-use data from an interface and figure out utilization (for a review of network management gadgets, including MRTG, see "SolarWinds Sheds Light on Networks"). Some analyzers can tap directly into a backbone gigabit connection to give you that information in real time. Interestingly, an enterprise analyzer that will do that for 10 Gigabit Ethernet still isn't available.
The bottom line: Either you need more bandwidth or you don't. If you can saturate a gigabit link, you have a problem. There are ways to balance network traffic across multiple gigabit trunks, and sometimes a redesign will mitigate your need by localizing traffic. So you may be able to get by while you wait for the inevitable price drop. On the other hand, you may be in a situation where the fiber to support multiple trunks is more expensive than even the high price of 802.3ae, which can range from $25,000 to $59,000 for Extreme and Foundry. It's also a truism of network design that simpler is better, and 802.3ae does indeed provide a simple, scalable solution for companies that have exhausted their gigabit connections.
Torture Testing
We used an Ixia 1600T chassis-based device to generate various types of Layer 2 and Layer 3 traffic. Ixia's testing equipment is capable of blasting precise patterns of traffic at levels limited only by the theoretical bandwidth of the interface. The 1600T came equipped with two 10 Gigabit Ethernet LAN modules as well as gigabit interfaces. Ixia's IxExplorer GUI and ScriptMate applications made it easy for us to hammer the Extreme and Foundry boxes with a barrage of full-duplex tests. The 10-gigabit modules supported the 1310nm LAN interface, which we requested the vendors provide because it's the most common type of physical interface used with 802.3ae (see "10 Gig Can't Wait to Interoperate" for an explanation of the different interfaces). We set up our tests to have zero tolerance for packet drops: If even one packet were lost, the test would fail.
Discover the benefits of scalable backbone and network services for application and cloud providers.
Network automation is gaining momentum. Here's how you can drive this powerful technology to its full potential.
Subsea cable alternatives can provide a level of comfort for those concerned about disruptions. Realistically, they will continue to play a small, but critical role in the short term.
