One key consideration you should think about is the ability to perform maintenance on redundant devices in the N+1 model without impacting the availability of the network.
Brent
Timothy Brown <tim@tux.org> Sent by: owner-nanog@merit.edu
01/16/2004 10:14 PM
To: nanog@merit.edu
cc:
Subject: One-element vs two-element design
I fear this may be a mother of a debate.
In my (short?) career, i've been involved in several designs, some successful,
some less so. I've recently been asked to contribute a design for one of the
networks I work on. The design brings with it a number of challenges, but
also, unlike a greenfield network, has a lot of history.
One of the major decisions i'm being faced with is a choice between one-element
or two-element design. When I refer to elements, what I really mean to say
is N or N+1. For quite some time now, vendors have been improving hardware
to the point where most components in a given device, with the exception of
a line card, can be made redundant. This includes things like routing and
switching processors, power supplies, busses, and even, in the case of vendor
J and several others, the possibility of inflight restarts of particular
portions of the software as part of either scheduled maintenance or to correct
a problem.
I have always been traditionally of the school of learning that states that
it is best to have two devices of equal power and on the same footing, and,
in multiple site configurations, four devices of equal power and equal footing.
I feel like a safe argument to make is N+1, so that is the philosophy that
I tend to adopt. N+2 or N...whatever doesn't seem to add a lot of additional
security into the network's model of availability. This adds complexity, but
I prefer to think of this in terms of, "Well, I can manage software or design
complexity in my configurations, but I can't manage the loss of a single
device which holds my network together." Now I must view this assertion in
the context of better designed hardware and cheap spares-on-hand.
Of course, like many other folks, I have tried to drink as deeply as I can
from the well of knowledge. I've perused at length Cisco Press' High
Availability Network Fundamentals, and understand MTBF calculations and
some of the design issues in building a highly available network. But from
a cost perspective, it seems that a single, larger box may be able to offer me
as much redundancy as two equally configured boxes handling the same traffic
load. Of course, there's that little demon on my shoulder, that tells me
that I could always lose a complete device due to a power issue or short,
and then i'd be up a creek.
We have a history of adopting the N+1 model on the specific network i'm
talking about, and it has worked very well so far in the face of occassional
software failures by a vendor we occassionally have ridiculed here on nanog-l.
However, in considering a comprehensive redesign, another vendor offers
significantly more software stability, so i'm re-evaluating the need for
multiple devices.
My mind's more or less already made up, but i'd like to hear the design
philosophies of other members of the operational community when adopting a
N+1 approach. In particular, i'd love to hear a catastrophic operational
failure which either proves or disproves either of the potential options.
Tim
ObDisclaimer: Please contact me off-list if you're okay with your thoughts
on this matter being published in a book targeted to the operations community.