Choosing a Service/Hosting Provider

Hello, I'm pretty sure that this question has been picked to death on this list, but I couldn't find a good thread in the nanog archives. If there is one in there, can someone drop me a pointer off-list? Anyways, here is my question: What should people look for when choosing a service or hosting provider? Thanks. Eric