Thx to all the folks replying off the list. The more I trouble shoot the more I'm convinced that it's not the sites that are doing rate-limiting. I went to a website of one of my previous employers (a small company). Chances of them having a fancy reverse proxy with some sort of black list filtering are slim to none, yet their site barely opens up as well. Must be something that either my firewall device is doing (which is what is doing the NATting) or I don't' know what else. I'm working with my firewall guy since f/w is his domain and I have no clue about that vendor of the firewalls (PaloAlto). Thanks all for the suggestions. I'll keep digging. ----- Andrey Gordon [andrey.gordon@gmail.com] On Tue, Feb 9, 2010 at 4:56 PM, Jay Hennigan <jay@west.net> wrote:
Andrey Gordon wrote:
Can't find my IP on any of the black lists. Don't have any proxies. Sites that behave poorly are consistent. That is to say that facebook.com, apple.com would always come up without an issue, but cnn.com, forever21.com(i know, don't ask, students), store.apple.com would consistently take forever to come up.
Just wanted to check of rate-limiting web clients is a common practice nowdays in the industry. If it's not, it's probably an unlikely cause of my troubles...
It could be that the problem sites have some form of load balancer that has an issue keeping state on multiple sessions from the same IP.
You mentioned that changing the source IP fixed it. Is this a temporary fix that breaks after several users access the sites from the new IP?
-- Jay Hennigan - CCIE #7880 - Network Engineering - jay@impulse.net Impulse Internet Service - http://www.impulse.net/ Your local telephone and internet company - 805 884-6323 - WB6RDV