We help IT Professionals succeed at work.

Squid returning 403 errors on some websites

bigbigpig
bigbigpig asked
on
4,937 Views
Last Modified: 2008-02-21
Currently I have squid 2.6 set up to not cache web pages, just proxy.  All I want at this phase is to capture the URLs visited in the access.log file.  Everything seems to run OK on most sites but on some certain sites (examples listed below) a 403 error is returned to the web browser.  The access.log shows TCP_MISS/403 for these sites.  I'm just starting to use squid so I'm not sure what is causing the problem here.  The configuration file is pretty much the default configuration except my line for 'cache deny all'.  These sites come up fine when bypassing the proxy.  Anyone know why some sites are responding with a 403 when going through the proxy?

Some sites getting 403 error:
http://www.ebay.com
http://wiki.squid-cache.org/
http://www.floridalottery.com
Comment
Watch Question

Author

Commented:
In addition I get TCP_MISS/600 on http://www.drudgereport.com... whatever a 600 return code is...
Artysystem administrator
Top Expert 2007

Commented:
I have squid Version 2.6.STABLE12 with a little paranoid configuration and I can visit all the listed sites without an error.

When you  test 'direct' connections, to you test them from the same external IP address as your squid?

So there may be 2 reasons of your problem:
1) That site admins either restricted your IP to visit them due to some violations or
2) They perform detection of any proxy and forbid accessing their sites from any proxy (or possibly from open proxy).

My 'paranoid' configuration strips all non-standard headers, including 'X-Forwarded-For:" (this header is often used to detect proxy) and makes proxy 'anonymous'.
Solution Architect
Commented:
This one is on us!
(Get your first solution completely free - no credit card required)
UNLOCK SOLUTION
Unlock the solution to this question.
Join our community and discover your potential

Experts Exchange is the only place where you can interact directly with leading experts in the technology field. Become a member today and access the collective knowledge of thousands of technology experts.

*This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

OR

Please enter a first name

Please enter a last name

8+ characters (letters, numbers, and a symbol)

By clicking, you agree to the Terms of Use and Privacy Policy.