Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not handling no_proxy #147

Closed
wummel opened this issue Dec 21, 2012 · 1 comment
Closed

Not handling no_proxy #147

wummel opened this issue Dec 21, 2012 · 1 comment

Comments

@wummel
Copy link
Owner

wummel commented Dec 21, 2012

Converted from SourceForge issue 1502968, submitted by iwanttokeepanon

I ran:
linkchecker -I -D -D

Python 2.4.2 (#1, Feb 14 2006, 18:11:24)
[GCC 3.3.6 (Gentoo 3.3.6, ssp-3.3.6-1.0, pie-8.7.8)] on
linux2
set threading with 10 threads
reading configuration from
['usr/share/linkchecker/linkcheckerrc',
'/home/rodney/.linkcheckerrc']
configuration: [('cookies', False),
('verbose', False),
...snip...
('proxy',
{'http': 'http://PROXY.xxxxxxx.com:8080/',
'https': 'https://PROXY.xxxxxxx.com:8080/',
'no': '127.0.0.1,localhost,10.0.4.10,10.0.4.20'}),

...NOTE: that the 'no' proxy environment variable is
parsed but is ignored below ...
...snip...
('interactive', True)]
enter one or more urls, separated by white-space
--> http://127.0.0.1/
LinkChecker 1.12.1 Copyright © 2000-2004
Bastian Kleineidam
LinkChecker comes with ABSOLUTELY NO WARRANTY!
This is free software, and you are welcome to
redistribute it
under certain conditions. Look at the file `LICENSE'
within this
distribution.
Get the newest version at
http://linkchecker.sourceforge.net/
Write comments and bugs to [email protected]

Start checking at 2006-06-08 10:00:00-005
Checking http link
urlname=http://127.0.0.1/
parentName=None
baseRef=None
cached=False
recursionLevel=0
urlConnection=None
line=0
column=0
name=None
checking syntax
checking cache
extern = (0, 0)
checking connection
robots.txt url http://127.0.0.1/robots.txt
url http://127.0.0.1/
robots.txt page info Content-Type: text/html;
charset=ISO-8859-1^M
Content-Length: 1608^M
Pragma: no-cache^M
Proxy-Connection: close^M

robots.txt allow all
Checking robot.txt allowance for:
user agent: 'LinkChecker/1.12.1'
url: 'http://127.0.0.1/'
host PROXY.xxxxxxx.com:8080
connect: (PROXY.xxxxxxx.com, 8080)

...NOTE: this should not be proxied ...

send: 'HEAD http://127.0.0.1/ HTTP/1.1\r\nHost:
PROXY.xxxxxxx.com:8080\r\nUser-Agent: LinkChecker/1.12.1
\r\nAccept-Encoding: gzip;q=1.0, deflate;q=0.9,
identity;q=0.5\r\n\r\n'
reply: 'HTTP/1.1 504 Gateway Time-Out\r\n'
header: Content-Type: text/html; charset=ISO-8859-1^M
header: Content-Length: 1608^M
header: Pragma: no-cache^M
header: Proxy-Connection: close^M
504 Gateway Time-Out Content-Type: text/html;
charset=ISO-8859-1^M
Content-Length: 1608^M
Pragma: no-cache^M
Proxy-Connection: close^M

host PROXY.xxxxxxx.com:8080
connect: (PROXY.xxxxxxx.com, 8080)
send: 'GET http://127.0.0.1/ HTTP/1.1\r\nHost:
PROXY.xxxxxxx.com:8080\r\nUser-Agent: LinkChecker/1.12.1
r\nAccept-Encoding: gzip;q=1.0, deflate;q=0.9,
identity;q=0.5\r\n\r\n'
reply: 'HTTP/1.1 504 Gateway Time-Out\r\n'
header: Content-Type: text/html; charset=ISO-8859-1^M
header: Content-Length: 1608^M
header: Pragma: no-cache^M
header: Proxy-Connection: close^M
504 Gateway Time-Out Content-Type: text/html;
charset=ISO-8859-1^M
Content-Length: 1608^M
Pragma: no-cache^M
Proxy-Connection: close^M

checking recursion
logging url

URL http://127.0.0.1/
Real URL http://127.0.0.1/
Check Time 1.389 seconds
Info Using Proxy 'PROXY.xxxxxxx.com:8080'
Result Error: 504 Gateway Time-Out
caching

Thats it. 1 error in 1 link found
Stopped checking at 2006-06-08 10:00:03-005 ( 2.256
seconds)
Hit RETURN to finish

@wummel
Copy link
Owner Author

wummel commented Dec 21, 2012

Submitted by calvin

Logged In: YES
user_id=9205

Hi,

please try to use a more recent version of LinkChecker. On
Gentoo, you can emerge a more recent version (3.3 at the
time of this writing) with:

$ ACCEPT_KEYWORDS="~x86" emerge -Dvp linkchecker

However I suggest installing the latest version, which is at
the moment 4.1.

Hope this helps,
Bastian

@wummel wummel closed this as completed Dec 21, 2012
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant