Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BS4 error from samair proxy parser #33

Closed
Hessu1337 opened this issue Jul 4, 2017 · 4 comments
Closed

BS4 error from samair proxy parser #33

Hessu1337 opened this issue Jul 4, 2017 · 4 comments

Comments

@Hessu1337
Copy link
Contributor

File "/usr/lib/python3.6/site-packages/http_request_randomizer/requests/proxy/requestProxy.py", line 55, in __init__ self.proxy_list += parsers[i].parse_proxyList() File "/usr/lib/python3.6/site-packages/http_request_randomizer/requests/parsers/SamairProxyParser.py", line 42, in parse_proxyList headings = [th.get_text() for th in table.find("tr").find_all("th")] AttributeError: 'NoneType' object has no attribute 'find'

@pgaref
Copy link
Owner

pgaref commented Jul 5, 2017

Hello @Hessu1337

Samair proxy provider looks unreachable to me. For instance, http://samair.ru/proxy/time-01.htm page returns a 404 error - that's why the specific proxy provider is skipped when I am listing all the available proxies. Are you sure the provider is reachable?

Cheers,
Panagiotis

@Hessu1337
Copy link
Contributor Author

Hessu1337 commented Jul 5, 2017

Hi @pgaref ,

It's reachable for me, I made a pull request with bs4 findAll fix and working like a charm here.

@pgaref
Copy link
Owner

pgaref commented Jul 5, 2017

Hello @Hessu1337

I guess they introduced geo-restrictions. May I ask the location(country) of your parser?
Thanks for the PR, please check some inline comments.

Cheers,
Panagiotis

@Hessu1337
Copy link
Contributor Author

Of course, the ip location is based in France.

pgaref pushed a commit that referenced this issue Jul 6, 2017
Addressing #33  - Tests are still failing
@pgaref pgaref closed this as completed Jul 30, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants