ProxyPool

Crawl and validate proxies from Internet

Requirement

requests
gevent
lxml
beautifulsoup4

just run in terminal

python proxypool.py

then

http://localhost:8000

or

http://localhost:8000/?num=1&port=80&type=3&protocol=http&area=北京

the parameter "type" means anonymous level
0: unknown
1: transparent
2: anonymous
3: high anonymous

Name		Name	Last commit message	Last commit date
Latest commit History 7 Commits
.idea		.idea
data		data
.gitignore		.gitignore
DB.py		DB.py
DB.pyc		DB.pyc
QQWry.Dat		QQWry.Dat
README.md		README.md
__init__.py		__init__.py
api.py		api.py
api.pyc		api.pyc
config.py		config.py
config.pyc		config.pyc
crawler.py		crawler.py
crawler.pyc		crawler.pyc
logger.py		logger.py
logger.pyc		logger.pyc
proxypool.py		proxypool.py
proxysites.py		proxysites.py
proxysites.pyc		proxysites.pyc
pyip.py		pyip.py
pyip.pyc		pyip.pyc
test.py		test.py
validator.py		validator.py
validator.pyc		validator.pyc