Skip to content

web crawling to save data in mongodb and query through python method

Notifications You must be signed in to change notification settings

NithK45/Web-crawling-scraping

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 

Repository files navigation

nithinwebcrawling

This project is built on scrapy framework, mongodb, python and pymongo.

Using scrapy framework, guradiannews website is crawled. Title and URL of news articles are saved in online cloud mongodb. Then a python script using pymongo is used to query data in mongodb and return results.

About

web crawling to save data in mongodb and query through python method

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages