A fast and nifty little crawler.
You need to install the following two packages:
- curl / libcurl : Developer’s libraries for curl
These instructions will get you a copy of the project up and running on your local machine for development and testing purposes. Open up your terminal after installing the prerequisites and put these commands.
git clone https://github.com/sebinbabu/Hammock.git
cd Hammock
make
sudo make install
Use the hammock help
command to get instructions.
hammock init
: initializes the current working directory as a Hammock directoryhammock depth 5
: sets the crawl depth of the crawler to 5 levels of recursionhammock add http:///www.google.com/
: adds Google's homepage to the crawl queuehammock add http://github.com/
: adds Github's homepage to the crawl queuehammock crawl
: starts the crawler on the queue
- Sebin Babu - Initial work - Sebin Babu
This project is licensed under the Apache 2.0 License - see the LICENSE.md file for details