rakeshmane / Links-Crawler Public

Notifications You must be signed in to change notification settings
Fork 4
Star 15

Simple web crawler to crawl website and organise URLs based on page extensions.

15 stars 4 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 31 Commits
SS		SS
Links_Crawler.py		Links_Crawler.py
README.md		README.md
domain.js		domain.js
index.html		index.html

Repository files navigation

Links-Crawler

Simple web crawler for finding endpoints.

Features:

All crawled URLs are organized by page extensions.
All parameters of same URL are organized and displayed together.

#Running from terminal

#Accessing crawled links

#Installation

pip3 install nyawc

git clone https://github.com/rakeshmane/Links-Crawler.git

cd Links-Crawler

python3 Links_Crawler.py

About

Simple web crawler to crawl website and organise URLs based on page extensions.

Report repository

Releases

No releases published

Packages

No packages published

Contributors 2

Languages