Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Show status code for each page #118

Open
undergroundwires opened this issue Jul 22, 2022 · 0 comments
Open

Show status code for each page #118

undergroundwires opened this issue Jul 22, 2022 · 0 comments
Labels
feature New feature or request

Comments

@undergroundwires
Copy link

Maybe a smaller step before #97 where responseCode: can be returned for each request in req_list and all_req_list. It would be HTTP status code that crawlergo has received such as 404 or 200. This way one could mark a page as up and down already in the crawling state and does not scan those URLs later on for other purposes.
@Qianlitp Qianlitp added the feature New feature or request label Dec 6, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@undergroundwires @Qianlitp