-
Notifications
You must be signed in to change notification settings - Fork 201
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Migrate Nginx importer to aboutcode pipeline #1575
Merged
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
36 tasks
keshav-space
force-pushed
the
nginx-importer-pipeline
branch
3 times, most recently
from
August 29, 2024 12:30
040bf58
to
71cb8c5
Compare
keshav-space
force-pushed
the
nginx-importer-pipeline
branch
2 times, most recently
from
September 4, 2024 13:15
1f8c1c5
to
70d37f4
Compare
keshav-space
force-pushed
the
nginx-importer-pipeline
branch
2 times, most recently
from
September 23, 2024 12:30
32a34f4
to
d7b4337
Compare
Import log from a clean run. ❯ python3 manage.py import nginx_importer
Importing data using nginx_importer
INFO 2024-09-23 13:41:19.723 Pipeline [NginxImporterPipeline] starting
INFO 2024-09-23 13:41:19.723 Step [fetch] starting
INFO 2024-09-23 13:41:19.723 Fetch `https://nginx.org/en/security_advisories.html`
INFO 2024-09-23 13:41:20.573 Step [fetch] completed in 1 seconds
INFO 2024-09-23 13:41:20.574 Step [collect_and_store_advisories] starting
INFO 2024-09-23 13:41:20.602 Progress: 10% (4/40)
INFO 2024-09-23 13:41:20.621 Progress: 20% (8/40)
INFO 2024-09-23 13:41:20.632 Progress: 30% (12/40)
INFO 2024-09-23 13:41:20.640 Progress: 40% (16/40)
INFO 2024-09-23 13:41:20.647 Progress: 50% (20/40)
INFO 2024-09-23 13:41:20.653 Progress: 60% (24/40)
INFO 2024-09-23 13:41:20.659 Progress: 70% (28/40)
INFO 2024-09-23 13:41:20.665 Progress: 80% (32/40)
INFO 2024-09-23 13:41:20.671 Progress: 90% (36/40)
INFO 2024-09-23 13:41:20.676 Progress: 100% (40/40)
INFO 2024-09-23 13:41:20.678 Successfully collected 40 advisories
INFO 2024-09-23 13:41:20.678 Step [collect_and_store_advisories] completed in 0 seconds
INFO 2024-09-23 13:41:20.678 Step [import_new_advisories] starting
INFO 2024-09-23 13:41:20.678 Importing 40 new advisories
INFO 2024-09-23 13:41:20.765 Progress: 10% (4/40) ETA: 1 seconds
INFO 2024-09-23 13:41:20.818 Progress: 20% (8/40) ETA: 1 seconds
INFO 2024-09-23 13:41:20.898 Progress: 30% (12/40) ETA: 1 seconds
INFO 2024-09-23 13:41:20.981 Progress: 40% (16/40)
INFO 2024-09-23 13:41:21.051 Progress: 50% (20/40)
INFO 2024-09-23 13:41:21.128 Progress: 60% (24/40)
INFO 2024-09-23 13:41:21.208 Progress: 70% (28/40)
INFO 2024-09-23 13:41:21.303 Progress: 80% (32/40)
INFO 2024-09-23 13:41:21.371 Progress: 90% (36/40)
INFO 2024-09-23 13:41:21.454 Progress: 100% (40/40)
INFO 2024-09-23 13:41:21.482 Successfully imported 40 new advisories
INFO 2024-09-23 13:41:21.482 Step [import_new_advisories] completed in 1 seconds
INFO 2024-09-23 13:41:21.482 Pipeline completed in 2 seconds Improver log ❯ python3 manage.py improve vulnerabilities.improvers.valid_versions.NginxBasicImprover
Improving data using vulnerabilities.improvers.valid_versions.NginxBasicImprover
Successfully improved data using vulnerabilities.improvers.valid_versions.NginxBasicImprover |
Signed-off-by: Keshav Priyadarshi <[email protected]>
Signed-off-by: Keshav Priyadarshi <[email protected]>
Signed-off-by: Keshav Priyadarshi <[email protected]>
Signed-off-by: Keshav Priyadarshi <[email protected]>
keshav-space
force-pushed
the
nginx-importer-pipeline
branch
from
September 27, 2024 12:00
44457ff
to
6773d76
Compare
TG1999
approved these changes
Sep 27, 2024
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR migrates Nginx importer to Nginx Importer pipeline