Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate Nginx importer to aboutcode pipeline #1575

Merged
merged 4 commits into from
Sep 27, 2024

Conversation

keshav-space
Copy link
Member

@keshav-space keshav-space commented Aug 29, 2024

@keshav-space keshav-space force-pushed the nginx-importer-pipeline branch 3 times, most recently from 040bf58 to 71cb8c5 Compare August 29, 2024 12:30
@keshav-space keshav-space self-assigned this Sep 2, 2024
@keshav-space keshav-space force-pushed the nginx-importer-pipeline branch 2 times, most recently from 1f8c1c5 to 70d37f4 Compare September 4, 2024 13:15
@keshav-space keshav-space force-pushed the nginx-importer-pipeline branch 2 times, most recently from 32a34f4 to d7b4337 Compare September 23, 2024 12:30
@keshav-space
Copy link
Member Author

keshav-space commented Sep 23, 2024

Import log from a clean run.

python3 manage.py import nginx_importer
Importing data using nginx_importer
INFO 2024-09-23 13:41:19.723 Pipeline [NginxImporterPipeline] starting
INFO 2024-09-23 13:41:19.723 Step [fetch] starting
INFO 2024-09-23 13:41:19.723 Fetch `https://nginx.org/en/security_advisories.html`
INFO 2024-09-23 13:41:20.573 Step [fetch] completed in 1 seconds
INFO 2024-09-23 13:41:20.574 Step [collect_and_store_advisories] starting
INFO 2024-09-23 13:41:20.602 Progress: 10% (4/40)
INFO 2024-09-23 13:41:20.621 Progress: 20% (8/40)
INFO 2024-09-23 13:41:20.632 Progress: 30% (12/40)
INFO 2024-09-23 13:41:20.640 Progress: 40% (16/40)
INFO 2024-09-23 13:41:20.647 Progress: 50% (20/40)
INFO 2024-09-23 13:41:20.653 Progress: 60% (24/40)
INFO 2024-09-23 13:41:20.659 Progress: 70% (28/40)
INFO 2024-09-23 13:41:20.665 Progress: 80% (32/40)
INFO 2024-09-23 13:41:20.671 Progress: 90% (36/40)
INFO 2024-09-23 13:41:20.676 Progress: 100% (40/40)
INFO 2024-09-23 13:41:20.678 Successfully collected 40 advisories
INFO 2024-09-23 13:41:20.678 Step [collect_and_store_advisories] completed in 0 seconds
INFO 2024-09-23 13:41:20.678 Step [import_new_advisories] starting
INFO 2024-09-23 13:41:20.678 Importing 40 new advisories
INFO 2024-09-23 13:41:20.765 Progress: 10% (4/40) ETA: 1 seconds
INFO 2024-09-23 13:41:20.818 Progress: 20% (8/40) ETA: 1 seconds
INFO 2024-09-23 13:41:20.898 Progress: 30% (12/40) ETA: 1 seconds
INFO 2024-09-23 13:41:20.981 Progress: 40% (16/40)
INFO 2024-09-23 13:41:21.051 Progress: 50% (20/40)
INFO 2024-09-23 13:41:21.128 Progress: 60% (24/40)
INFO 2024-09-23 13:41:21.208 Progress: 70% (28/40)
INFO 2024-09-23 13:41:21.303 Progress: 80% (32/40)
INFO 2024-09-23 13:41:21.371 Progress: 90% (36/40)
INFO 2024-09-23 13:41:21.454 Progress: 100% (40/40)
INFO 2024-09-23 13:41:21.482 Successfully imported 40 new advisories
INFO 2024-09-23 13:41:21.482 Step [import_new_advisories] completed in 1 seconds
INFO 2024-09-23 13:41:21.482 Pipeline completed in 2 seconds

Improver log

python3 manage.py improve vulnerabilities.improvers.valid_versions.NginxBasicImprover
Improving data using vulnerabilities.improvers.valid_versions.NginxBasicImprover
Successfully improved data using vulnerabilities.improvers.valid_versions.NginxBasicImprover

Copy link
Contributor

@TG1999 TG1999 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@keshav-space keshav-space merged commit f35640f into main Sep 27, 2024
9 checks passed
@keshav-space keshav-space deleted the nginx-importer-pipeline branch September 27, 2024 12:20
@TG1999 TG1999 added 1-next and removed 9-next labels Sep 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Development

Successfully merging this pull request may close these issues.

2 participants