Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add PYSEC importer #607

Closed
pombredanne opened this issue Feb 2, 2022 · 2 comments
Closed

Add PYSEC importer #607

pombredanne opened this issue Feb 2, 2022 · 2 comments
Milestone

Comments

@pombredanne
Copy link
Member

This would be a first OSV-based importer

@pombredanne pombredanne added this to the v30.0 milestone Feb 2, 2022
@ziadhany ziadhany mentioned this issue Feb 20, 2022
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Feb 25, 2022
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Mar 1, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

Add PyPL OSV

Signed-off-by: Ziad <[email protected]>

rename pypl_osv to pysec.py , add a test

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Mar 4, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

Add PyPL OSV

Signed-off-by: Ziad <[email protected]>

rename pypl_osv to pysec.py , add a test

Signed-off-by: Ziad <[email protected]>

squash! Add PyPI OSV importer

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Mar 5, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

Add PyPL OSV

Signed-off-by: Ziad <[email protected]>

rename pypl_osv to pysec.py , add a test

Signed-off-by: Ziad <[email protected]>

squash! Add PyPI OSV importer

Signed-off-by: Ziad <[email protected]>

check items before accessing them , add logs

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Mar 5, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

Add PyPL OSV

Signed-off-by: Ziad <[email protected]>

rename pypl_osv to pysec.py , add a test

Signed-off-by: Ziad <[email protected]>

squash! Add PyPI OSV importer

Signed-off-by: Ziad <[email protected]>

check items before accessing them , add logs

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Mar 6, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

Add PyPL OSV

Signed-off-by: Ziad <[email protected]>

rename pypl_osv to pysec.py , add a test

Signed-off-by: Ziad <[email protected]>

squash! Add PyPI OSV importer

Signed-off-by: Ziad <[email protected]>

check items before accessing them , add logs

Signed-off-by: Ziad <[email protected]>

fix_version ranges and add logs

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Mar 8, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

Add PyPL OSV

Signed-off-by: Ziad <[email protected]>

rename pypl_osv to pysec.py , add a test

Signed-off-by: Ziad <[email protected]>

squash! Add PyPI OSV importer

Signed-off-by: Ziad <[email protected]>

check items before accessing them , add logs

Signed-off-by: Ziad <[email protected]>

fix_version ranges and add logs

Signed-off-by: Ziad <[email protected]>

add more test , add multiple fixed_version for affected_pkg

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Mar 16, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

Add PyPL OSV

Signed-off-by: Ziad <[email protected]>

rename pypl_osv to pysec.py , add a test

Signed-off-by: Ziad <[email protected]>

squash! Add PyPI OSV importer

Signed-off-by: Ziad <[email protected]>

check items before accessing them , add logs

Signed-off-by: Ziad <[email protected]>

fix_version ranges and add logs

Signed-off-by: Ziad <[email protected]>

add more test , add multiple fixed_version for affected_pkg

Signed-off-by: Ziad <[email protected]>

add fixed_filter with a test . fix aliases , purl

Signed-off-by: Ziad <[email protected]>

add NotImplemented GIT-Version logs

Signed-off-by: Ziad <[email protected]>

add unit tests

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Mar 23, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

Add PyPL OSV

Signed-off-by: Ziad <[email protected]>

rename pypl_osv to pysec.py , add a test

Signed-off-by: Ziad <[email protected]>

squash! Add PyPI OSV importer

Signed-off-by: Ziad <[email protected]>

check items before accessing them , add logs

Signed-off-by: Ziad <[email protected]>

fix_version ranges and add logs

Signed-off-by: Ziad <[email protected]>

add more test , add multiple fixed_version for affected_pkg

Signed-off-by: Ziad <[email protected]>

add fixed_filter with a test . fix aliases , purl

Signed-off-by: Ziad <[email protected]>

add NotImplemented GIT-Version logs

Signed-off-by: Ziad <[email protected]>

add unit tests

Signed-off-by: Ziad <[email protected]>

add affected_pkg ranges , fix_version ecosystem support,

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Mar 23, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

Add PyPL OSV

Signed-off-by: Ziad <[email protected]>

rename pypl_osv to pysec.py , add a test

Signed-off-by: Ziad <[email protected]>

squash! Add PyPI OSV importer

Signed-off-by: Ziad <[email protected]>

check items before accessing them , add logs

Signed-off-by: Ziad <[email protected]>

fix_version ranges and add logs

Signed-off-by: Ziad <[email protected]>

add more test , add multiple fixed_version for affected_pkg

Signed-off-by: Ziad <[email protected]>

add fixed_filter with a test . fix aliases , purl

Signed-off-by: Ziad <[email protected]>

add NotImplemented GIT-Version logs

Signed-off-by: Ziad <[email protected]>

add unit tests

Signed-off-by: Ziad <[email protected]>

add affected_pkg ranges , fix_version ecosystem support,

Signed-off-by: Ziad <[email protected]>

Fix doctest

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Mar 24, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

Add PyPL OSV

Signed-off-by: Ziad <[email protected]>

rename pypl_osv to pysec.py , add a test

Signed-off-by: Ziad <[email protected]>

squash! Add PyPI OSV importer

Signed-off-by: Ziad <[email protected]>

check items before accessing them , add logs

Signed-off-by: Ziad <[email protected]>

fix_version ranges and add logs

Signed-off-by: Ziad <[email protected]>

add more test , add multiple fixed_version for affected_pkg

Signed-off-by: Ziad <[email protected]>

add fixed_filter with a test . fix aliases , purl

Signed-off-by: Ziad <[email protected]>

add NotImplemented GIT-Version logs

Signed-off-by: Ziad <[email protected]>

add unit tests

Signed-off-by: Ziad <[email protected]>

add affected_pkg ranges , fix_version ecosystem support,

Signed-off-by: Ziad <[email protected]>

Fix doctest

Signed-off-by: Ziad <[email protected]>

remove all empty lines in requirements.txt

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Mar 24, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

Add PyPL OSV

Signed-off-by: Ziad <[email protected]>

rename pypl_osv to pysec.py , add a test

Signed-off-by: Ziad <[email protected]>

squash! Add PyPI OSV importer

Signed-off-by: Ziad <[email protected]>

check items before accessing them , add logs

Signed-off-by: Ziad <[email protected]>

fix_version ranges and add logs

Signed-off-by: Ziad <[email protected]>

add more test , add multiple fixed_version for affected_pkg

Signed-off-by: Ziad <[email protected]>

add fixed_filter with a test . fix aliases , purl

Signed-off-by: Ziad <[email protected]>

add NotImplemented GIT-Version logs

Signed-off-by: Ziad <[email protected]>

add unit tests

Signed-off-by: Ziad <[email protected]>

add affected_pkg ranges , fix_version ecosystem support,

Signed-off-by: Ziad <[email protected]>

Fix doctest

Signed-off-by: Ziad <[email protected]>

remove all empty lines in requirements.txt

Signed-off-by: Ziad <[email protected]>

remove requirements.txt

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Mar 25, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

Add PyPL OSV

Signed-off-by: Ziad <[email protected]>

rename pypl_osv to pysec.py , add a test

Signed-off-by: Ziad <[email protected]>

squash! Add PyPI OSV importer

Signed-off-by: Ziad <[email protected]>

check items before accessing them , add logs

Signed-off-by: Ziad <[email protected]>

fix_version ranges and add logs

Signed-off-by: Ziad <[email protected]>

add more test , add multiple fixed_version for affected_pkg

Signed-off-by: Ziad <[email protected]>

add fixed_filter with a test . fix aliases , purl

Signed-off-by: Ziad <[email protected]>

add NotImplemented GIT-Version logs

Signed-off-by: Ziad <[email protected]>

add unit tests

Signed-off-by: Ziad <[email protected]>

add affected_pkg ranges , fix_version ecosystem support,

Signed-off-by: Ziad <[email protected]>

Fix doctest

Signed-off-by: Ziad <[email protected]>

remove all empty lines in requirements.txt

Signed-off-by: Ziad <[email protected]>

remove requirements.txt

Signed-off-by: Ziad <[email protected]>

fix the test

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Mar 29, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

Add PyPL OSV

Signed-off-by: Ziad <[email protected]>

rename pypl_osv to pysec.py , add a test

Signed-off-by: Ziad <[email protected]>

squash! Add PyPI OSV importer

Signed-off-by: Ziad <[email protected]>

check items before accessing them , add logs

Signed-off-by: Ziad <[email protected]>

fix_version ranges and add logs

Signed-off-by: Ziad <[email protected]>

add more test , add multiple fixed_version for affected_pkg

Signed-off-by: Ziad <[email protected]>

add fixed_filter with a test . fix aliases , purl

Signed-off-by: Ziad <[email protected]>

add NotImplemented GIT-Version logs

Signed-off-by: Ziad <[email protected]>

add unit tests

Signed-off-by: Ziad <[email protected]>

add affected_pkg ranges , fix_version ecosystem support,

Signed-off-by: Ziad <[email protected]>

Fix doctest

Signed-off-by: Ziad <[email protected]>

remove all empty lines in requirements.txt

Signed-off-by: Ziad <[email protected]>

remove requirements.txt

Signed-off-by: Ziad <[email protected]>

fix the test

Signed-off-by: Ziad <[email protected]>

Reference: aboutcode-org#604

fix osv with large fields

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Mar 29, 2022
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Apr 6, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

add the necessary changes

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Apr 10, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

add the necessary changes

Signed-off-by: Ziad <[email protected]>

remove aliases de-duplicate

Signed-off-by: Ziad <[email protected]>

reslove conflicts

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Apr 10, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

add the necessary changes

Signed-off-by: Ziad <[email protected]>

remove aliases de-duplicate

Signed-off-by: Ziad <[email protected]>

reslove conflicts

Signed-off-by: Ziad <[email protected]>

add dateparser to setup.cfg

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Apr 12, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

add the necessary changes

Signed-off-by: Ziad <[email protected]>

remove aliases de-duplicate

Signed-off-by: Ziad <[email protected]>

reslove conflicts

Signed-off-by: Ziad <[email protected]>

add dateparser to setup.cfg

Signed-off-by: Ziad <[email protected]>

Resolving conflicts

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Apr 17, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

add the necessary changes

Signed-off-by: Ziad <[email protected]>

remove aliases de-duplicate

Signed-off-by: Ziad <[email protected]>

reslove conflicts

Signed-off-by: Ziad <[email protected]>

add dateparser to setup.cfg

Signed-off-by: Ziad <[email protected]>

Resolving conflicts

Signed-off-by: Ziad <[email protected]>

resolve conflicts

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue Apr 19, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

add the necessary changes

Signed-off-by: Ziad <[email protected]>

remove aliases de-duplicate

Signed-off-by: Ziad <[email protected]>

reslove conflicts

Signed-off-by: Ziad <[email protected]>

add dateparser to setup.cfg

Signed-off-by: Ziad <[email protected]>

Resolving conflicts

Signed-off-by: Ziad <[email protected]>

resolve conflicts

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue May 3, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

add the necessary changes

Signed-off-by: Ziad <[email protected]>

remove aliases de-duplicate

Signed-off-by: Ziad <[email protected]>

reslove conflicts

Signed-off-by: Ziad <[email protected]>

add dateparser to setup.cfg

Signed-off-by: Ziad <[email protected]>

Resolving conflicts

Signed-off-by: Ziad <[email protected]>

resolve conflicts

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue May 5, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

add the necessary changes

Signed-off-by: Ziad <[email protected]>

remove aliases de-duplicate

Signed-off-by: Ziad <[email protected]>

reslove conflicts

Signed-off-by: Ziad <[email protected]>

add dateparser to setup.cfg

Signed-off-by: Ziad <[email protected]>

Resolving conflicts

Signed-off-by: Ziad <[email protected]>

resolve conflicts

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue May 6, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

add the necessary changes

Signed-off-by: Ziad <[email protected]>

remove aliases de-duplicate

Signed-off-by: Ziad <[email protected]>

reslove conflicts

Signed-off-by: Ziad <[email protected]>

add dateparser to setup.cfg

Signed-off-by: Ziad <[email protected]>

Resolving conflicts

Signed-off-by: Ziad <[email protected]>

resolve conflicts

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue May 13, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

add the necessary changes

Signed-off-by: Ziad <[email protected]>

remove aliases de-duplicate

Signed-off-by: Ziad <[email protected]>

reslove conflicts

Signed-off-by: Ziad <[email protected]>

add dateparser to setup.cfg

Signed-off-by: Ziad <[email protected]>

Resolving conflicts

Signed-off-by: Ziad <[email protected]>

resolve conflicts

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue May 14, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

add the necessary changes

Signed-off-by: Ziad <[email protected]>

remove aliases de-duplicate

Signed-off-by: Ziad <[email protected]>

reslove conflicts

Signed-off-by: Ziad <[email protected]>

add dateparser to setup.cfg

Signed-off-by: Ziad <[email protected]>

Resolving conflicts

Signed-off-by: Ziad <[email protected]>

resolve conflicts

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>
ziadhany added a commit to ziadhany/vulnerablecode that referenced this issue May 14, 2022
Reference: aboutcode-org#607
Signed-off-by: Ziad <[email protected]>

add the necessary changes

Signed-off-by: Ziad <[email protected]>

remove aliases de-duplicate

Signed-off-by: Ziad <[email protected]>

reslove conflicts

Signed-off-by: Ziad <[email protected]>

add dateparser to setup.cfg

Signed-off-by: Ziad <[email protected]>

Resolving conflicts

Signed-off-by: Ziad <[email protected]>

resolve conflicts

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>

add a require changes

Signed-off-by: Ziad <[email protected]>
@pombredanne
Copy link
Member Author

As a follow up, we need to check the schema version (and eventually fail if this is not what is expected)
Also we should contemplate using the https://github.com/pypa/advisory-database/ separately and directly as this and the OSV two may not be exactly in sync

@pombredanne
Copy link
Member Author

See #774 for followup. This is all imported and merged otehrwise.
@ziadhany Thank you ++ 🙇

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant