Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Expose new scan queue to many workers #49 #290

Merged
merged 32 commits into from
Mar 19, 2024
Merged

Expose new scan queue to many workers #49 #290

merged 32 commits into from
Mar 19, 2024

Commits on Feb 26, 2024

  1. Move maven priority queue related code to minecode.collectors #283 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    13d0212 View commit details
    Browse the repository at this point in the history

  2. Move npm code #283 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    ada55ea View commit details
    Browse the repository at this point in the history

  3. Create viewset for ScannableURI #49 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    cb4abad View commit details
    Browse the repository at this point in the history

  4. Return empty strings if nothing else on scan queue #49 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    fb9e696 View commit details
    Browse the repository at this point in the history

  5. Update ScannableURI API and model #285 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    93ad167 View commit details
    Browse the repository at this point in the history

  6. Update scan_project_url in update_status #49 #285 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    4739fb7 View commit details
    Browse the repository at this point in the history

  7. Modify ScannableURI fields #49 #285 

        * Create test for ScannableURI API

Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    20a33bc View commit details
    Browse the repository at this point in the history

  8. Ensure a response is returned in update_status #49 #285 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    e07cef0 View commit details
    Browse the repository at this point in the history

  9. Add test for scan indexing through API #49 #285 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    15f70c5 View commit details
    Browse the repository at this point in the history

  10. Renam instances of rescan to reindex #49 #285 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    79b4aa7 View commit details
    Browse the repository at this point in the history

  11. Create minecode/indexing.py #49 #285 

        * Update tests

Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    c4a7d52 View commit details
    Browse the repository at this point in the history

Commits on Feb 29, 2024

  1. Create command to manage in progress scans #49 #285 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    e5b78b2 View commit details
    Browse the repository at this point in the history

Commits on Mar 2, 2024

  1. Pass pipelines to be run to scancode.io 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 2, 2024
    Configuration menu
    Copy the full SHA
    42ae3e6 View commit details
    Browse the repository at this point in the history

Commits on Mar 5, 2024

  1. Create scan_queue_workers group #49 #285 

        * Guard scan_queue API endpoint

Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    5856cde View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2024

  1. Update ScannableURI migrations #49 #285 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    86b0885 View commit details
    Browse the repository at this point in the history

  2. Do not track scan progress from purldb #49 #285 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    4169da5 View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2024

  1. Share code between user creation commands #49 #285 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    38c5805 View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2024

  1. Set default pipelines to be run 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    d46c4b4 View commit details
    Browse the repository at this point in the history

  2. Get scan summary data and use it in index_package #49 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    ef57b49 View commit details
    Browse the repository at this point in the history

Commits on Mar 16, 2024

  1. Fix Package indexing issues #49 

        * Do not overwrite spdx license fields as these are generated
    * set Package fields to be nullable

Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 16, 2024
    Configuration menu
    Copy the full SHA
    ccdee32 View commit details
    Browse the repository at this point in the history

  2. Update package checksums using project extra data #49 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 16, 2024
    Configuration menu
    Copy the full SHA
    4921a9a View commit details
    Browse the repository at this point in the history

  3. Update update_status error responses #49 

        * Test to see if package data can be updated from indexing

Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 16, 2024
    Configuration menu
    Copy the full SHA
    1192879 View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2024

  1. Do not allow updates of finished ScannableURIs #49 #285 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    b0b8ddd View commit details
    Browse the repository at this point in the history

  2. Move validate_uuid to utils.py #49 #285 

        * Add tests for validate_uuid
    * Test for missing scan_status in update_status

Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    ff83b09 View commit details
    Browse the repository at this point in the history

  3. Move code from minecode/collectors to original location #49 #285 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    4ecd97a View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into 49-scan-queue-update

    @JonoYang
    JonoYang committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    06520b3 View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2024

  1. Add tests to ensure proper API permissions for scan_queue #49 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    e3f46fd View commit details
    Browse the repository at this point in the history

  2. Remove previous scan queue Docker services #49 #285 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    093d94b View commit details
    Browse the repository at this point in the history

  3. Fix quotes #49 #285 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    6fbd43b View commit details
    Browse the repository at this point in the history

  4. Update default pipelines to be run for packages #49 #285 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    8dcc1a3 View commit details
    Browse the repository at this point in the history

  5. Use reindex_uri attribute when calling index_package #49 #285 

        * Update quotes

Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    abb6439 View commit details
    Browse the repository at this point in the history

  6. Remove duplicate import #49 #285 

    Signed-off-by: Jono Yang <[email protected]>
    @JonoYang
    JonoYang committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    767e8a9 View commit details
    Browse the repository at this point in the history