Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Integrate SAM 2.1 #8610

Open
wants to merge 23 commits into
base: develop
Choose a base branch
from
Open

Integrate SAM 2.1 #8610

wants to merge 23 commits into from

Commits on Jul 31, 2024

  1. Introduce Segment Anything 2.0 for GPU only. 

    Segment Anything 2.0 require to compile a .cu file with nvcc at build time. Hence, a cuda devel baseImage is required to build the nuclio container.
    @jeanchristopheruel
    jeanchristopheruel committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    e2b9624 View commit details
    Browse the repository at this point in the history

  2. Create a changelog fragment

    @jeanchristopheruel
    jeanchristopheruel committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    d482fd9 View commit details
    Browse the repository at this point in the history

  3. remove useless docstring

    @jeanchristopheruel
    jeanchristopheruel committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    8cff678 View commit details
    Browse the repository at this point in the history

  4. fix readme regarding CPU capabilities for SAM2

    @jeanchristopheruel
    jeanchristopheruel committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    ac89a2f View commit details
    Browse the repository at this point in the history

  5. reduce the default number of cpu workers to 1

    @jeanchristopheruel
    jeanchristopheruel committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    a2ce34f View commit details
    Browse the repository at this point in the history

  6. add a try catch block as suggested by coderabbitai

    @jeanchristopheruel
    jeanchristopheruel committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    32a9b22 View commit details
    Browse the repository at this point in the history

  7. remove data logs in main

    @jeanchristopheruel
    jeanchristopheruel committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    bf650ab View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2024

  1. fix: introduce sam2 on cpu

    @jeanchristopheruel
    jeanchristopheruel committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    643081f View commit details
    Browse the repository at this point in the history

  2. fix: use newest installation mewthod from facebook. (configs files ar… 

    …e not embedded into installation package)
    @jeanchristopheruel
    jeanchristopheruel committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    6dd2eb7 View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2024

  1. update docs -> SAM2 now supports CPU

    @jeanchristopheruel
    jeanchristopheruel committed Aug 10, 2024
    Configuration menu
    Copy the full SHA
    288bdcf View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2024

  1. fix linter errors

    @jeanchristopheruel
    jeanchristopheruel committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    158dbba View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2024

  1. Update 20240731_000641_ruelj2.md

    @jeanchristopheruel
    jeanchristopheruel authored Aug 15, 2024
    Configuration menu
    Copy the full SHA
    618ffbf View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. Merge branch 'jeanchristopheruel/sam2' into feature/sam2

    Yousif Hashisho committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    2f4979f View commit details
    Browse the repository at this point in the history

  2. WIP: pass env CLIENT_PLUGINS to cvat_ui args in docker-compose.dev.ym… 

    …l as required in Dockerfile.ui for extra plugins, adjust function.yaml and function-gpu.yaml to accommodate SAM2.1 and frontend plugin, add index.tsx and inference.worker.ts, update main.py and model_handler.py accordingly
    Yousif Hashisho committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    bfcc5e2 View commit details
    Browse the repository at this point in the history

  3. WIP: start working on frontend errors, backend should be okay

    Yousif Hashisho committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    ffe6f50 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2024

  1. WIP: rework backend to include high_res_feats_0 and high_res_feats_1 … 

    …since not included in self.predictor.get_image_embedding() and needed in decoder and a new encoder class is added in image_encoder.py
    Yousif Hashisho committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    f562adc View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2024

  1. add new inputs (high_res_feat0, high_res_feat1) and do corresponding … 

    …changes in index.tsx, and accommodate those inputs in inference.worker.ts and add sam2.1_hiera_large.decoder where postprocessing steps are added to undergo minimal changes in sam2 plugin
    Yousif Hashisho committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    92d20ac View commit details
    Browse the repository at this point in the history

  2. clean code

    Yousif Hashisho committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    d5a9766 View commit details
    Browse the repository at this point in the history

  3. clean code

    Yousif Hashisho committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    f232eac View commit details
    Browse the repository at this point in the history

  4. update README.md

    Yousif Hashisho committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    bae57fb View commit details
    Browse the repository at this point in the history

  5. update docker-compose.dev.yml

    Yousif Hashisho committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    1f506aa View commit details
    Browse the repository at this point in the history

  6. fix function-gpu.yaml

    Yousif Hashisho committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    d027a6a View commit details
    Browse the repository at this point in the history

  7. fix pip install in function-gpu.yaml

    Yousif Hashisho committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    0a8d038 View commit details
    Browse the repository at this point in the history