Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

UX: Test if models are platform dependent #277

Open
thao-do opened this issue Apr 23, 2024 · 2 comments
Open

UX: Test if models are platform dependent #277

thao-do opened this issue Apr 23, 2024 · 2 comments
Assignees

Comments

@thao-do
Copy link
Collaborator

thao-do commented Apr 23, 2024

would a provided model from us (trained from working on a tutorial) work on a user's system (of course within the context of the napari plugin)?

Action: will test once we have Training working, we'll pass a model trained on one of our machines to other machines and use it on a same set of images with Prediction to see if it provides the same results. V1 won't allow retraining a (provided) model anyway, so we can test that later for V2.

@thao-do thao-do assigned thao-do and benjijamorris and unassigned thao-do Apr 23, 2024
@benjijamorris
Copy link

They should not be! Pytorch, pytorch-lightning, and cuda versions aremore likely to mess things up than the model checkpoints themselves. This is definitely worth testing though!

@benjijamorris
Copy link

The "model" (configs + checkpoint) should be os-agnostic. However, different versions of packages might be installed based on the users OS. Some of these are compatible (for example, pytorch lightning versions are largely compatible), but it's possible that users on different operating systems might not be able to share models because of different package versions. CUDA operations in pytorch are often stochastic, so changing CUDA version will slightly change results (I don't think this is a huge effect).
I don't think this will be a problem, but it's worth testing.

@thao-do thao-do self-assigned this Apr 23, 2024
@thao-do thao-do changed the title Check with Benji if models are platform dependent UX: Test if models are platform dependent Apr 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants