Unpin numpy

[IgorTatarnikov]

Before submitting a pull request (PR), please read the contributing guide.

Please fill out as much of this template as you can, but if you have any problems or questions, just leave a comment and we will help out :)

Description

What is this PR

• Bug fix
• Addition of a new feature
• Other

Why is this PR needed?
Previously, keras was incompatible with numpy>=2.0. This is solved by keras-team/keras#20049.

What does this PR do?
Unpins numpy and pins keras>=3.5.0 to ensure numpy>=2.0 compatibility.

References

#446 (nearly closes but the numpy<2.0 pin remains for Windows)

How has this PR been tested?

All tests pass in a fresh environment with numpy==2.0.1 and keras==3.5.0.
Manual testing by starting training via the napari GUI.

Is this a breaking change?

No

Does this PR require an update to the documentation?

No

Checklist:

• The code has been tested locally
• The code has been formatted with pre-commit

[IgorTatarnikov]

Seems there's an issue with MacOS will test further

[IgorTatarnikov]

Seems torch is no longer supporting x86 MacOS as of 2.3.0. I think this is leading to some incompatibility with numpy 2.0.

If torch is no longer supporting x86 macOS then I guess we aren't either? Especially if both the detection and classification are relying on torch. In that case we should drop the macos-13 tests from the matrix. Thoughts? @adamltyson @alessandrofelder

[adamltyson]

It's not ideal, as there are some intel macs floating out there, but I think dropping it is the right solution because:

• Not sure we have much of a choice
• I'd be surprised if these machines are being used for intensive analysis (although I suppose some labs might have mac pros?)

[IgorTatarnikov]

I was able to add a some conditional dependencies to allow us to keep testing against macOS x86.

This also uncovered that the windows build of torch==2.4.0 was not compiled against numpy 2.0 😞. They're aware of this issue and it will be fixed in 2.4.1, for now I've pinned numpy<2.0 just for windows. We can also wait for torch 2.4.1, the final changes are being compiled until 8/26 at which point they'll test and release (not sure how long the after 8/26 part will take!)

[IgorTatarnikov]

I'll make a separate PR removing macos-13 from our test suite