Require Distributed 2.15.0+

[jakirkham]

This is needed for serialization fixes when working with collections of objects (particularly when they contain 5+ elements).

xref: dask/distributed#3689
xref: #286

[pentschev]

Thanks @jakirkham .

[jakirkham]

These failures seem unexpected. Posting here for tracking purposes, but will go ahead and restart CI (suspect they are spurious).

=================================== FAILURES ===================================
_______________________ test_dataframe_merge[ucx-cudf-1] _______________________

backend = 'cudf', protocol = 'ucx', nworkers = 1

    @pytest.mark.parametrize("nworkers", [1, 2, 4])
    @pytest.mark.parametrize("backend", ["pandas", "cudf"])
    @pytest.mark.parametrize("protocol", ["tcp", "ucx"])
    def test_dataframe_merge(backend, protocol, nworkers):
        p = mp.Process(target=_test_dataframe_merge, args=(backend, protocol, nworkers))
        p.start()
        p.join()
>       assert not p.exitcode
E       assert not -11
E        +  where -11 = <SpawnProcess(SpawnProcess-12, stopped[SIGSEGV])>.exitcode

dask_cuda/tests/test_explicit_comms.py:90: AssertionError
_______________________ test_dataframe_merge[ucx-cudf-2] _______________________

backend = 'cudf', protocol = 'ucx', nworkers = 2

    @pytest.mark.parametrize("nworkers", [1, 2, 4])
    @pytest.mark.parametrize("backend", ["pandas", "cudf"])
    @pytest.mark.parametrize("protocol", ["tcp", "ucx"])
    def test_dataframe_merge(backend, protocol, nworkers):
        p = mp.Process(target=_test_dataframe_merge, args=(backend, protocol, nworkers))
        p.start()
        p.join()
>       assert not p.exitcode
E       assert not -11
E        +  where -11 = <SpawnProcess(SpawnProcess-13, stopped[SIGSEGV])>.exitcode

dask_cuda/tests/test_explicit_comms.py:90: AssertionError
_______________________ test_dataframe_merge[ucx-cudf-4] _______________________

backend = 'cudf', protocol = 'ucx', nworkers = 4

    @pytest.mark.parametrize("nworkers", [1, 2, 4])
    @pytest.mark.parametrize("backend", ["pandas", "cudf"])
    @pytest.mark.parametrize("protocol", ["tcp", "ucx"])
    def test_dataframe_merge(backend, protocol, nworkers):
        p = mp.Process(target=_test_dataframe_merge, args=(backend, protocol, nworkers))
        p.start()
        p.join()
>       assert not p.exitcode
E       assert not -11
E        +  where -11 = <SpawnProcess(SpawnProcess-14, stopped[SIGSEGV])>.exitcode

dask_cuda/tests/test_explicit_comms.py:90: AssertionError

https://gpuci.gpuopenanalytics.com/blue/organizations/jenkins/rapidsai%2Fgpuci%2Fdask-cuda%2Fprb%2Fdask-cuda-gpu-build/detail/dask-cuda-gpu-build/1054/pipeline

[jakirkham]

rerun tests

[pentschev]

#308 should fix errors.

[pentschev]

I just realized we probably want to update https://github.com/rapidsai/dask-cuda/blob/branch-0.15/conda/recipes/dask-cuda/meta.yaml#L28 too, what do you think @jakirkham ?

[pentschev]

rerun tests

[jakirkham]

I just realized we probably want to update https://github.com/rapidsai/dask-cuda/blob/branch-0.15/conda/recipes/dask-cuda/meta.yaml#L28 too, what do you think @jakirkham ?

Yep you're right. Thanks for catching that 🙂

Latest commit should fix this.

[jakirkham]

Thanks Ray! 😄

[jakirkham]

Went ahead and merged. Hope that is ok. If you catching anything else, I can fix it in a follow-up.