Failing tests overview

[fjetter]

I'm going over all known flaky tests and try to summarize them here such that this can serve as an overview.

• test_client_timeout flaky test_client_timeout #5703

Few failures on test report

• test_file_descriptor test_file_descriptor intermittent failures #4045
• test_tls_specific Flaky test_tls_specific #4215

Xfailed

• Flaky test test_worker_reconnects_mid_compute* #5621
• test_stress_creation_and_deletion test_stress_creation_and_deletion flaky #5388 test_stress_creation_and_deletion: ValueError: Could not find dependent #5172
• test_no_threads_lingering Workers have started leaking threads #5049
• test_restart_during_computation test_restart_during_computation flaky #4956
• test_adaptive_scale_down_override
• test_actor.py::test_linear_access
• test_auto_normalize_collection
• test_auto_normalize_collection_sync
• test_nested_prioritization Ordering using natural string order comparison dask#6807
• test_no_threads_lingering fillna(0) not working ! dask#5409
• test_annotations_survive_optimization Graph optimization loses annotations dask#7036
• test_no_unnecessary_imports_on_worker
• test_pubsub.py::test_basic
• test_scheduler.py::test_non_existent_worker
• test_scheduler.py::test_idle_timeout
• test_utils_perf.py::test_gc_diagnosis_rss_win
• test_worker.py::test_upload_large_file
• test_worker.py::test_share_communication
• test_worker.py::test_dont_overlap_communications_to_same_worker
• test_worker.py::test_wait_for_outgoing

Skipped randomly

• test_map test_map flaky #5007
• test_as_completed_with_results_no_raise (also failures seen) Flaky test test_as_completed_with_results_no_raise #4512

Marked rerun / flaky

• test_statistical_profiling test_statistical_profiling flaky #4974
• test_steal_twice test_steal_twice flaky #4957
• test_AllProgress_lost_key test_AllProgress_lost_key flaky #4915
• test_scale_up_down Flaky test_scale_up_down #4905
• test_target_duration Test timeout test_target_duration #4859
• test_profile Flaky test_profile #4619
• test_idle_timeout Flaky test_idle_timeout #4498
• test_wait_for_outgoing test_wait_for_outgoing breaking on master CI #4417
• test_profile_server Flaky test_profile_server #4251
• test_broken_worker_during_computation Flaky test_broken_worker_during_computation #4173
• test_pid_file test_pid_file failure #3734
• test_AllProgress
• test_target_duration
• test_submit_different_names Xfail test_submit_different_names #5916 Address resolution not consistent #5915

More than 2 weeks stable

• test_avoid_paused_workers Flaky test_avoid_paused_workers #5613
• test_aliases_2 test_aliases_2 flaky? #5516
• test_reschedule_concurrent_requests_deadlock test_reschedule_concurrent_requests_deadlock flaky #5494

GPU

• test_ucx_protocol[1234] Potentially flaky test_stress and test_ucx_protocol[1234] UCX tests #5542
• test_gpu_monitoring_recent test_gpu_monitoring_recent flaky #5287
• test_secede_rejoin_busy test_secede_rejoin_busy flaky #5275
• test_ucx_config_w_env_var distributed.comm.tests.test_ucx_config.test_ucx_config_w_env_var flaky #5229

Unknown

• Tornado Already reading errors #4742
• CI test failure in parse_timedelta (got str that cannot be coerced to float) #4583
• test_ssh.py is extremely flaky on MacOS #4543
• Fix test_open_close_many_workers #2129
• Tests leaking processes #1597