[CT-2656] Flaky Tests

[MichelleArk]

Flaky Tests

Beta Give feedback

1. BigQuery test access grants (to be updated)
2. [CT-3113] [Flaky Test] test_all_snapshots #8630
   backport 1.5.latest backport 1.6.latest flaky_test stale +4
3. [CT-3115] [Flaky Test] test_generic_tests_with_custom_names #8632
   backport 1.6.latest flaky_test stale +3
4. [CT-3152] [Flaky Tests] adapter/persist_docs/test_persist_docs.py::TestPersistDocs::test_has_comments_pglike #8707
   Impact: Adapters flaky_test stale +3
5. [CT-3222] [Flaky Tests] graph_selection/test_schema_test_graph_selection.py::TestSchemaTestGraphSelection::test_schema_tests_specify_model_and_parents #8853
   backport 1.1.latest backport 1.2.latest flaky_test stale tech_debt +5
6. [CT-3223] [Flaky Tests] dependencies/test_simple_dependency.py::TestSimpleDependencyWithModels::test_simple_dependency_with_models #8854
   backport 1.3.latest flaky_test stale tech_debt +4
7. [CT-3261] [Flaky Test] test_run_and_defer #8897
   backport 1.4.latest flaky_test stale +3
8. [New Flaky] test_simple_copy_with_materialized_views #9416
   flaky_test stale +2
9. [New Flaky] test_simple_copy #9418
   flaky_test stale +2
10. [CT-2636] TestVersionedModels::test_pp_versioned_models is flaky #7781
    backport 1.5.latest flaky_test tech_debt +3
11. [Flaky Test] test_basic_snapshot #9815
    flaky_test stale +2
12. [New Flaky] test_git_with_multiple_subdir #9900
    flaky_test stale +2
13. [New Flaky] test_simple_dependency_deps #9902
    flaky_test stale +2
14. [Flaky Test] test_deps_default #9903
    flaky_test stale +2
15. [Flaky Test] test_deps_add #9905
    flaky_test stale +2
16. [Flaky Test] test_simple_dependency #9906
    backport 1.5.latest backport 1.8.latest flaky_test stale +4
17. [Flaky Test] test_concurrency #9953
    flaky_test stale +2

Fixed Flaky Tests

Beta Give feedback

1. [CT-2647] TestRetry::test_fail_fast is flaky #7795
   flaky_test tech_debt +2
   
2. [CT-2613] TestFastFailingDuringRun::test_fail_fast_run is flaky #7744
   flaky_test tech_debt +2
   
3. [CT-2675] TestRetry::test_custom_target is flaky #7831
   flaky_test tech_debt +2
   
4. [CT-3019] TestShow::test_numeric_values, TestShow::test_numeric_values_with_nulls are flaky #8470
   backport 1.6.latest flaky_test +2
   
5. [CT-2310] [Bug] The test_no_introspect test fails intermittently #7179
   bug flaky_test repo ci/cd tech_debt +4
   
6. [CT-2757] Fix test_semantic_model_deleted_partial_parsing #7977
   flaky_test +1
   
7. [CT-2827] TestSingularTestsEphemeralSnowflake::test_singular_tests_ephemeral is flaky #8103
   flaky_test +1
8. [Bug] Integration test gives an error for the JST timezone #7664
   bug flaky_test +2
9. [CT-3016] [Flaky Test] test_pp_versioned_models #8464
   flaky_test +1
10. [New Flaky] test_project_env_vars #9898
    flaky_test +1
11. [New Flaky] test_project_env_vars #9899
    flaky_test +1
12. [testing] Reduce flaky tests by retrying git failures #9907
    tech_debt user docs +2
    

Flaky Tests we Can't Reproduce

Beta Give feedback

1. [CT-2674] TestSnapshotCheckCols::test_snapshot_check_cols is flaky #7830
   Impact: Adapters flaky_test tech_debt +3
   
2. [CT-2926] test_changing_strategy is flaky #8300
   flaky_test stale +2
3. [CT-2662] TestVerifyArtifacts::test_run_and_generate is flaky #7815
   flaky_test tech_debt +2
   
4. [CT-2930] test_custom_node_colors_configs.py: wrong exception raised #8311
   flaky_test stale +2
5. [Flaky Test] test__invalid_color_config_block #9817
   flaky_test +1
6. [CT-3008] test_changed_seed_config is flaky #8441
   flaky_test stale +2
7. [New Flaky] test_unit_test_ext_nodes #9623
   flaky_test +1

[emmyoop]

We are tracking flaky tests in DataDog and this Epic no longer serves a purpose.