You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
With #5640, we are now correctly recreating materialized views in bqetl_artifact_deployment but the first deploy after merging that seems to have caused a dry run failure for this commit on main 19c3f02.
There was a failure within an hour of the change so I would expect this to occur somewhat regularly and result in flaky CI.
I'm not sure if materialize views are only recreated if they've changed but that could be one way to reduce failures. A lot of the views needed to be recreated this time because they weren't getting updated before.
I'd bet that's due to materialized views being deleted in a separate step before being recreated, so for a period of time the materialized view wouldn't exist.
If we want materialized views to be recreated in this fashion maybe we should use CREATE OR REPLACE MATERIALIZED VIEW rather than CREATE MATERIALIZED VIEW IF NOT EXISTS (or use Jinja logic to conditionally generate the appropriate statement based on is_init()).
With #5640, we are now correctly recreating materialized views in
bqetl_artifact_deployment
but the first deploy after merging that seems to have caused a dry run failure for this commit on main 19c3f02.The error was
Not found: Table moz-fx-data-shared-prod:org_*******_ios_focus_derived.experiment_search_events_live_v1 was not found in location US
which is a materialized view that was deployed at the same time as the dry run https://workflow.telemetry.mozilla.org/dags/bqetl_artifact_deployment/grid?dag_run_id=manual__2024-06-20T17%3A14%3A47.878027%2B00%3A00&task_id=publish_new_tables&tab=logsThere was a failure within an hour of the change so I would expect this to occur somewhat regularly and result in flaky CI.
I'm not sure if materialize views are only recreated if they've changed but that could be one way to reduce failures. A lot of the views needed to be recreated this time because they weren't getting updated before.
┆Issue is synchronized with this Jira Task
The text was updated successfully, but these errors were encountered: