Current E2E Tests - Tracking Issue

[geriux]

This is a ticket to keep track of the current E2E tests, the ones that are disabled or any updates related to them.

Current E2E tests

Canaries E2E tests

• Gutenberg Editor File Block tests
• Gutenberg Editor Heading tests
• Gutenberg Editor Image Block tests
• Gutenberg Editor Slash Inserter tests

Full E2E tests

• Gutenberg Editor Audio Block tests
• Gutenberg Editor tests for Block insertion
• Gutenberg Editor Cover Block test
• Gutenberg Editor Drag & Drop blocks tests
  Two tests disabled in: [RNMobile] Temporarily skip failing copy/paste tests WordPress/gutenberg#46340
• Gutenberg Editor Blocks (Initial HTML) test
• Gutenberg Editor tests for Paragraph Block
• Gutenberg Editor paste tests
  Some tests disabled in: https://github.com/WordPress/gutenberg/pull/46340/files
• Gutenberg Editor Device Rotation tests
• Gutenberg Editor Search Block tests
• Gutenberg Editor Unsupported Block Editor Tests
  Disabled for Android in: Mobile: Disable Unsupported Block Editor Tests (Android) WordPress/gutenberg#46542

[fluiddot]

In a second iteration of the list, it would be great to identify the ones that could be replaced by an integration test. If an E2E test doesn't really test a native functionality, we should drop it in favor of an integration test.

[geriux]

I've gone through the list and I've made some updates in: WordPress/gutenberg#46583

• Gutenberg Editor Columns Block test (Removed)
  This test was removed since it already has coverage in integration tests (see)
• Gutenberg Editor Latest Post Block tests (Removed)
  It was migrated to an integration test (see)
• Gutenberg Editor tests for List block, Gutenberg Editor tests for List block (end), Gutenberg Editor tests for List block (Removed)
  These tests were removed since they were disabled when the new version of the List block V2 was merged, now it uses Inner Blocks so we don't have to test the List implementation with Aztec since is no longer used, we added plenty of integration tests for coverage (see)
• Gutenberg Editor More Block test (Removed)
  This test was migrated into an integration test (see)
• Gutenberg Editor Verse Block Tests (Removed)
  This test was moved to their integration tests (see)
• Gutenberg Editor Separator Block test (Removed)
  This test was migrated into an integration test (see)

I will update the original list once the PR referenced above is merged. Updated.

[geriux]

Gutenberg Editor tests for Block insertion 2 will be updated in WordPress/gutenberg#46822 to remove the inserts block before selected block test due to flakiness, now it will be covered by integration tests. I'll update this comment once that PR is merged.

It is now merged ✅

[geriux]

As a follow-up of WordPress/gutenberg#46822 I created another PR WordPress/gutenberg#46882 which will remove Gutenberg Editor tests for Block insertion 2 entirely in favor of integration tests, since it doesn't test native features. I will update the main ticket once it gets merged.

Gutenberg Editor tests for Block insertion 2 were finally removed in WordPress/gutenberg#46882

[geriux]

This tracking issue hasn't been updated since January, after some discussions in WordPress/gutenberg#55541 (review) which removes other tests that are currently disabled, I think it's best to close this. We can always open new GitHub issues for specific tests if needed.