Rethink running tests for all browsers in each browser

[f1ames]

Some time ago we have concluded that it will be good to run tests for all browsers in each browser (see #2481 and #2480). This allows to check if anything fails just by running tests in one browser. And since most of the things happening are detached from the DOM and use native API rarely it makes sense as browser environment does not affect those tests so much.

However, recently I have encountered a case were same input data, generates same normalization data but different model data in Chrome/Firefox vs Edge. Since test utils assumed that all tests are run in each browser, it required some not-good-looking tests skipping (see skip option):

generateTests( {
	input: 'image',
	type: 'integration',
	browsers: [ 'chrome', 'firefox', 'edge' ],
	editorConfig: {
		plugins: [ Clipboard, Paragraph, Image, Table, PasteFromOffice ]
	},
	skip: {
		chrome: ( env.isEdge ? [ 'adjacentGroups' ] : [] ),
		firefox: ( env.isEdge ? [ 'adjacentGroups' ] : [] ),
		edge: ( env.isEdge ? [] : [ 'adjacentGroups' ] )
	}
} );

Of course it could be written in a different ways to be more readable, but the point is, that skipping test like this is kind of hackish and not straight forward. I think we can live with one case like this, but if we encounter few more in the future it will be good to rethink testing approach.

[CKEditorBot]

There has been no activity on this issue for the past year. We've marked it as stale and will close it in 30 days. We understand it may be relevant, so if you're interested in the solution, leave a comment or reaction under this issue.

[CKEditorBot]

We've closed your issue due to inactivity over the last year. We understand that the issue may still be relevant. If so, feel free to open a new one (and link this issue to it).