Tests: Meta ticket for testing with external servers

[jrfnl]

There are several tickets open about tests using external servers/services and the fact that this means that those tests may fail on occation when the service is (temporarily) not available or when something changes in those endpoints.

This meta ticket is meant to bind those tickets together and to discuss the wider pespective of how to solve this.

Related tickets

Related tickets specific to tests with external services:

• Update httpbin endpoint on tests #315
• Tests: add/adjust SSL related tests #419
• Improve test infrastructure #496
• Task: re-enable alternateport test #639

Related tickets specific to features which can't currently be tested:

• 303 should change method to GET #7

Related tickets about documenting how to run the tests (locally with the test servers):

• Improve testing instructions #475
• Add CONTRIBUTING.md #668

External services providing endpoints

Known external services which provide endpoints for testing status code and other HTTP(S) responses:

• requests-php-tests.herokuapp.com (currently in use in the test suite)
• https://httpbin.org/ (currently in use in the test suite)
• http://portquiz.net/ (currently in use in the test suite)
• https://badssl.com/
• https://mock.codes/
• https://responseco.de/

In addition to this, a local copy of the https://github.com/RequestsPHP/test-server code is being run to provide responses for some tests.

To discuss/investigate

• Are there external services available for all needed endpoints ? I.e. can we abolish our dependency on the Heroku setup / test server repo ?
• Can the tests be made more stable by switching to different services for certain tests ?
• Can the tests be made more stable by having a helper function which will automatically retry a request a limited amount of times if it fails the first time ? (loosely related to feature request Retry option? #222)
• Can (some of) the tests be made more stable by having a fall-back URL ? I.e. if two different services both provide the response we need for the test, can a second server be tried if the request to the first server failed (via a helper function) ?
• etc