Test framework: ExpectError test steps result in state being cleared

[alexng-canuck]

When tests have an ExpectError test step that expects some sort of validation error; this results in any previous state being cleared. Any subsequent test steps will no longer have the previous state, resulting in resources being created again rather than reusing the state from before the error.

Terraform Version

0.11.7

Terraform Configuration Files

Not Applicable

Debug Output

Crash Output

Expected Behavior

Suppose we have 3 test steps:

1. Create a resource
2. Change the config to force some validation error and expect that error.
3. Update the resource.

The state should still be preserved after step 2; and step 3 should update the resources created in step 1.

Actual Behavior

Step 3 will end up creating the resources from step 1 again. This is resulting in resources from step 1 being leaked.

Steps to Reproduce

Additional Context

This behavior regressed from v0.9; where the expected behavior occurred.

References

[kmoe]

This is fixed in #262, the new binary acceptance test driver, which can be enabled from v1.7.0 onwards.

[ghost]

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.

If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.