Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update QA Document #363

Merged
merged 2 commits into from
Oct 4, 2022
Merged

Update QA Document #363

merged 2 commits into from
Oct 4, 2022

Conversation

shaspitz
Copy link
Contributor

@shaspitz shaspitz commented Sep 22, 2022

Closes #351

This PR is intended to compliment #342. I split these diffs out so that extra attention could be put into verifying the updates to quality_assurance.md are correct.

@shaspitz shaspitz marked this pull request as ready for review September 22, 2022 22:33
Copy link
Contributor

@sainoe sainoe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@danwt danwt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the updates. I'll approve but think we should wait for Marius.

| ID | Concern | Code Review | Unit Testing | E2E Testing | Diff. Testing | Testnet |
| -- | ------- | ----------- | ------------ | ----------- | ------------- | ------- |
| 2.01 | Create IBC clients | `Scheduled` (ibc-go team) | `Done` | `??` | `Future work` | `Scheduled` |
| 2.02 | Getting consumer `UnbondingPeriod` from IBC client | `Scheduled` (ibc-go team) | `Done`, see TestUnbondingTime` | `??` | `NA` | `NA` |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ultra nit: I'd be wary of specifying test names as it might change in future.

Comment on lines +63 to +65
| 3.01 | Changes to staking module | `Scheduled` (sdk team) | `??` | `Partial coverage` <br /> see [unbonding_test.go](../tests/e2e/unbonding_test.go) <br /> redelegation could be expanded, validator unbonding missing | `Partial coverage` | `Scheduled` |
| 3.02 | Changes to slashing module | `Scheduled` (sdk team) | `??` | `Done` <br /> see [TestValidatorDowntime](../tests/e2e/slashing_test.go#L502) <br /> | `NA` | `Scheduled` |
| 3.03 | Changes to evidence module | `Scheduled` (sdk team) | `??` | `Done` <br /> see [TestValidatorDoubleSigning](../tests/e2e/slashing_test.go#L584) <br /> | `NA` | `Scheduled` |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ditto: I'm a bit wary of linking/specifying test names. (Although I see this was already done before your PR so not on you!)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm yea I agree with you that linking hardcoded test names and specific lines of code is not ideal. On the other hand, the links may save people time searching through files, and I can't really think of a better alternative. Lmk if one exists 🤔

@shaspitz
Copy link
Contributor Author

shaspitz commented Oct 4, 2022

@mpoke I'll wait on your review before merging

Copy link
Contributor

@jtremback jtremback left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jtremback jtremback merged commit bcb69b8 into main Oct 4, 2022
@jtremback jtremback deleted the qa-update branch October 4, 2022 21:48
@mpoke
Copy link
Contributor

mpoke commented Oct 5, 2022

@smarshall-spitzbart I'll have a look over the changes anyway ;)

@mpoke mpoke mentioned this pull request Oct 5, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

QA plan does not distinguish between UTs and E2E tests
5 participants