improve auto generated fullstack tests

[lidezhu]

What problem does this PR solve?

Issue Number: close #xxx

Problem Summary:

What is changed and how it works?

remove some obsolete tests and add some fullstack test

Release note

None

[ti-chi-bot]

[REVIEW NOTIFICATION]

This pull request has been approved by:

• JaySon-Huang

To complete the pull request process, please ask the reviewers in the list to review by filling /cc @reviewer in the comment.
After your PR has acquired the required number of LGTMs, you can assign this pull request to the committer in the list by filling /assign @committer in the comment to help you merge this pull request.

The full list of commands accepted by this bot can be found here.

Reviewer can indicate their review by submitting an approval review.
Reviewer can cancel approval by submitting a request changes review.

[lidezhu]

/run-all-tests

[sre-bot]

Coverage detail: https://ci-internal.pingcap.net/job/tics_ghpr_unit_test/251/cobertura/
(Coverage detail url is limited office network access)

lines: 40.2% (44316 out of 110111)
branches: 5.6% (67029 out of 1197890)

[JaySon-Huang]

We can update it to python3 here?
https://github.com/pingcap/tics/blob/767cf9983fd5a9aaf58eb2a759e76b16d8d8c25e/tests/run-test.sh#L160

[JaySon-Huang]

Can you explain more about what's the difference between the old script and your new script?

[JaySon-Huang]

Add tests/fullstack-test2/auto_gen/ to .gitignore

[lidezhu]

We can update it to python3 here?

https://github.com/pingcap/tics/blob/767cf9983fd5a9aaf58eb2a759e76b16d8d8c25e/tests/run-test.sh#L160

python2 is default installed by many OS, so I think using python2 is still better.

[lidezhu]

Can you explain more about what's the difference between the old script and your new script?

One of the most important motivation of the old script is to add some tests after tiflash support the pk_is_handle feature. So it tests all kinds of int type primary key with the same columns and the same operations.
For each kinds of primary key, it generates four test files which corresponding the following operations sequence: https://github.com/pingcap/tics/pull/3592/files#diff-f4ecbee0af8135c575a773fd118ebdb70f942d794387123f06c98916851937bbL449.
I think just test insert, update, delete operation on different primary key is enough. The four different operations sequence really make no difference. So the new script just keep one which is [INSERT, SELECT, UPDATE, SELECT, DELETE, SELECT].

The main improvements the new script covered can be summarized as follows:

1. cover more data types;
2. refactor the table result builder code;
3. remove the tedious dml sequence;
4. add dml tests cover cluster index type primary keys;

[lidezhu]

Add tests/fullstack-test2/auto_gen/ to .gitignore

Added.

[JaySon-Huang]

LGTM

[JaySon-Huang]

/merge

[ti-chi-bot]

@JaySon-Huang: It seems you want to merge this PR, I will help you trigger all the tests:

/run-all-tests

You only need to trigger /merge once, and if the CI test fails, you just re-trigger the test that failed and the bot will merge the PR for you after the CI passes.

If you have any questions about the PR merge process, please refer to pr process.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

[ti-chi-bot]

This pull request has been accepted and is ready to merge.

Commit hash: 6c1bcbd

[sre-bot]

Coverage detail: https://ci-internal.pingcap.net/job/tics_ghpr_unit_test/273/cobertura/
(Coverage detail url is limited office network access)

lines: 40.2% (44311 out of 110112)
branches: 5.6% (67023 out of 1197894)

[ti-chi-bot]

@lidezhu: Your PR was out of date, I have automatically updated it for you.

At the same time I will also trigger all tests for you:

/run-all-tests

If the CI test fails, you just re-trigger the test that failed and the bot will merge the PR for you after the CI passes.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository.

[sre-bot]

Coverage detail: https://ci-internal.pingcap.net/job/tics_ghpr_unit_test/276/cobertura/
(Coverage detail url is limited office network access)

lines: 40.3% (44434 out of 110200)
branches: 5.6% (67156 out of 1198208)