You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When querying the /api/testsuites/ttraceSmokeTestsSuite/version/${version} API, the results returns in the summary.lastRun block are not accurate. It seems to be returning the first run instead of the last run. If you look at my screenshots, you can see that the time, passes, etc. do not represent the last run. The summary.run field does seem to be correct, and all the fields within fullSteps seem to be accurate. There is just an issue with the lastRun json block.
To Reproduce
Steps to reproduce the behavior:
create a test suite as such
type: TestSuite
spec:
id: ttraceSmokeTestsSuite
name: Smoke Tests Suite
description: Runs all cricial test case
steps:
# - ../tests/sometest.yaml
apply the testsuite via command line tracetest apply testsuite -f smokeTests.yaml
execute the testsuite via command line tracetest run testsuite -f smokeTests.yaml
make some changes to the test, add an assertation or failure so that result is different than before
apply the testsuite again via command line tracetest apply testsuite -f smokeTests.yaml
execute the testsuite again via command line tracetest run testsuite -f smokeTests.yaml
Change the description of the testsuite (to force a version change)
apply the testsuite again via command line tracetest apply testsuite -f smokeTests.yaml
execute the testsuite again via command line tracetest run testsuite -f smokeTests.yaml
query the following api
/api/testsuites/ttraceSmokeTestsSuite/version/2
If you look at the lastRun block, it will not represent your last run
Expected behavior
The summary.lastRun should show the results of the last run
Screenshots
You can see from the UI, the last run was 12-2-24 and tests passed was 84, etc... However the API seems to be returning a 10-25-24 run as the lastRun despite there being more recent runs.
The text was updated successfully, but these errors were encountered:
When querying the /api/testsuites/ttraceSmokeTestsSuite/version/${version} API, the results returns in the summary.lastRun block are not accurate. It seems to be returning the first run instead of the last run. If you look at my screenshots, you can see that the time, passes, etc. do not represent the last run. The summary.run field does seem to be correct, and all the fields within fullSteps seem to be accurate. There is just an issue with the lastRun json block.
To Reproduce
Steps to reproduce the behavior:
apply the testsuite via command line
tracetest apply testsuite -f smokeTests.yaml
execute the testsuite via command line
tracetest run testsuite -f smokeTests.yaml
make some changes to the test, add an assertation or failure so that result is different than before
apply the testsuite again via command line
tracetest apply testsuite -f smokeTests.yaml
execute the testsuite again via command line
tracetest run testsuite -f smokeTests.yaml
Change the description of the testsuite (to force a version change)
apply the testsuite again via command line
tracetest apply testsuite -f smokeTests.yaml
execute the testsuite again via command line
tracetest run testsuite -f smokeTests.yaml
query the following api
/api/testsuites/ttraceSmokeTestsSuite/version/2
If you look at the lastRun block, it will not represent your last run
Expected behavior
The summary.lastRun should show the results of the last run
Screenshots
You can see from the UI, the last run was 12-2-24 and tests passed was 84, etc... However the API seems to be returning a 10-25-24 run as the lastRun despite there being more recent runs.
The text was updated successfully, but these errors were encountered: