-
Notifications
You must be signed in to change notification settings - Fork 2.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adding YAML Test Cases - 2nd Nov #11305
Conversation
PR #11305: Size comparison from 12ec702 to 83d1417 Increases above 0.2%:
Increases (1 build for linux)
Full report (37 builds for efr32, esp32, k32w, linux, mbed, nrfconnect, p6, qpg, telink)
|
Fast track: this adds more test cases |
@kvikrambhat the Darwin failure looks like a real failure in three tests:
The Level Control test looks like it was expecting a value of "128" but the value that actually came back was "255" (aka "null"). TC_OO_2_1_000000_ReadAttribute is failing because it expects the device to start in the "off" state, but one of the new tests is presumably leaving it in the "on" state instead of restoring it to initial state when done. TC_OO_2_1_000001_ReadAttribute is failing for the same reason. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Needs to fix the test failures.
7eb8e35
to
e1131b4
Compare
1.Test_TC_BI_2_1 2.Test_TC_CC_9_2 3.Test_TC_CC_9_3 4.Test_TC_OCC_2_2 5.Test_TC_LVL_4_1 6.Test_TC_LVL_5_1 7.Test_TC_PRS_1_1 8.Test_TC_PRS_2_1 9.Test_TC_RH_2_2 10.Test_TC_TM_2_2 11.Test_TC_TSUIC_2_2 12.Test_TC_WNCV_2_5 13.Test_TC_DIAGSW_1_1
e1131b4
to
2c0468b
Compare
PR #11305: Size comparison from d5810e5 to 0335879 Increases above 0.2%:
Increases (1 build for linux)
Decreases (1 build for esp32)
Full report (38 builds for efr32, esp32, k32w, linux, mbed, nrfconnect, p6, qpg, telink)
|
Test Script Added
1.Test_TC_BI_2_1
2.Test_TC_CC_9_2
3.Test_TC_CC_9_3
4.Test_TC_OCC_2_2
5.Test_TC_LVL_4_1
6.Test_TC_LVL_5_1
7.Test_TC_PRS_1_1
8.Test_TC_PRS_2_1
9.Test_TC_RH_2_2
10.Test_TC_TM_2_2
11.Test_TC_TSUIC_2_2
12.Test_TC_WNCV_2_5
13.Test_TC_DIAGSW_1_1
Testing
Executed all YAML test scripts, attached logs for referen
Complete_Test_Run.txt
ce