-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SQA] [Access-Control-Cluster] Facing issue while executing all ACL test case combinedly #5
Comments
@Survensa We will fix this in upcoming PR. |
Verified with latest released image(Version: v2.8-official Sha: 3a3e9b3). Issue is not resolved. When all the semi-automated test case in Access-Control-cluster is executed using PICS below mentioned test case fails. TC-ACL-2.4 Scenario 1: Logs: ACL_All semi-automated.txt, Scenario 2: Logs: ACL_without 2.7.txt Scenario 3: Logs: ACL_without 2.7 and 2.8.txt Note: TC-ACL-2.7, TC-ACL-2.8 and TC-ACL-2.10 gets failed even when the test case is executed individually or combined raised issue for the same |
@raul-marquez-csa did you get a chance to look into this ? |
Verified with latest released image(Version: TH Fall2023 Sha: 22538eb7). Issue is not resolved. When all the semi-automated test case in Access-Control-cluster is executed using PICS below mentioned test case fails.
Logs: ACL_Semi-automated_2023_09_06_14_58_29.log |
Verified with latest released image(Version: TH Fall2023 Sha: 3f84bff5). Issue is not resolved. When all the semi-automated test case in Access-Control-cluster is executed using PICS below mentioned test case fails.
Logs: ACL_all-semi-automated_2023_10_19_13_03_00.log |
@raul-marquez-csa Can you take a look at this please ? Looks like I forgot to tag you after I moved it to the open-source repo |
@raju-apple raised an SDK issue, once it is fixed we will fix the script project-chip/connectedhomeip#30170 |
From chip-test-scripts created by Survensa: CHIP-Specifications/chip-test-scripts#511
Description:
When all the test case in Access-Control-cluster is executed using PICS in UI, the below mentioned test cases are gets failed.
If the same test cases are executed separately it passed with same PICS uploaded in UI.
Scenario 1:
Executing all test-cases at same time : TC-ACL-2.7,TC-ACL-2.8 in UI is got stuck individually.
Logs: ACL- All tc's_stuck up 2.7.log , ACL- without 2.7_stuck up 2.8.log
Report: ACL- All tc's_stuck up 2.7.pdf ACL- without 2.7_stuck up 2.8.pdf
Scenario 2:
Executing all other test cases except the above one : TC-ACL-2.3, TC-ACL-2.4 and TC-ACL-2.9 are failed.
Log: ACL-without 2.7,2.8.log
Report: ACL- without 2.7, 2.8.pdf
Scenario 3:
Executing all the above test cases individually, the same is passed.
Logs: ACL- 2.3.log, ACL- 2.8.log, ACL- 2.9.log, ACL- 2.4.log, ACL- 2.7.log
Report: ACL- 2.7.pdf, ACL- 2.8.pdf, ACL- 2.9.pdf , ACL- 2.3.pdf, ACL- 2.4.pdf
The text was updated successfully, but these errors were encountered: