Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Yaml Test Runner: Add support for Python constraints #34487

Merged

Conversation

ksperling-apple
Copy link
Contributor

Example:

constraints:
    python: len(value) == len(initialNetworks) and all(n in initialNetworks for n in value)

Copy link

github-actions bot commented Jul 24, 2024

PR #34487: Size comparison from c88d5cf to 639ddeb

Full report (82 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, mbed, nxp, psoc6, qpg, stm32, telink, tizen)
platform target config section c88d5cf 639ddeb change % change
bl602 lighting-app bl602 FLASH 1271964 1271964 0 0.0
RAM 95384 95384 0 0.0
bl602+mfd FLASH 1286222 1286222 0 0.0
RAM 95528 95528 0 0.0
bl602+rpc FLASH 1310932 1310932 0 0.0
RAM 103808 103808 0 0.0
bl702 lighting-app bl702 FLASH 1092858 1092858 0 0.0
RAM 15245 15245 0 0.0
bl702+mfd FLASH 1103552 1103552 0 0.0
RAM 15397 15397 0 0.0
bl702+rpc FLASH 1182924 1182924 0 0.0
RAM 24245 24245 0 0.0
bl706-eth FLASH 876158 876158 0 0.0
RAM 27348 27348 0 0.0
bl706-wifi FLASH 1128342 1128342 0 0.0
RAM 14681 14681 0 0.0
bl702l lighting-app bl702l FLASH 1079756 1079756 0 0.0
RAM 21800 21800 0 0.0
bl702l+mfd FLASH 1091018 1091018 0 0.0
RAM 21960 21960 0 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 798924 798924 0 0.0
RAM 109236 109236 0 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 816684 816684 0 0.0
RAM 117020 117020 0 0.0
lock-mtd LP_EM_CC1354P10_6 FLASH 808516 808516 0 0.0
RAM 111308 111308 0 0.0
pump-app LP_EM_CC1354P10_6 FLASH 761132 761132 0 0.0
RAM 105408 105408 0 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 746916 746916 0 0.0
RAM 105632 105632 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 606494 606494 0 0.0
RAM 204564 204564 0 0.0
lock CC3235SF_LAUNCHXL FLASH 652026 652026 0 0.0
RAM 204836 204836 0 0.0
cyw30739 light CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 668041 668041 0 0.0
RAM 77700 77700 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 687893 687893 0 0.0
RAM 80340 80340 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 687893 687893 0 0.0
RAM 80340 80340 0 0.0
CYW930739M2EVB-02 unknown 2040 2040 0 0.0
FLASH 644829 644829 0 0.0
RAM 72768 72768 0 0.0
light-switch CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 609585 609585 0 0.0
RAM 70884 70884 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 629221 629221 0 0.0
RAM 73428 73428 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 629221 629221 0 0.0
RAM 73428 73428 0 0.0
lock CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 625289 625289 0 0.0
RAM 73900 73900 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 644997 644997 0 0.0
RAM 76444 76444 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 644997 644997 0 0.0
RAM 76444 76444 0 0.0
thermostat CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 593509 593509 0 0.0
RAM 67852 67852 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 613361 613361 0 0.0
RAM 70492 70492 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 613361 613361 0 0.0
RAM 70492 70492 0 0.0
efr32 lighting-app BRD4187C FLASH 926120 926120 0 0.0
RAM 134528 134528 0 0.0
lock-app BRD4338a FLASH 734524 734516 -8 -0.0
RAM 208004 208004 0 0.0
window-app BRD4187C FLASH 1014604 1014604 0 0.0
RAM 126648 126648 0 0.0
esp32 all-clusters-app c3devkit DRAM 90948 90948 0 0.0
FLASH 1471086 1471086 0 0.0
IRAM 75570 75570 0 0.0
m5stack DRAM 117428 117428 0 0.0
FLASH 1540211 1540211 0 0.0
IRAM 125403 125403 0 0.0
linux air-purifier-app debug unknown 4632 4632 0 0.0
FLASH 2710279 2710279 0 0.0
RAM 125200 125200 0 0.0
all-clusters-app debug unknown 5400 5400 0 0.0
FLASH 5838628 5838628 0 0.0
RAM 494560 494560 0 0.0
all-clusters-minimal-app debug unknown 5312 5312 0 0.0
FLASH 5298426 5298426 0 0.0
RAM 235728 235728 0 0.0
bridge-app debug unknown 5296 5296 0 0.0
FLASH 4699178 4699178 0 0.0
RAM 212992 212992 0 0.0
chip-tool debug unknown 5784 5784 0 0.0
FLASH 12279306 12279306 0 0.0
RAM 548050 548050 0 0.0
chip-tool-ipv6only arm64 unknown 20128 20128 0 0.0
FLASH 10986972 10986972 0 0.0
RAM 597680 597680 0 0.0
fabric-admin debug unknown 5672 5672 0 0.0
FLASH 11299679 11299679 0 0.0
RAM 544890 544890 0 0.0
fabric-bridge-app debug unknown 4568 4568 0 0.0
FLASH 4453412 4453412 0 0.0
RAM 199024 199024 0 0.0
lighting-app debug+rpc+ui unknown 5968 5968 0 0.0
FLASH 5623249 5623249 0 0.0
RAM 224272 224272 0 0.0
lock-app debug unknown 5232 5232 0 0.0
FLASH 4757630 4757630 0 0.0
RAM 200704 200704 0 0.0
ota-provider-app debug unknown 4608 4608 0 0.0
FLASH 4402124 4402124 0 0.0
RAM 194880 194880 0 0.0
ota-requestor-app debug unknown 4544 4544 0 0.0
FLASH 4539938 4539938 0 0.0
RAM 199416 199416 0 0.0
shell debug unknown 4168 4168 0 0.0
FLASH 2982829 2982829 0 0.0
RAM 153704 153704 0 0.0
thermostat-no-ble arm64 unknown 9208 9208 0 0.0
FLASH 4259572 4259572 0 0.0
RAM 236360 236360 0 0.0
tv-app debug unknown 5504 5504 0 0.0
FLASH 5974781 5974781 0 0.0
RAM 573184 573184 0 0.0
tv-casting-app debug unknown 5168 5168 0 0.0
FLASH 10490877 10490877 0 0.0
RAM 633352 633352 0 0.0
mbed lock-app-release cy8cproto_062_4343w FLASH 1503276 1503276 0 0.0
RAM 226720 226720 0 0.0
nxp contact k32w0+release FLASH 576100 576100 0 0.0
RAM 70104 70104 0 0.0
k32w1+release FLASH 591672 591672 0 0.0
RAM 74144 74144 0 0.0
light k32w0+release FLASH 610432 610432 0 0.0
RAM 69564 69564 0 0.0
k32w1+release FLASH 675216 675216 0 0.0
RAM 82872 82872 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1611476 1611476 0 0.0
RAM 209728 209728 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1531828 1531828 0 0.0
RAM 206544 206544 0 0.0
light cy8ckit_062s2_43012 FLASH 1458860 1458860 0 0.0
RAM 199808 199808 0 0.0
lock cy8ckit_062s2_43012 FLASH 1459500 1459500 0 0.0
RAM 224328 224328 0 0.0
qpg lighting-app qpg6105+debug FLASH 651748 651748 0 0.0
RAM 104636 104636 0 0.0
lock-app qpg6105+debug FLASH 612136 612136 0 0.0
RAM 99320 99320 0 0.0
stm32 light STM32WB5MM-DK FLASH 474144 474144 0 0.0
RAM 144260 144260 0 0.0
telink air-quality-sensor-app tlsr9528a_retention FLASH 633112 633112 0 0.0
RAM 50576 50576 0 0.0
all-clusters-app tlsr9118bdk40d FLASH 658786 658786 0 0.0
RAM 148480 148480 0 0.0
all-clusters-minimal-app tlsr9528a FLASH 779012 779012 0 0.0
RAM 113260 113260 0 0.0
bridge-app tlsr9258a FLASH 676032 676032 0 0.0
RAM 95344 95344 0 0.0
contact-sensor-app tlsr9528a_retention FLASH 634696 634696 0 0.0
RAM 50620 50620 0 0.0
light-switch-app-ota-shell-factory-data tlsr9528a FLASH 720568 720568 0 0.0
RAM 77196 77196 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 614066 614066 0 0.0
RAM 144684 144684 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 801870 801870 0 0.0
RAM 103088 103088 0 0.0
lock-app-dfu tlsr9528a FLASH 666524 666524 0 0.0
RAM 69900 69900 0 0.0
ota-requestor-app tlsr9258a FLASH 695394 695394 0 0.0
RAM 95068 95068 0 0.0
pump-app tlsr9518adk80d FLASH 616960 616960 0 0.0
RAM 57000 57000 0 0.0
pump-controller-app tlsr9518adk80d FLASH 607370 607370 0 0.0
RAM 56800 56800 0 0.0
shell tlsr9518adk80d FLASH 466520 466520 0 0.0
RAM 72488 72488 0 0.0
smoke_co_alarm-app tlsr9528a_retention FLASH 641314 641314 0 0.0
RAM 52248 52248 0 0.0
temperature-measurement-app-mars-ota tlsr9518adk80d FLASH 651192 651192 0 0.0
RAM 60436 60436 0 0.0
thermostat tlsr9518adk80d FLASH 626078 626078 0 0.0
RAM 57124 57124 0 0.0
window-covering tlsr9118bdk40d FLASH 519462 519462 0 0.0
RAM 97856 97856 0 0.0
tizen all-clusters-app arm unknown 1588 1588 0 0.0
FLASH 1640516 1640516 0 0.0
RAM 48708 48708 0 0.0
chip-tool-ubsan arm unknown 2388 2388 0 0.0
FLASH 16290886 16290886 0 0.0
RAM 7153232 7153232 0 0.0

@github-actions github-actions bot added the documentation Improvements or additions to documentation label Jul 25, 2024
Copy link

github-actions bot commented Jul 25, 2024

PR #34487: Size comparison from c88d5cf to 84da271

Full report (82 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, mbed, nxp, psoc6, qpg, stm32, telink, tizen)
platform target config section c88d5cf 84da271 change % change
bl602 lighting-app bl602 FLASH 1271964 1271964 0 0.0
RAM 95384 95384 0 0.0
bl602+mfd FLASH 1286222 1286222 0 0.0
RAM 95528 95528 0 0.0
bl602+rpc FLASH 1310932 1311188 256 0.0
RAM 103808 103808 0 0.0
bl702 lighting-app bl702 FLASH 1092858 1092858 0 0.0
RAM 15245 15245 0 0.0
bl702+mfd FLASH 1103552 1103808 256 0.0
RAM 15397 15397 0 0.0
bl702+rpc FLASH 1182924 1182924 0 0.0
RAM 24245 24245 0 0.0
bl706-eth FLASH 876158 876158 0 0.0
RAM 27348 27348 0 0.0
bl706-wifi FLASH 1128342 1128598 256 0.0
RAM 14681 14681 0 0.0
bl702l lighting-app bl702l FLASH 1079756 1080012 256 0.0
RAM 21800 21800 0 0.0
bl702l+mfd FLASH 1091018 1091274 256 0.0
RAM 21960 21960 0 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 798924 798972 48 0.0
RAM 109236 109236 0 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 816684 816684 0 0.0
RAM 117020 117020 0 0.0
lock-mtd LP_EM_CC1354P10_6 FLASH 808516 808516 0 0.0
RAM 111308 111308 0 0.0
pump-app LP_EM_CC1354P10_6 FLASH 761132 761132 0 0.0
RAM 105408 105408 0 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 746916 746916 0 0.0
RAM 105632 105632 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 606494 606494 0 0.0
RAM 204564 204564 0 0.0
lock CC3235SF_LAUNCHXL FLASH 652026 652026 0 0.0
RAM 204836 204836 0 0.0
cyw30739 light CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 668041 668081 40 0.0
RAM 77700 77700 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 687893 687933 40 0.0
RAM 80340 80340 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 687893 687933 40 0.0
RAM 80340 80340 0 0.0
CYW930739M2EVB-02 unknown 2040 2040 0 0.0
FLASH 644829 644869 40 0.0
RAM 72768 72768 0 0.0
light-switch CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 609585 609585 0 0.0
RAM 70884 70884 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 629221 629221 0 0.0
RAM 73428 73428 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 629221 629221 0 0.0
RAM 73428 73428 0 0.0
lock CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 625289 625289 0 0.0
RAM 73900 73900 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 644997 644997 0 0.0
RAM 76444 76444 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 644997 644997 0 0.0
RAM 76444 76444 0 0.0
thermostat CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 593509 593509 0 0.0
RAM 67852 67852 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 613361 613361 0 0.0
RAM 70492 70492 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 613361 613361 0 0.0
RAM 70492 70492 0 0.0
efr32 lighting-app BRD4187C FLASH 926120 926152 32 0.0
RAM 134528 134528 0 0.0
lock-app BRD4338a FLASH 734524 734516 -8 -0.0
RAM 208004 208004 0 0.0
window-app BRD4187C FLASH 1014604 1014604 0 0.0
RAM 126648 126648 0 0.0
esp32 all-clusters-app c3devkit DRAM 90948 90948 0 0.0
FLASH 1471086 1471120 34 0.0
IRAM 75570 75570 0 0.0
m5stack DRAM 117428 117428 0 0.0
FLASH 1540211 1540255 44 0.0
IRAM 125403 125403 0 0.0
linux air-purifier-app debug unknown 4632 4632 0 0.0
FLASH 2710279 2710279 0 0.0
RAM 125200 125200 0 0.0
all-clusters-app debug unknown 5400 5400 0 0.0
FLASH 5838628 5838962 334 0.0
RAM 494560 494560 0 0.0
all-clusters-minimal-app debug unknown 5312 5312 0 0.0
FLASH 5298426 5298760 334 0.0
RAM 235728 235728 0 0.0
bridge-app debug unknown 5296 5296 0 0.0
FLASH 4699178 4699178 0 0.0
RAM 212992 212992 0 0.0
chip-tool debug unknown 5784 5784 0 0.0
FLASH 12279306 12279306 0 0.0
RAM 548050 548050 0 0.0
chip-tool-ipv6only arm64 unknown 20128 20128 0 0.0
FLASH 10986972 10986972 0 0.0
RAM 597680 597680 0 0.0
fabric-admin debug unknown 5672 5672 0 0.0
FLASH 11299679 11299679 0 0.0
RAM 544890 544890 0 0.0
fabric-bridge-app debug unknown 4568 4568 0 0.0
FLASH 4453412 4453412 0 0.0
RAM 199024 199024 0 0.0
lighting-app debug+rpc+ui unknown 5968 5968 0 0.0
FLASH 5623249 5623585 336 0.0
RAM 224272 224272 0 0.0
lock-app debug unknown 5232 5232 0 0.0
FLASH 4757630 4757630 0 0.0
RAM 200704 200704 0 0.0
ota-provider-app debug unknown 4608 4608 0 0.0
FLASH 4402124 4402124 0 0.0
RAM 194880 194880 0 0.0
ota-requestor-app debug unknown 4544 4544 0 0.0
FLASH 4539938 4540272 334 0.0
RAM 199416 199416 0 0.0
shell debug unknown 4168 4168 0 0.0
FLASH 2982829 2983165 336 0.0
RAM 153704 153704 0 0.0
thermostat-no-ble arm64 unknown 9208 9208 0 0.0
FLASH 4259572 4259572 0 0.0
RAM 236360 236360 0 0.0
tv-app debug unknown 5504 5504 0 0.0
FLASH 5974781 5974781 0 0.0
RAM 573184 573184 0 0.0
tv-casting-app debug unknown 5168 5168 0 0.0
FLASH 10490877 10490877 0 0.0
RAM 633352 633352 0 0.0
mbed lock-app-release cy8cproto_062_4343w FLASH 1503276 1503276 0 0.0
RAM 226720 226720 0 0.0
nxp contact k32w0+release FLASH 576100 576100 0 0.0
RAM 70104 70104 0 0.0
k32w1+release FLASH 591672 591672 0 0.0
RAM 74144 74144 0 0.0
light k32w0+release FLASH 610432 610464 32 0.0
RAM 69564 69564 0 0.0
k32w1+release FLASH 675216 675248 32 0.0
RAM 82872 82872 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1611476 1611572 96 0.0
RAM 209728 209728 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1531828 1531940 112 0.0
RAM 206544 206544 0 0.0
light cy8ckit_062s2_43012 FLASH 1458860 1458956 96 0.0
RAM 199808 199808 0 0.0
lock cy8ckit_062s2_43012 FLASH 1459500 1459500 0 0.0
RAM 224328 224328 0 0.0
qpg lighting-app qpg6105+debug FLASH 651748 651780 32 0.0
RAM 104636 104636 0 0.0
lock-app qpg6105+debug FLASH 612136 612136 0 0.0
RAM 99320 99320 0 0.0
stm32 light STM32WB5MM-DK FLASH 474144 474176 32 0.0
RAM 144260 144260 0 0.0
telink air-quality-sensor-app tlsr9528a_retention FLASH 633112 633112 0 0.0
RAM 50576 50576 0 0.0
all-clusters-app tlsr9118bdk40d FLASH 658786 658820 34 0.0
RAM 148480 148480 0 0.0
all-clusters-minimal-app tlsr9528a FLASH 779012 779046 34 0.0
RAM 113260 113260 0 0.0
bridge-app tlsr9258a FLASH 676032 676032 0 0.0
RAM 95344 95344 0 0.0
contact-sensor-app tlsr9528a_retention FLASH 634696 634696 0 0.0
RAM 50620 50620 0 0.0
light-switch-app-ota-shell-factory-data tlsr9528a FLASH 720568 720568 0 0.0
RAM 77196 77196 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 614066 614100 34 0.0
RAM 144684 144684 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 801870 801904 34 0.0
RAM 103088 103088 0 0.0
lock-app-dfu tlsr9528a FLASH 666524 666524 0 0.0
RAM 69900 69900 0 0.0
ota-requestor-app tlsr9258a FLASH 695394 695428 34 0.0
RAM 95068 95068 0 0.0
pump-app tlsr9518adk80d FLASH 616960 616960 0 0.0
RAM 57000 57000 0 0.0
pump-controller-app tlsr9518adk80d FLASH 607370 607370 0 0.0
RAM 56800 56800 0 0.0
shell tlsr9518adk80d FLASH 466520 466520 0 0.0
RAM 72488 72488 0 0.0
smoke_co_alarm-app tlsr9528a_retention FLASH 641314 641314 0 0.0
RAM 52248 52248 0 0.0
temperature-measurement-app-mars-ota tlsr9518adk80d FLASH 651192 651192 0 0.0
RAM 60436 60436 0 0.0
thermostat tlsr9518adk80d FLASH 626078 626078 0 0.0
RAM 57124 57124 0 0.0
window-covering tlsr9118bdk40d FLASH 519462 519462 0 0.0
RAM 97856 97856 0 0.0
tizen all-clusters-app arm unknown 1588 1588 0 0.0
FLASH 1640516 1640836 320 0.0
RAM 48708 48708 0 0.0
chip-tool-ubsan arm unknown 2388 2388 0 0.0
FLASH 16290886 16290886 0 0.0
RAM 7153232 7153232 0 0.0

ksperling-apple added a commit to ksperling-apple/connectedhomeip that referenced this pull request Jul 26, 2024
Base on CHIP-Specifications/chip-test-plans#4322
but contains some additional steps which will be added to the test plan.

Some validations depend on PR project-chip#34487 and are commented out.
@woody-apple
Copy link
Contributor

Approving this pending comment review, but this does follow GItHub Workflow and Actions paradigms, and does unblock automated testing from the CSG, so I'm on board with this. I do agree we need to put guards in place such that this doesn't become a full language model, but - I don't think this PR is doing that.

mergify bot pushed a commit that referenced this pull request Jul 29, 2024
* Thread Network Directory GetOperationalDataset does not required timed invoke

See CHIP-Specifications/connectedhomeip-spec#10106

* Actually return the dataset in GetOperationalDataset

* Add test scripts for THNETDIR cluster

Base on CHIP-Specifications/chip-test-plans#4322
but contains some additional steps which will be added to the test plan.

Some validations depend on PR #34487 and are commented out.

* Darwin: Avoid linker issues with pigweed clang

* Prefix network-manager binary name with matter-

* Run THNETDIR tests against network-manager app in CI

* Add test script for WIFINM cluster and include in CI

* Add network-manager app to darwin-tests.yaml

* Update WIFINM cluster definition and test to match latest spec

Based on CHIP-Specifications/connectedhomeip-spec#10025

* zap_regen_all

* Disable tests for NEEDS_TIMED_INTERACTION for now

These currently fail when run with darwin-framework-tool because
Matter.framework automatically defaults to using a timed interaction when the
cluster command requires it, defeating the test.

* Fix network-manager-app zap/matter files

* Add apiMaturity attributes

* Add missing attribute read step and improve step names
@woody-apple woody-apple requested a review from raju-apple July 30, 2024 01:52
j-ororke pushed a commit to j-ororke/connectedhomeip that referenced this pull request Jul 31, 2024
* Thread Network Directory GetOperationalDataset does not required timed invoke

See CHIP-Specifications/connectedhomeip-spec#10106

* Actually return the dataset in GetOperationalDataset

* Add test scripts for THNETDIR cluster

Base on CHIP-Specifications/chip-test-plans#4322
but contains some additional steps which will be added to the test plan.

Some validations depend on PR project-chip#34487 and are commented out.

* Darwin: Avoid linker issues with pigweed clang

* Prefix network-manager binary name with matter-

* Run THNETDIR tests against network-manager app in CI

* Add test script for WIFINM cluster and include in CI

* Add network-manager app to darwin-tests.yaml

* Update WIFINM cluster definition and test to match latest spec

Based on CHIP-Specifications/connectedhomeip-spec#10025

* zap_regen_all

* Disable tests for NEEDS_TIMED_INTERACTION for now

These currently fail when run with darwin-framework-tool because
Matter.framework automatically defaults to using a timed interaction when the
cluster command requires it, defeating the test.

* Fix network-manager-app zap/matter files

* Add apiMaturity attributes

* Add missing attribute read step and improve step names
rochaferraz pushed a commit to rochaferraz/connectedhomeip that referenced this pull request Jul 31, 2024
* Thread Network Directory GetOperationalDataset does not required timed invoke

See CHIP-Specifications/connectedhomeip-spec#10106

* Actually return the dataset in GetOperationalDataset

* Add test scripts for THNETDIR cluster

Base on CHIP-Specifications/chip-test-plans#4322
but contains some additional steps which will be added to the test plan.

Some validations depend on PR project-chip#34487 and are commented out.

* Darwin: Avoid linker issues with pigweed clang

* Prefix network-manager binary name with matter-

* Run THNETDIR tests against network-manager app in CI

* Add test script for WIFINM cluster and include in CI

* Add network-manager app to darwin-tests.yaml

* Update WIFINM cluster definition and test to match latest spec

Based on CHIP-Specifications/connectedhomeip-spec#10025

* zap_regen_all

* Disable tests for NEEDS_TIMED_INTERACTION for now

These currently fail when run with darwin-framework-tool because
Matter.framework automatically defaults to using a timed interaction when the
cluster command requires it, defeating the test.

* Fix network-manager-app zap/matter files

* Add apiMaturity attributes

* Add missing attribute read step and improve step names
@mergify mergify bot merged commit faef75c into project-chip:master Aug 8, 2024
71 checks passed
austina-csa pushed a commit to austina-csa/connectedhomeip that referenced this pull request Aug 12, 2024
)

* Yaml Test Runner: Add support for Python constraints

* Restyle / appease the linter

* Add to schema documentation
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
app documentation Improvements or additions to documentation review - approved scripts tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants