Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

python test framework: PICS 2.0 #34384

Merged
merged 13 commits into from
Jul 27, 2024
Merged

Conversation

cecille
Copy link
Contributor

@cecille cecille commented Jul 18, 2024

Adds test decorators and hooks that will let the test framework select ALL appropriate endpoints for a test and run the test against each endpoint. This means that tests will only need to be run once for the entire node, rather than against a specific endpoint.

Includes a hooks callback to indicate when no appropriate endpoints are selected as well as new decorators for per_endpoint and per_node tests. decorator demonstrated on the time sync test.

Copy link

github-actions bot commented Jul 18, 2024

PR #34384: Size comparison from e73be38 to 37c0a12

Full report (80 builds for bl602, bl702, bl702l, cc32xx, cyw30739, efr32, esp32, linux, mbed, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
platform target config section e73be38 37c0a12 change % change
bl602 lighting-app bl602 FLASH 1271594 1271594 0 0.0
RAM 95328 95328 0 0.0
bl602+mfd FLASH 1286108 1286108 0 0.0
RAM 95472 95472 0 0.0
bl602+rpc FLASH 1310810 1310810 0 0.0
RAM 103752 103752 0 0.0
bl702 lighting-app bl702 FLASH 1092702 1092702 0 0.0
RAM 15161 15161 0 0.0
bl702+mfd FLASH 1103396 1103396 0 0.0
RAM 15313 15313 0 0.0
bl702+rpc FLASH 1182512 1182512 0 0.0
RAM 24181 24181 0 0.0
bl706-eth FLASH 875834 875834 0 0.0
RAM 27272 27272 0 0.0
bl706-wifi FLASH 1128248 1128248 0 0.0
RAM 14605 14605 0 0.0
bl702l lighting-app bl702l FLASH 1079588 1079588 0 0.0
RAM 21732 21732 0 0.0
bl702l+mfd FLASH 1090850 1090850 0 0.0
RAM 21892 21892 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 606538 606538 0 0.0
RAM 204508 204508 0 0.0
lock CC3235SF_LAUNCHXL FLASH 651870 651870 0 0.0
RAM 204780 204780 0 0.0
cyw30739 light CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 667809 667809 0 0.0
RAM 77644 77644 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 687669 687669 0 0.0
RAM 80276 80276 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 687669 687669 0 0.0
RAM 80276 80276 0 0.0
CYW930739M2EVB-02 unknown 2040 2040 0 0.0
FLASH 644597 644597 0 0.0
RAM 72712 72712 0 0.0
light-switch CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 609425 609425 0 0.0
RAM 70804 70804 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 629053 629053 0 0.0
RAM 73356 73356 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 629053 629053 0 0.0
RAM 73356 73356 0 0.0
lock CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 625145 625145 0 0.0
RAM 73820 73820 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 644861 644861 0 0.0
RAM 76372 76372 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 644861 644861 0 0.0
RAM 76372 76372 0 0.0
thermostat CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 593525 593525 0 0.0
RAM 67788 67788 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 613369 613369 0 0.0
RAM 70420 70420 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 613369 613369 0 0.0
RAM 70420 70420 0 0.0
efr32 lighting-app BRD4187C FLASH 924772 924764 -8 -0.0
RAM 137528 137528 0 0.0
lock-app BRD4338a FLASH 733972 733964 -8 -0.0
RAM 207892 207892 0 0.0
window-app BRD4187C FLASH 1012764 1012764 0 0.0
RAM 129632 129632 0 0.0
esp32 all-clusters-app c3devkit DRAM 90924 90924 0 0.0
FLASH 1471186 1471186 0 0.0
IRAM 75570 75570 0 0.0
m5stack DRAM 117404 117404 0 0.0
FLASH 1540087 1540087 0 0.0
IRAM 125403 125403 0 0.0
linux air-purifier-app debug unknown 4624 4624 0 0.0
FLASH 2628137 2628137 0 0.0
RAM 124496 124496 0 0.0
all-clusters-app debug unknown 5392 5392 0 0.0
FLASH 5761186 5761186 0 0.0
RAM 493984 493984 0 0.0
all-clusters-minimal-app debug unknown 5304 5304 0 0.0
FLASH 5219070 5219070 0 0.0
RAM 234992 234992 0 0.0
bridge-app debug unknown 5288 5288 0 0.0
FLASH 4615802 4615802 0 0.0
RAM 212256 212256 0 0.0
chip-tool debug unknown 5776 5776 0 0.0
FLASH 12220800 12220800 0 0.0
RAM 548018 548018 0 0.0
chip-tool-ipv6only arm64 unknown 20144 20144 0 0.0
FLASH 10916284 10916284 0 0.0
RAM 597872 597872 0 0.0
fabric-admin debug unknown 5672 5672 0 0.0
FLASH 11233873 11233873 0 0.0
RAM 544858 544858 0 0.0
fabric-bridge-app debug unknown 4560 4560 0 0.0
FLASH 4363598 4363598 0 0.0
RAM 198272 198272 0 0.0
lighting-app debug+rpc+ui unknown 5968 5968 0 0.0
FLASH 5540177 5540177 0 0.0
RAM 223520 223520 0 0.0
lock-app debug unknown 5224 5224 0 0.0
FLASH 4674748 4674748 0 0.0
RAM 199952 199952 0 0.0
ota-provider-app debug unknown 4600 4600 0 0.0
FLASH 4316808 4316808 0 0.0
RAM 194128 194128 0 0.0
ota-requestor-app debug unknown 4536 4536 0 0.0
FLASH 4455394 4455394 0 0.0
RAM 198680 198680 0 0.0
shell debug unknown 4168 4168 0 0.0
FLASH 2905021 2905021 0 0.0
RAM 152920 152920 0 0.0
thermostat-no-ble arm64 unknown 9184 9184 0 0.0
FLASH 4170012 4170012 0 0.0
RAM 235840 235840 0 0.0
tv-app debug unknown 5496 5496 0 0.0
FLASH 5816815 5816815 0 0.0
RAM 341360 341360 0 0.0
tv-casting-app debug unknown 5160 5160 0 0.0
FLASH 10361821 10361821 0 0.0
RAM 402232 402232 0 0.0
mbed lock-app-release cy8cproto_062_4343w FLASH 1503044 1503044 0 0.0
RAM 226648 226648 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 883200 883200 0 0.0
RAM 142259 142259 0 0.0
nrf7002dk_nrf5340_cpuapp FLASH 953540 953540 0 0.0
RAM 140687 140687 0 0.0
all-clusters-minimal-app nrf52840dk_nrf52840 FLASH 828264 828264 0 0.0
RAM 141123 141123 0 0.0
nxp contact k32w0+release FLASH 576164 576164 0 0.0
RAM 70024 70024 0 0.0
k32w1+release FLASH 591648 591648 0 0.0
RAM 74056 74056 0 0.0
light k32w0+release FLASH 610512 610512 0 0.0
RAM 69500 69500 0 0.0
k32w1+release FLASH 675288 675288 0 0.0
RAM 82816 82816 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1616036 1616036 0 0.0
RAM 209764 209764 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1536556 1536556 0 0.0
RAM 206588 206588 0 0.0
light cy8ckit_062s2_43012 FLASH 1463164 1463164 0 0.0
RAM 199876 199876 0 0.0
lock cy8ckit_062s2_43012 FLASH 1463900 1463900 0 0.0
RAM 224388 224388 0 0.0
qpg lighting-app qpg6105+debug FLASH 651556 651556 0 0.0
RAM 104564 104564 0 0.0
lock-app qpg6105+debug FLASH 612088 612088 0 0.0
RAM 99240 99240 0 0.0
stm32 light STM32WB5MM-DK FLASH 473880 473880 0 0.0
RAM 144196 144196 0 0.0
telink air-quality-sensor-app tlsr9528a_retention FLASH 633066 633066 0 0.0
RAM 50528 50528 0 0.0
all-clusters-app tlsr9118bdk40d FLASH 658954 658954 0 0.0
RAM 148436 148436 0 0.0
all-clusters-minimal-app tlsr9528a FLASH 779226 779226 0 0.0
RAM 113212 113212 0 0.0
bridge-app tlsr9258a FLASH 676058 676058 0 0.0
RAM 95304 95304 0 0.0
contact-sensor-app tlsr9528a_retention FLASH 634650 634650 0 0.0
RAM 50572 50572 0 0.0
light-switch-app-ota-shell-factory-data tlsr9528a FLASH 720510 720510 0 0.0
RAM 77148 77148 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 614030 614030 0 0.0
RAM 144636 144636 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 801812 801812 0 0.0
RAM 103040 103040 0 0.0
lock-app-dfu tlsr9528a FLASH 666466 666466 0 0.0
RAM 69852 69852 0 0.0
ota-requestor-app tlsr9258a FLASH 695390 695390 0 0.0
RAM 95028 95028 0 0.0
pump-app tlsr9518adk80d FLASH 616924 616924 0 0.0
RAM 56952 56952 0 0.0
pump-controller-app tlsr9518adk80d FLASH 607308 607308 0 0.0
RAM 56752 56752 0 0.0
shell tlsr9518adk80d FLASH 466438 466438 0 0.0
RAM 72484 72484 0 0.0
smoke_co_alarm-app tlsr9528a_retention FLASH 641268 641268 0 0.0
RAM 52200 52200 0 0.0
temperature-measurement-app-mars-ota tlsr9518adk80d FLASH 651134 651134 0 0.0
RAM 60388 60388 0 0.0
thermostat tlsr9518adk80d FLASH 626198 626198 0 0.0
RAM 57084 57084 0 0.0
window-covering tlsr9118bdk40d FLASH 519424 519424 0 0.0
RAM 97800 97800 0 0.0
tizen all-clusters-app arm unknown 1584 1584 0 0.0
FLASH 1639904 1639904 0 0.0
RAM 48620 48620 0 0.0
chip-tool-ubsan arm unknown 2384 2384 0 0.0
FLASH 16309414 16309414 0 0.0
RAM 7162056 7162056 0 0.0

Copy link
Contributor

@ccruzagralopes ccruzagralopes left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tested this using TH and it worked fine 😄

@cecille cecille changed the title [WIP] python test framework PICS 2.0 python test framework: PICS 2.0 Jul 24, 2024
@cecille cecille marked this pull request as ready for review July 24, 2024 01:50
Copy link

github-actions bot commented Jul 24, 2024

PR #34384: Size comparison from 138fb4f to 375a5ac

Full report (82 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, mbed, nxp, psoc6, qpg, stm32, telink, tizen)
platform target config section 138fb4f 375a5ac change % change
bl602 lighting-app bl602 FLASH 1271952 1271952 0 0.0
RAM 95384 95384 0 0.0
bl602+mfd FLASH 1286210 1286210 0 0.0
RAM 95528 95528 0 0.0
bl602+rpc FLASH 1310920 1310920 0 0.0
RAM 103808 103808 0 0.0
bl702 lighting-app bl702 FLASH 1092846 1092846 0 0.0
RAM 15245 15245 0 0.0
bl702+mfd FLASH 1103540 1103540 0 0.0
RAM 15397 15397 0 0.0
bl702+rpc FLASH 1182912 1182912 0 0.0
RAM 24245 24245 0 0.0
bl706-eth FLASH 876146 876146 0 0.0
RAM 27348 27348 0 0.0
bl706-wifi FLASH 1128328 1128328 0 0.0
RAM 14681 14681 0 0.0
bl702l lighting-app bl702l FLASH 1079744 1079744 0 0.0
RAM 21800 21800 0 0.0
bl702l+mfd FLASH 1091006 1091006 0 0.0
RAM 21960 21960 0 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 798900 798900 0 0.0
RAM 109236 109236 0 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 816652 816652 0 0.0
RAM 117020 117020 0 0.0
lock-mtd LP_EM_CC1354P10_6 FLASH 808492 808492 0 0.0
RAM 111308 111308 0 0.0
pump-app LP_EM_CC1354P10_6 FLASH 761108 761108 0 0.0
RAM 105408 105408 0 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 746892 746892 0 0.0
RAM 105632 105632 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 606670 606670 0 0.0
RAM 204564 204564 0 0.0
lock CC3235SF_LAUNCHXL FLASH 652018 652018 0 0.0
RAM 204836 204836 0 0.0
cyw30739 light CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 668009 668009 0 0.0
RAM 77700 77700 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 687861 687861 0 0.0
RAM 80340 80340 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 687861 687861 0 0.0
RAM 80340 80340 0 0.0
CYW930739M2EVB-02 unknown 2040 2040 0 0.0
FLASH 644805 644805 0 0.0
RAM 72768 72768 0 0.0
light-switch CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 609561 609561 0 0.0
RAM 70884 70884 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 629189 629189 0 0.0
RAM 73428 73428 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 629189 629189 0 0.0
RAM 73428 73428 0 0.0
lock CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 625257 625257 0 0.0
RAM 73900 73900 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 644965 644965 0 0.0
RAM 76444 76444 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 644965 644965 0 0.0
RAM 76444 76444 0 0.0
thermostat CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 593629 593629 0 0.0
RAM 67852 67852 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 613481 613481 0 0.0
RAM 70492 70492 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 613481 613481 0 0.0
RAM 70492 70492 0 0.0
efr32 lighting-app BRD4187C FLASH 926120 926120 0 0.0
RAM 134528 134528 0 0.0
lock-app BRD4338a FLASH 734508 734500 -8 -0.0
RAM 208004 208004 0 0.0
window-app BRD4187C FLASH 1014572 1014572 0 0.0
RAM 126648 126648 0 0.0
esp32 all-clusters-app c3devkit DRAM 90924 90924 0 0.0
FLASH 1471174 1471174 0 0.0
IRAM 75570 75570 0 0.0
m5stack DRAM 117404 117404 0 0.0
FLASH 1540279 1540279 0 0.0
IRAM 125403 125403 0 0.0
linux air-purifier-app debug unknown 4632 4632 0 0.0
FLASH 2707145 2707145 0 0.0
RAM 125200 125200 0 0.0
all-clusters-app debug unknown 5400 5400 0 0.0
FLASH 5835622 5835622 0 0.0
RAM 494784 494784 0 0.0
all-clusters-minimal-app debug unknown 5312 5312 0 0.0
FLASH 5295322 5295322 0 0.0
RAM 235728 235728 0 0.0
bridge-app debug unknown 5296 5296 0 0.0
FLASH 4694644 4694644 0 0.0
RAM 212992 212992 0 0.0
chip-tool debug unknown 5784 5784 0 0.0
FLASH 12297328 12297328 0 0.0
RAM 548882 548882 0 0.0
chip-tool-ipv6only arm64 unknown 20168 20168 0 0.0
FLASH 11003276 11003276 0 0.0
RAM 598528 598528 0 0.0
fabric-admin debug unknown 5672 5672 0 0.0
FLASH 11315167 11315167 0 0.0
RAM 545722 545722 0 0.0
fabric-bridge-app debug unknown 4568 4568 0 0.0
FLASH 4448878 4448878 0 0.0
RAM 199024 199024 0 0.0
lighting-app debug+rpc+ui unknown 5968 5968 0 0.0
FLASH 5618721 5618721 0 0.0
RAM 224272 224272 0 0.0
lock-app debug unknown 5232 5232 0 0.0
FLASH 4753096 4753096 0 0.0
RAM 200704 200704 0 0.0
ota-provider-app debug unknown 4608 4608 0 0.0
FLASH 4397590 4397590 0 0.0
RAM 194880 194880 0 0.0
ota-requestor-app debug unknown 4544 4544 0 0.0
FLASH 4535372 4535372 0 0.0
RAM 199416 199416 0 0.0
shell debug unknown 4168 4168 0 0.0
FLASH 2979837 2979837 0 0.0
RAM 153736 153736 0 0.0
thermostat-no-ble arm64 unknown 9208 9208 0 0.0
FLASH 4257044 4257044 0 0.0
RAM 236336 236336 0 0.0
tv-app debug unknown 5504 5504 0 0.0
FLASH 5970429 5970429 0 0.0
RAM 573376 573376 0 0.0
tv-casting-app debug unknown 5168 5168 0 0.0
FLASH 10509565 10509565 0 0.0
RAM 634344 634344 0 0.0
mbed lock-app-release cy8cproto_062_4343w FLASH 1503276 1503276 0 0.0
RAM 226720 226720 0 0.0
nxp contact k32w0+release FLASH 576100 576100 0 0.0
RAM 70104 70104 0 0.0
k32w1+release FLASH 591664 591664 0 0.0
RAM 74144 74144 0 0.0
light k32w0+release FLASH 610400 610400 0 0.0
RAM 69564 69564 0 0.0
k32w1+release FLASH 675184 675184 0 0.0
RAM 82872 82872 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1611668 1611668 0 0.0
RAM 209728 209728 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1532020 1532020 0 0.0
RAM 206544 206544 0 0.0
light cy8ckit_062s2_43012 FLASH 1458844 1458844 0 0.0
RAM 199808 199808 0 0.0
lock cy8ckit_062s2_43012 FLASH 1459484 1459484 0 0.0
RAM 224328 224328 0 0.0
qpg lighting-app qpg6105+debug FLASH 651724 651724 0 0.0
RAM 104636 104636 0 0.0
lock-app qpg6105+debug FLASH 612112 612112 0 0.0
RAM 99320 99320 0 0.0
stm32 light STM32WB5MM-DK FLASH 474120 474120 0 0.0
RAM 144260 144260 0 0.0
telink air-quality-sensor-app tlsr9528a_retention FLASH 633084 633084 0 0.0
RAM 50576 50576 0 0.0
all-clusters-app tlsr9118bdk40d FLASH 658936 658936 0 0.0
RAM 148480 148480 0 0.0
all-clusters-minimal-app tlsr9528a FLASH 779162 779162 0 0.0
RAM 113260 113260 0 0.0
bridge-app tlsr9258a FLASH 676004 676004 0 0.0
RAM 95344 95344 0 0.0
contact-sensor-app tlsr9528a_retention FLASH 634668 634668 0 0.0
RAM 50620 50620 0 0.0
light-switch-app-ota-shell-factory-data tlsr9528a FLASH 720540 720540 0 0.0
RAM 77196 77196 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 614038 614038 0 0.0
RAM 144684 144684 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 801842 801842 0 0.0
RAM 103088 103088 0 0.0
lock-app-dfu tlsr9528a FLASH 666496 666496 0 0.0
RAM 69900 69900 0 0.0
ota-requestor-app tlsr9258a FLASH 695366 695366 0 0.0
RAM 95068 95068 0 0.0
pump-app tlsr9518adk80d FLASH 616932 616932 0 0.0
RAM 57000 57000 0 0.0
pump-controller-app tlsr9518adk80d FLASH 607342 607342 0 0.0
RAM 56800 56800 0 0.0
shell tlsr9518adk80d FLASH 466520 466520 0 0.0
RAM 72488 72488 0 0.0
smoke_co_alarm-app tlsr9528a_retention FLASH 641286 641286 0 0.0
RAM 52248 52248 0 0.0
temperature-measurement-app-mars-ota tlsr9518adk80d FLASH 651164 651164 0 0.0
RAM 60436 60436 0 0.0
thermostat tlsr9518adk80d FLASH 626228 626228 0 0.0
RAM 57124 57124 0 0.0
window-covering tlsr9118bdk40d FLASH 519434 519434 0 0.0
RAM 97856 97856 0 0.0
tizen all-clusters-app arm unknown 1588 1588 0 0.0
FLASH 1641280 1641280 0 0.0
RAM 48708 48708 0 0.0
chip-tool-ubsan arm unknown 2388 2388 0 0.0
FLASH 16324974 16324974 0 0.0
RAM 7168664 7168664 0 0.0

Copy link

github-actions bot commented Jul 25, 2024

PR #34384: Size comparison from c91a779 to d1764ea

Full report (85 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, mbed, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
platform target config section c91a779 d1764ea change % change
bl602 lighting-app bl602 FLASH 1271964 1271964 0 0.0
RAM 95384 95384 0 0.0
bl602+mfd FLASH 1286222 1286222 0 0.0
RAM 95528 95528 0 0.0
bl602+rpc FLASH 1311188 1311188 0 0.0
RAM 103808 103808 0 0.0
bl702 lighting-app bl702 FLASH 1092858 1092858 0 0.0
RAM 15245 15245 0 0.0
bl702+mfd FLASH 1103808 1103808 0 0.0
RAM 15397 15397 0 0.0
bl702+rpc FLASH 1182924 1182924 0 0.0
RAM 24245 24245 0 0.0
bl706-eth FLASH 876158 876158 0 0.0
RAM 27348 27348 0 0.0
bl706-wifi FLASH 1128598 1128598 0 0.0
RAM 14681 14681 0 0.0
bl702l lighting-app bl702l FLASH 1080012 1080012 0 0.0
RAM 21800 21800 0 0.0
bl702l+mfd FLASH 1091274 1091274 0 0.0
RAM 21960 21960 0 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 798972 798972 0 0.0
RAM 109236 109236 0 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 816684 816684 0 0.0
RAM 117020 117020 0 0.0
lock-mtd LP_EM_CC1354P10_6 FLASH 808516 808516 0 0.0
RAM 111308 111308 0 0.0
pump-app LP_EM_CC1354P10_6 FLASH 761132 761132 0 0.0
RAM 105408 105408 0 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 746916 746916 0 0.0
RAM 105632 105632 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 606494 606494 0 0.0
RAM 204564 204564 0 0.0
lock CC3235SF_LAUNCHXL FLASH 652026 652026 0 0.0
RAM 204836 204836 0 0.0
cyw30739 light CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 668081 668081 0 0.0
RAM 77700 77700 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 687933 687933 0 0.0
RAM 80340 80340 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 687933 687933 0 0.0
RAM 80340 80340 0 0.0
CYW930739M2EVB-02 unknown 2040 2040 0 0.0
FLASH 644869 644869 0 0.0
RAM 72768 72768 0 0.0
light-switch CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 609585 609585 0 0.0
RAM 70884 70884 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 629221 629221 0 0.0
RAM 73428 73428 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 629221 629221 0 0.0
RAM 73428 73428 0 0.0
lock CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 625289 625289 0 0.0
RAM 73900 73900 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 644997 644997 0 0.0
RAM 76444 76444 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 644997 644997 0 0.0
RAM 76444 76444 0 0.0
thermostat CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 593517 593517 0 0.0
RAM 67852 67852 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 613369 613369 0 0.0
RAM 70492 70492 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 613369 613369 0 0.0
RAM 70492 70492 0 0.0
efr32 lighting-app BRD4187C FLASH 926152 926152 0 0.0
RAM 134528 134528 0 0.0
lock-app BRD4338a FLASH 734524 734516 -8 -0.0
RAM 208004 208004 0 0.0
window-app BRD4187C FLASH 1014604 1014604 0 0.0
RAM 126648 126648 0 0.0
esp32 all-clusters-app c3devkit DRAM 90948 90948 0 0.0
FLASH 1471128 1471128 0 0.0
IRAM 75570 75570 0 0.0
m5stack DRAM 117428 117428 0 0.0
FLASH 1540255 1540255 0 0.0
IRAM 125403 125403 0 0.0
linux air-purifier-app debug unknown 4632 4632 0 0.0
FLASH 2710279 2710279 0 0.0
RAM 125200 125200 0 0.0
all-clusters-app debug unknown 5416 5416 0 0.0
FLASH 5849966 5849966 0 0.0
RAM 494592 494592 0 0.0
all-clusters-minimal-app debug unknown 5312 5312 0 0.0
FLASH 5298760 5298760 0 0.0
RAM 235728 235728 0 0.0
bridge-app debug unknown 5296 5296 0 0.0
FLASH 4699178 4699178 0 0.0
RAM 212992 212992 0 0.0
chip-tool debug unknown 5784 5784 0 0.0
FLASH 12279384 12279384 0 0.0
RAM 548050 548050 0 0.0
chip-tool-ipv6only arm64 unknown 20128 20128 0 0.0
FLASH 10987004 10987004 0 0.0
RAM 597680 597680 0 0.0
fabric-admin debug unknown 5672 5672 0 0.0
FLASH 11299943 11299943 0 0.0
RAM 544890 544890 0 0.0
fabric-bridge-app debug unknown 4568 4568 0 0.0
FLASH 4453464 4453464 0 0.0
RAM 199024 199024 0 0.0
lighting-app debug+rpc+ui unknown 5968 5968 0 0.0
FLASH 5623585 5623585 0 0.0
RAM 224272 224272 0 0.0
lock-app debug unknown 5232 5232 0 0.0
FLASH 4757630 4757630 0 0.0
RAM 200704 200704 0 0.0
ota-provider-app debug unknown 4608 4608 0 0.0
FLASH 4402124 4402124 0 0.0
RAM 194880 194880 0 0.0
ota-requestor-app debug unknown 4544 4544 0 0.0
FLASH 4540272 4540272 0 0.0
RAM 199416 199416 0 0.0
shell debug unknown 4168 4168 0 0.0
FLASH 2983165 2983165 0 0.0
RAM 153704 153704 0 0.0
thermostat-no-ble arm64 unknown 9208 9208 0 0.0
FLASH 4259572 4259572 0 0.0
RAM 236360 236360 0 0.0
tv-app debug unknown 5504 5504 0 0.0
FLASH 5974781 5974781 0 0.0
RAM 573184 573184 0 0.0
tv-casting-app debug unknown 5168 5168 0 0.0
FLASH 10490877 10490877 0 0.0
RAM 633352 633352 0 0.0
mbed lock-app-release cy8cproto_062_4343w FLASH 1503276 1503276 0 0.0
RAM 226720 226720 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 887792 887792 0 0.0
RAM 141556 141556 0 0.0
nrf7002dk_nrf5340_cpuapp FLASH 956088 956088 0 0.0
RAM 140660 140660 0 0.0
all-clusters-minimal-app nrf52840dk_nrf52840 FLASH 831548 831548 0 0.0
RAM 140424 140424 0 0.0
nxp contact k32w0+release FLASH 576100 576100 0 0.0
RAM 70104 70104 0 0.0
k32w1+release FLASH 591672 591672 0 0.0
RAM 74144 74144 0 0.0
light k32w0+release FLASH 610464 610464 0 0.0
RAM 69564 69564 0 0.0
k32w1+release FLASH 675248 675248 0 0.0
RAM 82872 82872 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1611588 1611588 0 0.0
RAM 209728 209728 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1531940 1531940 0 0.0
RAM 206544 206544 0 0.0
light cy8ckit_062s2_43012 FLASH 1458956 1458956 0 0.0
RAM 199808 199808 0 0.0
lock cy8ckit_062s2_43012 FLASH 1459500 1459500 0 0.0
RAM 224328 224328 0 0.0
qpg lighting-app qpg6105+debug FLASH 651796 651796 0 0.0
RAM 104636 104636 0 0.0
lock-app qpg6105+debug FLASH 612152 612152 0 0.0
RAM 99320 99320 0 0.0
stm32 light STM32WB5MM-DK FLASH 474176 474176 0 0.0
RAM 144260 144260 0 0.0
telink air-quality-sensor-app tlsr9528a_retention FLASH 633112 633112 0 0.0
RAM 50576 50576 0 0.0
all-clusters-app tlsr9118bdk40d FLASH 658826 658826 0 0.0
RAM 148480 148480 0 0.0
all-clusters-minimal-app tlsr9528a FLASH 779052 779052 0 0.0
RAM 113260 113260 0 0.0
bridge-app tlsr9258a FLASH 676032 676032 0 0.0
RAM 95344 95344 0 0.0
contact-sensor-app tlsr9528a_retention FLASH 634696 634696 0 0.0
RAM 50620 50620 0 0.0
light-switch-app-ota-shell-factory-data tlsr9528a FLASH 720568 720568 0 0.0
RAM 77196 77196 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 614100 614100 0 0.0
RAM 144684 144684 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 801904 801904 0 0.0
RAM 103088 103088 0 0.0
lock-app-dfu tlsr9528a FLASH 666524 666524 0 0.0
RAM 69900 69900 0 0.0
ota-requestor-app tlsr9258a FLASH 695428 695428 0 0.0
RAM 95068 95068 0 0.0
pump-app tlsr9518adk80d FLASH 616960 616960 0 0.0
RAM 57000 57000 0 0.0
pump-controller-app tlsr9518adk80d FLASH 607370 607370 0 0.0
RAM 56800 56800 0 0.0
shell tlsr9518adk80d FLASH 466520 466520 0 0.0
RAM 72488 72488 0 0.0
smoke_co_alarm-app tlsr9528a_retention FLASH 641314 641314 0 0.0
RAM 52248 52248 0 0.0
temperature-measurement-app-mars-ota tlsr9518adk80d FLASH 651192 651192 0 0.0
RAM 60436 60436 0 0.0
thermostat tlsr9518adk80d FLASH 626084 626084 0 0.0
RAM 57124 57124 0 0.0
window-covering tlsr9118bdk40d FLASH 519462 519462 0 0.0
RAM 97856 97856 0 0.0
tizen all-clusters-app arm unknown 1588 1588 0 0.0
FLASH 1640836 1640836 0 0.0
RAM 48708 48708 0 0.0
chip-tool-ubsan arm unknown 2388 2388 0 0.0
FLASH 16291318 16291318 0 0.0
RAM 7153452 7153452 0 0.0

Copy link

github-actions bot commented Jul 26, 2024

PR #34384: Size comparison from c91a779 to f0b46ca

Increases above 0.2%:

platform target config section c91a779 f0b46ca change % change
esp32 all-clusters-app c3devkit FLASH 1471128 1475532 4404 0.3
m5stack FLASH 1540255 1544739 4484 0.3
linux all-clusters-app debug FLASH 5849966 5870326 20360 0.3
bridge-app debug RAM 212992 213664 672 0.3
shell debug FLASH 2983165 2991677 8512 0.3
RAM 153704 154056 352 0.2
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 887792 891200 3408 0.4
nrf7002dk_nrf5340_cpuapp FLASH 956088 958928 2840 0.3
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1611588 1615916 4328 0.3
stm32 light STM32WB5MM-DK FLASH 474176 475456 1280 0.3
telink all-clusters-app tlsr9118bdk40d FLASH 658826 662062 3236 0.5
bridge-app tlsr9258a FLASH 676032 677462 1430 0.2
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 614100 615524 1424 0.2
tizen all-clusters-app arm FLASH 1640836 1651544 10708 0.7
RAM 48708 48916 208 0.4
Full report (84 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, mbed, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
platform target config section c91a779 f0b46ca change % change
bl602 lighting-app bl602 FLASH 1271964 1274146 2182 0.2
RAM 95384 95424 40 0.0
bl602+mfd FLASH 1286222 1288404 2182 0.2
RAM 95528 95568 40 0.0
bl602+rpc FLASH 1311188 1313114 1926 0.1
RAM 103808 103848 40 0.0
bl702 lighting-app bl702 FLASH 1092858 1095040 2182 0.2
RAM 15245 15245 0 0.0
bl702+mfd FLASH 1103808 1105734 1926 0.2
RAM 15397 15397 0 0.0
bl702+rpc FLASH 1182924 1185106 2182 0.2
RAM 24245 24245 0 0.0
bl706-eth FLASH 876158 878084 1926 0.2
RAM 27348 27348 0 0.0
bl706-wifi FLASH 1128598 1130780 2182 0.2
RAM 14681 14681 0 0.0
bl702l lighting-app bl702l FLASH 1080012 1081938 1926 0.2
RAM 21800 21800 0 0.0
bl702l+mfd FLASH 1091274 1093200 1926 0.2
RAM 21960 21960 0 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 798972 800260 1288 0.2
RAM 109236 109276 40 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 816684 816684 0 0.0
RAM 117020 117020 0 0.0
lock-mtd LP_EM_CC1354P10_6 FLASH 808516 808652 136 0.0
RAM 111308 111308 0 0.0
pump-app LP_EM_CC1354P10_6 FLASH 761132 762416 1284 0.2
RAM 105408 105448 40 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 746916 747068 152 0.0
RAM 105632 105632 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 606494 606670 176 0.0
RAM 204564 204564 0 0.0
lock CC3235SF_LAUNCHXL FLASH 652026 652210 184 0.0
RAM 204836 204836 0 0.0
cyw30739 light CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 668081 669329 1248 0.2
RAM 77700 77740 40 0.1
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 687933 689189 1256 0.2
RAM 80340 80380 40 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 687933 689189 1256 0.2
RAM 80340 80380 40 0.0
CYW930739M2EVB-02 unknown 2040 2040 0 0.0
FLASH 644869 646125 1256 0.2
RAM 72768 72808 40 0.1
light-switch CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 609585 609737 152 0.0
RAM 70884 70884 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 629221 629365 144 0.0
RAM 73428 73428 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 629221 629365 144 0.0
RAM 73428 73428 0 0.0
lock CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 625289 625433 144 0.0
RAM 73900 73900 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 644997 645141 144 0.0
RAM 76444 76444 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 644997 645141 144 0.0
RAM 76444 76444 0 0.0
thermostat CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 593517 593661 144 0.0
RAM 67852 67852 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 613369 613513 144 0.0
RAM 70492 70492 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 613369 613513 144 0.0
RAM 70492 70492 0 0.0
efr32 lighting-app BRD4187C FLASH 926152 927304 1152 0.1
RAM 134528 134568 40 0.0
lock-app BRD4338a FLASH 734524 734676 152 0.0
RAM 208004 208004 0 0.0
window-app BRD4187C FLASH 1014604 1014772 168 0.0
RAM 126648 126648 0 0.0
esp32 all-clusters-app c3devkit DRAM 90948 91012 64 0.1
FLASH 1471128 1475532 4404 0.3
IRAM 75570 75570 0 0.0
m5stack DRAM 117428 117492 64 0.1
FLASH 1540255 1544739 4484 0.3
IRAM 125403 125403 0 0.0
linux air-purifier-app debug unknown 4632 4632 0 0.0
FLASH 2710279 2710575 296 0.0
RAM 125200 125200 0 0.0
all-clusters-app debug unknown 5416 5416 0 0.0
FLASH 5849966 5870326 20360 0.3
RAM 494592 495272 680 0.1
all-clusters-minimal-app debug unknown 5312 5312 0 0.0
FLASH 5298760 5306994 8234 0.2
RAM 235728 235920 192 0.1
bridge-app debug unknown 5296 5296 0 0.0
FLASH 4699178 4707492 8314 0.2
RAM 212992 213664 672 0.3
chip-tool debug unknown 5784 5784 0 0.0
FLASH 12279384 12284870 5486 0.0
RAM 548050 548498 448 0.1
chip-tool-ipv6only arm64 unknown 20128 20144 16 0.1
FLASH 10987004 10991020 4016 0.0
RAM 597680 598152 472 0.1
fabric-admin debug unknown 5672 5672 0 0.0
FLASH 11299943 11305463 5520 0.0
RAM 544890 545338 448 0.1
fabric-bridge-app debug unknown 4568 4568 0 0.0
FLASH 4453464 4453760 296 0.0
RAM 199024 199024 0 0.0
lighting-app debug+rpc+ui unknown 5968 5968 0 0.0
FLASH 5623585 5631585 8000 0.1
RAM 224272 224464 192 0.1
lock-app debug unknown 5232 5232 0 0.0
FLASH 4757630 4757958 328 0.0
RAM 200704 200704 0 0.0
ota-provider-app debug unknown 4608 4608 0 0.0
FLASH 4402124 4402420 296 0.0
RAM 194880 194880 0 0.0
ota-requestor-app debug unknown 4544 4544 0 0.0
FLASH 4540272 4540568 296 0.0
RAM 199416 199416 0 0.0
shell debug unknown 4168 4176 8 0.2
FLASH 2983165 2991677 8512 0.3
RAM 153704 154056 352 0.2
thermostat-no-ble arm64 unknown 9208 9208 0 0.0
FLASH 4259572 4259844 272 0.0
RAM 236360 236360 0 0.0
tv-app debug unknown 5504 5504 0 0.0
FLASH 5974781 5983117 8336 0.1
RAM 573184 574016 832 0.1
tv-casting-app debug unknown 5168 5168 0 0.0
FLASH 10490877 10496589 5712 0.1
RAM 633352 633784 432 0.1
mbed lock-app-release cy8cproto_062_4343w FLASH 1503276 1503444 168 0.0
RAM 226720 226720 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 887792 891200 3408 0.4
RAM 141556 141604 48 0.0
nrf7002dk_nrf5340_cpuapp FLASH 956088 958928 2840 0.3
RAM 140660 140708 48 0.0
all-clusters-minimal-app nrf52840dk_nrf52840 FLASH 831548 832696 1148 0.1
RAM 140424 140464 40 0.0
nxp contact k32w0+release FLASH 576100 576100 0 0.0
RAM 70104 70104 0 0.0
k32w1+release FLASH 591672 591808 136 0.0
RAM 74144 74144 0 0.0
light k32w0+release FLASH 610464 611696 1232 0.2
RAM 69564 69608 44 0.1
k32w1+release FLASH 675248 676528 1280 0.2
RAM 82872 82912 40 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1611588 1615916 4328 0.3
RAM 209728 209776 48 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1531940 1533476 1536 0.1
RAM 206544 206584 40 0.0
light cy8ckit_062s2_43012 FLASH 1458956 1460500 1544 0.1
RAM 199808 199848 40 0.0
lock cy8ckit_062s2_43012 FLASH 1459500 1459668 168 0.0
RAM 224328 224328 0 0.0
qpg lighting-app qpg6105+debug FLASH 651796 653084 1288 0.2
RAM 104636 104680 44 0.0
lock-app qpg6105+debug FLASH 612152 612288 136 0.0
RAM 99320 99320 0 0.0
stm32 light STM32WB5MM-DK FLASH 474176 475456 1280 0.3
RAM 144260 144300 40 0.0
telink air-quality-sensor-app tlsr9528a_retention FLASH 633112 633182 70 0.0
RAM 50576 50576 0 0.0
all-clusters-app tlsr9118bdk40d FLASH 658826 662062 3236 0.5
RAM 148480 148528 48 0.0
all-clusters-minimal-app tlsr9528a FLASH 779052 780470 1418 0.2
RAM 113260 113300 40 0.0
bridge-app tlsr9258a FLASH 676032 677462 1430 0.2
RAM 95344 95384 40 0.0
contact-sensor-app tlsr9528a_retention FLASH 634696 634766 70 0.0
RAM 50620 50620 0 0.0
light-switch-app-ota-shell-factory-data tlsr9528a FLASH 720568 720638 70 0.0
RAM 77196 77196 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 614100 615524 1424 0.2
RAM 144684 144724 40 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 801904 803328 1424 0.2
RAM 103088 103128 40 0.0
lock-app-dfu tlsr9528a FLASH 666524 666594 70 0.0
RAM 69900 69900 0 0.0
ota-requestor-app tlsr9258a FLASH 695428 695498 70 0.0
RAM 95068 95068 0 0.0
pump-controller-app tlsr9518adk80d FLASH 607370 607440 70 0.0
RAM 56800 56800 0 0.0
shell tlsr9518adk80d FLASH 466520 466520 0 0.0
RAM 72488 72488 0 0.0
smoke_co_alarm-app tlsr9528a_retention FLASH 641314 641384 70 0.0
RAM 52248 52248 0 0.0
temperature-measurement-app-mars-ota tlsr9518adk80d FLASH 651192 651262 70 0.0
RAM 60436 60436 0 0.0
thermostat tlsr9518adk80d FLASH 626084 626148 64 0.0
RAM 57124 57124 0 0.0
window-covering tlsr9118bdk40d FLASH 519462 519532 70 0.0
RAM 97856 97856 0 0.0
tizen all-clusters-app arm unknown 1588 1588 0 0.0
FLASH 1640836 1651544 10708 0.7
RAM 48708 48916 208 0.4
chip-tool-ubsan arm unknown 2388 2388 0 0.0
FLASH 16291318 16298454 7136 0.0
RAM 7153452 7156200 2748 0.0

@mergify mergify bot merged commit f4d9188 into project-chip:master Jul 27, 2024
69 checks passed
rochaferraz pushed a commit to rochaferraz/connectedhomeip that referenced this pull request Jul 31, 2024
* [WIP] python test framework PICS 2.0

* typo

* use ms int for test duration

* Add documentation to decorators and helpers

* Remove unused parameters

* Restyled by autopep8

* Restyled by isort

* linter

* fix merge conflict

* formatting of imports

* address review comments

---------

Co-authored-by: Restyled.io <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants