Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

First set of test scripts to have automated implementation of python tests to use Metadata script as an intermediate argument holder #34032

Merged
merged 10 commits into from
Jun 20, 2024

Conversation

vatsalghelani-csa
Copy link
Contributor

Work for Issue #31317

Follow up to PR #33888

PR #6 - First set of test scripts to have automated implementation of python tests to use Metadata script as an intermediate argument holder. Modified first set of python test script to now use the newer approach of extracting the arguments required through the new created metadata script and use it for execution.

Files Worked:

  • .github/workflows/tests.yaml
  • src/python_testing/*
    • 37 python test files

Copy link

github-actions bot commented Jun 20, 2024

PR #34032: Size comparison from e407d40 to 24f75fe

Full report (85 builds for bl602, bl702, bl702l, cc13x4_26x4, cc32xx, cyw30739, efr32, esp32, linux, mbed, nrfconnect, nxp, psoc6, qpg, stm32, telink, tizen)
platform target config section e407d40 24f75fe change % change
bl602 lighting-app bl602 FLASH 1270534 1270534 0 0.0
RAM 95328 95328 0 0.0
bl602+mfd FLASH 1284812 1284812 0 0.0
RAM 95480 95480 0 0.0
bl602+rpc FLASH 1309734 1309734 0 0.0
RAM 103760 103760 0 0.0
bl702 lighting-app bl702 FLASH 1091430 1091430 0 0.0
RAM 14897 14897 0 0.0
bl702+mfd FLASH 1102124 1102124 0 0.0
RAM 15049 15049 0 0.0
bl702+rpc FLASH 1181240 1181240 0 0.0
RAM 23925 23925 0 0.0
bl706-eth FLASH 874774 874774 0 0.0
RAM 27016 27016 0 0.0
bl706-wifi FLASH 1127068 1127068 0 0.0
RAM 14349 14349 0 0.0
bl702l lighting-app bl702l FLASH 1078316 1078316 0 0.0
RAM 21468 21468 0 0.0
bl702l+mfd FLASH 1089578 1089578 0 0.0
RAM 21628 21628 0 0.0
cc13x4_26x4 lighting-app LP_EM_CC1354P10_6 FLASH 798100 798100 0 0.0
RAM 103088 103088 0 0.0
lock-ftd LP_EM_CC1354P10_6 FLASH 813752 813752 0 0.0
RAM 113568 113568 0 0.0
lock-mtd LP_EM_CC1354P10_6 FLASH 803276 803276 0 0.0
RAM 107688 107688 0 0.0
pump-app LP_EM_CC1354P10_6 FLASH 756052 756052 0 0.0
RAM 101788 101788 0 0.0
pump-controller-app LP_EM_CC1354P10_6 FLASH 741724 741724 0 0.0
RAM 102036 102036 0 0.0
cc32xx air-purifier CC3235SF_LAUNCHXL FLASH 605750 605750 0 0.0
RAM 204512 204512 0 0.0
lock CC3235SF_LAUNCHXL FLASH 650770 650770 0 0.0
RAM 204772 204772 0 0.0
cyw30739 light CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 665865 665865 0 0.0
RAM 75100 75100 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 685725 685725 0 0.0
RAM 77732 77732 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 685725 685725 0 0.0
RAM 77732 77732 0 0.0
CYW930739M2EVB-02 unknown 2040 2040 0 0.0
FLASH 642653 642653 0 0.0
RAM 70168 70168 0 0.0
light-switch CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 608337 608337 0 0.0
RAM 70804 70804 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 627965 627965 0 0.0
RAM 73356 73356 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 627965 627965 0 0.0
RAM 73356 73356 0 0.0
lock CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 623817 623817 0 0.0
RAM 73820 73820 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 643533 643533 0 0.0
RAM 76372 76372 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 643533 643533 0 0.0
RAM 76372 76372 0 0.0
thermostat CYW30739B2-P5-EVK-01 unknown 2040 2040 0 0.0
FLASH 592389 592389 0 0.0
RAM 67788 67788 0 0.0
CYW30739B2-P5-EVK-02 unknown 2040 2040 0 0.0
FLASH 612233 612233 0 0.0
RAM 70420 70420 0 0.0
CYW30739B2-P5-EVK-03 unknown 2040 2040 0 0.0
FLASH 612233 612233 0 0.0
RAM 70420 70420 0 0.0
efr32 lighting-app BRD4187C FLASH 888232 888224 -8 -0.0
RAM 183424 183424 0 0.0
lock-app BRD4338a FLASH 699848 699848 0 0.0
RAM 242228 242228 0 0.0
window-app BRD4187C FLASH 969748 969748 0 0.0
RAM 167856 167856 0 0.0
esp32 all-clusters-app c3devkit DRAM 88324 88324 0 0.0
FLASH 1468934 1468934 0 0.0
IRAM 75570 75570 0 0.0
m5stack DRAM 114796 114796 0 0.0
FLASH 1538059 1538059 0 0.0
IRAM 125403 125403 0 0.0
linux air-purifier-app debug unknown 4592 4592 0 0.0
FLASH 2528192 2528192 0 0.0
RAM 125072 125072 0 0.0
all-clusters-app debug unknown 5368 5368 0 0.0
FLASH 5578270 5578270 0 0.0
RAM 479304 479304 0 0.0
all-clusters-minimal-app debug unknown 5288 5288 0 0.0
FLASH 5050696 5050696 0 0.0
RAM 232856 232856 0 0.0
bridge-app debug unknown 5256 5256 0 0.0
FLASH 4476408 4476408 0 0.0
RAM 212768 212768 0 0.0
chip-tool debug unknown 5728 5728 0 0.0
FLASH 11548231 11548231 0 0.0
RAM 531386 531386 0 0.0
chip-tool-ipv6only arm64 unknown 19816 19816 0 0.0
FLASH 10680388 10680388 0 0.0
RAM 580120 580120 0 0.0
fabric-admin debug unknown 5584 5584 0 0.0
FLASH 10547127 10547127 0 0.0
RAM 525466 525466 0 0.0
fabric-bridge-app debug unknown 5264 5264 0 0.0
FLASH 4346936 4346936 0 0.0
RAM 204896 204896 0 0.0
lighting-app debug+rpc+ui unknown 5904 5904 0 0.0
FLASH 5372770 5372770 0 0.0
RAM 221672 221672 0 0.0
lock-app debug unknown 5192 5192 0 0.0
FLASH 4540008 4540008 0 0.0
RAM 200192 200192 0 0.0
ota-provider-app debug unknown 4576 4576 0 0.0
FLASH 4195768 4195768 0 0.0
RAM 194432 194432 0 0.0
ota-requestor-app debug unknown 4512 4512 0 0.0
FLASH 4321256 4321256 0 0.0
RAM 199088 199088 0 0.0
shell debug unknown 4112 4112 0 0.0
FLASH 2793965 2793965 0 0.0
RAM 150416 150416 0 0.0
thermostat-no-ble arm64 unknown 9184 9184 0 0.0
FLASH 4167060 4167060 0 0.0
RAM 235784 235784 0 0.0
tv-app debug unknown 5472 5472 0 0.0
FLASH 5593624 5593624 0 0.0
RAM 341672 341672 0 0.0
tv-casting-app debug unknown 5096 5096 0 0.0
FLASH 9595926 9595926 0 0.0
RAM 348848 348848 0 0.0
mbed lock-app-release cy8cproto_062_4343w FLASH 1502020 1502020 0 0.0
RAM 226672 226672 0 0.0
nrfconnect all-clusters-app nrf52840dk_nrf52840 FLASH 880892 880892 0 0.0
RAM 139693 139693 0 0.0
nrf7002dk_nrf5340_cpuapp FLASH 951704 951704 0 0.0
RAM 138121 138121 0 0.0
all-clusters-minimal-app nrf52840dk_nrf52840 FLASH 826448 826448 0 0.0
RAM 138591 138591 0 0.0
nxp contact k32w0+release FLASH 575604 575604 0 0.0
RAM 70024 70024 0 0.0
k32w1+release FLASH 590728 590728 0 0.0
RAM 74056 74056 0 0.0
light k32w0+release FLASH 609680 609680 0 0.0
RAM 69500 69500 0 0.0
k32w1+release FLASH 674232 674232 0 0.0
RAM 82808 82808 0 0.0
psoc6 all-clusters cy8ckit_062s2_43012 FLASH 1613444 1613444 0 0.0
RAM 207132 207132 0 0.0
all-clusters-minimal cy8ckit_062s2_43012 FLASH 1534228 1534228 0 0.0
RAM 204036 204036 0 0.0
light cy8ckit_062s2_43012 FLASH 1461092 1461092 0 0.0
RAM 197316 197316 0 0.0
lock cy8ckit_062s2_43012 FLASH 1462844 1462844 0 0.0
RAM 224380 224380 0 0.0
qpg lighting-app qpg6105+debug FLASH 650600 650600 0 0.0
RAM 104556 104556 0 0.0
lock-app qpg6105+debug FLASH 610700 610700 0 0.0
RAM 99232 99232 0 0.0
stm32 light STM32WB5MM-DK FLASH 472136 472136 0 0.0
RAM 141652 141652 0 0.0
telink air-quality-sensor-app tlsr9528a_retention FLASH 632130 632130 0 0.0
RAM 50528 50528 0 0.0
all-clusters-app tlsr9118bdk40d FLASH 657126 657126 0 0.0
RAM 145872 145872 0 0.0
all-clusters-minimal-app tlsr9528a FLASH 777190 777190 0 0.0
RAM 110684 110684 0 0.0
bridge-app tlsr9258a FLASH 675114 675114 0 0.0
RAM 95304 95304 0 0.0
contact-sensor-app tlsr9528a_retention FLASH 633714 633714 0 0.0
RAM 50572 50572 0 0.0
light-switch-app-ota-shell-factory-data tlsr9528a FLASH 719492 719492 0 0.0
RAM 77148 77148 0 0.0
lighting-app-ota-factory-data tlsr9118bdk40d FLASH 612268 612268 0 0.0
RAM 142104 142104 0 0.0
lighting-app-ota-rpc-factory-data-4mb tlsr9518adk80d FLASH 799822 799822 0 0.0
RAM 100508 100508 0 0.0
lock-app-dfu tlsr9528a FLASH 665278 665278 0 0.0
RAM 69860 69860 0 0.0
ota-requestor-app tlsr9258a FLASH 694444 694444 0 0.0
RAM 95028 95028 0 0.0
pump-app tlsr9518adk80d FLASH 615978 615978 0 0.0
RAM 56952 56952 0 0.0
pump-controller-app tlsr9518adk80d FLASH 606362 606362 0 0.0
RAM 56752 56752 0 0.0
shell tlsr9518adk80d FLASH 466154 466154 0 0.0
RAM 72484 72484 0 0.0
smoke_co_alarm-app tlsr9528a_retention FLASH 640074 640074 0 0.0
RAM 52200 52200 0 0.0
temperature-measurement-app-mars-ota tlsr9518adk80d FLASH 650188 650188 0 0.0
RAM 60388 60388 0 0.0
thermostat tlsr9518adk80d FLASH 625252 625252 0 0.0
RAM 57084 57084 0 0.0
window-covering tlsr9118bdk40d FLASH 518710 518710 0 0.0
RAM 97800 97800 0 0.0
tizen all-clusters-app arm unknown 1560 1560 0 0.0
FLASH 1633264 1633264 0 0.0
RAM 46020 46020 0 0.0
chip-tool-ubsan arm unknown 2364 2364 0 0.0
FLASH 15881842 15881842 0 0.0
RAM 6972008 6972008 0 0.0

@mergify mergify bot merged commit c4f863e into project-chip:master Jun 20, 2024
68 checks passed
@vatsalghelani-csa vatsalghelani-csa deleted the firstSetPythonTests branch June 20, 2024 16:49
austina-csa pushed a commit to austina-csa/connectedhomeip that referenced this pull request Jul 10, 2024
…tests to use Metadata script as an intermediate argument holder (project-chip#34032)

* Adding first iteration of pyton tests to automated metadata argument holder process

* Adding modified tests.yaml

* Adding more tests

* Adding more tests

* Adding more tests

* Adding more tests

* Adding more tests

* Adding more tests

* Adding more tests

* Restyled by autopep8

---------

Co-authored-by: Restyled.io <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants