Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test Script Added Test_TC_BI_2_1, Test_TC_OCC_2_2, Test_TC_LVL_4_1, Test_TC_LVL_5_1 #11147

Closed

Conversation

kvikrambhat
Copy link
Contributor

Test Script Added

  • Adding YAML test scripts for Test_TC_BI_2_1, Test_TC_OCC_2_2, Test_TC_LVL_4_1, Test_TC_LVL_5_1
  • Generated script files

Testing
Executed all YAML test scripts, attached logs for reference
Complete_Test_Run.txt

Issues Related to PR

@andy31415
Copy link
Contributor

fast track: adding more tests

@github-actions
Copy link

github-actions bot commented Oct 28, 2021

PR #11147: Size comparison from 313cb4b to 538f2e2

Increases above 0.2%:

platform target config section 313cb4b 538f2e2 change % change
linux chip-tool debug (read only) 4264789 4285093 20304 0.5
(read/write) 122176 122464 288 0.2
.data.rel.ro 97504 97792 288 0.3
.rodata 214256 216432 2176 1.0
.text 3787733 3805189 17456 0.5
Increases (1 build for linux)
platform target config section 313cb4b 538f2e2 change % change
linux chip-tool debug (read only) 4264789 4285093 20304 0.5
(read/write) 122176 122464 288 0.2
.data.rel.ro 97504 97792 288 0.3
.rodata 214256 216432 2176 1.0
.text 3787733 3805189 17456 0.5
Decreases (1 build for esp32)
platform target config section 313cb4b 538f2e2 change % change
esp32 all-clusters-app m5stack (read only) 907407 907319 -88 -0.0
.flash.text 907407 907319 -88 -0.0
Full report (37 builds for efr32, esp32, k32w, linux, mbed, nrfconnect, p6, qpg, telink)
platform target config section 313cb4b 538f2e2 change % change
efr32 lighting-app BRD4161A (read only) 737460 737460 0 0.0
(read/write) 115428 115428 0 0.0
.bss 113676 113676 0 0.0
.data 1752 1752 0 0.0
.text 737452 737452 0 0.0
BRD4161A+rpc (read only) 724900 724900 0 0.0
(read/write) 132032 132032 0 0.0
.bss 130180 130180 0 0.0
.data 1852 1852 0 0.0
.text 724892 724892 0 0.0
lock-app BRD4161A (read only) 716756 716756 0 0.0
(read/write) 113244 113244 0 0.0
.bss 111532 111532 0 0.0
.data 1712 1712 0 0.0
.text 716748 716748 0 0.0
window-app BRD4161A (read only) 717660 717660 0 0.0
(read/write) 113568 113568 0 0.0
.bss 111852 111852 0 0.0
.data 1716 1716 0 0.0
.text 717652 717652 0 0.0
esp32 all-clusters-app c3devkit (read only) 876026 876026 0 0.0
(read/write) 1308672 1308672 0 0.0
.dram0.bss 59248 59248 0 0.0
.dram0.data 16448 16448 0 0.0
.flash.rodata 199744 199744 0 0.0
.flash.text 876026 876026 0 0.0
.iram0.text 57554 57554 0 0.0
m5stack (read only) 907407 907319 -88 -0.0
(read/write) 428460 428460 0 0.0
.dram0.bss 61744 61744 0 0.0
.dram0.data 32084 32084 0 0.0
.flash.rodata 208468 208468 0 0.0
.flash.text 907407 907319 -88 -0.0
.iram0.text 125115 125115 0 0.0
k32w lighting-app k32w061+se05x+release (read/write) 701024 701024 0 0.0
.bss 78688 78688 0 0.0
.data 1900 1900 0 0.0
.text 614636 614636 0 0.0
lock-app k32w061+debug (read/write) 592980 592980 0 0.0
.bss 69172 69172 0 0.0
.data 1864 1864 0 0.0
.text 516144 516144 0 0.0
shell k32w061+debug (read/write) 425252 425252 0 0.0
.bss 63256 63256 0 0.0
.data 672 672 0 0.0
.text 359620 359620 0 0.0
linux all-clusters-app debug (read only) 1653841 1653841 0 0.0
(read/write) 119104 119104 0 0.0
.bss 51376 51376 0 0.0
.data 978 978 0 0.0
.data.rel.ro 61504 61504 0 0.0
.dynamic 592 592 0 0.0
.got 4088 4088 0 0.0
.init 27 27 0 0.0
.init_array 520 520 0 0.0
.rodata 137749 137749 0 0.0
.text 1383826 1383826 0 0.0
bridge-app debug+rpc (read only) 1282125 1282125 0 0.0
(read/write) 85160 85160 0 0.0
.bss 51856 51856 0 0.0
.data 976 976 0 0.0
.data.rel.ro 27336 27336 0 0.0
.dynamic 592 592 0 0.0
.got 3952 3952 0 0.0
.init 27 27 0 0.0
.init_array 400 400 0 0.0
.rodata 110724 110724 0 0.0
.text 1076085 1076085 0 0.0
chip-tool debug (read only) 4264789 4285093 20304 0.5
(read/write) 122176 122464 288 0.2
.bss 17680 17680 0 0.0
.data 1584 1584 0 0.0
.data.rel.ro 97504 97792 288 0.3
.dynamic 592 592 0 0.0
.got 4368 4368 0 0.0
.init 27 27 0 0.0
.init_array 424 424 0 0.0
.rodata 214256 216432 2176 1.0
.text 3787733 3805189 17456 0.5
lighting-app debug+rpc (read only) 1541097 1541097 0 0.0
(read/write) 102000 102000 0 0.0
.bss 41208 41208 0 0.0
.data 1106 1106 0 0.0
.data.rel.ro 54416 54416 0 0.0
.dynamic 608 608 0 0.0
.got 4112 4112 0 0.0
.init 27 27 0 0.0
.init_array 528 528 0 0.0
.rodata 128881 128881 0 0.0
.text 1279762 1279762 0 0.0
ota-provider-app debug (read only) 1238617 1238617 0 0.0
(read/write) 67872 67872 0 0.0
.bss 37440 37440 0 0.0
.data 752 752 0 0.0
.data.rel.ro 24584 24584 0 0.0
.dynamic 592 592 0 0.0
.got 4016 4016 0 0.0
.init 27 27 0 0.0
.init_array 440 440 0 0.0
.rodata 110888 110888 0 0.0
.text 1031554 1031554 0 0.0
ota-requestor-app debug (read only) 1300713 1300713 0 0.0
(read/write) 76616 76616 0 0.0
.bss 45216 45216 0 0.0
.data 816 816 0 0.0
.data.rel.ro 25464 25464 0 0.0
.dynamic 592 592 0 0.0
.got 3984 3984 0 0.0
.init 27 27 0 0.0
.init_array 512 512 0 0.0
.rodata 127584 127584 0 0.0
.text 1075314 1075314 0 0.0
shell debug (read only) 787089 787089 0 0.0
(read/write) 57760 57760 0 0.0
.bss 16168 16168 0 0.0
.data 242 242 0 0.0
.data.rel.ro 36848 36848 0 0.0
.dynamic 592 592 0 0.0
.got 3528 3528 0 0.0
.init 27 27 0 0.0
.init_array 336 336 0 0.0
.rodata 77455 77455 0 0.0
.text 608098 608098 0 0.0
tv-app debug (read only) 1774209 1774209 0 0.0
(read/write) 289624 289624 0 0.0
.bss 223280 223280 0 0.0
.data 2032 2032 0 0.0
.data.rel.ro 58672 58672 0 0.0
.dynamic 592 592 0 0.0
.got 4408 4408 0 0.0
.init 27 27 0 0.0
.init_array 608 608 0 0.0
.rodata 154680 154680 0 0.0
.text 1477266 1477266 0 0.0
mbed all-clusters-app CY8CPROTO_062_4343W+release (read only) 6224 6224 0 0.0
(read/write) 2290720 2290720 0 0.0
.bss 180620 180620 0 0.0
.data 5192 5192 0 0.0
.heap 850632 850632 0 0.0
.text 1253320 1253320 0 0.0
lighting-app CY8CPROTO_062_4343W+release (read only) 6224 6224 0 0.0
(read/write) 2274992 2274992 0 0.0
.bss 172820 172820 0 0.0
.data 5568 5568 0 0.0
.heap 858056 858056 0 0.0
.text 1237592 1237592 0 0.0
lock-app CY8CPROTO_062_4343W+release (read only) 6224 6224 0 0.0
(read/write) 2252712 2252712 0 0.0
.bss 171724 171724 0 0.0
.data 5552 5552 0 0.0
.heap 859168 859168 0 0.0
.text 1215312 1215312 0 0.0
pigweed-app CY8CPROTO_062_4343W+release (read only) 6224 6224 0 0.0
(read/write) 1139744 1139744 0 0.0
.bss 11752 11752 0 0.0
.data 4368 4368 0 0.0
.heap 1020328 1020328 0 0.0
.text 103128 103128 0 0.0
shell CY8CPROTO_062_4343W+release (read only) 6224 6224 0 0.0
(read/write) 2048976 2048976 0 0.0
.bss 156208 156208 0 0.0
.data 4968 4968 0 0.0
.heap 875272 875272 0 0.0
.text 1011576 1011576 0 0.0
nrfconnect lighting-app nrf52840dk_nrf52840 (read/write) 862911 862911 0 0.0
bss 112132 112132 0 0.0
rodata 97528 97528 0 0.0
text 577624 577624 0 0.0
nrf52840dk_nrf52840+rpc (read/write) 823735 823735 0 0.0
bss 108372 108372 0 0.0
rodata 88304 88304 0 0.0
text 550800 550800 0 0.0
nrf5340dk_nrf5340_cpuapp (read/write) 787902 787902 0 0.0
bss 113504 113504 0 0.0
rodata 92768 92768 0 0.0
text 507092 507092 0 0.0
lock-app nrf52840dk_nrf52840 (read/write) 839583 839583 0 0.0
bss 111168 111168 0 0.0
rodata 93880 93880 0 0.0
text 559108 559108 0 0.0
nrf5340dk_nrf5340_cpuapp (read/write) 764882 764882 0 0.0
bss 112576 112576 0 0.0
rodata 89188 89188 0 0.0
text 488668 488668 0 0.0
pigweed-app nrf52840dk_nrf52840 (read/write) 497323 497323 0 0.0
bss 51824 51824 0 0.0
rodata 45776 45776 0 0.0
text 339436 339436 0 0.0
pump-app nrf52840dk_nrf52840 (read/write) 844287 844287 0 0.0
bss 111304 111304 0 0.0
rodata 95128 95128 0 0.0
text 562320 562320 0 0.0
pump-controller-app nrf52840dk_nrf52840 (read/write) 839575 839575 0 0.0
bss 111200 111200 0 0.0
rodata 93904 93904 0 0.0
text 558952 558952 0 0.0
shell nrf52840dk_nrf52840 (read/write) 776435 776435 0 0.0
bss 109072 109072 0 0.0
rodata 72536 72536 0 0.0
text 520236 520236 0 0.0
nrf5340dk_nrf5340_cpuapp (read/write) 691490 691490 0 0.0
bss 110056 110056 0 0.0
rodata 67180 67180 0 0.0
text 440848 440848 0 0.0
p6 lock-app default (read/write) 2169096 2169096 0 0.0
.bss 67168 67168 0 0.0
.data 2416 2416 0 0.0
.heap 963760 963760 0 0.0
.text 1127360 1127360 0 0.0
qpg lighting-app qpg6100+debug (read only) 491224 491224 0 0.0
(read/write) 114144 114144 0 0.0
.bss 51288 51288 0 0.0
.data 1000 1000 0 0.0
.text 485904 485904 0 0.0
lock-app qpg6100+debug (read only) 467556 467556 0 0.0
(read/write) 114140 114140 0 0.0
.bss 50240 50240 0 0.0
.data 956 956 0 0.0
.text 462236 462236 0 0.0
persistent-storage-app qpg6100+debug (read only) 155236 155236 0 0.0
(read/write) 114140 114140 0 0.0
.bss 27752 27752 0 0.0
.data 372 372 0 0.0
.text 149916 149916 0 0.0
telink lighting-app tlsr9518adk80d (read/write) 664518 664518 0 0.0
bss 69944 69944 0 0.0
noinit 33216 33216 0 0.0
text 458070 458070 0 0.0

@woody-apple
Copy link
Contributor

/rebase

kvikrambhat and others added 3 commits October 30, 2021 12:58
1.Test_TC_BI_2_1
2.Test_TC_OCC_2_2
3.Test_TC_LVL_4_1
4.Test_TC_LVL_5_1
@kvikrambhat
Copy link
Contributor Author

Rebased.

@github-actions
Copy link

github-actions bot commented Oct 30, 2021

PR #11147: Size comparison from bf585f8 to 8ed80cb

Increases above 0.2%:

platform target config section bf585f8 8ed80cb change % change
linux chip-tool debug (read only) 4314925 4335229 20304 0.5
.data.rel.ro 98928 99216 288 0.3
.rodata 217360 219536 2176 1.0
.text 3831621 3849077 17456 0.5
Increases (1 build for linux)
platform target config section bf585f8 8ed80cb change % change
linux chip-tool debug (read only) 4314925 4335229 20304 0.5
(read/write) 123648 123936 288 0.2
.data.rel.ro 98928 99216 288 0.3
.rodata 217360 219536 2176 1.0
.text 3831621 3849077 17456 0.5
Decreases (1 build for esp32)
platform target config section bf585f8 8ed80cb change % change
esp32 all-clusters-app m5stack (read only) 911451 911375 -76 -0.0
.flash.text 911451 911375 -76 -0.0
Full report (37 builds for efr32, esp32, k32w, linux, mbed, nrfconnect, p6, qpg, telink)
platform target config section bf585f8 8ed80cb change % change
efr32 lighting-app BRD4161A (read only) 736636 736636 0 0.0
(read/write) 114476 114476 0 0.0
.bss 112724 112724 0 0.0
.data 1752 1752 0 0.0
.text 736628 736628 0 0.0
BRD4161A+rpc (read only) 724076 724076 0 0.0
(read/write) 131080 131080 0 0.0
.bss 129228 129228 0 0.0
.data 1852 1852 0 0.0
.text 724068 724068 0 0.0
lock-app BRD4161A (read only) 715932 715932 0 0.0
(read/write) 112292 112292 0 0.0
.bss 110580 110580 0 0.0
.data 1712 1712 0 0.0
.text 715924 715924 0 0.0
window-app BRD4161A (read only) 716836 716836 0 0.0
(read/write) 112616 112616 0 0.0
.bss 110900 110900 0 0.0
.data 1716 1716 0 0.0
.text 716828 716828 0 0.0
esp32 all-clusters-app c3devkit (read only) 880562 880562 0 0.0
(read/write) 1307800 1307800 0 0.0
.dram0.bss 58456 58456 0 0.0
.dram0.data 16464 16464 0 0.0
.flash.rodata 199640 199640 0 0.0
.flash.text 880562 880562 0 0.0
.iram0.text 57554 57554 0 0.0
m5stack (read only) 911451 911375 -76 -0.0
(read/write) 427560 427560 0 0.0
.dram0.bss 60952 60952 0 0.0
.dram0.data 32100 32100 0 0.0
.flash.rodata 208344 208344 0 0.0
.flash.text 911451 911375 -76 -0.0
.iram0.text 125115 125115 0 0.0
k32w lighting-app k32w061+se05x+release (read/write) 699128 699128 0 0.0
.bss 77720 77720 0 0.0
.data 1900 1900 0 0.0
.text 613708 613708 0 0.0
lock-app k32w061+debug (read/write) 591432 591432 0 0.0
.bss 68220 68220 0 0.0
.data 1864 1864 0 0.0
.text 515548 515548 0 0.0
shell k32w061+debug (read/write) 424988 424988 0 0.0
.bss 63280 63280 0 0.0
.data 672 672 0 0.0
.text 359332 359332 0 0.0
linux all-clusters-app debug (read only) 1687001 1687001 0 0.0
(read/write) 119024 119024 0 0.0
.bss 50640 50640 0 0.0
.data 1010 1010 0 0.0
.data.rel.ro 62112 62112 0 0.0
.dynamic 592 592 0 0.0
.got 4088 4088 0 0.0
.init 27 27 0 0.0
.init_array 536 536 0 0.0
.rodata 138069 138069 0 0.0
.text 1415874 1415874 0 0.0
bridge-app debug+rpc (read only) 1281957 1281957 0 0.0
(read/write) 84136 84136 0 0.0
.bss 50800 50800 0 0.0
.data 976 976 0 0.0
.data.rel.ro 27368 27368 0 0.0
.dynamic 592 592 0 0.0
.got 3952 3952 0 0.0
.init 27 27 0 0.0
.init_array 400 400 0 0.0
.rodata 110020 110020 0 0.0
.text 1076693 1076693 0 0.0
chip-tool debug (read only) 4314925 4335229 20304 0.5
(read/write) 123648 123936 288 0.2
.bss 17712 17712 0 0.0
.data 1584 1584 0 0.0
.data.rel.ro 98928 99216 288 0.3
.dynamic 592 592 0 0.0
.got 4368 4368 0 0.0
.init 27 27 0 0.0
.init_array 424 424 0 0.0
.rodata 217360 219536 2176 1.0
.text 3831621 3849077 17456 0.5
lighting-app debug+rpc (read only) 1540865 1540865 0 0.0
(read/write) 101008 101008 0 0.0
.bss 40184 40184 0 0.0
.data 1106 1106 0 0.0
.data.rel.ro 54448 54448 0 0.0
.dynamic 608 608 0 0.0
.got 4112 4112 0 0.0
.init 27 27 0 0.0
.init_array 528 528 0 0.0
.rodata 128113 128113 0 0.0
.text 1280370 1280370 0 0.0
ota-provider-app debug (read only) 1239033 1239033 0 0.0
(read/write) 67104 67104 0 0.0
.bss 36640 36640 0 0.0
.data 752 752 0 0.0
.data.rel.ro 24616 24616 0 0.0
.dynamic 592 592 0 0.0
.got 4016 4016 0 0.0
.init 27 27 0 0.0
.init_array 440 440 0 0.0
.rodata 110408 110408 0 0.0
.text 1032498 1032498 0 0.0
ota-requestor-app debug (read only) 1302033 1302033 0 0.0
(read/write) 76360 76360 0 0.0
.bss 44896 44896 0 0.0
.data 816 816 0 0.0
.data.rel.ro 25528 25528 0 0.0
.dynamic 592 592 0 0.0
.got 3984 3984 0 0.0
.init 27 27 0 0.0
.init_array 512 512 0 0.0
.rodata 127072 127072 0 0.0
.text 1077170 1077170 0 0.0
shell debug (read only) 786145 786145 0 0.0
(read/write) 57664 57664 0 0.0
.bss 16072 16072 0 0.0
.data 242 242 0 0.0
.data.rel.ro 36848 36848 0 0.0
.dynamic 592 592 0 0.0
.got 3528 3528 0 0.0
.init 27 27 0 0.0
.init_array 336 336 0 0.0
.rodata 77423 77423 0 0.0
.text 607186 607186 0 0.0
tv-app debug (read only) 1773337 1773337 0 0.0
(read/write) 288600 288600 0 0.0
.bss 222224 222224 0 0.0
.data 2032 2032 0 0.0
.data.rel.ro 58704 58704 0 0.0
.dynamic 592 592 0 0.0
.got 4408 4408 0 0.0
.init 27 27 0 0.0
.init_array 608 608 0 0.0
.rodata 153464 153464 0 0.0
.text 1477682 1477682 0 0.0
mbed all-clusters-app CY8CPROTO_062_4343W+release (read only) 6224 6224 0 0.0
(read/write) 2294952 2294952 0 0.0
.bss 179828 179828 0 0.0
.data 5216 5216 0 0.0
.heap 851400 851400 0 0.0
.text 1257552 1257552 0 0.0
lighting-app CY8CPROTO_062_4343W+release (read only) 6224 6224 0 0.0
(read/write) 2274336 2274336 0 0.0
.bss 171868 171868 0 0.0
.data 5568 5568 0 0.0
.heap 859008 859008 0 0.0
.text 1236936 1236936 0 0.0
lock-app CY8CPROTO_062_4343W+release (read only) 6224 6224 0 0.0
(read/write) 2252056 2252056 0 0.0
.bss 170772 170772 0 0.0
.data 5552 5552 0 0.0
.heap 860120 860120 0 0.0
.text 1214656 1214656 0 0.0
pigweed-app CY8CPROTO_062_4343W+release (read only) 6224 6224 0 0.0
(read/write) 1139744 1139744 0 0.0
.bss 11752 11752 0 0.0
.data 4368 4368 0 0.0
.heap 1020328 1020328 0 0.0
.text 103128 103128 0 0.0
shell CY8CPROTO_062_4343W+release (read only) 6224 6224 0 0.0
(read/write) 2048656 2048656 0 0.0
.bss 156232 156232 0 0.0
.data 4968 4968 0 0.0
.heap 875248 875248 0 0.0
.text 1011256 1011256 0 0.0
nrfconnect lighting-app nrf52840dk_nrf52840 (read/write) 861267 861267 0 0.0
bss 111180 111180 0 0.0
rodata 96860 96860 0 0.0
text 577612 577612 0 0.0
nrf52840dk_nrf52840+rpc (read/write) 822095 822095 0 0.0
bss 107424 107424 0 0.0
rodata 87640 87640 0 0.0
text 550784 550784 0 0.0
nrf5340dk_nrf5340_cpuapp (read/write) 786306 786306 0 0.0
bss 112556 112556 0 0.0
rodata 92100 92100 0 0.0
text 507080 507080 0 0.0
lock-app nrf52840dk_nrf52840 (read/write) 837975 837975 0 0.0
bss 110216 110216 0 0.0
rodata 93216 93216 0 0.0
text 559092 559092 0 0.0
nrf5340dk_nrf5340_cpuapp (read/write) 763270 763270 0 0.0
bss 111628 111628 0 0.0
rodata 88520 88520 0 0.0
text 488652 488652 0 0.0
pigweed-app nrf52840dk_nrf52840 (read/write) 497323 497323 0 0.0
bss 51824 51824 0 0.0
rodata 45776 45776 0 0.0
text 339436 339436 0 0.0
pump-app nrf52840dk_nrf52840 (read/write) 842643 842643 0 0.0
bss 110352 110352 0 0.0
rodata 94460 94460 0 0.0
text 562300 562300 0 0.0
pump-controller-app nrf52840dk_nrf52840 (read/write) 837947 837947 0 0.0
bss 110252 110252 0 0.0
rodata 93236 93236 0 0.0
text 558932 558932 0 0.0
shell nrf52840dk_nrf52840 (read/write) 776179 776179 0 0.0
bss 109096 109096 0 0.0
rodata 72536 72536 0 0.0
text 519936 519936 0 0.0
nrf5340dk_nrf5340_cpuapp (read/write) 691202 691202 0 0.0
bss 110080 110080 0 0.0
rodata 67180 67180 0 0.0
text 440548 440548 0 0.0
p6 lock-app default (read/write) 2167872 2167872 0 0.0
.bss 66216 66216 0 0.0
.data 2416 2416 0 0.0
.heap 964712 964712 0 0.0
.text 1126136 1126136 0 0.0
qpg lighting-app qpg6100+debug (read only) 490500 490500 0 0.0
(read/write) 114144 114144 0 0.0
.bss 50336 50336 0 0.0
.data 1000 1000 0 0.0
.text 485180 485180 0 0.0
lock-app qpg6100+debug (read only) 466844 466844 0 0.0
(read/write) 114140 114140 0 0.0
.bss 49288 49288 0 0.0
.data 956 956 0 0.0
.text 461524 461524 0 0.0
persistent-storage-app qpg6100+debug (read only) 155820 155820 0 0.0
(read/write) 114140 114140 0 0.0
.bss 27752 27752 0 0.0
.data 372 372 0 0.0
.text 150500 150500 0 0.0
telink lighting-app tlsr9518adk80d (read/write) 662890 662890 0 0.0
bss 68992 68992 0 0.0
noinit 33216 33216 0 0.0
text 458036 458036 0 0.0

@kvikrambhat
Copy link
Contributor Author

Closing, opened a new PR(##11305) with all the test scripts.

@kvikrambhat kvikrambhat closed this Nov 2, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants