5.11.0 - RC1 breaks PDMC on some Nuvoton targets. #8927

ashok-rao · 2018-11-30T18:45:17Z

Description

The following targets are affected by this issue:

NUMAKER_PFM_M487
NUMAKER_IOT_M487

For NUMAKER_PFM_M487: The following tests are passing.
NUMAKER_PFM_M487_ARM_output.txt

For NUMAKER_IOT_M487: The following tests are passing.
NUMAKER_IOT_M487_ARM_output.txt

With 5.10.4 the PDMC tests on these exact boards are passing fine. Results below:

[2018-11-30 10:27:38] INFO: TEST RUNNER RESULTS:

+-------------------------+---------------------+-------------------------------------------------+--------+--------+
| target                  | platform_name       | test suite                                      | result |   time |
+-------------------------+---------------------+-------------------------------------------------+--------+--------+
| NUMAKER_PFM_M487-ARM    | NUMAKER_PFM_M487    | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK     |   69.3 |
| NUMAKER_PFM_M487-ARM    | NUMAKER_PFM_M487    | simple-mbed-cloud-client-tests-dev_mgmt-update  | OK     | 139.86 |
| K66F-ARM                | K66F                | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK     |  92.49 |
| K66F-ARM                | K66F                | simple-mbed-cloud-client-tests-dev_mgmt-update  | OK     | 176.27 |
| NUCLEO_F429ZI-ARM       | NUCLEO_F429ZI       | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK     |  83.55 |
| NUCLEO_F429ZI-ARM       | NUCLEO_F429ZI       | simple-mbed-cloud-client-tests-dev_mgmt-update  | OK     | 172.03 |
| DISCO_L475VG_IOT01A-ARM | DISCO_L475VG_IOT01A | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK     |  88.64 |
| DISCO_L475VG_IOT01A-ARM | DISCO_L475VG_IOT01A | simple-mbed-cloud-client-tests-dev_mgmt-update  | OK     | 196.17 |
| UBLOX_EVK_ODIN_W2-ARM   | UBLOX_EVK_ODIN_W2   | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK     | 175.92 |
| UBLOX_EVK_ODIN_W2-ARM   | UBLOX_EVK_ODIN_W2   | simple-mbed-cloud-client-tests-dev_mgmt-update  | OK     | 492.89 |
| DISCO_F413ZH-ARM        | DISCO_F413ZH        | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK     |  88.77 |
| DISCO_F413ZH-ARM        | DISCO_F413ZH        | simple-mbed-cloud-client-tests-dev_mgmt-update  | OK     | 176.32 |
| NUCLEO_F746ZG-ARM       | NUCLEO_F746ZG       | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK     |  74.32 |
| NUCLEO_F746ZG-ARM       | NUCLEO_F746ZG       | simple-mbed-cloud-client-tests-dev_mgmt-update  | OK     | 154.13 |
| NUMAKER_IOT_M487-ARM    | NUMAKER_IOT_M487    | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK     | 110.85 |
| NUMAKER_IOT_M487-ARM    | NUMAKER_IOT_M487    | simple-mbed-cloud-client-tests-dev_mgmt-update  | OK     | 204.66 |
| UBLOX_C030_U201-ARM     | UBLOX_C030_U201     | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK     | 161.46 |
| UBLOX_C030_U201-ARM     | UBLOX_C030_U201     | simple-mbed-cloud-client-tests-dev_mgmt-update  | OK     | 979.02 |
| K64F-ARM                | K64F                | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK     |  94.79 |
| K64F-ARM                | K64F                | simple-mbed-cloud-client-tests-dev_mgmt-update  | OK     |  181.9 |
| MTB_MXCHIP_EMW3166-ARM  | MTB_MXCHIP_EMW3166  | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK     |  99.82 |
| MTB_MXCHIP_EMW3166-ARM  | MTB_MXCHIP_EMW3166  | simple-mbed-cloud-client-tests-dev_mgmt-update  | OK     | 231.66 |
+-------------------------+---------------------+-------------------------------------------------+--------+--------+


[2018-11-30 10:27:38] INFO: TEST FINISHED

However, updating ONLY the Mbed OS to 5.11.0-RC1 is breaking the same tests on the same boards.
For NUMAKER_PFM_M487: The following tests are failing:
NUMAKER_PFM_M487_ARM_output.txt

For NUMAKER_IOT_M487: The followign tests are failing:
NUMAKER_IOT_M487_ARM_output.txt

With 5.11.0-RC1 the PDMC tests on these exact boards are failing. Results below:

[2018-11-30 13:16:25] INFO: TEST RUNNER RESULTS:

+-------------------------+---------------------+-------------------------------------------------+---------+---------+
| target                  | platform_name       | test suite                                      | result  |    time |
+-------------------------+---------------------+-------------------------------------------------+---------+---------+
| NUMAKER_PFM_M487-ARM    | NUMAKER_PFM_M487    | simple-mbed-cloud-client-tests-dev_mgmt-connect | TIMEOUT |  276.71 |
| NUMAKER_PFM_M487-ARM    | NUMAKER_PFM_M487    | simple-mbed-cloud-client-tests-dev_mgmt-update  | TIMEOUT |   828.2 |
| K66F-ARM                | K66F                | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK      |   92.66 |
| K66F-ARM                | K66F                | simple-mbed-cloud-client-tests-dev_mgmt-update  | OK      |   193.0 |
| NUCLEO_F429ZI-ARM       | NUCLEO_F429ZI       | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK      |   83.24 |
| NUCLEO_F429ZI-ARM       | NUCLEO_F429ZI       | simple-mbed-cloud-client-tests-dev_mgmt-update  | OK      |  174.48 |
| DISCO_L475VG_IOT01A-ARM | DISCO_L475VG_IOT01A | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK      |  103.72 |
| DISCO_L475VG_IOT01A-ARM | DISCO_L475VG_IOT01A | simple-mbed-cloud-client-tests-dev_mgmt-update  | OK      |   185.7 |
| UBLOX_EVK_ODIN_W2-ARM   | UBLOX_EVK_ODIN_W2   | simple-mbed-cloud-client-tests-dev_mgmt-connect | TIMEOUT |  278.22 |
| UBLOX_EVK_ODIN_W2-ARM   | UBLOX_EVK_ODIN_W2   | simple-mbed-cloud-client-tests-dev_mgmt-update  | TIMEOUT |    78.5 |
| DISCO_F413ZH-ARM        | DISCO_F413ZH        | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK      |   84.58 |
| DISCO_F413ZH-ARM        | DISCO_F413ZH        | simple-mbed-cloud-client-tests-dev_mgmt-update  | OK      |  180.72 |
| NUCLEO_F746ZG-ARM       | NUCLEO_F746ZG       | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK      |   74.27 |
| NUCLEO_F746ZG-ARM       | NUCLEO_F746ZG       | simple-mbed-cloud-client-tests-dev_mgmt-update  | OK      |  171.83 |
| NUMAKER_IOT_M487-ARM    | NUMAKER_IOT_M487    | simple-mbed-cloud-client-tests-dev_mgmt-connect | TIMEOUT |   97.06 |
| NUMAKER_IOT_M487-ARM    | NUMAKER_IOT_M487    | simple-mbed-cloud-client-tests-dev_mgmt-update  | FAIL    |   48.46 |
| UBLOX_C030_U201-ARM     | UBLOX_C030_U201     | simple-mbed-cloud-client-tests-dev_mgmt-connect | TIMEOUT |  267.24 |
| UBLOX_C030_U201-ARM     | UBLOX_C030_U201     | simple-mbed-cloud-client-tests-dev_mgmt-update  | TIMEOUT | 1109.38 |
| K64F-ARM                | K64F                | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK      |   95.54 |
| K64F-ARM                | K64F                | simple-mbed-cloud-client-tests-dev_mgmt-update  | OK      |  183.65 |
| MTB_MXCHIP_EMW3166-ARM  | MTB_MXCHIP_EMW3166  | simple-mbed-cloud-client-tests-dev_mgmt-connect | OK      |  189.74 |
| MTB_MXCHIP_EMW3166-ARM  | MTB_MXCHIP_EMW3166  | simple-mbed-cloud-client-tests-dev_mgmt-update  | OK      |  259.39 |
+-------------------------+---------------------+-------------------------------------------------+---------+---------+


[2018-11-30 13:16:25] INFO: TEST FINISHED

This indicates there is something breaking these targets between the 2 versions.

Steps to reproduce: (please note that this repo is private to Arm & partners only)

mbed import pelion-enablement
cd pelion-enablement
mbed test -t ARM -n simple-mbed-cloud-client-tests-dev_mgmt* -m <targets_mentioned_above>

Expected:
All tests for connect + update should pass.

Actual:
Connect + update tests fails with either TIMEOUT or ERROR for the targets mentioned above.

This also impacts OoB for 5.11.0.
cc: @MarceloSalazar @screamerbg @0xc0170 @cmonr .

Issue request type

[ ] Question
[ ] Enhancement
[x] Bug

The text was updated successfully, but these errors were encountered:

ciarmcom · 2018-11-30T21:09:15Z

Internal Jira reference: https://jira.arm.com/browse/MBOCUSTRIA-233

samchuarm · 2018-12-03T09:54:03Z

@ARMmbed/team-nuvoton

0xc0170 · 2018-12-03T13:04:13Z

I am reviewing the changes between the versions. First thing t hat came to my mind: MPU enablement.

@ashok-rao Can you quickly test one of the failing tests with 5.11rc1, remove MPU from device_has from MCU_M480 target and add MBED_MPU_CUSTOM to macros. If not mpu related, we shall investigate further what has changed between the two versions

0xc0170 · 2018-12-04T12:22:25Z

@c1728p9 Do you have a device to test this ? @ashok-rao is away for most of this week.

c1728p9 · 2018-12-05T00:12:17Z

Hi @0xc0170 I don't have either of the Nuvoton boards to test with.

0xc0170 · 2018-12-05T11:21:19Z

@ashok-rao @ARMmbed/team-nuvoton If anyone can help us narrow down the problem would be great

cyliangtw · 2018-12-05T13:03:37Z

@0xc0170 , I can't find any 5.11.x tag in mbed-os master branch, so just pull the last mbed-os. M487-iot log file shows network connect successfully but failed in "Initialize Simple PDMC", the root cause seems TLS init HW ECC twice and we are in modifying HW ECC init implementation to fulfill this use case.

m487-iot-ouput.txt

0xc0170 · 2018-12-05T13:11:13Z

Use https://github.com/ARMmbed/mbed-os/releases/tag/tools-release-5.11.0-rc1 tag, or can just fetch master as it should be also there (hasn't been yet addressed).

cmonr · 2018-12-05T15:12:39Z

@cyliangtw Since we're in the middle of a feature release, the tag won't be added until the release is published.

For now, you can use either the mbed-os-5.11 branch, or master. Once #8974 comes in, you should only use mbed-os-5.11 for testing.

c1728p9 · 2018-12-06T20:27:44Z

I created #8994 to turn off the MPU for the MCU_M480 family of devices. The root cause of this problem still needs to be determined.

Patater · 2018-12-07T14:00:25Z

We can probably turn the MPU back on on this target, if the ECC issue is the only issue.

We have root caused the ECC issue and have a fix available at #9005

adbridge · 2018-12-07T15:01:38Z

@c1728p9 See Jaeden's comment

cmonr · 2018-12-07T19:04:59Z

@adbridge @Patater It'll probably remain off for the rest of OOB since that can be brought in during a patch release.

@c1728p9 to confirm.

c1728p9 · 2018-12-11T02:14:42Z

Sounds good to me.

0xc0170 · 2018-12-11T14:13:40Z

@ashok-rao What is remaining here (for this issue to be closed) ?

ashok-rao · 2018-12-11T16:26:33Z

@0xc0170 .. This -> #9020

cmonr · 2018-12-11T19:08:14Z

Closing since #9020 is now merged.

ashok-rao changed the title ~~5.11.0 - RC1 breaks PDMC on some targets.~~ 5.11.0 - RC1 breaks PDMC on some Nuvoton targets. Nov 30, 2018

ciarmcom added type: bug Jira status: OPEN labels Nov 30, 2018

cmonr self-assigned this Nov 30, 2018

ccli8 mentioned this issue Dec 6, 2018

Nuvoton: Fix mbedtls crypto ECC AC management failed #8985

Closed

adbridge added the Found in OOB label Dec 7, 2018

Patater mentioned this issue Dec 7, 2018

Mbed TLS: Fix ECC hardware double initialization #9005

Merged

cmonr removed their assignment Dec 10, 2018

cmonr mentioned this issue Dec 11, 2018

Revert "Turn off MPU on targets failing OOB" #9020

Merged

0xc0170 closed this as completed Dec 12, 2018

ciarmcom added Jira status: CLOSED and removed Jira status: OPEN labels Dec 12, 2018

ccli8 mentioned this issue Dec 13, 2018

PDMC test failed with ESP8266 #9088

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

5.11.0 - RC1 breaks PDMC on some Nuvoton targets. #8927

5.11.0 - RC1 breaks PDMC on some Nuvoton targets. #8927

ashok-rao commented Nov 30, 2018 •

edited

Loading

ciarmcom commented Nov 30, 2018

samchuarm commented Dec 3, 2018

0xc0170 commented Dec 3, 2018 •

edited

Loading

0xc0170 commented Dec 4, 2018 •

edited

Loading

c1728p9 commented Dec 5, 2018

0xc0170 commented Dec 5, 2018

cyliangtw commented Dec 5, 2018

0xc0170 commented Dec 5, 2018

cmonr commented Dec 5, 2018

c1728p9 commented Dec 6, 2018

Patater commented Dec 7, 2018

adbridge commented Dec 7, 2018

cmonr commented Dec 7, 2018

c1728p9 commented Dec 11, 2018

0xc0170 commented Dec 11, 2018

ashok-rao commented Dec 11, 2018

cmonr commented Dec 11, 2018

5.11.0 - RC1 breaks PDMC on some Nuvoton targets. #8927

5.11.0 - RC1 breaks PDMC on some Nuvoton targets. #8927

Comments

ashok-rao commented Nov 30, 2018 • edited Loading

Description

Issue request type

ciarmcom commented Nov 30, 2018

samchuarm commented Dec 3, 2018

0xc0170 commented Dec 3, 2018 • edited Loading

0xc0170 commented Dec 4, 2018 • edited Loading

c1728p9 commented Dec 5, 2018

0xc0170 commented Dec 5, 2018

cyliangtw commented Dec 5, 2018

0xc0170 commented Dec 5, 2018

cmonr commented Dec 5, 2018

c1728p9 commented Dec 6, 2018

Patater commented Dec 7, 2018

adbridge commented Dec 7, 2018

cmonr commented Dec 7, 2018

c1728p9 commented Dec 11, 2018

0xc0170 commented Dec 11, 2018

ashok-rao commented Dec 11, 2018

cmonr commented Dec 11, 2018

ashok-rao commented Nov 30, 2018 •

edited

Loading

0xc0170 commented Dec 3, 2018 •

edited

Loading

0xc0170 commented Dec 4, 2018 •

edited

Loading