Syncd and orchagent crash when warm-reboot command is exected via ssh

[nazeerhussainf]

Description

When a warm-reboot command is issued via ssh, orchagent and syncd crash occurs and switch doesn't go for a warm-reboot.
This crash happens on Dell Z9100 platform.
Attached show-tech, config_db.json and core file in the attachment(warm-reboot_crash.zip)

johnar@83f6110999f3:~/sonic-mgmt/ansible$ ssh -o StrictHostKeyChecking=no [email protected] sudo warm-reboot
Warning: Permanently added '10.11.150.14' (RSA) to the list of known hosts.
[email protected]'s password:

johnar@83f6110999f3:~/sonic-mgmt/ansible$

root@sonic-z9100-02:/var/core# ls -al
total 10840
drwxr-xr-x 1 root root 4096 Jul 30 13:49 .
drwxr-xr-x 1 root root 4096 Jul 30 13:48 ..
-rw-r--r-- 1 root root 201814 Jul 30 13:50 9100-tech-support_30_Jul.txt
-rw-rw-rw- 1 root root 258930 Jul 30 13:47 orchagent.1564494434.77.core.gz
-rw-rw-rw- 1 root root 258544 Jul 30 13:49 orchagent.1564494555.79.core.gz
-rw-rw-rw- 1 root root 10360227 Jul 30 13:45 syncd.1564494331.41.core.gz
root@sonic-z9100-02:/var/core#

Steps to reproduce the issue:
Execute warm-reboot command via ssh.
johnar@83f6110999f3:~/sonic-mgmt/ansible$ ssh -o StrictHostKeyChecking=no [email protected] sudo warm-reboot
Warning: Permanently added '10.11.150.14' (RSA) to the list of known hosts.
[email protected]'s password:

johnar@83f6110999f3:~/sonic-mgmt/ansible$

Describe the results you received:
Orchagent and syncd crash occurred.

Describe the results you expected:

Additional information you deem important (e.g. issue happens only occasionally):
warm-reboot_crash.zip

**Output of `show version`:**

root@sonic-z9100-02:/var/core# show version

SONiC Software Version: SONiC.HEAD.48-7271fe59
Distribution: Debian 9.9
Kernel: 4.9.0-9-2-amd64
Build commit: 7271fe5
Build date: Tue Jul 30 08:08:32 UTC 2019
Built by: johnar@jenkins-worker-4

Platform: x86_64-dell_z9100_c2538-r0
HwSKU: Force10-Z9100-C8D48
ASIC: broadcom
Serial Number: CN0GTX3X7793151D0003
Uptime: 13:48:07 up 14 min, 1 user, load average: 3.04, 2.23, 1.25

Docker images:
REPOSITORY TAG IMAGE ID SIZE
docker-syncd-brcm HEAD.48-7271fe59 0c572a842328 391MB
docker-syncd-brcm latest 0c572a842328 391MB
docker-fpm-frr HEAD.48-7271fe59 241b6c171bd1 319MB
docker-fpm-frr latest 241b6c171bd1 319MB
docker-lldp-sv2 HEAD.48-7271fe59 cc364572e75f 298MB
docker-lldp-sv2 latest cc364572e75f 298MB
docker-dhcp-relay HEAD.48-7271fe59 8902f40c7d3c 289MB
docker-dhcp-relay latest 8902f40c7d3c 289MB
docker-database HEAD.48-7271fe59 39ac0d69edbd 281MB
docker-database latest 39ac0d69edbd 281MB
docker-snmp-sv2 HEAD.48-7271fe59 70c198b1b574 312MB
docker-snmp-sv2 latest 70c198b1b574 312MB
docker-orchagent HEAD.48-7271fe59 8d72459f0c6d 321MB
docker-orchagent latest 8d72459f0c6d 321MB
docker-teamd HEAD.48-7271fe59 27eb84cbe66e 302MB
docker-teamd latest 27eb84cbe66e 302MB
docker-sonic-telemetry HEAD.48-7271fe59 53e45bb45e96 304MB
docker-sonic-telemetry latest 53e45bb45e96 304MB
docker-router-advertiser HEAD.48-7271fe59 d8e09119e7ee 281MB
docker-router-advertiser latest d8e09119e7ee 281MB
docker-platform-monitor HEAD.48-7271fe59 eaba4fbb3cf3 325MB
docker-platform-monitor latest eaba4fbb3cf3 325MB

root@sonic-z9100-02:

**Attach debug file `sudo generate_dump`:**

```
(paste your output here)
```

[yxieca]

@nazeerhussainf SONiC image doesn't have root account login enabled by default. We use admin account for access and management. And we do ssh into the sonic and issue "sudo warm-reboot" regularly not having issue.

Can you try to run this test with admin account instead?

[yxieca]

@nazeerhussainf if you can still repeat the issue. can you attach syslog instead of core?

[rlhui]

potential duplicate of #3934