Rpi4 crash when using more than 34 USB serial ports #4008
Comments
|
Please post a full dmesg since boot (with the devices connected). Also post the output of lsusb -t. I would expect the controller to reject more than 31 devices, because it has 32 device slots (minus 1 for the onboard hub). |
|
|
The first device in this huge chain is a TUSB2046 hub - which is running at full speed. All downstream devices have messages similar to |
|
The TUSB2046B only supports full speed. So it is to be expected that it only runs at 12 MBit/s. Also as I wrote in the bug report, the crash doesn't happen when the serial port chain is connected to my notebook. |
|
Weird hardware design decisions aside, the controller is crashing - not the kernel. The clue is Which is the root complex timing out on a read transaction. It'll probably be easier/cheaper to buy a boatload of FT4232H adapters to replicate the issue rather than try and source this specialist hardware. |
|
So the VL805 connected to the PCIe bridge crashes or enters a state that isn't handled? You can't simply buy this HW, you would have to build it yourself, it is open hardware. So yes, buying 9 FT4232H adapters (e.g. Digitus DA-70159) and a few switches is the only other way to replicate it. |
|
The fact that a read returned a completion timeout indicates an access to one of the xhci controller registers (nominally hardware) failed. It's not clear what the interaction is between the firmware and controller hardware in this case. We know it has supervisory functions and can e.g. write to power state control registers inside the PCIe endpoint based on controller activity, but any clarification would have to come from VIA. |
r-schmidt
changed the title
|
To eliminate the HUB daisy chain as the cause for the issue I split the 48 ports into 4x12 ports and connected 3 of those so the USB tree looked like this: The result was the same, with the 35th serial connection opened, the kernel driver prints errors and the system is unresponsive. I then tested with a Rpi 1 (with some rather old Linux on it) and there it was working with the full 48 port chain, pretty slow but at least no hangs or crash. Thinking that the Rpi 3B+ had a similar USB layout to the Rpi 1 (i.e. no PCIe device) I tried that one and the result was even worse than with the Rpi 4. The Rpi 3B+ silently hangs after about 10-20 seconds after connecting the chain. Reducing the chain to 36 ports everything was fine on the Rpi3B+. Trying to attach the last 12 ports separately again triggered the memory allocation error. After some searching the solution was simple: Adding coherent_pool=2M to cmdline.txt allows the use of all 48 ports on the Rpi3B+. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the bug
The system prints kernel messages about an unhandled fault when accessing more than 34 serial ports (ttyUSB).
To reproduce
seq 0 35; do screen -d -m -S port${i} /dev/ttyUSB${i} 115200; done')Expected behaviour
Actual behaviour
System
Raspberry Pi 4B
$ cat /etc/rpi-issue
Raspberry Pi reference 2020-05-27
Generated using pi-gen, https://github.com/RPi-Distro/pi-gen, 825107f04027269db77426046f5085475b1ea22f, stage2
$ vcgencmd version
Nov 30 2020 22:12:08
Copyright (c) 2012 Broadcom
version ab1181cc0cb6df52bfae3b1d3fef0ce7c325166c (clean) (release) (start)
$ uname -a
Linux raspberrypi 5.4.79-v7l+ #1373 SMP Mon Nov 23 13:27:40 GMT 2020 armv7l GNU/Linux
Logs
On the console is printed the following output:
[ 103.715803] 8<--- cut here ---
[ 103.720089] Unhandled fault: asynchronous external abort (0x1211) at 0x00000000
[ 103.728619] pgd = d30b99fe
[ 103.732532] [00000000] *pgd=17787003, *pmd=00000000
[ 103.738634] Internal error: : 1211 [#1] SMP ARM
[ 103.744388] Modules linked in: sha256_generic libsha256 cfg80211 rfkill 8021q garp stp llc ftdi_sio usbserial vc4 cec rpivid_mem v3d drm_kms_helper gpu_sched drm bcm2835_codec(C) bcm2835_v4l2(C) bcm2835_isp(C) v4l2_mem2mem bcm2835_mmal_vchiq(C) videobuf2_dma_contig videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 videobuf2_common drm_panel_orientation_quirks raspberrypi_hwmon snd_soc_core videodev mc vc_sm_cma(C) snd_compress snd_pcm_dmaengine snd_pcm snd_timer snd syscopyarea sysfillrect sysimgblt fb_sys_fops uio_pdrv_genirq uio ip_tables x_tables ipv6
[ 103.797884] CPU: 0 PID: 2336 Comm: sudo Tainted: G C 5.4.79-v7l+ #1373
[ 103.807232] Hardware name: BCM2711
[ 103.812161] PC is at lockref_put_return+0x50/0x9c
[ 103.818379] LR is at dput.part.8+0x58/0x3b8
[ 103.824052] pc : [] lr : [] psr: 60000013
[ 103.831839] sp : d6dbbe50 ip : 00000000 fp : d6dbbe6c
[ 103.838602] r10: d71f8c70 r9 : 00000001 r8 : 00080060
[ 103.845375] r7 : 00000001 r6 : 00030003 r5 : 00000000 r4 : 00030003
[ 103.853475] r3 : 00000001 r2 : 00030003 r1 : 00000064 r0 : d91b1fb8
[ 103.861570] Flags: nZCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user
[ 103.870286] Control: 30c5383d Table: 177ea000 DAC: fffffffd
[ 103.877630] Process sudo (pid: 2336, stack limit = 0xb7a13c6b)
[ 103.885085] Stack: (0xd6dbbe50 to 0xd6dbc000)
[ 103.891075] be40: d91b1f68 d91b1fb8 c0de3628 00080040
[ 103.900914] be60: d6dbbea4 d6dbbe70 c04287c0 c06a2f54 00000000 c040e3bc 00000000 d6c58180
[ 103.910762] be80: d71f8c70 080a801d ef32e850 d91b1f68 00000010 d71f8c70 d6dbbeb4 d6dbbea8
[ 103.920635] bea0: c0428b38 c0428774 d6dbbef4 d6dbbeb8 c040e42c c0428b2c 00000000 00000000
[ 103.930523] bec0: c020ce54 d6c58188 d6d0eff0 d6c58180 00000000 d6d0eac0 d6d0f01c c12b9d54
[ 103.940423] bee0: d6d0eff0 c1204fc8 d6dbbf04 d6dbbef8 c040e59c c040e34c d6dbbf2c d6dbbf08
[ 103.950351] bf00: c02433f8 c040e590 ffffe000 d6dbbfb0 c02011c4 00000004 fffffe30 5ac3c35a
[ 103.960296] bf20: d6dbbfac d6dbbf30 c020ce54 c0243350 d6dbbf4c d6dbbf40 5ac3c35a c1204fcc
[ 103.970269] bf40: d6dbbf6c d6dbbf50 c0407de8 c040eb18 00000004 d6d60600 d7a73c00 00000000
[ 103.980258] bf60: d6dbbf94 d6dbbf70 c042fcc0 c0407d84 02008150 b6e63b1c 00000000 8dd7b910
[ 103.990263] bf80: c02011c4 02008150 b6e63b1c 00000000 00000006 c02011c4 d6dba000 00000006
[ 104.000294] bfa0: 00000000 d6dbbfb0 c0201034 c020c8cc 00000000 00000444 b6e636d8 b6d83864
[ 104.010348] bfc0: 02008150 b6e63b1c 00000000 00000006 b66ff29c b66ff298 020082b8 00000000
[ 104.020416] bfe0: 00000000 bef0ef68 b6d85088 b6de8f74 20000010 00000004 00000000 00000000
[ 104.030494] Backtrace:
[ 104.034839] [] (lockref_put_return) from [] (dput.part.8+0x58/0x3b8)
[ 104.044880] r7:00080040 r6:c0de3628 r5:d91b1fb8 r4:d91b1f68
[ 104.052509] [] (dput.part.8) from [] (dput+0x18/0x1c)
[ 104.061293] r10:d71f8c70 r9:00000010 r8:d91b1f68 r7:ef32e850 r6:080a801d r5:d71f8c70
[ 104.071136] r4:d6c58180
[ 104.075682] [] (dput) from [] (__fput+0xec/0x244)
[ 104.084163] [] (__fput) from [] (____fput+0x18/0x1c)
[ 104.092917] r10:c1204fc8 r9:d6d0eff0 r8:c12b9d54 r7:d6d0f01c r6:d6d0eac0 r5:00000000
[ 104.102826] r4:d6c58180
[ 104.107432] [] (____fput) from [] (task_work_run+0xb4/0xd4)
[ 104.116843] [] (task_work_run) from [] (do_work_pending+0x594/0x59c)
[ 104.127050] r9:5ac3c35a r8:fffffe30 r7:00000004 r6:c02011c4 r5:d6dbbfb0 r4:ffffe000
[ 104.136925] [] (do_work_pending) from [] (slow_work_pending+0xc/0x20)
[ 104.147255] Exception stack(0xd6dbbfb0 to 0xd6dbbff8)
[ 104.154468] bfa0: 00000000 00000444 b6e636d8 b6d83864
[ 104.164831] bfc0: 02008150 b6e63b1c 00000000 00000006 b66ff29c b66ff298 020082b8 00000000
[ 104.175197] bfe0: 00000000 bef0ef68 b6d85088 b6de8f74 20000010 00000004
[ 104.184017] r10:00000006 r9:d6dba000 r8:c02011c4 r7:00000006 r6:00000000 r5:b6e63b1c
[ 104.194070] r4:02008150
[ 104.198818] Code: 1a000002 e1a0cf94 e33c0000 1afffff8 (e1570003)
[ 104.207145] ---[ end trace e5ed96736c0aa23a ]---
[ 104.214070] pcieport 0000:00:00.0: AER: Multiple Uncorrected (Non-Fatal) error received: 0000:00:00.0
[ 105.586945] ------------[ cut here ]------------
[ 105.593927] WARNING: CPU: 2 PID: 131 at drivers/firmware/raspberrypi.c:63 rpi_firmware_transaction+0xec/0x128
[ 105.606193] Firmware transaction timeout
[ 105.606196] Modules linked in: sha256_generic libsha256 cfg80211 rfkill 8021q garp stp llc ftdi_sio usbserial vc4 cec rpivid_mem v3d drm_kms_helper gpu_sched drm bcm2835_codec(C) bcm2835_v4l2(C) bcm2835_isp(C) v4l2_mem2mem bcm2835_mmal_vchiq(C) videobuf2_dma_contig videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 videobuf2_common drm_panel_orientation_quirks raspberrypi_hwmon snd_soc_core videodev mc vc_sm_cma(C) snd_compress snd_pcm_dmaengine snd_pcm snd_timer snd syscopyarea sysfillrect sysimgblt fb_sys_fops uio_pdrv_genirq uio ip_tables x_tables ipv6
[ 105.669241] CPU: 2 PID: 131 Comm: kworker/2:3 Tainted: G D C 5.4.79-v7l+ #1373
[ 105.680175] Hardware name: BCM2711
[ 105.686158] Workqueue: events get_values_poll [raspberrypi_hwmon]
[ 105.694845] Backtrace:
[ 105.699878] [] (dump_backtrace) from [] (show_stack+0x20/0x24)
[ 105.710075] r7:ffffffff r6:00000000 r5:60000013 r4:c129fab0
[ 105.718362] [] (show_stack) from [] (dump_stack+0xd8/0x11c)
[ 105.728314] [] (dump_stack) from [] (__warn+0xe0/0x108)
[ 105.737905] r10:dec12008 r9:00000009 r8:c08dd810 r7:0000003f r6:00000009 r5:c08dd810
[ 105.748380] r4:c0e3a554 r3:00000000
[ 105.754599] [] (__warn) from [] (warn_slowpath_fmt+0xa4/0xc0)
[ 105.764755] r7:0000003f r6:c0e3a554 r5:c1204fc8 r4:c0e3a574
[ 105.773087] [] (warn_slowpath_fmt) from [] (rpi_firmware_transaction+0xec/0x128)
[ 105.784913] r9:efa10440 r8:00000010 r7:00000000 r6:ffffff92 r5:efa10440 r4:c1204fc8
[ 105.795361] [] (rpi_firmware_transaction) from [] (rpi_firmware_property_list+0xbc/0x170)
[ 105.808010] r7:c1204fc8 r6:dec12000 r5:00001000 r4:dec1201c
[ 105.816340] [] (rpi_firmware_property_list) from [] (rpi_firmware_property+0x70/0x118)
[ 105.828626] r10:d6da2bcc r9:00030046 r8:00000010 r7:efa10440 r6:d8b8bee0 r5:00000004
[ 105.839032] r4:d6da2bc0
[ 105.844114] [] (rpi_firmware_property) from [] (get_values_poll+0x4c/0x150 [raspberrypi_hwmon])
[ 105.857144] r10:00000000 r9:00000080 r8:00000000 r7:eff3e600 r6:eff3b300 r5:d87a1a4c
[ 105.867582] r4:c1204fc8 r3:00000004
[ 105.873766] [] (get_values_poll [raspberrypi_hwmon]) from [] (process_one_work+0x250/0x570)
[ 105.886507] r5:d8be6300 r4:d87a1a4c
[ 105.892720] [] (process_one_work) from [] (worker_thread+0x60/0x5d0)
[ 105.903490] r10:eff3b300 r9:c1203d00 r8:eff3b318 r7:00000008 r6:eff3b300 r5:d8be6314
[ 105.914007] r4:d8be6300
[ 105.919233] [] (worker_thread) from [] (kthread+0x170/0x174)
[ 105.929334] r10:ef939e74 r9:c023eba4 r8:d8be6300 r7:d8b8a000 r6:00000000 r5:d8c63b80
[ 105.939872] r4:d8c63800
[ 105.945104] [] (kthread) from [] (ret_from_fork+0x14/0x28)
[ 105.955050] Exception stack(0xd8b8bfb0 to 0xd8b8bff8)
[ 105.962811] bfa0: 00000000 00000000 00000000 00000000
[ 105.973718] bfc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 105.984616] bfe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 105.993925] r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c0245e60
[ 106.004444] r4:d8c63b80
[ 106.009681] ---[ end trace e5ed96736c0aa23b ]---
[ 106.017184] hwmon hwmon1: Failed to get throttled (-110)
[ 115.025715] sched: RT throttling activated
[ 115.025783] pcieport 0000:00:00.0: AER: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, (Requester ID)
[ 115.046856] pcieport 0000:00:00.0: AER: device [14e4:2711] error status/mask=00004000/00000000
[ 115.058368] pcieport 0000:00:00.0: AER: [14] CmpltTO (First)
[ 115.072822] 8<--- cut here ---
[ 115.072914] pcieport 0000:00:00.0: AER: Device recovery failed
[ 115.078604] Unhandled fault: asynchronous external abort (0x1211) at 0x00000000
[ 115.078611] pgd = 275d29b4
[ 115.078615] [00000000] *pgd=17685003, *pmd=7fe40003
[ 115.078628] Internal error: : 1211 [#2] SMP ARM
[ 115.087180] pcieport 0000:00:00.0: AER: Uncorrected (Non-Fatal) error received: 0000:00:00.0
[ 115.097149] Modules linked in: sha256_generic libsha256 cfg80211 rfkill 8021q garp stp llc ftdi_sio usbserial vc4 cec rpivid_mem v3d drm_kms_helper gpu_sched drm bcm2835_codec(C) bcm2835_v4l2(C) bcm2835_isp(C) v4l2_mem2mem bcm2835_mmal_vchiq(C) videobuf2_dma_contig videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 videobuf2_common drm_panel_orientation_quirks raspberrypi_hwmon snd_soc_core videodev mc vc_sm_cma(C) snd_compress snd_pcm_dmaengine snd_pcm snd_timer snd syscopyarea sysfillrect sysimgblt fb_sys_fops uio_pdrv_genirq uio ip_tables x_tables ipv6
[ 115.102550] pcieport 0000:00:00.0: AER: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, (Requester ID)
[ 115.110065] CPU: 2 PID: 2332 Comm: screen Tainted: G D WC 5.4.79-v7l+ #1373
[ 115.110069] Hardware name: BCM2711
[ 115.110079] PC is at xhci_urb_dequeue+0xd8/0x474
[ 115.110084] LR is at 0xefb901a8
[ 115.117270] pcieport 0000:00:00.0: AER: device [14e4:2711] error status/mask=00004000/00000000
[ 115.128351] pc : [] lr : [] psr: 80000093
[ 115.128355] sp : d772faf0 ip : 00000000 fp : d772fb44
[ 115.128359] r10: 20000013 r9 : 00000000 r8 : efb901a0
[ 115.128365] r7 : efb90000 r6 : d6da2c00 r5 : efb90000 r4 : d75316c0
[ 115.185903] pcieport 0000:00:00.0: AER: [14] CmpltTO (First)
[ 115.200336] r3 : deaddead r2 : 00000000 r1 : 0000000e r0 : d84da280
[ 115.200342] Flags: Nzcv IRQs off FIQs on Mode SVC_32 ISA ARM Segment user
[ 115.200346] Control: 30c5383d Table: 16da2000 DAC: 55555555
[ 115.200353] Process screen (pid: 2332, stack limit = 0xad38c8bd)
[ 115.211299] pcieport 0000:00:00.0: AER: Device recovery failed
[ 115.217488] Stack: (0xd772faf0 to 0xd7730000)
[ 115.217494] fae0: c020bc44 c020cf3c c020bc44 00000000
[ 115.217501] fb00: c081e91c c10a8b10 c0a95480 efb90170 d8171000 00000000 00001388 d75316c0
[ 115.217507] fb20: 60000013 efb90000 fffffffe d772fc18 00001388 d6da20c0 d772fb6c d772fb48
[ 115.225819] 8<--- cut here ---
[ 115.231000] fb40: c081cf3c c08360e8 d75316c0 60000013 d87c4000 fffffffe d772fc18 00001388
[ 115.242694] Unhandled fault: asynchronous external abort (0x1211) at 0x00000000
[ 115.251811] fb60: d772fb8c d772fb70 c081e930 c081cf0c d75316c0 c1204fc8 d75316d0 d772fbc8
[ 115.259867] pgd = 6f1d3327
[ 115.267897] fb80: d772fbc4 d772fb90 c0820078 c081e8c4 c025249c 00000100 00000122 8dd7b910
[ 115.277222] [00000000] *pgd=1806c003, *pmd=7fcd9003
[ 115.287249] fba0: d75316c0 8dd7b910 d75316c0 c1204fc8 00000000 d772fbc8 d772fc04 d772fbc8
[ 115.445710] fbc0: c0820760 c082000c 00000000 00020002 d772fbd0 d772fbd0 00000003 8dd7b910
[ 115.456506] fbe0: c1204fc8 d87c4000 00000002 00000000 00000000 00000005 d772fc4c d772fc08
[ 115.467298] fc00: c0820848 c0820690 c03f3f6c d6da2c40 80000f80 000000c0 000001fc 8dd7b910
[ 115.478086] fc20: d772fc54 d6da2c40 d8209a00 d87c7c00 d772fc92 00000000 ffffb34a d777a900
[ 115.488874] fc40: d772fc8c d772fc50 bf1a56a8 c0820780 00000000 00000003 d6da2c40 00000002
[ 115.499660] fc60: 00001388 c10a8b10 c0a95480 c1204fc8 00000000 d772e000 00000001 c1203d00
[ 115.510434] fc80: d772fcac d772fc90 bf1a57ec bf1a560c 00000000 8dd7b910 d772fcbc d87c7c00
[ 115.521198] fca0: d772fcd4 d772fcb0 bf171200 bf1a57c8 d82fe100 d81e0600 d87c7c00 d82fe158
[ 115.531943] fcc0: 00000000 00000000 d772fcfc d772fcd8 bf16f414 bf171184 00000000 d81e0600
[ 115.542675] fce0: c1204fc8 0000000a d81e0674 00000000 d772fd3c d772fd00 c074fe88 bf16f3bc
[ 115.553398] fd00: d772fd24 d772fd10 c0a8fea0 c07512cc d772fd3c 8dd7b910 c07512cc c1204fc8
[ 115.564113] fd20: d777a900 d81e0600 0000000a d81e0674 d772fd94 d772fd40 c07506a8 c074fd90
[ 115.574817] fd40: 00000406 00000000 000018b2 00008a30 7f1c0300 64020415 1a131100 170f1200
[ 115.585512] fd60: 00000016 0001c200 0001c200 8dd7b910 d81e0600 c1204fc8 bebfcbfc d6d7d780
[ 115.596188] fd80: c074c660 bebfcbfc d772fdec d772fd98 c0750b78 c0750574 00000500 00000005
[ 115.606866] fda0: 00000cbd 00008a3b 7f1c0300 01000415 1a131100 c0a8fea0 00000000 d81e0618
[ 115.617535] fdc0: d772fde4 8dd7b910 c0a8fea0 d81e0600 d81e0600 bebfcbfc d6d7d780 c074c660
[ 115.628193] fde0: d772fe0c d772fdf0 c0750dcc c0750868 d81e0600 bebfcbfc c1204fc8 d6d7d780
[ 115.638839] fe00: d772fe34 d772fe10 c074c698 c0750da0 00005403 d81e0600 c1204fc8 d6d7d780
[ 115.649469] fe20: c074c660 bebfcbfc d772fedc d772fe38 c074a5b0 c074c66c bebfcbfc 00000001
[ 115.660099] fe40: d772fe84 d772fe50 c03d1a3c c0211be4 c03c1a70 04e00000 ffffe000 c1204fc8
[ 115.670732] fe60: 75c9f3df 00000040 c13365c0 75c9f3df 00000000 c03c5ffc d772ff24 d772fe88
[ 115.681361] fe80: c03c5ffc c021b7f4 75c9ffdf 04e00000 00000000 d772fea0 c020cf60 c020bbc4
[ 115.691988] fea0: c1204fc8 00000000 d755a600 8dd7b910 d6c96068 c1204fc8 bebfcbfc d6d7d780
[ 115.702620] fec0: 00000004 bebfcbfc 00000004 d84a4778 d772ff6c d772fee0 c0422dcc c074a324
[ 115.713259] fee0: 00000000 ffede3b0 deb34ee8 00000000 d755a600 8dd7b910 d772ff24 d772ffb0
[ 115.723897] ff00: d6d0bd00 d755a600 b6e76e50 0000020b d6c96068 c0a95c40 d772ff74 d772ff28
[ 115.734536] ff20: c0a95c40 c027b438 c020cf60 c020bbc4 c1204fc8 00000000 ffffffff 8dd7b910
[ 115.745197] ff40: 00000000 d6d7d780 d6d7d780 00000000 00005403 bebfcbfc 00000004 00000036
[ 115.755860] ff60: d772ff94 d772ff70 c042354c c0422d18 bebfcc78 00000001 00076c18 00000036
[ 115.766517] ff80: c02011c4 d772e000 d772ffa4 d772ff98 c0423588 c04234ec 00000000 d772ffa8
[ 115.777183] ffa0: c0201000 c042357c bebfcc78 00000001 00000004 00005403 bebfcbfc 00008a30
[ 115.787862] ffc0: bebfcc78 00000001 00076c18 00000036 00000004 b6f55bb0 00000001 00000000
[ 115.798544] ffe0: 00000000 bebfcbf8 00000000 b6dfb7a4 80000010 00000004 00000000 00000000
[ 115.809196] Backtrace:
[ 115.814099] [] (xhci_urb_dequeue) from [] (unlink1+0x3c/0x11c)
[ 115.824151] r10:d6da20c0 r9:00001388 r8:d772fc18 r7:fffffffe r6:efb90000 r5:60000013
[ 115.834466] r4:d75316c0
[ 115.839475] [] (unlink1) from [] (usb_hcd_unlink_urb+0x78/0x94)
[ 115.849631] r9:00001388 r8:d772fc18 r7:fffffffe r6:d87c4000 r5:60000013 r4:d75316c0
[ 115.859876] [] (usb_hcd_unlink_urb) from [] (usb_kill_urb+0x78/0x108)
[ 115.870568] r7:d772fbc8 r6:d75316d0 r5:c1204fc8 r4:d75316c0
[ 115.878761] [] (usb_kill_urb) from [] (usb_start_wait_urb+0xdc/0xf0)
[ 115.889379] r7:d772fbc8 r6:00000000 r5:c1204fc8 r4:d75316c0
[ 115.897503] [] (usb_start_wait_urb) from [] (usb_control_msg+0xd4/0x12c)
[ 115.908359] r9:00000005 r8:00000000 r7:00000000 r6:00000002 r5:d87c4000 r4:c1204fc8
[ 115.918478] [] (usb_control_msg) from [] (ftdi_get_modem_status+0xa8/0x128 [ftdi_sio])
[ 115.930497] r10:d777a900 r9:ffffb34a r8:00000000 r7:d772fc92 r6:d87c7c00 r5:d8209a00
[ 115.940667] r4:d6da2c40
[ 115.945531] [] (ftdi_get_modem_status [ftdi_sio]) from [] (ftdi_tx_empty+0x30/0x5c [ftdi_sio])
[ 115.958280] r8:c1203d00 r7:00000001 r6:d772e000 r5:00000000 r4:c1204fc8
[ 115.967394] [] (ftdi_tx_empty [ftdi_sio]) from [] (usb_serial_generic_wait_until_sent+0x88/0xc8 [usbserial])
[ 115.981391] r4:d87c7c00
[ 115.986343] [] (usb_serial_generic_wait_until_sent [usbserial]) from [] (serial_wait_until_sent+0x64/0x70 [usbserial])
[ 116.001255] r9:00000000 r8:00000000 r7:d82fe158 r6:d87c7c00 r5:d81e0600 r4:d82fe100
[ 116.011503] [] (serial_wait_until_sent [usbserial]) from [] (tty_wait_until_sent+0x104/0x188)
[ 116.024295] r9:00000000 r8:d81e0674 r7:0000000a r6:c1204fc8 r5:d81e0600 r4:00000000
[ 116.034575] [] (tty_wait_until_sent) from [] (set_termios+0x140/0x2f4)
[ 116.045379] r8:d81e0674 r7:0000000a r6:d81e0600 r5:d777a900 r4:c1204fc8
[ 116.054618] [] (set_termios) from [] (tty_mode_ioctl+0x31c/0x538)
[ 116.064999] r9:bebfcbfc r8:c074c660 r7:d6d7d780 r6:bebfcbfc r5:c1204fc8 r4:d81e0600
[ 116.075304] [] (tty_mode_ioctl) from [] (n_tty_ioctl_helper+0x38/0x138)
[ 116.086227] r8:c074c660 r7:d6d7d780 r6:bebfcbfc r5:d81e0600 r4:d81e0600
[ 116.095499] [] (n_tty_ioctl_helper) from [] (n_tty_ioctl+0x38/0x13c)
[ 116.106170] r7:d6d7d780 r6:c1204fc8 r5:bebfcbfc r4:d81e0600
[ 116.114401] [] (n_tty_ioctl) from [] (tty_ioctl+0x298/0x9f4)
[ 116.124377] r9:bebfcbfc r8:c074c660 r7:d6d7d780 r6:c1204fc8 r5:d81e0600 r4:00005403
[ 116.134711] [] (tty_ioctl) from [] (do_vfs_ioctl+0xc0/0x7d4)
[ 116.144684] r10:d84a4778 r9:00000004 r8:bebfcbfc r7:00000004 r6:d6d7d780 r5:bebfcbfc
[ 116.155090] r4:c1204fc8
[ 116.160176] [] (do_vfs_ioctl) from [] (ksys_ioctl+0x6c/0x90)
[ 116.170140] r10:00000036 r9:00000004 r8:bebfcbfc r7:00005403 r6:00000000 r5:d6d7d780
[ 116.180534] r4:d6d7d780
[ 116.185605] [] (ksys_ioctl) from [] (sys_ioctl+0x18/0x1c)
[ 116.195297] r9:d772e000 r8:c02011c4 r7:00000036 r6:00076c18 r5:00000001 r4:bebfcc78
[ 116.205607] [] (sys_ioctl) from [] (ret_fast_syscall+0x0/0x28)
[ 116.215739] Exception stack(0xd772ffa8 to 0xd772fff0)
[ 116.223354] ffa0: bebfcc78 00000001 00000004 00005403 bebfcbfc 00008a30
[ 116.234111] ffc0: bebfcc78 00000001 00076c18 00000036 00000004 b6f55bb0 00000001 00000000
[ 116.244862] ffe0: 00000000 bebfcbf8 00000000 b6dfb7a4
[ 116.252480] Code: e5933004 f57ff04f e3730001 0a00002a (e597c678)
[ 116.261144] ---[ end trace e5ed96736c0aa23c ]---
[ 116.277705] raspberrypi-firmware soc:firmware: Request 0x00030046 returned status 0x80000001
[ 137.295291] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[ 137.302984] rcu: 1-...0: (1 GPs behind) idle=cb6/1/0x40000000 softirq=7420/7433 fqs=714
[ 137.312899] (detected by 0, t=2103 jiffies, g=3593, q=2184)
[ 137.320295] Sending NMI from CPU 0 to CPUs 1:
[ 147.327309] rcu: rcu_sched kthread starved for 1000 jiffies! g3593 f0x0 RCU_GP_DOING_FQS(6) ->state=0x0 ->cpu=2
[ 147.339214] rcu: RCU grace-period kthread stack dump:
[ 147.346013] rcu_sched R running task 0 10 2 0x00000000
[ 147.354809] Backtrace:
[ 147.358987] [] (__schedule) from [] (preempt_schedule_common+0x1c/0x34)
[ 147.369088] r10:c1203d00 r9:ef910000 r8:00000000 r7:c120508c r6:00000000 r5:00000000
[ 147.378674] r4:ffffe000
[ 147.382948] [] (preempt_schedule_common) from [] (_cond_resched+0x50/0x58)
[ 147.393321] r5:00000000 r4:00000001
[ 147.398650] [] (_cond_resched) from [] (rcu_gp_kthread+0x548/0xa40)
[ 147.408420] r5:00000000 r4:c12110c0
[ 147.413752] [] (rcu_gp_kthread) from [] (kthread+0x170/0x174)
[ 147.422999] r7:ef910000
[ 147.427282] [] (kthread) from [] (ret_from_fork+0x14/0x28)
[ 147.436271] Exception stack(0xef911fb0 to 0xef911ff8)
[ 147.443086] 1fa0: 00000000 00000000 00000000 00000000
[ 147.453040] 1fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 147.462983] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 147.471352] r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c0245e60
[ 147.480932] r4:ef86fcc0
[ 156.945148] ------------[ cut here ]------------
[ 156.951535] WARNING: CPU: 3 PID: 24 at net/sched/sch_generic.c:448 dev_watchdog+0x314/0x318
[ 156.961652] NETDEV WATCHDOG: eth0 (bcmgenet): transmit queue 0 timed out
[ 156.970115] Modules linked in: sha256_generic libsha256 cfg80211 rfkill 8021q garp stp llc ftdi_sio usbserial vc4 cec rpivid_mem v3d drm_kms_helper gpu_sched drm bcm2835_codec(C) bcm2835_v4l2(C) bcm2835_isp(C) v4l2_mem2mem bcm2835_mmal_vchiq(C) videobuf2_dma_contig videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 videobuf2_common drm_panel_orientation_quirks raspberrypi_hwmon snd_soc_core videodev mc vc_sm_cma(C) snd_compress snd_pcm_dmaengine snd_pcm snd_timer snd syscopyarea sysfillrect sysimgblt fb_sys_fops uio_pdrv_genirq uio ip_tables x_tables ipv6
[ 157.024882] CPU: 3 PID: 24 Comm: migration/3 Tainted: G D WC 5.4.79-v7l+ #1373
[ 157.035028] Hardware name: BCM2711
[ 157.040290] Backtrace:
[ 157.044593] [] (dump_backtrace) from [] (show_stack+0x20/0x24)
[ 157.054024] r7:ffffffff r6:00000000 r5:60000113 r4:c129fab0
[ 157.061536] [] (show_stack) from [] (dump_stack+0xd8/0x11c)
[ 157.070704] [] (dump_stack) from [] (__warn+0xe0/0x108)
[ 157.079504] r10:c12a6f78 r9:00000009 r8:c0982fa0 r7:000001c0 r6:00000009 r5:c0982fa0
[ 157.089182] r4:c0e47714 r3:00000000
[ 157.094581] [] (__warn) from [] (warn_slowpath_fmt+0xa4/0xc0)
[ 157.103897] r7:000001c0 r6:c0e47714 r5:c1204fc8 r4:c0e476d8
[ 157.111377] [] (warn_slowpath_fmt) from [] (dev_watchdog+0x314/0x318)
[ 157.121378] r9:eff48440 r8:ef254000 r7:c1203d00 r6:ef1aa800 r5:ef2542a8 r4:00000000
[ 157.130928] [] (dev_watchdog) from [] (call_timer_fn+0x40/0x1b0)
[ 157.140469] r8:00000000 r7:ffffc820 r6:c0982c8c r5:00000101 r4:ef2542a8
[ 157.148947] [] (call_timer_fn) from [] (run_timer_softirq+0x46c/0x640)
[ 157.158974] r8:00000000 r7:ffffc820 r6:00000000 r5:ef93fd34 r4:ef2542a8
[ 157.167434] [] (run_timer_softirq) from [] (__do_softirq+0x194/0x444)
[ 157.177377] r10:ffffe000 r9:ef93e000 r8:00000002 r7:00000101 r6:00000001 r5:00000002
[ 157.186960] r4:c1203084
[ 157.191236] [] (__do_softirq) from [] (irq_exit+0xdc/0x100)
[ 157.200292] r10:00000000 r9:ef93e000 r8:ef850800 r7:00000001 r6:00000000 r5:00000000
[ 157.209875] r4:ffffe000
[ 157.214149] [] (irq_exit) from [] (__handle_domain_irq+0x70/0xc4)
[ 157.223725] r5:00000000 r4:c10aa2a4
[ 157.229044] [] (__handle_domain_irq) from [] (gic_handle_irq+0x4c/0x88)
[ 157.239151] r9:ef93e000 r8:f0815000 r7:ef93fe60 r6:f0814000 r5:f081400c r4:c1205a34
[ 157.248654] [] (gic_handle_irq) from [] (__irq_svc+0x5c/0x7c)
[ 157.257884] Exception stack(0xef93fe60 to 0xef93fea8)
[ 157.264684] fe60: c1204ff0 00000000 00000002 00000000 ef939e00 00000001 00000001 00000000
[ 157.274622] fe80: c1204ff0 ef939dec 00000000 ef93febc ef93fec0 ef93feb0 c02dd3b8 c02dd338
[ 157.284549] fea0: 60000013 ffffffff
[ 157.289772] r9:ef93e000 r8:c1204ff0 r7:ef93fe94 r6:ffffffff r5:60000013 r4:c02dd338
[ 157.299267] [] (stop_machine_yield) from [] (multi_cpu_stop+0x74/0x178)
[ 157.309363] [] (multi_cpu_stop) from [] (cpu_stopper_thread+0x90/0x164)
[ 157.319463] r10:ef939d8c r9:eff49988 r8:eff49990 r7:ef939dec r6:c02dd344 r5:ffffe000
[ 157.329050] r4:eff49984
[ 157.333316] [] (cpu_stopper_thread) from [] (smpboot_thread_fn+0x110/0x1e8)
[ 157.343771] r10:00000000 r9:00000000 r8:00000001 r7:c1204fc8 r6:c1217204 r5:ffffe000
[ 157.353364] r4:ef87f740
[ 157.357651] [] (smpboot_thread_fn) from [] (kthread+0x170/0x174)
[ 157.367147] r10:ef8dbda4 r9:c0249cd4 r8:ef87f740 r7:ef93e000 r6:00000000 r5:ef87f7c0
[ 157.376746] r4:ef87f800
[ 157.381032] [] (kthread) from [] (ret_from_fork+0x14/0x28)
[ 157.390020] Exception stack(0xef93ffb0 to 0xef93fff8)
[ 157.396821] ffa0: 00000000 00000000 00000000 00000000
[ 157.406762] ffc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 157.416699] ffe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 157.425064] r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c0245e60
[ 157.434624] r4:ef87f7c0
[ 157.438875] ---[ end trace e5ed96736c0aa23d ]---
[ 200.345089] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[ 200.352737] rcu: 1-...0: (1 GPs behind) idle=cb6/1/0x40000000 softirq=7420/7433 fqs=715
[ 200.362638] (detected by 0, t=8408 jiffies, g=3593, q=2187)
[ 200.370014] Sending NMI from CPU 0 to CPUs 1:
[ 210.377010] rcu: rcu_sched kthread starved for 7305 jiffies! g3593 f0x2 RCU_GP_DOING_FQS(6) ->state=0x0 ->cpu=0
[ 210.388827] rcu: RCU grace-period kthread stack dump:
[ 210.395593] rcu_sched R running task 0 10 2 0x00000000
[ 210.404357] Backtrace:
[ 210.408514] [] (__schedule) from [] (preempt_schedule_common+0x1c/0x34)
[ 210.418579] r10:c1203d00 r9:ef910000 r8:00000000 r7:c120508c r6:00000000 r5:00000000
[ 210.428128] r4:ffffe000
[ 210.432366] [] (preempt_schedule_common) from [] (_cond_resched+0x50/0x58)
[ 210.442707] r5:00000000 r4:00000001
[ 210.448000] [] (_cond_resched) from [] (rcu_gp_kthread+0x548/0xa40)
[ 210.457742] r5:00000000 r4:c12110c0
[ 210.463051] [] (rcu_gp_kthread) from [] (kthread+0x170/0x174)
[ 210.472291] r7:ef910000
[ 210.476563] [] (kthread) from [] (ret_from_fork+0x14/0x28)
[ 210.485531] Exception stack(0xef911fb0 to 0xef911ff8)
[ 210.492331] 1fa0: 00000000 00000000 00000000 00000000
[ 210.502255] 1fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 210.512144] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 210.520410] r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c0245e60
[ 210.529849] r4:ef86fcc0
[ 263.395085] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[ 263.402601] rcu: 1-...0: (1 GPs behind) idle=cb6/1/0x40000000 softirq=7420/7433 fqs=715
[ 263.412387] (detected by 0, t=14713 jiffies, g=3593, q=2187)
[ 263.419739] Sending NMI from CPU 0 to CPUs 1:
[ 273.426617] rcu: rcu_sched kthread starved for 13610 jiffies! g3593 f0x2 RCU_GP_DOING_FQS(6) ->state=0x0 ->cpu=0
[ 273.438413] rcu: RCU grace-period kthread stack dump:
[ 273.445088] rcu_sched R running task 0 10 2 0x00000000
[ 273.453755] Backtrace:
[ 273.457812] [] (__schedule) from [] (preempt_schedule_common+0x1c/0x34)
[ 273.467789] r10:c1203d00 r9:ef910000 r8:00000000 r7:c120508c r6:00000000 r5:00000000
[ 273.477251] r4:ffffe000
[ 273.481396] [] (preempt_schedule_common) from [] (_cond_resched+0x50/0x58)
[ 273.491646] r5:00000000 r4:00000001
[ 273.496841] [] (_cond_resched) from [] (rcu_gp_kthread+0x548/0xa40)
[ 273.506480] r5:00000000 r4:c12110c0
[ 273.511672] [] (rcu_gp_kthread) from [] (kthread+0x170/0x174)
[ 273.520777] r7:ef910000
[ 273.524921] [] (kthread) from [] (ret_from_fork+0x14/0x28)
[ 273.533763] Exception stack(0xef911fb0 to 0xef911ff8)
[ 273.540424] 1fa0: 00000000 00000000 00000000 00000000
[ 273.550232] 1fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 273.560026] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[ 273.568242] r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c0245e60
[ 273.577668] r4:ef86fcc0
Additional context
When connecting the USB serial ports to a different computer (my notebook) this works fine.
The original bug report is in the freetserv project:
freetserv/freetserv#48
The text was updated successfully, but these errors were encountered: