Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

raspberry pi zero - reproducible - unable to handle kernel NULL pointer dereference #4178

Closed
mhano opened this issue Feb 26, 2021 · 7 comments

Comments

@mhano
Copy link

mhano commented Feb 26, 2021

Is this the right place for my bug report?

reliable/repeatable crash with most basic of steps to reproduce

based on all the testing below I’m wondering if this is a hardware issue as unlikely as that is allegedly?

Describe the bug

Raspberry Pi zero w crashes (upgraded or not) on downloading 1GB file with curl (or writing 1GB files filled from dev/urandom).

Have reproduced with the following installs:

  • tried two different wifi networks / different brands of router
  • full desktop raspbian offline install from noobs sd card
  • raspbian lite
  • raspbian lite - upgraded (apt update and upgrade after initial setup)
  • two different 16GB micro sd cards

To reproduce

install

  • either full desktop raspbian offline; or
  • install raspbian lite

configure basics -

  • host name “raspi4z”
  • wifi AU wifi region
  • default locale - AU/Sydney time zone
  • Boot to CLI instead of desktop (if installed desktop)
  • Set password on pi account
  • Enable ssh
  • In some tests I’d installed pivpn via curl|bash but this didn’t make a difference - refer to the dev/urandom test below

Reboot login as pi / run

for i in {0..9}; do
curl -o ~/test-$i.dl http://speedcheck.cdn.on.net/1000meg.test
done

usually crashes before downloading first 1GB file

have not been able to cause to crash by creating 1GB files from /dev/zero with dd..

for i in {0..9}; do
dd if=/dev/zero of=./bigzero-$i.test bs=4096 count=244141 status=progress
done

running dd like above from /dev/urandom instead of /dev/zero did produce a partial crash - raspberrypi was not unresponsive and managed to download syslog (see comment with syslog - it crashed at around the 600MB mark of the second 1GB file). It did however shortly afterwards become unresponsive.

Update: the urandom based write was also able to crash the most basic of install during the write of the first 1GB file (612 MiB in). the install this crashed on was just straight noobs offline full desktop install from sd, start terminal (ignoring piwiz) when desktop started, use raspi-config to set host name and boot to cli, restart, login to cli and run loop of dd commands creating 1gb files from dev/urand). This was the same version as the details below.

Expected behaviour doesn’t crash.
Actual behaviour crashes.

System

Logs
Screen shot / photo of crash attached (ssh connection dies on crash - but local hdmi console shows error).

2ADA14D5-33E8-4A67-AAA7-AC3CBCCBD328

Additional context
RaspberryPi completely unresponsive / frozen after crash (can’t interact with local keyboard or via ssh).

** raspinfo **

alloc failures: 0
compactions: 0
legacy block fails: 0

Filesystem information

Filesystem 1K-blocks Used Available Use% Mounted on
/dev/root 12437304 7013092 4769392 60% /
devtmpfs 188256 0 188256 0% /dev
tmpfs 221272 0 221272 0% /dev/shm
tmpfs 221272 3204 218068 2% /run
tmpfs 5120 4 5116 1% /run/lock
tmpfs 221272 0 221272 0% /sys/fs/cgroup
/dev/mmcblk0p6 258094 54603 203491 22% /boot
tmpfs 44252 0 44252 0% /run/user/1000

Filename Type Size Used Priority
/var/swap file 102396 0 -2

Package version information

raspberrypi-ui-mods:
Installed: 1.20200611
raspberrypi-sys-mods:
Installed: 20200812
openbox:
Installed: 3.6.1-8+rpt4
lxpanel:
Installed: 0.10.0-2+rpt12
pcmanfm:
Installed: 1.3.1-1+rpt22
rpd-plym-splash:
Installed: 0.24

Networking Information

lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536
inet x.x.x.x netmask x.x.x.x
inet6 ::1 prefixlen 128 scopeid 0x10
loop txqueuelen 1000 (Local Loopback)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

tun0: flags=4305<UP,POINTOPOINT,RUNNING,NOARP,MULTICAST> mtu 1500
inet x.x.x.x netmask x.x.x.x destination x.x.x.x
inet6 y::y.y.y.y prefixlen 64 scopeid 0x20
unspec 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00 txqueuelen 100 (UNSPEC)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 4 bytes 192 (192.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

wlan0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet x.x.x.x netmask x.x.x.x broadcast x.x.x.x
inet6 y::y.y.y.y prefixlen 64 scopeid 0x20
inet6 y.y.y.y.y.y.y.y prefixlen 64 scopeid 0x0
ether m.m.m.m txqueuelen 1000 (Ethernet)
RX packets 33633 bytes 50182960 (47.8 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 10231 bytes 941864 (919.7 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

USB Information

/: Bus 01.Port 1: Dev 1, Class=root_hub, Driver=dwc_otg/1p, 480M
|__ Port 1: Dev 2, If 0, Class=Human Interface Device, Driver=usbhid, 1.5M
|__ Port 1: Dev 2, If 1, Class=Human Interface Device, Driver=usbhid, 1.5M

config.txt

aphy_params_current=547
arm_freq=1000
arm_freq_min=700
audio_pwm_mode=514
config_hdmi_boost=5
core_freq=400
disable_auto_turbo=1
disable_commandline_tags=2
disable_splash=1
display_hdmi_rotate=-1
display_lcd_rotate=-1
dphy_params_current=547
enable_tvout=1
force_eeprom_read=1
force_pwm_open=1
framebuffer_ignore_alpha=1
framebuffer_swap=1
gpu_freq=300
ignore_lcd=1
init_uart_clock=0x2dc6c00
over_voltage_avs=0x249f0
pause_burst_frames=1
program_serial_random=1
sdram_freq=450
second_boot=1
total_mem=512
hdmi_force_cec_address:0=65535
hdmi_force_cec_address:1=65535
hdmi_pixel_freq_limit:0=0x9a7ec80
device_tree=-
overlay_prefix=overlays/
hdmi_cvt:0=
hdmi_cvt:1=
hdmi_edid_filename:0=
hdmi_edid_filename:1=
hdmi_timings:0=
hdmi_timings:1=

cmdline.txt

coherent_pool=1M 8250.nr_uarts=0 snd_bcm2835.enable_compat_alsa=0 snd_bcm2835.enable_hdmi=1 snd_bc
m2835.enable_headphones=1 bcm2708_fb.fbwidth=1824 bcm2708_fb.fbheight=984 bcm2708_fb.fbswap=1 smsc
95xx.macaddr=B8:27:EB:59:2C:E7 vc_mem.mem_base=0x1ec00000 vc_mem.mem_size=0x20000000 console=ttyS
0,115200 console=tty1 root=/dev/mmcblk0p7 rootfstype=ext4 elevator=deadline fsck.repair=yes rootwa
it

raspi-gpio settings

BANK0 (GPIO 0 to 27):
GPIO 0: level=1 fsel=0 func=INPUT
GPIO 1: level=1 fsel=0 func=INPUT
GPIO 2: level=1 fsel=0 func=INPUT
GPIO 3: level=1 fsel=0 func=INPUT
GPIO 4: level=1 fsel=0 func=INPUT
GPIO 5: level=1 fsel=0 func=INPUT
GPIO 6: level=1 fsel=0 func=INPUT
GPIO 7: level=1 fsel=0 func=INPUT
GPIO 8: level=1 fsel=0 func=INPUT
GPIO 9: level=0 fsel=0 func=INPUT
GPIO 10: level=0 fsel=0 func=INPUT
GPIO 11: level=0 fsel=0 func=INPUT
GPIO 12: level=0 fsel=0 func=INPUT
GPIO 13: level=0 fsel=0 func=INPUT
GPIO 14: level=0 fsel=0 func=INPUT
GPIO 15: level=1 fsel=0 func=INPUT
GPIO 16: level=0 fsel=0 func=INPUT
GPIO 17: level=0 fsel=0 func=INPUT
GPIO 18: level=0 fsel=0 func=INPUT
GPIO 19: level=0 fsel=0 func=INPUT
GPIO 20: level=0 fsel=0 func=INPUT
GPIO 21: level=0 fsel=0 func=INPUT
GPIO 22: level=0 fsel=0 func=INPUT
GPIO 23: level=0 fsel=0 func=INPUT
GPIO 24: level=0 fsel=0 func=INPUT
GPIO 25: level=0 fsel=0 func=INPUT
GPIO 26: level=0 fsel=0 func=INPUT
GPIO 27: level=0 fsel=0 func=INPUT
BANK1 (GPIO 28 to 45):
GPIO 28: level=1 fsel=0 func=INPUT
GPIO 29: level=1 fsel=0 func=INPUT
GPIO 30: level=0 fsel=7 alt=3 func=CTS0
GPIO 31: level=0 fsel=7 alt=3 func=RTS0
GPIO 32: level=1 fsel=7 alt=3 func=TXD0
GPIO 33: level=1 fsel=7 alt=3 func=RXD0
GPIO 34: level=0 fsel=7 alt=3 func=SD1_CLK
GPIO 35: level=1 fsel=7 alt=3 func=SD1_CMD
GPIO 36: level=1 fsel=7 alt=3 func=SD1_DAT0
GPIO 37: level=1 fsel=7 alt=3 func=SD1_DAT1
GPIO 38: level=1 fsel=7 alt=3 func=SD1_DAT2
GPIO 39: level=1 fsel=7 alt=3 func=SD1_DAT3
GPIO 40: level=0 fsel=1 func=OUTPUT
GPIO 41: level=1 fsel=1 func=OUTPUT
GPIO 42: level=0 fsel=0 func=INPUT
GPIO 43: level=1 fsel=4 alt=0 func=GPCLK2
GPIO 44: level=0 fsel=1 func=OUTPUT
GPIO 45: level=1 fsel=1 func=OUTPUT
BANK2 (GPIO 46 to 53):
GPIO 46: level=0 fsel=0 func=INPUT
GPIO 47: level=0 fsel=1 func=OUTPUT
GPIO 48: level=0 fsel=4 alt=0 func=SD0_CLK
GPIO 49: level=1 fsel=4 alt=0 func=SD0_CMD
GPIO 50: level=1 fsel=4 alt=0 func=SD0_DAT0
GPIO 51: level=1 fsel=4 alt=0 func=SD0_DAT1
GPIO 52: level=1 fsel=4 alt=0 func=SD0_DAT2
GPIO 53: level=1 fsel=4 alt=0 func=SD0_DAT3

vcdbg log messages

001251.772: brfs: File read: /mfs/sd/config.txt
001252.552: brfs: File read: 1820 bytes
001310.821: brfs: File read: /mfs/sd/config.txt
001311.495: gpioman: gpioman_get_pin_num: pin LEDS_PWR_OK not defined
001323.478: brfs: File read: 1820 bytes
001501.004: gpioman: gpioman_get_pin_num: pin LEDS_PWR_OK not defined
001501.055: *** Restart logging
001533.946: HDMI0: hdmi_pixel_encoding: 162000000
001539.269: dtb_file 'bcm2708-rpi-zero-w.dtb'
001545.852: brfs: File read: /mfs/sd/bcm2708-rpi-zero-w.dtb
001545.877: Loading 'bcm2708-rpi-zero-w.dtb' to 0x100 size 0x656d
001558.096: brfs: File read: 25965 bytes
001571.255: brfs: File read: /mfs/sd/overlays/overlay_map.dtb
001630.950: brfs: File read: 1423 bytes
001637.085: brfs: File read: /mfs/sd/config.txt
001637.456: dtparam: audio=on
001653.190: brfs: File read: 1820 bytes
001656.780: brfs: File read: /mfs/sd/cmdline.txt
001656.814: Read command line from file 'cmdline.txt':
001656.833: 'console=serial0,115200 console=tty1 root=/dev/mmcblk0p7 rootfstype=ext4 elevator=dead
line fsck.repair=yes rootwait'
003817.169: gpioman: gpioman_get_pin_num: pin EMMC_ENABLE not defined
003838.319: brfs: File read: 115 bytes
004204.560: brfs: File read: /mfs/sd/kernel.img
004204.586: Loading 'kernel.img' to 0x8000 size 0x510e20
004204.617: Device tree loaded to 0x1bfe9600 (size 0x6957)
004205.370: gpioman: gpioman_get_pin_num: pin SDCARD_CONTROL_POWER not defined
007985.525: vchiq_core: vchiq_init_state: slot_zero = 0x57d80000, is_master = 1
007991.826: hdmi: HDMI:hdmi_get_state is deprecated, use hdmi_get_display_state instead
007999.401: TV service:host side not connected, dropping notification 0x00000002, 0x00000001, 0x00
000010

dmesg log

[ 0.000000] Booting Linux on physical CPU 0x0
[ 0.000000] Linux version 5.4.51+ (dom@buildbot) (gcc version 4.9.3 (crosstool-NG crosstool-ng-
1.22.0-88-g8460611)) #1333 Mon Aug 10 16:38:02 BST 2020
[ 0.000000] CPU: ARMv6-compatible processor [410fb767] revision 7 (ARMv7), cr=00c5387d
[ 0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT nonaliasing instruction cache
[ 0.000000] OF: fdt: Machine model: Raspberry Pi Zero W Rev 1.1
[ 0.000000] Memory policy: Data cache writeback
[ 0.000000] Reserved memory: created CMA memory pool at 0x17c00000, size 64 MiB
[ 0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
[ 0.000000] On node 0 totalpages: 114688
[ 0.000000] Normal zone: 1008 pages used for memmap
[ 0.000000] Normal zone: 0 pages reserved
[ 0.000000] Normal zone: 114688 pages, LIFO batch:31
[ 0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
[ 0.000000] pcpu-alloc: [0] 0
[ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 113680
[ 0.000000] Kernel command line: coherent_pool=1M 8250.nr_uarts=0 snd_bcm2835.enable_compat_als
a=0 snd_bcm2835.enable_hdmi=1 snd_bcm2835.enable_headphones=1 bcm2708_fb.fbwidth=1824 bcm2708_fb.f
bheight=984 bcm2708_fb.fbswap=1 smsc95xx.macaddr=m.m.m.m vc_mem.mem_base=0x1ec00000 vc_mem.mem_siz
e=0x20000000 console=ttyS0,115200 console=tty1 root=/dev/mmcblk0p7 rootfstype=ext4 elevator=deadl
ine fsck.repair=yes rootwait
[ 0.000000] Dentry cache hash table entries: 65536 (order: 6, 262144 bytes, linear)
[ 0.000000] Inode-cache hash table entries: 32768 (order: 5, 131072 bytes, linear)
[ 0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[ 0.000000] Memory: 376516K/458752K available (7579K kernel code, 702K rwdata, 2404K rodata, 49
2K init, 800K bss, 16700K reserved, 65536K cma-reserved)
[ 0.000000] SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[ 0.000000] ftrace: allocating 26696 entries in 53 pages
[ 0.000000] NR_IRQS: 16, nr_irqs: 16, preallocated irqs: 16
[ 0.000000] random: get_random_bytes called from start_kernel+0x2a8/0x4dc with crng_init=0
[ 0.000025] sched_clock: 32 bits at 1000kHz, resolution 1000ns, wraps every 2147483647500ns
[ 0.000090] clocksource: timer: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 191126044
6275 ns
[ 0.000211] bcm2835: system timer (irq = 27)
[ 0.000837] Console: colour dummy device 80x30
[ 0.001456] printk: console [tty1] enabled
[ 0.001554] Calibrating delay loop... 697.95 BogoMIPS (lpj=3489792)
[ 0.050418] pid_max: default: 32768 minimum: 301
[ 0.051027] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes, linear)
[ 0.051105] Mountpoint-cache hash table entries: 1024 (order: 0, 4096 bytes, linear)
[ 0.053134] Disabling memory control group subsystem
[ 0.053413] CPU: Testing write buffer coherency: ok
[ 0.055142] Setting up static identity map for 0x8200 - 0x8238
[ 0.056385] devtmpfs: initialized
[ 0.069415] VFP support v0.3: implementor 41 architecture 1 part 20 variant b rev 5
[ 0.069940] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260
4462750000 ns
[ 0.070032] futex hash table entries: 256 (order: -1, 3072 bytes, linear)
[ 0.078881] pinctrl core: initialized pinctrl subsystem
[ 0.081081] NET: Registered protocol family 16
[ 0.085820] DMA: preallocated 1024 KiB pool for atomic coherent allocations
[ 0.094071] hw-breakpoint: found 6 breakpoint and 1 watchpoint registers.
[ 0.094152] hw-breakpoint: maximum watchpoint size is 4 bytes.
[ 0.094370] Serial: AMBA PL011 UART driver
[ 0.098242] bcm2835-mbox 2000b880.mailbox: mailbox enabled
[ 0.120861] raspberrypi-firmware soc:firmware: Attached to firmware from 2020-08-19 17:40, vari
ant start
[ 0.130892] raspberrypi-firmware soc:firmware: Firmware hash is e90cba19a98a0d1f2ef086b9cafcbca
00778f094
[ 0.194472] bcm2835-dma 20007000.dma: DMA legacy API manager, dmachans=0x1
[ 0.197788] SCSI subsystem initialized
[ 0.198142] usbcore: registered new interface driver usbfs
[ 0.198303] usbcore: registered new interface driver hub
[ 0.198612] usbcore: registered new device driver usb
[ 0.201609] clocksource: Switched to clocksource timer
[ 1.461335] VFS: Disk quotas dquot_6.6.0
[ 1.461544] VFS: Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[ 1.462147] FS-Cache: Loaded
[ 1.462594] CacheFiles: Loaded
[ 1.483306] thermal_sys: Registered thermal governor 'step_wise'
[ 1.484069] NET: Registered protocol family 2
[ 1.485694] tcp_listen_portaddr_hash hash table entries: 512 (order: 0, 4096 bytes, linear)
[ 1.485824] TCP established hash table entries: 4096 (order: 2, 16384 bytes, linear)
[ 1.485956] TCP bind hash table entries: 4096 (order: 2, 16384 bytes, linear)
[ 1.486086] TCP: Hash tables configured (established 4096 bind 4096)
[ 1.486308] UDP hash table entries: 256 (order: 0, 4096 bytes, linear)
[ 1.486388] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes, linear)
[ 1.486921] NET: Registered protocol family 1
[ 1.488360] RPC: Registered named UNIX socket transport module.
[ 1.488432] RPC: Registered udp transport module.
[ 1.488470] RPC: Registered tcp transport module.
[ 1.488504] RPC: Registered tcp NFSv4.1 backchannel transport module.
[ 1.490093] hw perfevents: no irqs for PMU, sampling events not supported
[ 1.490224] hw perfevents: enabled with armv6_1176 PMU driver, 3 counters available
[ 1.495480] Initialise system trusted keyrings
[ 1.496024] workingset: timestamp_bits=14 max_order=17 bucket_order=3
[ 1.513515] FS-Cache: Netfs 'nfs' registered for caching
[ 1.515232] NFS: Registering the id_resolver key type
[ 1.515349] Key type id_resolver registered
[ 1.515393] Key type id_legacy registered
[ 1.515475] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[ 1.517943] Key type asymmetric registered
[ 1.518018] Asymmetric key parser 'x509' registered
[ 1.518145] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 249)
[ 1.518202] io scheduler mq-deadline registered
[ 1.518242] io scheduler kyber registered
[ 1.522004] bcm2708_fb soc:fb: FB found 1 display(s)
[ 1.585093] Console: switching to colour frame buffer device 228x61
[ 1.619049] bcm2708_fb soc:fb: Registered framebuffer for display 0, size 1824x984
[ 1.628703] bcm2835-rng 20104000.rng: hwrng registered
[ 1.629689] vc-mem: phys_addr:0x00000000 mem_base=0x1ec00000 mem_size:0x20000000(512 MiB)
[ 1.631510] vc-sm: Videocore shared memory driver
[ 1.632925] gpiomem-bcm2835 20200000.gpiomem: Initialised: Registers at 0x20200000
[ 1.659078] brd: module loaded
[ 1.677756] loop: module loaded
[ 1.680472] Loading iSCSI transport class v2.0-870.
[ 1.682213] usbcore: registered new interface driver smsc95xx
[ 1.682520] dwc_otg: version 3.00a 10-AUG-2012 (platform bus)
[ 2.411802] Core Release: 2.80a
[ 2.412003] Setting default values for core params
[ 2.412249] Finished setting default values for core params
[ 2.481618] random: fast init done
[ 2.613446] Using Buffer DMA mode
[ 2.613633] Periodic Transfer Interrupt Enhancement - disabled
[ 2.613870] Multiprocessor Interrupt Enhancement - disabled
[ 2.614098] OTG VER PARAM: 0, OTG VER FLAG: 0
[ 2.614418] Dedicated Tx FIFOs mode
[ 2.615767] WARN::dwc_otg_hcd_init:1074: FIQ DMA bounce buffers: virt = d7d14000 dma = 0x57d140
00 len=9024
[ 2.616189] FIQ FSM acceleration enabled for :
Non-periodic Split Transactions
Periodic Split Transactions
High-Speed Isochronous Endpoints
Interrupt/Control Split Transaction hack enabled
[ 2.616953] dwc_otg: Microframe scheduler enabled
[ 2.617160] WARN::hcd_init_fiq:457: FIQ on core 0
[ 2.626452] WARN::hcd_init_fiq:458: FIQ ASM at c0569268 length 36
[ 2.635485] WARN::hcd_init_fiq:497: MPHI regs_base at dc810000
[ 2.644858] dwc_otg 20980000.usb: DWC OTG Controller
[ 2.653913] dwc_otg 20980000.usb: new USB bus registered, assigned bus number 1
[ 2.663422] dwc_otg 20980000.usb: irq 56, io mem 0x00000000
[ 2.672439] Init: Port Power? op_state=1
[ 2.681529] Init: Power Port (0)
[ 2.690933] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04
[ 2.700349] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 2.709388] usb usb1: Product: DWC OTG Controller
[ 2.718515] usb usb1: Manufacturer: Linux 5.4.51+ dwc_otg_hcd
[ 2.727859] usb usb1: SerialNumber: 20980000.usb
[ 2.738339] hub 1-0:1.0: USB hub found
[ 2.747954] hub 1-0:1.0: 1 port detected
[ 2.758541] dwc_otg: FIQ enabled
[ 2.758562] dwc_otg: NAK holdoff enabled
[ 2.758577] dwc_otg: FIQ split-transaction FSM enabled
[ 2.758606] Module dwc_common_port init
[ 2.759376] usbcore: registered new interface driver usb-storage
[ 2.769129] mousedev: PS/2 mouse device common for all mice
[ 2.780844] bcm2835-wdt bcm2835-wdt: Broadcom BCM2835 watchdog timer
[ 2.790489] bcm2835-cpufreq: min=700000 max=1000000
[ 2.801424] sdhci: Secure Digital Host Controller Interface driver
[ 2.810764] sdhci: Copyright(c) Pierre Ossman
[ 2.820955] mmc-bcm2835 20300000.mmcnr: could not get clk, deferring probe
[ 2.831818] sdhost-bcm2835 20202000.mmc: could not get clk, deferring probe
[ 2.841356] sdhci-pltfm: SDHCI platform and OF driver helper
[ 2.851746] ledtrig-cpu: registered to indicate activity on CPUs
[ 2.862216] hidraw: raw HID events driver (C) Jiri Kosina
[ 2.871565] usbcore: registered new interface driver usbhid
[ 2.880937] usbhid: USB HID core driver
[ 2.891569] vchiq: vchiq_init_state: slot_zero = (ptrval)
[ 2.903596] [vc_sm_connected_init]: start
[ 2.917362] [vc_sm_connected_init]: end - returning 0
[ 2.929942] Initializing XFRM netlink socket
[ 2.939051] NET: Registered protocol family 17
[ 2.948395] Key type dns_resolver registered
[ 2.958612] registered taskstats version 1
[ 2.967537] Loading compiled-in X.509 certificates
[ 2.976488] Indeed it is in host mode hprt0 = 00041901
[ 3.064922] uart-pl011 20201000.serial: cts_event_workaround enabled
[ 3.074040] 20201000.serial: ttyAMA0 at MMIO 0x20201000 (irq = 81, base_baud = 0) is a PL011 re
v2
[ 3.086633] bcm2835-power bcm2835-power: Broadcom BCM2835 power domains driver
[ 3.098876] mmc-bcm2835 20300000.mmcnr: mmc_debug:0 mmc_debug2:0
[ 3.107981] mmc-bcm2835 20300000.mmcnr: DMA channel allocated
[ 3.146596] sdhost: log_buf @ (ptrval) (57d13000)
[ 3.191763] usb 1-1: new low-speed USB device number 2 using dwc_otg
[ 3.201072] mmc1: queuing unknown CIS tuple 0x80 (2 bytes)
[ 3.212217] mmc1: queuing unknown CIS tuple 0x80 (3 bytes)
[ 3.221396] Indeed it is in host mode hprt0 = 00041901
[ 3.290829] mmc0: sdhost-bcm2835 loaded - DMA enabled (>1)
[ 3.304484] of_cfs_init
[ 3.314433] of_cfs_init: OK
[ 3.324272] mmc1: queuing unknown CIS tuple 0x80 (3 bytes)
[ 3.334703] Waiting for root device /dev/mmcblk0p7...
[ 3.367209] mmc1: queuing unknown CIS tuple 0x80 (7 bytes)
[ 3.443883] mmc0: host does not support reading read-only switch, assuming write-enable
[ 3.460050] mmc0: new high speed SDHC card at address e624
[ 3.472150] mmcblk0: mmc0:e624 SL16G 14.8 GiB
[ 3.493320] mmcblk0: p1 p2 < p5 p6 p7 >
[ 3.529392] EXT4-fs (mmcblk0p7): INFO: recovery required on readonly filesystem
[ 3.538642] EXT4-fs (mmcblk0p7): write access will be enabled during recovery
[ 3.555689] mmc1: new high speed SDIO card at address 0001
[ 3.565817] usb 1-1: New USB device found, idVendor=03f0, idProduct=034a, bcdDevice= 1.21
[ 3.575024] usb 1-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[ 3.584329] usb 1-1: Product: HP Elite USB Keyboard
[ 3.593573] usb 1-1: Manufacturer: Chicony
[ 3.633083] input: Chicony HP Elite USB Keyboard as /devices/platform/soc/20980000.usb/usb1/1-1
/1-1:1.0/0003:03F0:034A.0001/input/input0
[ 3.713138] hid-generic 0003:03F0:034A.0001: input,hidraw0: USB HID v1.10 Keyboard [Chicony HP
Elite USB Keyboard] on usb-20980000.usb-1/input0
[ 3.742013] input: Chicony HP Elite USB Keyboard System Control as /devices/platform/soc/209800
00.usb/usb1/1-1/1-1:1.1/0003:03F0:034A.0002/input/input1
[ 3.822299] input: Chicony HP Elite USB Keyboard Consumer Control as /devices/platform/soc/2098
0000.usb/usb1/1-1/1-1:1.1/0003:03F0:034A.0002/input/input2
[ 3.835600] hid-generic 0003:03F0:034A.0002: input,hidraw1: USB HID v1.10 Device [Chicony HP El
ite USB Keyboard] on usb-20980000.usb-1/input1
[ 4.286339] EXT4-fs (mmcblk0p7): recovery complete
[ 4.302781] EXT4-fs (mmcblk0p7): mounted filesystem with ordered data mode. Opts: (null)
[ 4.313976] VFS: Mounted root (ext4 filesystem) readonly on device 179:7.
[ 4.329097] devtmpfs: mounted
[ 4.347088] Freeing unused kernel memory: 492K
[ 4.357628] This architecture does not have kernel memory protection.
[ 4.368206] Run /sbin/init as init process
[ 5.221377] systemd[1]: System time before build time, advancing clock.
[ 5.414315] NET: Registered protocol family 10
[ 5.427984] Segment Routing with IPv6
[ 5.513268] systemd[1]: systemd 241 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMO
R +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +K
MOD -IDN2 +IDN -PCRE2 default-hierarchy=hybrid)
[ 5.537609] systemd[1]: Detected architecture arm.
[ 5.604424] systemd[1]: Set hostname to .
[ 9.290905] random: systemd: uninitialized urandom read (16 bytes read)
[ 9.347562] random: systemd: uninitialized urandom read (16 bytes read)
[ 9.361187] systemd[1]: Listening on Syslog Socket.
[ 9.387995] random: systemd: uninitialized urandom read (16 bytes read)
[ 9.406780] systemd[1]: Created slice system-openvpn.slice.
[ 9.434223] systemd[1]: Listening on fsck to fsckd communication Socket.
[ 9.461939] systemd[1]: Listening on udev Control Socket.
[ 9.489286] systemd[1]: Listening on Journal Socket.
[ 9.525050] systemd[1]: Mounting RPC Pipe File System...
[ 9.614025] systemd[1]: Starting Set the console keyboard layout...
[ 10.535876] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skip
ped.
[ 10.587163] systemd[1]: Listening on udev Kernel Socket.
[ 10.641405] i2c /dev entries driver
[ 10.714555] systemd[1]: Starting udev Coldplug all Devices...
[ 10.791874] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being s
kipped.
[ 10.845230] systemd[1]: Created slice User and Session Slice.
[ 10.915429] systemd[1]: Reached target Slices.
[ 11.034855] systemd[1]: Starting Journal Service...
[ 11.233170] systemd[1]: Mounting POSIX Message Queue File System...
[ 11.531343] systemd[1]: Mounted RPC Pipe File System.
[ 11.652663] systemd[1]: Mounted Kernel Debug File System.
[ 14.291919] EXT4-fs (mmcblk0p7): re-mounted. Opts: (null)
[ 15.279184] systemd-journald[93]: Received request to flush runtime journal from PID 1
[ 18.204284] vc_sm_cma: module is from the staging directory, the quality is unknown, you have b
een warned.
[ 18.223906] bcm2835_vc_sm_cma_probe: Videocore shared memory driver
[ 18.223966] [vc_sm_connected_init]: start
[ 18.272946] mc: Linux media interface: v0.10
[ 18.277426] [vc_sm_connected_init]: installed successfully
[ 18.532200] videodev: Linux video capture interface: v2.00
[ 18.585953] snd_bcm2835: module is from the staging directory, the quality is unknown, you have
been warned.
[ 18.638148] bcm2835_mmal_vchiq: module is from the staging directory, the quality is unknown, y
ou have been warned.
[ 18.652004] bcm2835_mmal_vchiq: module is from the staging directory, the quality is unknown, y
ou have been warned.
[ 18.657787] bcm2835_mmal_vchiq: module is from the staging directory, the quality is unknown, y
ou have been warned.
[ 18.690078] bcm2835_v4l2: module is from the staging directory, the quality is unknown, you hav
e been warned.
[ 18.703206] bcm2835_audio bcm2835_audio: card created with 4 channels
[ 18.710756] bcm2835_isp: module is from the staging directory, the quality is unknown, you have
been warned.
[ 18.735952] bcm2835_audio bcm2835_audio: card created with 4 channels
[ 18.751409] bcm2835_codec: module is from the staging directory, the quality is unknown, you ha
ve been warned.
[ 18.771940] bcm2835-isp bcm2835-isp: Device node output[0] registered as /dev/video13
[ 18.807274] bcm2835-isp bcm2835-isp: Device node capture[0] registered as /dev/video14
[ 18.815481] bcm2835-isp bcm2835-isp: Device node capture[1] registered as /dev/video15
[ 18.819377] bcm2835-isp bcm2835-isp: Device node stats[2] registered as /dev/video16
[ 18.819448] bcm2835-isp bcm2835-isp: Register output node 0 with media controller
[ 18.819517] bcm2835-isp bcm2835-isp: Register capture node 1 with media controller
[ 18.819553] bcm2835-isp bcm2835-isp: Register capture node 2 with media controller
[ 18.819585] bcm2835-isp bcm2835-isp: Register capture node 3 with media controller
[ 18.828909] bcm2835-isp bcm2835-isp: Loaded V4L2 bcm2835-isp
[ 18.852894] bcm2835-codec bcm2835-codec: Device registered as /dev/video10
[ 18.852990] bcm2835-codec bcm2835-codec: Loaded V4L2 decode
[ 18.871777] bcm2835-codec bcm2835-codec: Device registered as /dev/video11
[ 18.871894] bcm2835-codec bcm2835-codec: Loaded V4L2 encode
[ 18.943511] bcm2835-codec bcm2835-codec: Device registered as /dev/video12
[ 18.943606] bcm2835-codec bcm2835-codec: Loaded V4L2 isp
[ 21.526163] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[ 22.047088] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[ 22.782143] brcmfmac: F1 signature read @0x18000000=0x1541a9a6
[ 22.812172] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43430-sdio for chip BCM43430/1
[ 22.812765] usbcore: registered new interface driver brcmfmac
[ 22.839053] brcmfmac mmc1:0001:1: Direct firmware load for brcm/brcmfmac43430-sdio.raspberrypi,
model-zero-w.txt failed with error -2
[ 22.859993] random: crng init done
[ 22.860023] random: 7 urandom warning(s) missed due to ratelimiting
[ 23.138582] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43430-sdio for chip BCM43430/1
[ 23.138829] brcmfmac: brcmf_c_process_clm_blob: no clm_blob available (err=-2), device may have
limited channels available
[ 23.140319] brcmfmac: brcmf_c_preinit_dcmds: Firmware: BCM43430/1 wl0: Oct 22 2019 01:59:28 ver
sion 7.45.98.94 (r723000 CY) FWID 01-3b33decd
[ 35.248907] 8021q: 802.1Q VLAN Support v1.8
[ 36.032338] uart-pl011 20201000.serial: no DMA platform data
[ 38.148074] brcmfmac: brcmf_cfg80211_set_power_mgmt: power save enabled
[ 39.349738] Adding 102396k swap on /var/swap. Priority:-2 extents:1 across:102396k SSFS
[ 40.798921] IPv6: ADDRCONF(NETDEV_CHANGE): wlan0: link becomes ready
[ 40.893899] Bluetooth: Core ver 2.22
[ 40.894056] NET: Registered protocol family 31
[ 40.894071] Bluetooth: HCI device and connection manager initialized
[ 40.894109] Bluetooth: HCI socket layer initialized
[ 40.894130] Bluetooth: L2CAP socket layer initialized
[ 40.894178] Bluetooth: SCO socket layer initialized
[ 40.949264] Bluetooth: HCI UART driver ver 2.3
[ 40.949290] Bluetooth: HCI UART protocol H4 registered
[ 40.949429] Bluetooth: HCI UART protocol Three-wire (H5) registered
[ 40.949749] Bluetooth: HCI UART protocol Broadcom registered
[ 41.881778] tun: Universal TUN/TAP device driver, 1.6
[ 42.580672] ICMPv6: process `dhcpcd' is using deprecated sysctl (syscall) net.ipv6.neigh.wlan0.
retrans_time - use net.ipv6.neigh.wlan0.retrans_time_ms instead
[ 43.307686] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
[ 43.307706] Bluetooth: BNEP filters: protocol multicast
[ 43.307741] Bluetooth: BNEP socket layer initialized
[ 44.123017] Bluetooth: RFCOMM TTY layer initialized
[ 44.123065] Bluetooth: RFCOMM socket layer initialized
[ 44.123124] Bluetooth: RFCOMM ver 1.11
pi@raspi4z:~$

@mhano
Copy link
Author

mhano commented Feb 26, 2021

syslog of crash caused by writing 1GB files from /dev/urandom...

Feb 26 19:00:39 raspi4z systemd[1]: Started Session c7 of user pi.
Feb 26 19:06:49 raspi4z systemd[1]: Started Session c8 of user pi.
Feb 26 19:12:19 raspi4z kernel: [ 5322.086977] 8<--- cut here ---
Feb 26 19:12:19 raspi4z kernel: [ 5322.091703] Unable to handle kernel paging request at virtual address fadcf041
Feb 26 19:12:19 raspi4z kernel: [ 5322.096425] pgd = 9dd85b50
Feb 26 19:12:19 raspi4z kernel: [ 5322.100795] [fadcf041] *pgd=00000000
Feb 26 19:12:19 raspi4z kernel: [ 5322.105406] Internal error: Oops: 5 [#1] ARM
Feb 26 19:12:19 raspi4z kernel: [ 5322.109990] Modules linked in: binfmt_misc aes_arm aes_generic cmac rfcomm bnep tun hci_uart btbcm bluetooth ecdh_generic ecc libaes 8021q garp stp llc nft_counter nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack nf_defrag_ipv4 xt_comment nft_compat nf_tables nfnetlink evdev joydev brcmfmac brcmutil sha256_generic libsha256 cfg80211 rfkill raspberrypi_hwmon bcm2835_codec(C) bcm2835_isp(C) bcm2835_v4l2(C) v4l2_mem2mem bcm2835_mmal_vchiq(C) videobuf2_dma_contig snd_bcm2835(C) videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 videobuf2_common snd_pcm snd_timer snd videodev mc vc_sm_cma(C) uio_pdrv_genirq uio fixed i2c_dev ip_tables x_tables ipv6 nf_defrag_ipv6
Feb 26 19:12:19 raspi4z kernel: [ 5322.126404] CPU: 0 PID: 34 Comm: kswapd0 Tainted: G C 5.4.51+ #1333
Feb 26 19:12:19 raspi4z kernel: [ 5322.132041] Hardware name: BCM2835
Feb 26 19:12:19 raspi4z kernel: [ 5322.137834] PC is at shrink_page_list+0x688/0xfd4
Feb 26 19:12:19 raspi4z kernel: [ 5322.143721] LR is at 0x0
Feb 26 19:12:19 raspi4z kernel: [ 5322.149268] pc : [] lr : [<00000000>] psr: 60000013
Feb 26 19:12:19 raspi4z kernel: [ 5322.155279] sp : d7649cb8 ip : c0a473fc fp : d7649d64
Feb 26 19:12:19 raspi4z kernel: [ 5322.161245] r10: d7649f10 r9 : 00000000 r8 : d7649ce0
Feb 26 19:12:19 raspi4z kernel: [ 5322.166853] r7 : d7649d98 r6 : d7649d90 r5 : d78c7864 r4 : d78c7868
Feb 26 19:12:19 raspi4z kernel: [ 5322.172752] r3 : fadcf041 r2 : fadcf041 r1 : 00011eb0 r0 : 00000001
Feb 26 19:12:19 raspi4z kernel: [ 5322.178620] Flags: nZCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user
Feb 26 19:12:19 raspi4z kernel: [ 5322.184202] Control: 00c5387d Table: 16bac008 DAC: 00000055
Feb 26 19:12:19 raspi4z kernel: [ 5322.190060] Process kswapd0 (pid: 34, stack limit = 0x1b0e0147)
Feb 26 19:12:19 raspi4z kernel: [ 5322.195940] Stack: (0xd7649cb8 to 0xd764a000)
Feb 26 19:12:19 raspi4z kernel: [ 5322.201487] 9ca0: c0a47028 c0adee88
Feb 26 19:12:19 raspi4z kernel: [ 5322.207394] 9cc0: 00000000 00000007 00000000 d5705690 d5705690 00000001 c00148c0 0000355c
Feb 26 19:12:19 raspi4z kernel: [ 5322.213389] 9ce0: d7649ce0 d7649ce0 d78c7844 d78d5aac 00000000 d7649d00 c00135d0 c00148a8
Feb 26 19:12:19 raspi4z kernel: [ 5322.219158] 9d00: d7649d90 00000000 c0158074 d7649e84 d7649df0 c00d9878 c0b6a700 c015757c
Feb 26 19:12:19 raspi4z kernel: [ 5322.225258] 9d20: c0a60dfc c0158074 00000001 c0adf4b0 d7649d64 fadcf041 c00d9884 c0b6a700
Feb 26 19:12:19 raspi4z kernel: [ 5322.231298] 9d40: 00000020 d7649f10 c0adf518 00000001 c0adf4b0 d7649d90 d7649dec d7649d68
Feb 26 19:12:19 raspi4z kernel: [ 5322.237345] 9d60: c01575cc c0155c54 d7649d98 00000000 c059b8a8 00000000 c0768378 c0adf51c
Feb 26 19:12:19 raspi4z kernel: [ 5322.243629] 9d80: c0adf51c c0adee88 d7649dec 00000020 d795a208 d78c788c 00000000 00000000
Feb 26 19:12:19 raspi4z kernel: [ 5322.249688] 9da0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 fadcf041
Feb 26 19:12:19 raspi4z kernel: [ 5322.256100] 9dc0: d7649f10 00000002 d7649e1c 00000060 d7649f10 00000000 00000020 c0adf4b0
Feb 26 19:12:19 raspi4z kernel: [ 5322.262545] 9de0: d7649e84 d7649df0 c0158074 c01573ec ffffffff ffffffff 00000000 00000000
Feb 26 19:12:19 raspi4z kernel: [ 5322.268743] 9e00: d7649e40 00000003 0000330c 00001800 c0154b98 00000000 00000000 00000172
Feb 26 19:12:19 raspi4z kernel: [ 5322.275308] 9e20: 00000006 c0a65c64 00000000 00000000 000001f2 00000066 c0a65c64 00000000
Feb 26 19:12:19 raspi4z kernel: [ 5322.281759] 9e40: d7649e40 d7649e40 d7649e48 d7649e48 00000000 fadcf041 00000000 d7649f10
Feb 26 19:12:19 raspi4z kernel: [ 5322.288397] 9e60: 00000000 00000000 00000000 c0a47858 000001e7 c0adee88 d7649edc d7649e88
Feb 26 19:12:19 raspi4z kernel: [ 5322.295235] 9e80: c0158508 c0157ce0 d7649f04 d757e560 d7649eb4 d7649f2c d7649f48 00000000
Feb 26 19:12:19 raspi4z kernel: [ 5322.301893] 9ea0: 00000000 000001e7 00012c66 fadcf041 00000ab7 00001800 00000000 00000001
Feb 26 19:12:19 raspi4z kernel: [ 5322.308934] 9ec0: 00000001 00000000 c0adf4a8 c0adee88 d7649f7c d7649ee0 c01598d4 c015845c
Feb 26 19:12:19 raspi4z kernel: [ 5322.315784] 9ee0: d75bb900 00000000 00000000 d7649f1c 00000000 00000000 c0adf480 000001e7
Feb 26 19:12:19 raspi4z kernel: [ 5322.323008] 9f00: d7649f80 00000000 00000000 00000000 00001800 00000000 00000000 00070007
Feb 26 19:12:19 raspi4z kernel: [ 5322.330264] 9f20: 00000cc0 00000068 000001e7 00000000 00000000 00000000 00000000 00000000
Feb 26 19:12:19 raspi4z kernel: [ 5322.337229] 9f40: 00000060 00000060 00000001 fadcf041 c00433d0 d75fc980 d76083c0 00000000
Feb 26 19:12:19 raspi4z kernel: [ 5322.344536] 9f60: c0adee88 c015955c d74e1e18 d75fc998 d7649fac d7649f80 c0044134 c0159568
Feb 26 19:12:19 raspi4z kernel: [ 5322.351630] 9f80: ffffffff d76083c0 c0044018 00000000 00000000 00000000 00000000 00000000
Feb 26 19:12:19 raspi4z kernel: [ 5322.359078] 9fa0: 00000000 d7649fb0 c00090ac c0044024 00000000 00000000 00000000 00000000
Feb 26 19:12:19 raspi4z kernel: [ 5322.366248] 9fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Feb 26 19:12:19 raspi4z kernel: [ 5322.373718] 9fe0: 00000000 00000000 00000000 00000000 00000013 00000000 00000000 00000000
Feb 26 19:12:19 raspi4z kernel: [ 5322.381036] Backtrace:
Feb 26 19:12:19 raspi4z kernel: [ 5322.388265] [] (shrink_page_list) from [] (shrink_inactive_list+0x1ec/0x41c)
Feb 26 19:12:19 raspi4z kernel: [ 5322.395981] r10:d7649d90 r9:c0adf4b0 r8:00000001 r7:c0adf518 r6:d7649f10 r5:00000020
Feb 26 19:12:19 raspi4z kernel: [ 5322.403441] r4:c0b6a700
Feb 26 19:12:19 raspi4z kernel: [ 5322.411172] [] (shrink_inactive_list) from [] (shrink_node_memcg+0x3a0/0x77c)
Feb 26 19:12:19 raspi4z kernel: [ 5322.418871] r10:c0adf4b0 r9:00000020 r8:00000000 r7:d7649f10 r6:00000060 r5:d7649e1c
Feb 26 19:12:19 raspi4z kernel: [ 5322.426925] r4:00000002
Feb 26 19:12:19 raspi4z kernel: [ 5322.434617] [] (shrink_node_memcg) from [] (shrink_node+0xb8/0x520)
Feb 26 19:12:19 raspi4z kernel: [ 5322.442800] r10:c0adee88 r9:000001e7 r8:c0a47858 r7:00000000 r6:00000000 r5:00000000
Feb 26 19:12:19 raspi4z kernel: [ 5322.450673] r4:d7649f10
Feb 26 19:12:19 raspi4z kernel: [ 5322.458744] [] (shrink_node) from [] (kswapd+0x378/0x8dc)
Feb 26 19:12:19 raspi4z kernel: [ 5322.466696] r10:c0adee88 r9:c0adf4a8 r8:00000000 r7:00000001 r6:00000001 r5:00000000
Feb 26 19:12:19 raspi4z kernel: [ 5322.474987] r4:00001800
Feb 26 19:12:19 raspi4z kernel: [ 5322.482662] [] (kswapd) from [] (kthread+0x11c/0x154)
Feb 26 19:12:19 raspi4z kernel: [ 5322.490455] r10:d75fc998 r9:d74e1e18 r8:c015955c r7:c0adee88 r6:00000000 r5:d76083c0
Feb 26 19:12:19 raspi4z kernel: [ 5322.497882] r4:d75fc980
Feb 26 19:12:19 raspi4z kernel: [ 5322.504904] [] (kthread) from [] (ret_from_fork+0x14/0x28)
Feb 26 19:12:19 raspi4z kernel: [ 5322.512235] Exception stack(0xd7649fb0 to 0xd7649ff8)
Feb 26 19:12:19 raspi4z kernel: [ 5322.519296] 9fa0: 00000000 00000000 00000000 00000000
Feb 26 19:12:19 raspi4z kernel: [ 5322.526775] 9fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Feb 26 19:12:19 raspi4z kernel: [ 5322.533930] 9fe0: 00000000 00000000 00000000 00000000 00000013 00000000
Feb 26 19:12:19 raspi4z kernel: [ 5322.541304] r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c0044018
Feb 26 19:12:19 raspi4z kernel: [ 5322.548513] r4:d76083c0 r3:ffffffff
Feb 26 19:12:19 raspi4z kernel: [ 5322.555822] Code: e5943000 e3130001 12433001 01a03005 (e5933000)
Feb 26 19:12:19 raspi4z kernel: [ 5322.563290] ---[ end trace 410ca2b57413bd41 ]---
Feb 26 19:12:30 raspi4z kernel: [ 5333.252805] 8<--- cut here ---
Feb 26 19:12:30 raspi4z kernel: [ 5333.262296] Unable to handle kernel paging request at virtual address 6ef5e65b
Feb 26 19:12:30 raspi4z kernel: [ 5333.271501] pgd = 9dd85b50
Feb 26 19:12:30 raspi4z kernel: [ 5333.280802] [6ef5e65b] *pgd=00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.289795] Internal error: Oops: 5 [#2] ARM
Feb 26 19:12:30 raspi4z kernel: [ 5333.298509] Modules linked in: binfmt_misc aes_arm aes_generic cmac rfcomm bnep tun hci_uart btbcm bluetooth ecdh_generic ecc libaes 8021q garp stp llc nft_counter nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack nf_defrag_ipv4 xt_comment nft_compat nf_tables nfnetlink evdev joydev brcmfmac brcmutil sha256_generic libsha256 cfg80211 rfkill raspberrypi_hwmon bcm2835_codec(C) bcm2835_isp(C) bcm2835_v4l2(C) v4l2_mem2mem bcm2835_mmal_vchiq(C) videobuf2_dma_contig snd_bcm2835(C) videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 videobuf2_common snd_pcm snd_timer snd videodev mc vc_sm_cma(C) uio_pdrv_genirq uio fixed i2c_dev ip_tables x_tables ipv6 nf_defrag_ipv6
Feb 26 19:12:30 raspi4z kernel: [ 5333.327091] CPU: 0 PID: 11754 Comm: dd Tainted: G D C 5.4.51+ #1333
Feb 26 19:12:30 raspi4z kernel: [ 5333.336647] Hardware name: BCM2835
Feb 26 19:12:30 raspi4z kernel: [ 5333.346383] PC is at shrink_page_list+0x688/0xfd4
Feb 26 19:12:30 raspi4z kernel: [ 5333.355749] LR is at 0x0
Feb 26 19:12:30 raspi4z kernel: [ 5333.365112] pc : [] lr : [<00000000>] psr: 60000013
Feb 26 19:12:30 raspi4z kernel: [ 5333.374574] sp : d2f018f8 ip : c0a473fc fp : d2f019a4
Feb 26 19:12:30 raspi4z kernel: [ 5333.383751] r10: d2f01b80 r9 : 00000000 r8 : d2f01920
Feb 26 19:12:30 raspi4z kernel: [ 5333.393204] r7 : d2f019d8 r6 : d2f019d0 r5 : d7858630 r4 : d7858634
Feb 26 19:12:30 raspi4z kernel: [ 5333.402296] r3 : 6ef5e65b r2 : 6ef5e65b r1 : 0001583b r0 : 00000001
Feb 26 19:12:30 raspi4z kernel: [ 5333.411574] Flags: nZCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user
Feb 26 19:12:30 raspi4z kernel: [ 5333.420632] Control: 00c5387d Table: 16bac008 DAC: 00000055
Feb 26 19:12:30 raspi4z kernel: [ 5333.429910] Process dd (pid: 11754, stack limit = 0xb959454f)
Feb 26 19:12:30 raspi4z kernel: [ 5333.438814] Stack: (0xd2f018f8 to 0xd2f02000)
Feb 26 19:12:30 raspi4z kernel: [ 5333.447866] 18e0: c0a47028 c0adee88
Feb 26 19:12:30 raspi4z kernel: [ 5333.456855] 1900: 00000000 00000000 00000000 d5705690 d5705690 00000001 c00148c0 0000355c
Feb 26 19:12:30 raspi4z kernel: [ 5333.465716] 1920: d2f01920 d2f01920 d2f01928 d2f01928 00000000 d2f01940 c00135d0 c00148a8
Feb 26 19:12:30 raspi4z kernel: [ 5333.474869] 1940: d2f019d0 00000000 c0158074 d2f01ac4 d2f01a30 c00d9878 c0b6a700 c015757c
Feb 26 19:12:30 raspi4z kernel: [ 5333.483672] 1960: c0a60dfc c0158074 00000001 c0adf4b0 d2f019a4 6ef5e65b c00d9884 c0b6a700
Feb 26 19:12:30 raspi4z kernel: [ 5333.492754] 1980: 00000020 d2f01b80 c0adf518 00000001 c0adf4b0 d2f019d0 d2f01a2c d2f019a8
Feb 26 19:12:30 raspi4z kernel: [ 5333.501559] 19a0: c01575cc c0155c54 d2f019d8 00000000 00000001 d3f88000 d77ab540 c0adf51c
Feb 26 19:12:30 raspi4z kernel: [ 5333.510621] 19c0: c0adf51c c0adee88 d2f01a2c 00000020 d78fca10 d7858658 00000000 00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.519313] 19e0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 6ef5e65b
Feb 26 19:12:30 raspi4z kernel: [ 5333.528325] 1a00: d2f01b80 00000002 d2f01a5c 00000000 d2f01b80 00000000 00000020 c0adf4b0
Feb 26 19:12:30 raspi4z kernel: [ 5333.536941] 1a20: d2f01ac4 d2f01a30 c0158074 c01573ec ffffffff ffffffff 00000000 00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.545788] 1a40: d2f01a80 00000003 000033d9 00000020 c0154b98 00000000 00000000 00000006
Feb 26 19:12:30 raspi4z kernel: [ 5333.554350] 1a60: 00000006 c0a65c64 00000000 00000000 00000026 00000006 c0a65c64 00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.563120] 1a80: d2f01a80 d2f01a80 d2f01a88 d2f01a88 00000000 6ef5e65b 00000000 d2f01b80
Feb 26 19:12:30 raspi4z kernel: [ 5333.571565] 1aa0: 00000000 00000000 00000000 c0a47858 00000013 c0adee88 d2f01b1c d2f01ac8
Feb 26 19:12:30 raspi4z kernel: [ 5333.580335] 1ac0: c0158508 c0157ce0 d2f01b28 d757e560 9aad76d1 d2f01b9c d2f01bb8 00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.588754] 1ae0: 00000000 00000013 0001664a 6ef5e65b c0adf448 d2f01b80 c0adf448 c0adee88
Feb 26 19:12:30 raspi4z kernel: [ 5333.597390] 1b00: 00101cca 00000000 c0adf448 00000000 d2f01b5c d2f01b20 c0158a6 c015845c
Feb 26 19:12:30 raspi4z kernel: [ 5333.605809] 1b20: 0000000c d2f00000 00000000 6ef5e65b d6cf3c00 00101cca c0a47028 00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.614349] 1b40: c0adf448 00101cca c0adee88 c0adee88 d2f01bec d2f01b60 c0158ee0 c015897c
Feb 26 19:12:30 raspi4z kernel: [ 5333.622711] 1b60: d6c61838 00000001 c055f730 00000008 d2f01b9c d6c61800 ffffffff 00000044
Feb 26 19:12:30 raspi4z kernel: [ 5333.631195] 1b80: 00000020 00000000 00000000 010b0007 00101cca 00000001 00000013 00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.639540] 1ba0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 6ef5e65b
Feb 26 19:12:30 raspi4z kernel: [ 5333.647847] 1bc0: 00000000 00000200 00400000 00000400 c0a47730 00101cca 00000000 00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.656049] 1be0: d2f01cb4 d2f01bf0 c018daa8 c0158d48 c0a60dfc 00000000 d6c61800 00000002
Feb 26 19:12:30 raspi4z kernel: [ 5333.664314] 1c00: dc800520 001018ca 00000000 00101cca 00101cca 00000000 d2f01c40 00000001
Feb 26 19:12:30 raspi4z kernel: [ 5333.672370] 1c20: 00000000 00000001 000002c0 dc80052c 00000012 00101cca 000002c0 00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.680626] 1c40: 00000002 d6c61800 c0adf448 00000000 c0adf448 00000001 00000001 00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.688573] 1c60: d2f01cb4 d2f01c70 c013f5b4 c07654e4 00000001 d5705694 0002c226 00260000
Feb 26 19:12:30 raspi4z kernel: [ 5333.696743] 1c80: d73b6d10 6ef5e65b 00000000 00000000 00101cca d5705690 0002c226 c0a47028
Feb 26 19:12:30 raspi4z kernel: [ 5333.704625] 1ca0: c0a47950 0000000e d2f01cf4 d2f01cb8 c013fad0 c018d5b0 d2f01cd4 d2f01cc8
Feb 26 19:12:30 raspi4z kernel: [ 5333.712753] 1cc0: c052e63c 6ef5e65b c0a578c0 00001000 00000000 d2f01db8 d5705598 00001000
Feb 26 19:12:30 raspi4z kernel: [ 5333.720531] 1ce0: d5705690 c0a47028 d2f01d0c d2f01cf8 c013fc58 c013f8ec 00000000 00001000
Feb 26 19:12:30 raspi4z kernel: [ 5333.728639] 1d00: d2f01d84 d2f01d10 c027e268 c013fc3c 00000080 6ef5e65b 00001000 c01d4728
Feb 26 19:12:30 raspi4z kernel: [ 5333.736439] 1d20: 2c227000 00000000 d2f01d68 0002c226 00001000 00000000 d2f01db4 d3e57b40
Feb 26 19:12:30 raspi4z kernel: [ 5333.744519] 1d40: d2f01d9c d2f01d58 2c226000 00000000 00000000 6ef5e65b 200c25bb 00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.752302] 1d60: 00001000 d2f01ec0 d5705690 00001000 d3e57b40 c0780818 d2f01dec d2f01d88
Feb 26 19:12:30 raspi4z kernel: [ 5333.760368] 1d80: c013d5a8 c027e1a8 00001000 00000000 d2f01db4 d2f01db8 c01d47e0 d2f00000
Feb 26 19:12:30 raspi4z kernel: [ 5333.768205] 1da0: 00000000 d3e57b40 2c226000 00000000 6038ad6d 00000000 00000000 6ef5e65b
Feb 26 19:12:30 raspi4z kernel: [ 5333.776373] 1dc0: c0a60dfc 00000000 d2f01ed8 d5705690 c0a47028 00000000 d3e57b40 d2f01ec0
Feb 26 19:12:30 raspi4z kernel: [ 5333.784004] 1de0: d2f01e34 d2f01df0 c0143030 c013d4e8 d2f01e34 d2f01e00 c013d478 c013d328
Feb 26 19:12:30 raspi4z kernel: [ 5333.791678] 1e00: d2f01e08 c00d9844 00001000 d2f01ed8 d5705598 d2f01ec0 c0a47028 00001000
Feb 26 19:12:30 raspi4z kernel: [ 5333.798818] 1e20: d5705598 d5705614 d2f01eac d2f01e38 c0268d84 c0142ea8 d2f01e64 00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.805879] 1e40: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.813007] 1e60: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 6ef5e65b
Feb 26 19:12:30 raspi4z kernel: [ 5333.819808] 1e80: c007d420 d3e57b40 c0a47028 2c226000 00000000 d2f01f60 00001000 00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.826934] 1ea0: d2f01f2c d2f01eb0 c01b53f8 c0268bd8 00001000 ffffffff 01788000 00001000
Feb 26 19:12:30 raspi4z kernel: [ 5333.833778] 1ec0: 00000005 00000000 00001000 d2f01eb8 00000001 00000001 d3e57b40 00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.840915] 1ee0: 2c226000 00000000 00000000 d2f01e5c 00000000 00000000 00000000 00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.847938] 1f00: 7cff9f34 6ef5e65b 00001000 d3e57b40 01788000 d2f01f60 01788000 d2f00000
Feb 26 19:12:30 raspi4z kernel: [ 5333.854907] 1f20: d2f01f5c d2f01f30 c01b8098 c01b52c4 00000000 c01d82bc d2f01f5c d3e57b40
Feb 26 19:12:30 raspi4z kernel: [ 5333.862091] 1f40: d3e57b40 c0a47028 00001000 01788000 d2f01f94 d2f01f60 c01b8378 c01b7ff4
Feb 26 19:12:30 raspi4z kernel: [ 5333.869007] 1f60: 2c226000 00000000 d2f01fa4 6ef5e65b c00854f4 00000000 00001000 0002f1e0
Feb 26 19:12:30 raspi4z kernel: [ 5333.876203] 1f80: 00000004 c00091a4 d2f01fa4 d2f01f98 c01b8410 c01b8318 00000000 d2f01fa8
Feb 26 19:12:30 raspi4z kernel: [ 5333.883115] 1fa0: c0009000 c01b8404 00000000 00001000 00000001 01788000 00001000 00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.890341] 1fc0: 00000000 00001000 0002f1e0 00000004 00000000 00000001 00000000 0002f150
Feb 26 19:12:30 raspi4z kernel: [ 5333.897495] 1fe0: 0000006c be94f950 000145a4 b6e69944 60000010 00000001 00000000 00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.904387] Backtrace:
Feb 26 19:12:30 raspi4z kernel: [ 5333.911453] [] (shrink_page_list) from [] (shrink_inactive_list+0x1ec/0x41c)
Feb 26 19:12:30 raspi4z kernel: [ 5333.918409] r10:d2f019d0 r9:c0adf4b0 r8:00000001 r7:c0adf518 r6:d2f01b80 r5:00000020
Feb 26 19:12:30 raspi4z kernel: [ 5333.925650] r4:c0b6a700
Feb 26 19:12:30 raspi4z kernel: [ 5333.932512] [] (shrink_inactive_list) from [] (shrink_node_memcg+0x3a0/0x77c)
Feb 26 19:12:30 raspi4z kernel: [ 5333.939837] r10:c0adf4b0 r9:00000020 r8:00000000 r7:d2f01b80 r6:00000000 r5:d2f01a5c
Feb 26 19:12:30 raspi4z kernel: [ 5333.947156] r4:00000002
Feb 26 19:12:30 raspi4z kernel: [ 5333.954131] [] (shrink_node_memcg) from [] (shrink_node+0xb8/0x520)
Feb 26 19:12:30 raspi4z kernel: [ 5333.961562] r10:c0adee88 r9:00000013 r8:c0a47858 r7:00000000 r6:00000000 r5:00000000
Feb 26 19:12:30 raspi4z kernel: [ 5333.968728] r4:d2f01b80
Feb 26 19:12:30 raspi4z kernel: [ 5333.976107] [] (shrink_node) from [] (do_try_to_free_pages+0xf8/0x3cc)
Feb 26 19:12:30 raspi4z kernel: [ 5333.983377] r10:00000000 r9:c0adf448 r8:00000000 r7:00101cca r6:c0adee88 r5:c0adf448
Feb 26 19:12:30 raspi4z kernel: [ 5333.990916] r4:d2f01b80
Feb 26 19:12:30 raspi4z kernel: [ 5333.998242] [] (do_try_to_free_pages) from [] (try_to_free_pages+0x1a4/0x478)
Feb 26 19:12:30 raspi4z kernel: [ 5334.005738] r10:c0adee88 r9:c0adee88 r8:00101cca r7:c0adf448 r6:00000000 r5:c0a47028
Feb 26 19:12:30 raspi4z kernel: [ 5334.013369] r4:00101cca
Feb 26 19:12:30 raspi4z kernel: [ 5334.020663] [] (try_to_free_pages) from [] (__alloc_pages_nodemask+0x504/0xf6c)
Feb 26 19:12:30 raspi4z kernel: [ 5334.028430] r10:00000000 r9:00000000 r8:00101cca r7:c0a47730 r6:00000400 r5:00400000
Feb 26 19:12:30 raspi4z kernel: [ 5334.035884] r4:00000200
Feb 26 19:12:30 raspi4z kernel: [ 5334.043557] [] (__alloc_pages_nodemask) from [] (pagecache_get_page+0x1f0/0x350)
Feb 26 19:12:30 raspi4z kernel: [ 5334.051125] r10:0000000e r9:c0a47950 r8:c0a47028 r7:0002c226 r6:d5705690 r5:00101cca
Feb 26 19:12:30 raspi4z kernel: [ 5334.059048] r4:00000000
Feb 26 19:12:30 raspi4z kernel: [ 5334.066613] [] (pagecache_get_page) from [] (grab_cache_page_write_begin+0x28/0x3c)
Feb 26 19:12:30 raspi4z kernel: [ 5334.074688] r10:c0a47028 r9:d5705690 r8:00001000 r7:d5705598 r6:d2f01db8 r5:00000000
Feb 26 19:12:30 raspi4z kernel: [ 5334.082474] r4:00001000
Feb 26 19:12:30 raspi4z kernel: [ 5334.090503] [] (grab_cache_page_write_begin) from [] (ext4_da_write_begin+0xcc/0x450)
Feb 26 19:12:30 raspi4z kernel: [ 5334.098563] r4:00001000 r3:00000000
Feb 26 19:12:30 raspi4z kernel: [ 5334.106672] [] (ext4_da_write_begin) from [] (generic_perform_write+0xcc/0x1e0)
Feb 26 19:12:30 raspi4z kernel: [ 5334.114885] r10:c0780818 r9:d3e57b40 r8:00001000 r7:d5705690 r6:d2f01ec0 r5:00001000
Feb 26 19:12:30 raspi4z kernel: [ 5334.123099] r4:00000000
Feb 26 19:12:30 raspi4z kernel: [ 5334.131234] [] (generic_perform_write) from [] (__generic_file_write_iter+0x194/0x1f8)
Feb 26 19:12:30 raspi4z kernel: [ 5334.139512] r10:d2f01ec0 r9:d3e57b40 r8:00000000 r7:c0a47028 r6:d5705690 r5:d2f01ed8
Feb 26 19:12:30 raspi4z kernel: [ 5334.147860] r4:00000000
Feb 26 19:12:30 raspi4z kernel: [ 5334.156063] [] (__generic_file_write_iter) from [] (ext4_file_write_iter+0x1b8/0x420)
Feb 26 19:12:30 raspi4z kernel: [ 5334.164542] r10:d5705614 r9:d5705598 r8:00001000 r7:c0a47028 r6:d2f01ec0 r5:d5705598
Feb 26 19:12:30 raspi4z kernel: [ 5334.172947] r4:d2f01ed8
Feb 26 19:12:30 raspi4z kernel: [ 5334.181348] [] (ext4_file_write_iter) from [] (__vfs_write+0x140/0x1e0)
Feb 26 19:12:30 raspi4z kernel: [ 5334.189855] r10:00000000 r9:00001000 r8:d2f01f60 r7:00000000 r6:2c226000 r5:c0a47028
Feb 26 19:12:30 raspi4z kernel: [ 5334.198366] r4:d3e57b40
Feb 26 19:12:30 raspi4z kernel: [ 5334.206848] [] (__vfs_write) from [] (vfs_write+0xb0/0x1c8)
Feb 26 19:12:30 raspi4z kernel: [ 5334.215331] r9:d2f00000 r8:01788000 r7:d2f01f60 r6:01788000 r5:d3e57b40 r4:00001000
Feb 26 19:12:30 raspi4z kernel: [ 5334.224000] [] (vfs_write) from [] (ksys_write+0x6c/0xec)
Feb 26 19:12:30 raspi4z kernel: [ 5334.232454] r8:01788000 r7:00001000 r6:c0a47028 r5:d3e57b40 r4:d3e57b40
Feb 26 19:12:30 raspi4z kernel: [ 5334.241284] [] (ksys_write) from [] (sys_write+0x18/0x1c)
Feb 26 19:12:30 raspi4z kernel: [ 5334.249848] r8:c00091a4 r7:00000004 r6:0002f1e0 r5:00001000 r4:00000000
Feb 26 19:12:30 raspi4z kernel: [ 5334.258738] [] (sys_write) from [] (ret_fast_syscall+0x0/0x28)
Feb 26 19:12:30 raspi4z kernel: [ 5334.267339] Exception stack(0xd2f01fa8 to 0xd2f01ff0)
Feb 26 19:12:30 raspi4z kernel: [ 5334.276271] 1fa0: 00000000 00001000 00000001 01788000 00001000 00000000
Feb 26 19:12:30 raspi4z kernel: [ 5334.285008] 1fc0: 00000000 00001000 0002f1e0 00000004 00000000 00000001 00000000 0002f150
Feb 26 19:12:30 raspi4z kernel: [ 5334.294012] 1fe0: 0000006c be94f950 000145a4 b6e69944
Feb 26 19:12:30 raspi4z kernel: [ 5334.302641] Code: e5943000 e3130001 12433001 01a03005 (e5933000)
Feb 26 19:12:30 raspi4z kernel: [ 5334.311820] ---[ end trace 410ca2b57413bd42 ]---
Feb 26 19:15:48 raspi4z systemd[1]: Started Session c9 of user pi.

@mhano
Copy link
Author

mhano commented Mar 2, 2021

I’ll purchase another pi zero w board from a different supplier and try to confirm whether it’s a hardware issue specific to this board.

@mhano
Copy link
Author

mhano commented Mar 2, 2021

New board ordered - should arrive tomorrow.

almost certain this is a heat/hardware issue...

  • writing large files causes it to crash.
  • crashes during heavy workloads (big installs/upgrades)
  • downloading data to it doesn’t cause crashes (unless you write the downloaded data to file)
  • Uploading from it causes crashes (e.g.
    from another host run: ssh pi@raspi4z "timeout 3600 cat /dev/urandom | base64 -w 100" | pv | wc)
  • Uploading from it whilst the board is out of its case draped over a desk fan has not crashed it yet...

After performing the upload from it test which crashed it - upon removing it from its case, the board was warm - but not too hot to touch.

@popcornmix
Copy link
Collaborator

If it is a hardware issue then it may be worth trying either:

over_voltage=2

or

arm_freq=800

in config.txt. Maybe it is borderline reliable at 1000MHz and the extra heat pushes it over.

@mhano
Copy link
Author

mhano commented Mar 3, 2021

Thank you very much for suggestions..

Having clocked to 800 per suggestion above it took a lot longer to crash / needed to get a lot warmer. * update - at 800mhz I’ve only managed to cause it to crash once with this approach.

I was running the upload via ssh test (a few GBs) in parallel with the writing large files from urand.

will be interesting to see how I go with replacement board I’ve ordered.

Is there a way I should report this hardware issue or just return to the retailer?

@mhano
Copy link
Author

mhano commented Mar 4, 2021

Definitely a hardware issue.

No issue running the same tests on new board (with default cpu speed).

@mhano mhano closed this as completed Mar 4, 2021
@mhano
Copy link
Author

mhano commented Mar 5, 2021

Board appears physically fine.

155FA0EA-9A68-42C0-AB4F-45FCDE2D22FB

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants