Delayed interactions since librespot 0.4

[honza]

I'm using Fedora 41. Stable rust to compile myself.

My config is simple:

[global]
device_name = "..."
device = "front:CARD=Generic_1,DEV=0"
zeroconf_port = 1234

Since f53deb9, starting/stopping playback, changing songs, and changing volume takes a long time. Volume especially (I change the volume on my phone and it takes 10s to react on the server where before it's instant).

I tried updating librespot to 0.4.2 and even trying @davidgauch librespot 0.5 PR #1309 and those are unchanged.

What can I do to debug this?