[Bug] recent change of param "block_size_x/y, unroll" in dlight/gpu/matmul.py significantly decrease q4f16_1 prefill speed on android 8gen3 device #126
Triggered via issue
September 21, 2024 14:16
xuguodong1999
Status
Skipped
Total duration
3s
Artifacts
–