Support different multi-lora adapter?

[mzx987654]

hi,I would like to know if the Punica can support different Lora adapters, such as Lora of different ranks or different devices，thanks and hope for your response.

[jcao-ai]

As of different ranks, you can pad the rank to the largest supported.
For different devices, maybe need some further declaration.