[feature] Loras support for SD and Flux models

[tsubasakong]

For HF Diffusers, it supports Loras (https://huggingface.co/docs/diffusers/tutorials/using_peft_for_inference)
And Flux Lora, see this example for ComfyUI (https://huggingface.co/XLabs-AI/flux-RealismLora)

[feifeibear]

We are looking for contributions to LoRA on Flux.
Currently, the top priority for the maintainer of xDiT is to improve the scalability of parallel Flux inference.

[feifeibear]

We have also realized the importance of LoRA + ComfyUI for the Diffusion Model community. We are currently developing corresponding solutions and look forward to collaborating with the community to build this initiative together.