Enable Qlora scripts on Intel GPUs

[abhilash1910]

Motivation:

• Thanks for the qlora repo, this PR is for adding intel gpu support for quantized inference in the qlora script.
• There is an internal progress on B&B enabling for intel gpus which will make the support complete.

@artidoro could you please review . Would appreciate your thoughts on this. Thanks

[artidoro]

Thanks for the PR!

[abhilash1910]

@artidoro requesting re-review , let me know if any changes needed else can this be merged?

[artidoro]

So it looks good to me, however, I cannot test the code as I don't have an Intel GPU. Could you let me know how you verified that it works?
@TimDettmers do you have thoughts on adding this to the repo? It could be helpful to people using Intel GPUs and it seems relatively few changes.

[abhilash1910]

@artidoro @TimDettmers at Intel we are planning to integrate our kernel code for the quantization cu kernels . This is a work in progress internally and after validation I will flag a PR at b&b. The pythonic frontend (here) has relatively easier changes but the core of the task is in the kernel adaptation for our gpu devices which we are integrating.

[artidoro]

Sounds good! I am happy to merge this PR. Might be useful to add some documentation too.