You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
hi there!im trying to develop based on your fancy project,but i faced some questions
i wannder to figure out the GPU requirements to run your model, i think the raw llama13b is too heavy to combine this project with other applications,
Whether to provide quantized model operations to reduce the GPU burden?
thanks a lot in advance QAQ!
The text was updated successfully, but these errors were encountered:
hi there!im trying to develop based on your fancy project,but i faced some questions
i wannder to figure out the GPU requirements to run your model, i think the raw llama13b is too heavy to combine this project with other applications,
Whether to provide quantized model operations to reduce the GPU burden?
thanks a lot in advance QAQ!
The text was updated successfully, but these errors were encountered: