-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Doc] Update ipex-llm ollama troubleshooting for v0.4.6 #12642
Conversation
@@ -227,3 +228,9 @@ If you meet this error, please check your Linux kernel version first. You may en | |||
|
|||
#### 8. Save GPU memory by specify `OLLAMA_NUM_PARALLEL=1` | |||
If you have a limited GPU memory, use `set OLLAMA_NUM_PARALLEL=1` on Windows or `export OLLAMA_NUM_PARALLEL=1` on Linux before `ollama serve` to reduce GPU usage. The default `OLLAMA_NUM_PARALLEL` in ollama upstream is set to 4. | |||
|
|||
#### 9. `cannot open shared object file` error when executing `ollama serve` |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I feel it's a same issue as 3 ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you just reuse 3 instead of creating a new one ? or maybe we just modify 3 ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think these 2 errors have different manifestations and are specific to different versions, keeping section 3 could be helpful for users that are still running earlier versions.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please also update related Chinese version.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Description
1. Why the change?
Update sycl-related troubleshootings.
2. User API changes
3. Summary of the change