Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Doc] Update ipex-llm ollama troubleshooting for v0.4.6 #12642

Merged
merged 3 commits into from
Jan 2, 2025

Conversation

sgwhat
Copy link
Contributor

@sgwhat sgwhat commented Jan 2, 2025

Description

1. Why the change?

Update sycl-related troubleshootings.

2. User API changes

3. Summary of the change

@sgwhat sgwhat requested a review from rnwang04 January 2, 2025 08:51
@@ -227,3 +228,9 @@ If you meet this error, please check your Linux kernel version first. You may en

#### 8. Save GPU memory by specify `OLLAMA_NUM_PARALLEL=1`
If you have a limited GPU memory, use `set OLLAMA_NUM_PARALLEL=1` on Windows or `export OLLAMA_NUM_PARALLEL=1` on Linux before `ollama serve` to reduce GPU usage. The default `OLLAMA_NUM_PARALLEL` in ollama upstream is set to 4.

#### 9. `cannot open shared object file` error when executing `ollama serve`
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I feel it's a same issue as 3 ?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you just reuse 3 instead of creating a new one ? or maybe we just modify 3 ?

Copy link
Contributor Author

@sgwhat sgwhat Jan 2, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think these 2 errors have different manifestations and are specific to different versions, keeping section 3 could be helpful for users that are still running earlier versions.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please also update related Chinese version.

Copy link
Contributor

@rnwang04 rnwang04 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@sgwhat sgwhat merged commit 550fa01 into intel-analytics:main Jan 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants