Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Something strange with any non-english prompts with alpaca/gpt4all/vicuna #198

Open
4eJIoBek1 opened this issue Apr 4, 2023 · 1 comment

Comments

@4eJIoBek1
Copy link

When you try to chat with these on not english language, the answer will hallucinate and on english, but if you use file as prompt, everything works fine(picrelated). This is strange.
IMG_20230404_090641_914

pixelkaiser pushed a commit to pixelkaiser/gpt4all.cpp that referenced this issue Apr 4, 2023
* Add chatLLaMa script

* Fix shellcheck errors and do some cleanup

* Move chatLLaMa script to `examples` directory

* Reduce chatLLaMa context size to 2048

Ref d7def1a

* Include n_predict to 2048 in examples/chatLLaMa
@zakalaxRex
Copy link

Hi,
I see that you have vicuna installed and you run it with alpaca.cpp. I'm new with all of that and i would like to talk about the right way to use an other model with alpaca.cpp .
Thanks zakalaxRex.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants