Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is there a wiki for superbooga? #2085

Closed
1 task done
bbecausereasonss opened this issue May 15, 2023 · 3 comments
Closed
1 task done

Is there a wiki for superbooga? #2085

bbecausereasonss opened this issue May 15, 2023 · 3 comments
Labels
bug Something isn't working stale

Comments

@bbecausereasonss
Copy link

Describe the bug

Can't seem to get it to work.

Is there an existing issue for this?

  • I have searched the existing issues

Reproduction

Use superbooga

Screenshot

No response

Logs

Traceback (most recent call last):
  File "/home/perplexity/miniconda3/envs/textgen/lib/python3.10/site-packages/gradio/routes.py", line 395, in run_predict
    output = await app.get_blocks().process_api(
  File "/home/perplexity/miniconda3/envs/textgen/lib/python3.10/site-packages/gradio/blocks.py", line 1193, in process_api
    result = await self.call_function(
  File "/home/perplexity/miniconda3/envs/textgen/lib/python3.10/site-packages/gradio/blocks.py", line 930, in call_function
    prediction = await anyio.to_thread.run_sync(
  File "/home/perplexity/miniconda3/envs/textgen/lib/python3.10/site-packages/anyio/to_thread.py", line 31, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "/home/perplexity/miniconda3/envs/textgen/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
    return await future
  File "/home/perplexity/miniconda3/envs/textgen/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 867, in run
    result = context.run(func, *args)
  File "/home/perplexity/miniconda3/envs/textgen/lib/python3.10/site-packages/gradio/utils.py", line 491, in async_iteration
    return next(iterator)
  File "/home/perplexity/text-generation-webui/modules/chat.py", line 307, in generate_chat_reply_wrapper
    for history in generate_chat_reply(text, state, regenerate, _continue):
  File "/home/perplexity/text-generation-webui/modules/chat.py", line 301, in generate_chat_reply
    for history in chatbot_wrapper(text, state, regenerate=regenerate, _continue=_continue):
  File "/home/perplexity/text-generation-webui/modules/chat.py", line 193, in chatbot_wrapper
    stopping_strings = get_stopping_strings(state)
  File "/home/perplexity/text-generation-webui/modules/chat.py", line 128, in get_stopping_strings
    state['turn_template'].split('<|user-message|>')[1].split('<|bot|>')[0] + '<|bot|>',
IndexError: list index out of range

System Info

Chrome, Latest Win11, Latest Commit
@bbecausereasonss bbecausereasonss added the bug Something isn't working label May 15, 2023
@n00mkrad
Copy link

You need to load an instruct template (Alpaca should be fine for most models) to fix this.

Chat Settings -> Instruction template

I think there's a bug right now where this isn't saved/loaded by default, causing an error because the code tries to insert something into an empty template.

@github-actions github-actions bot added the stale label Jul 26, 2023
@github-actions
Copy link

This issue has been closed due to inactivity for 30 days. If you believe it is still relevant, please leave a comment below.

@truedat101
Copy link

This was extremely insightful in understanding how to use this feature: (the original concept pull request) #1548

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working stale
Projects
None yet
Development

No branches or pull requests

3 participants