Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updated-UI, Continuous Chat, Setting Profiles, Streaming Response and more. #152

Merged
merged 153 commits into from
Jun 9, 2023

Conversation

Webifi
Copy link
Contributor

@Webifi Webifi commented Jun 3, 2023

Let's see if this one gets through the gates:

Refactored a bunch of code while adding new features including:

  • Continuous chat via First-In-First-Out or Auto-summarize, keeping chats going before hitting the token limit.
  • Setting profiles + export/import/clone (Only three static starter profiles for now)
  • Ability to use system prompt
  • Streaming responses (based on pull request Added wrapper to allow word-by-word chat stream responses #107.)
  • New settings to manage the above
  • Clone chats
  • Import/Export chats
  • Settings saved per chat (plus profiles)
  • To have a more robust selection, most icons were changed from emojis/unicode to font awesome.
  • Consolidated some of the chat option (delete, clone, clear, plus new ones, into a 3-dot menu in the upper right)
  • Added running total for tokens used for entire chat session. (See how much your entire chat session is costing you.)
  • logit_bias can be manually added to setting profiles, and they work, but no UI for it yet.
  • Updated UI to work more like official ChatGPT
  • Many other UI fixes and enhancements and under-the-hood changes.

For "profiles", while the ability the create a character for each by setting the system prompt is part of it, the main focus of the profiles are to have different setting profiles independent of the chat sessions. So all settings are now stored and recalled with the chat session, and then also can be saved to custom "profiles", one of which can be selected as the default for new chat sessions. More/better example static profiles should be added. The can be exported, imported using the new 3-dot menu in the settings dialog, allowing profiles to be easily shared.

For auto-summarization / FIFO, there are new settings in the chat setting modal; to enable it, the threshold for when it triggers, how many tokens it will try to summarize down to, how many prompts at the top and bottom should try to be preserved during the process, and the prompt used to generate the summary. Once messages are summarized, they will be displayed slightly translucently, will no longer be editable or removeable. The completion they were boiled down to will be displayed below them. FIFO messages are simply hidden from future submissions.

For deleting/editing past messages/prompts, currently a tool drawer will appear on hover with different options depending on the message state. For editing messages, just double click or double tap the the message. You can hide message from future ends with the eye icon, and can truncate all message from the one you're editing and send with the paper plane icon.

Some of the issues addressed:
#121, #113 #29 #3 #27 (simply delete the last message and hit the send button to regenerate) #16 (eye icon) #85 #7 (system prompts) #115 #14 #140 #70 #110 #131

Known issues:

  • No real integration of the existing prompt DB into the new UI and profiles.

Plenty more to do.

Demo Here:
https://webifi.github.io/ChatGPT-Web-Updated-UI/

@Niek
Copy link
Owner

Niek commented Jun 9, 2023

I don't see any more issues - if you give me the OK @Webifi I'll merge this.

@Webifi
Copy link
Contributor Author

Webifi commented Jun 9, 2023

Go for it.

@Niek Niek merged commit 1d24c76 into Niek:main Jun 9, 2023
@Niek
Copy link
Owner

Niek commented Jun 9, 2023

@all-contributors please add @Webifi for code and ideas

@allcontributors
Copy link
Contributor

@Niek

I've put up a pull request to add @Webifi! 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants