Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use predicted size of the message to expand message size #6523

Open
ariadesu opened this issue Nov 11, 2024 · 0 comments
Open

Use predicted size of the message to expand message size #6523

ariadesu opened this issue Nov 11, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@ariadesu
Copy link

In parameters, there's max new tokens, so you can reliably predict how long the message is going to be.
Reading while it's generating is hard because of the constant scrolling.
Other UIs often solve this by scrolling down such that the start of the new message is at the top of the screen, and it doesn't need to scroll as the message is generating until it reaches the bottom of the window. This approach means you can't read the history without scrolling back up. I imagine you've seen this approach and rejected it.

How about a compromise where the message is assumed to be the length of the max new tokens as soon as you hit enter, and then if it ends up being less than that, the message box can shrink.

@ariadesu ariadesu added the enhancement New feature or request label Nov 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant