This repository has been archived by the owner on Jun 24, 2024. It is now read-only.

Replying to messages to continue generation #11

Open

philpax opened this issue Jun 19, 2023 · 0 comments

Collaborator

philpax commented Jun 19, 2023

You should be able to reply to generated text to insert new text into a generation. This should have an optional prefix for chat mode.

It should keep a few sessions in memory in a LRU cache. Sessions not in memory are replayed with a progress indicator.

philpax mentioned this issue

Add Embed message and increase the MESSAGE_CHUNK_SIZE to 4096 #20

Closed

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.