System_prompt

[EvilSumrak2049]

Good afternoon, I noticed that the model works as if with a pre-configured system prompt, which cannot be changed in any way. Please tell me if there is an opportunity to change this system prompt.

[justheuristic]

Hi!
The python interface does not have a preconfigured system prompt, you can fully control which tokens are sent in.

You may be referring to https://chat.petals.dev/ , an example chat interface. There, you can fork the project
https://github.com/petals-infra/chat.petals.dev/
and change this line: https://github.com/petals-infra/chat.petals.dev/blob/main/templates/index.html#L66
(Or, if you have the bandwidth, implement custom prompts)