how to enable output streaming ?

[yonnic]

By default the API returns the whole message if its done processing which takes a while depending on length.
the chatGPT interface outputs the message in a stream which is possible in the api by proving the stream: true parameter in the body. I tried to add the parameter but the app breaks.

Any quick way to switch to streaming output ?

[kylebuildsstuff]

Sorry I missed this issue, but I don't think it's supported right now. The site just does a normal fetch and plops the response in the UI. I'm not exactly sure what would be needed to support streamed responses the app.