Dev/v0.2 - Enable streaming support for openai v1.0.0b3

[Alvaromah]

Why are these changes needed?

The OpenAI API, along with other LLM frameworks, offers streaming capabilities that enhance debugging workflows by eliminating the need to wait for complete responses, resulting in a more efficient and time-saving process.

This is a simple mechanism to support streaming.
Tested on openai v1.0.0b3.

To enable streaming just use this code:

llm_config={
    "config_list": config_list,
    # Enable, disable streaming (defaults to False)
    "stream": True,
}

assistant = autogen.AssistantAgent(
    name="assistant",
    llm_config=llm_config,
)

Related issue number

Related to #465, #217

Checks

• I've included any doc changes needed for https://microsoft.github.io/autogen/. See https://microsoft.github.io/autogen/docs/Contribute#documentation to build and test documentation locally.
• I've added tests (if relevant) corresponding to the changes introduced in this PR.
• I've made sure all auto checks have passed.

[sonichi]

Let me find a few reviewers who are interested in streaming support. Feel free to invite if you know any.
Meanwhile, the structure looks good to me. It's a good time to add a test.

[sonichi]

Is this needed? I'd like to avoid modifying the original dict if not necessary.

[ragyabraham]

This works great for me. We've also managed to integrate it with #394 (see gif below).

Given that streaming is essentially a UX centric issue, it would probably make sense to open another PR to formally integrate streaming with some sort of messaging framework (e.g. sockets).

[ragyabraham]

LGTM

[pq-dong]

Are there any plans to merge into microsoft:dev/v0.2？
When to be merged into microsoft:dev/v0.2 ?

[sonichi]

Are there any plans to merge into microsoft:dev/v0.2？ When to be merged into microsoft:dev/v0.2 ?

After the conversation is resolved, and no further revision request from other reviewers.

[franciscoabenza]

@ragyabraham 🙏 Please please please, can you explain me how are you running the UI?/ is it part of your autogen branch?

[ragyabraham]

Hey @franciscoabenza yeah, this a web UI we are building for autogen. You can find it here

[sonichi]

dev/v0.2 is merged into main. Could you recreate the PR to target main? @Alvaromah

[Alvaromah]

dev/v0.2 is merged into main. Could you recreate the PR to target main? @Alvaromah

Sure! I will, as soon as possible.

[Alvaromah]

dev/v0.2 is merged into main. Could you recreate the PR to target main? @Alvaromah

Created PR #597 to target main.