New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support streaming in DeepSpeed MII truss #66

Merged

ttim merged 2 commits into main from tabishev/deepspeed_streaming

Nov 10, 2023

Contributor

ttim commented Nov 10, 2023

I've added couple of improvements to DeepSpeed MII:

Support streaming output
Do not base it on custom image since newer image was released so it's not needed
Ignore mii.serve exceptions in draft mode to improve dev workflow


          support stream use case

4cb5db9

ttim requested a review from pankajroark

November 10, 2023 23:06


          apply isort

ba8b77b

pankajroark approved these changes

View reviewed changes

ttim merged commit 06bd8f1 into main

1 check passed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet