Skip to content

Issues: microsoft/DeepSpeedExamples

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

292 Open 251 Closed
292 Open 251 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Assertion srcIndex < srcSelectDimSize failed
#946 opened Dec 18, 2024 by boqiny
Question to attention computation
#944 opened Dec 15, 2024 by yuzhenmao
KV_cache offload
#943 opened Dec 15, 2024 by yuzhenmao
A bug in argument parser.
#941 opened Dec 10, 2024 by ChenDaiwei-99
How can I change the master_port when using deepspeed for multi-GPU on single node, i.e. localhost
#936 opened Nov 20, 2024 by lovedoubledan
4
Does DeepSpeed's Pipeline-Parallelism optimizer supports skip connections?
#932 opened Oct 17, 2024 by RoyMahlab
How to calculate training efficiency ,i.e tokens/sec of step 1 fine tuning of llama2 model ?
#923 opened Aug 29, 2024 by sowmya04101998
Actor loss nan and Resizing model embedding
#922 opened Aug 29, 2024 by ouyanmei
1
step2 without any response for a long time
#915 opened Aug 15, 2024 by asfadfaf
Different zero stage the training memory compute
#912 opened Jul 17, 2024 by Arcmoon-Hu
an error with gradient checkpointing in DeepspeedChat step 3
#908 opened Jun 28, 2024 by wangyuwen1999
@lekurile
单机多卡进行RLHF在第三步中使用Qwen模型作Actor Model报错
#907 opened Jun 25, 2024 by Dakai798
2
DeepSpeed-Chat step-1 hanging for a long time
#906 opened Jun 19, 2024 by lemon-little
CPU OOM when inferencing Llama3-70B-Chinese-Chat
#904 opened May 20, 2024 by GORGEOUSLCX
cannot pickle 'Stream' object
#903 opened May 17, 2024 by teis-e
can not run the test-gpt.sh because of assertionError
#902 opened May 16, 2024 by leachee99
请问fastgen 是否支持长文本和序列并行推理
#901 opened May 14, 2024 by AceCoder0
[Error] AutoTune: connect to host localhost port 22: Connection refused
#894 opened Apr 20, 2024 by wqw547243068
How to use deepspeed for multi-node and multi-card task in slurm cluster
#893 opened Apr 18, 2024 by dshwei
Does Zero-Inference support TP?
#892 opened Apr 16, 2024 by preminstrel
11
Deepspeed support finetune extra model with lora ?
#890 opened Apr 12, 2024 by wanghongqu
1
The actor constantly generates ['</s>'] or ['<|endoftext|></s>'] after 200 steps in RLHF with hybrid engine disabled
#887 opened Apr 9, 2024 by mousewu
1
About multiple-thread attention computation on CPU using zero-inference example.
#886 opened Apr 4, 2024 by luckyq
Suggested GPU to run the demo code of step2_reward_model_finetuning (DeepSpeed-Chat)
#885 opened Apr 4, 2024 by wenbozhangjs
[REQUEST] More fine-grained distributed strategies for RLHF training
#884 opened Apr 3, 2024 by krisx0101
ProTip! Mix and match filters to narrow down what you’re looking for.