Skip to content

Issues: OpenRLHF/OpenRLHF

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

43 Open 214 Closed
43 Open 214 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

请问我想将框架更改为支持PRM的多步训练，而不是ORM的单步训练，是否能实现，应该改哪些部分？
#464 opened Oct 16, 2024 by Gikiman
3
使用adam_offload后，训练完模型save_model时报错
#460 opened Oct 14, 2024 by pythonla
3
知识蒸馏结果复现
#456 opened Oct 7, 2024 by jinchenyu
@ifromeast
5
Can't save model
#454 opened Oct 7, 2024 by LZY-the-boys
3
questions on the training configuration
#452 opened Sep 30, 2024 by WayXG
1
Feature: Concurrent support of remote RM
#450 opened Sep 29, 2024 by catqaq
Lora merge error after dpo training with lora.
#436 opened Sep 11, 2024 by KaedinLian
1
Support for Token-Level Rewards?
#433 opened Sep 8, 2024 by pagepal666
5
Evaluate the PPO Process: Compatibility issues between DeepSpeed checkpoints and Transformers models
#426 opened Aug 20, 2024 by Ricardokevins
1
4卡4090 训练qwen2-7b-instruct时报错CUDA out of memory
#424 opened Aug 20, 2024 by SuiJiGuoChengSuiJiGuo
2
PPO训练overlap_comm打开会对训练表现造成很大影响
#423 opened Aug 20, 2024 by andylrx
1
Support RLOO
#371 opened Jul 19, 2024 by gohsyi
1
DPO后的模型推理出的结果都是无序符号
#366 opened Jul 18, 2024 by 2024WY
3
A worker died or was killed while executing a task by an unexpected system error.
#360 opened Jul 15, 2024 by lusongshuo-mt
4
会不会支持异步生成训练
#353 opened Jul 11, 2024 by syx11237744
1
How much memory(RAM) is required to train a 70B Llama2 model with two 80G A800 nodes?
#332 opened Jun 26, 2024 by luo-li-ba-suo
8
PPO加载完模型后卡在bundle_reservation_check_func这里
#331 opened Jun 24, 2024 by lixsh6
4
qwen2 72B PPO OOM
#329 opened Jun 20, 2024 by lixsh6
5
Generate function for distributional training
#324 opened Jun 8, 2024 by louieworth
2
可以增加支持SimPO吗
#311 opened May 29, 2024 by victorShawFan
3
Dummy token for prompts in HH datasets
#308 opened May 28, 2024 by louieworth
2
Will 2 x GPU setups be supported
#307 opened May 27, 2024 by llmlocal
1
使用Deepseek-lite训练DPO，显示expected mat1 and mat2 to have the same type, but got: float != c10: : BFLoat16
#306 opened May 27, 2024 by victorShawFan
3
Suggestion on the configurations
#304 opened May 23, 2024 by Ricardokevins
1
[Question] EOS in reward model dataset
#300 opened May 22, 2024 by qwenzo
4
ProTip! Type g i on any issue or pull request to go back to the issue listing page.