Support Deepspeed to reduce RAM
how to run:
accelerate launch --config_file=dp_z2.yaml --gradient_accumulation_steps 4 trl_ft_chatmode.py
-
Notifications
You must be signed in to change notification settings - Fork 1
hellangleZ/TRL_chat_mode_FT_LLAMA3-with-Deepspeed
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|