Bug Fix while training using SFTTrainer with DataCollatorForCompletio…

…nOnlyLM (huggingface#1861) * Bug Fix while training using SFTTrainer with DataCollatorForCompletionOnlyLM Added ```dataset_text_field``` in the SFTConfig while training * Update docs/source/sft_trainer.mdx --------- Co-authored-by: Kashif Rasul <[email protected]>
claralp · Jul 28, 2024 · 4f043bc · 4f043bc
1 parent a4272ce
commit 4f043bc
Showing 1 changed file with 4 additions and 1 deletion.
diff --git a/docs/source/sft_trainer.mdx b/docs/source/sft_trainer.mdx
@@ -110,7 +110,10 @@ collator = DataCollatorForCompletionOnlyLM(instruction_template=instruction_temp
 
 trainer = SFTTrainer(
     model,
-    args=SFTConfig(output_dir="/tmp"),
+    args=SFTConfig(
+        output_dir="/tmp",
+        dataset_text_field = "text",
+    ),
     train_dataset=dataset,
     data_collator=collator,
 )