IBM Granite
Release Plan for Instruction Templates Used in Evaluation? #2
-
|
Hello! I'm impressed with the promising results your model offers. Are there any plans to release specific instruction templates utilized for each instruction-tuned model in your experiments? Providing these templates would greatly assist researchers. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
For each instruction-tuned model, we used the specific prompt format mentioned in their HuggingFace model card to obtain the best results (as suggested by the corresponding model creators). We have added the following few sentences in Section 6.1.1 of our technical paper. In addition to make it clear, we will also add/release all the prompt templates used for evaluation in our GitHub repo very soon.
|
Beta Was this translation helpful? Give feedback.
For each instruction-tuned model, we used the specific prompt format mentioned in their HuggingFace model card to obtain the best results (as suggested by the corresponding model creators). We have added the following few sentences in Section 6.1.1 of our technical paper. In addition to make it clear, we will also add/release all the prompt templates used for evaluation in our GitHub repo very soon.
In constructing prompts for instruction-tuned models, we adhere to the formats provided in their official examples. We search for a suitable prompt format in the HuggingFace model card, GitHub repository, and formal publications or technical reports.