Skip to content

Commit

Permalink
Merge pull request #16 from eltociear/patch-1
Browse files Browse the repository at this point in the history
docs: update README.md
  • Loading branch information
(Bill) Yuchen Lin authored Jun 28, 2024
2 parents e650f54 + de14d9e commit 15c706e
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -157,7 +157,7 @@ You should change the code to add these APIs, for example, gemini, cohere, claud
We suggest to use OpenAI's [Batch Mode](https://platform.openai.com/docs/guides/batch) for evaluation, which is faster, cheaper and more reliable.

You can:
- 1. Run `bash evaluation/run_all_eval_batch.sh ${MODEL_PRETTY_NAME}`to submmit the eval jobs.; Or if you only want to do scoring, running `bash evaluation/run_score_eval_batch.sh` to submmit the eval jobs for only doing the WB Score. (about $5 per model)
- 1. Run `bash evaluation/run_all_eval_batch.sh ${MODEL_PRETTY_NAME}`to submit the eval jobs.; Or if you only want to do scoring, running `bash evaluation/run_score_eval_batch.sh` to submit the eval jobs for only doing the WB Score. (about $5 per model)
- 2. Run `python src/openai_batch_eval/check_batch_status_with_model_name.py ${MODEL_PRETTY_NAME}` to track the status of the batch jobs.
- 3. Step 2 will download the results when batch jobs are finished, and then you can view the results (see next section).

Expand Down Expand Up @@ -395,4 +395,4 @@ python src/openai_batch_eval/check_batch_status_with_model_name.py Llama-3-8B-Op
python src/openai_batch_eval/check_batch_status_with_model_name.py Llama-3-8B-Ultrachat-200K
python src/openai_batch_eval/check_batch_status_with_model_name.py Llama-3-8B-WizardLM-196K
python src/openai_batch_eval/check_batch_status_with_model_name.py Llama-3-8B-ShareGPT-112K
-->
-->

0 comments on commit 15c706e

Please sign in to comment.