Skip to content

Commit

Permalink
Doc: update harness readme (#12324)
Browse files Browse the repository at this point in the history
  • Loading branch information
cranechu0131 authored Nov 4, 2024
1 parent 4644cb6 commit a01371f
Showing 1 changed file with 6 additions and 1 deletion.
7 changes: 6 additions & 1 deletion python/llm/dev/benchmark/harness/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -77,4 +77,9 @@ Please refer to these:

- [Security features from the Hugging Face datasets library · Issue #1135 · EleutherAI/lm-evaluation-harness (github.com)](https://github.com/EleutherAI/lm-evaluation-harness/issues/1135#issuecomment-1961928695)

You have to manually run `export HF_DATASETS_TRUST_REMOTE_CODE=1` to solve the problem.
You have to manually run `export HF_DATASETS_TRUST_REMOTE_CODE=1` to solve the problem.

### 3.Error: xe_addons.rotary_half_inplaced(self.rotary_emb.inv_freq, position_ids,RuntimeError: unsupported dtype, only fp32 and fp16 are supported.
This error is because `ipex-llm` currently only support models with `torch_dtype` of `fp16` or `fp32`.

You can add `--model_args dtype=float16` to your command to solve this problem.

0 comments on commit a01371f

Please sign in to comment.