From a01371f90b48cc35e90e243c0b8376e4692054e2 Mon Sep 17 00:00:00 2001 From: "Chu,Youcheng" <1340390339@qq.com> Date: Mon, 4 Nov 2024 14:58:54 +0800 Subject: [PATCH] Doc: update harness readme (#12324) --- python/llm/dev/benchmark/harness/README.md | 7 ++++++- 1 file changed, 6 insertions(+), 1 deletion(-) diff --git a/python/llm/dev/benchmark/harness/README.md b/python/llm/dev/benchmark/harness/README.md index 4c1ba420e5c..69a7820999c 100644 --- a/python/llm/dev/benchmark/harness/README.md +++ b/python/llm/dev/benchmark/harness/README.md @@ -77,4 +77,9 @@ Please refer to these: - [Security features from the Hugging Face datasets library · Issue #1135 · EleutherAI/lm-evaluation-harness (github.com)](https://github.com/EleutherAI/lm-evaluation-harness/issues/1135#issuecomment-1961928695) -You have to manually run `export HF_DATASETS_TRUST_REMOTE_CODE=1` to solve the problem. \ No newline at end of file +You have to manually run `export HF_DATASETS_TRUST_REMOTE_CODE=1` to solve the problem. + +### 3.Error: xe_addons.rotary_half_inplaced(self.rotary_emb.inv_freq, position_ids,RuntimeError: unsupported dtype, only fp32 and fp16 are supported. +This error is because `ipex-llm` currently only support models with `torch_dtype` of `fp16` or `fp32`. + +You can add `--model_args dtype=float16` to your command to solve this problem. \ No newline at end of file