Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: update readme for ppl test #11865

Merged
merged 12 commits into from
Aug 20, 2024
Merged

feat: update readme for ppl test #11865

merged 12 commits into from
Aug 20, 2024

Conversation

cranechu0131
Copy link
Contributor

update readme for ppl test

python/llm/dev/benchmark/perplexity/README.md Outdated Show resolved Hide resolved
python/llm/dev/benchmark/perplexity/README.md Outdated Show resolved Hide resolved
python/llm/dev/benchmark/perplexity/README.md Outdated Show resolved Hide resolved
python/llm/dev/benchmark/perplexity/README.md Show resolved Hide resolved
python/llm/dev/benchmark/perplexity/README.md Outdated Show resolved Hide resolved
python/llm/dev/benchmark/perplexity/README.md Outdated Show resolved Hide resolved
python/llm/dev/benchmark/perplexity/README.md Outdated Show resolved Hide resolved
python/llm/dev/benchmark/perplexity/README.md Outdated Show resolved Hide resolved
python/llm/dev/benchmark/perplexity/README.md Show resolved Hide resolved
sgwhat and others added 8 commits August 20, 2024 19:19
* add ipex-llm npu release

* update example doc

* meet latest release changes
* Update default transformers version to 4.37.0

* Add dependency requirements for qwen and qwen-vl

* Temp fix transformers version for these not yet verified models

* Skip qwen test in UT for now as it requires transformers<4.37.0
….0` (#11869)

* Update igpu performance from transformers 4.36.2 to 4.37.0 (#11841)

* upgrade arc perf test to transformers 4.37 (#11842)

* fix load low bit com dtype (#11832)

* feat: add mixed_precision argument on ppl longbench evaluation

* fix: delete extra code

* feat: upgrade arc perf test to transformers 4.37

* fix: add missing codes

* fix: keep perf test for qwen-vl-chat in transformers 4.36

* fix: remove extra space

* fix: resolve pr comment

* fix: add empty line

* fix: add pip install for spr and core test

* fix: delete extra comments

* fix: remove python -m for pip

* Revert "fix load low bit com dtype (#11832)"

This reverts commit 6841a9a.

---------

Co-authored-by: Zhao Changmin <[email protected]>
Co-authored-by: Jinhe Tang <[email protected]>

* add transformers==4.36 for qwen vl in igpu-perf (#11846)

* add transformers==4.36.2 for qwen-vl

* Small update

---------

Co-authored-by: Yuwen Hu <[email protected]>

* fix: remove qwen-7b on core test (#11851)

* fix: remove qwen-7b on core test

* fix: change delete to comment

---------

Co-authored-by: Jinhe Tang <[email protected]>

* replce filename (#11854)

* fix: remove qwen-7b on core test

* fix: change delete to comment

* fix: replace filename

---------

Co-authored-by: Jinhe Tang <[email protected]>

* fix: delete extra comments (#11863)

* Remove transformers installation for temp test purposes

* Small fix

* Small update

---------

Co-authored-by: Chu,Youcheng <[email protected]>
Co-authored-by: Zhao Changmin <[email protected]>
Co-authored-by: Jinhe Tang <[email protected]>
Co-authored-by: Zijie Li <[email protected]>
Co-authored-by: Chu,Youcheng <[email protected]>
* yi sync

* delete 4.34 constraint

* delete 4.34 constraint

* delete 4.31 constraint

* delete 4.34 constraint

* delete 4.35 constraint

* added <=4.33.3 constraint

* added <=4.33.3 constraint

* switched to chinese prompt
@cranechu0131 cranechu0131 reopened this Aug 20, 2024
@hkvision hkvision merged commit 32f0a77 into intel-analytics:main Aug 20, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants