[OpenVINO] Use torch 2.4.0 and newer optimim version (vllm-project#9121)

Co-authored-by: DarkLight1337 <[email protected]> Signed-off-by: Alvant <[email protected]>
compressa-ai · Oct 26, 2024 · 4a6e7da · 4a6e7da
1 parent c325b93
commit 4a6e7da
Showing 1 changed file with 5 additions and 5 deletions.
diff --git a/requirements-openvino.txt b/requirements-openvino.txt
@@ -1,8 +1,8 @@
 # Common dependencies
 -r requirements-common.txt
 
-# OpenVINO dependencies
-torch >= 2.1.2
-openvino ~= 2024.4.0
-openvino-tokenizers[transformers] ~= 2024.4.0
-optimum-intel[openvino] >= 1.19.0
+torch == 2.4.0 #  should be aligned with "common" vLLM torch version
+openvino >= 2024.4.0 # since 2024.4.0 both CPU and GPU support Paged Attention
+
+optimum @ git+https://github.com/huggingface/optimum.git@main # latest optimum is used to support latest transformers version
+optimum-intel[nncf] @ git+https://github.com/huggingface/optimum-intel.git@main # latest optimum-intel is used to support latest transformers version