[OpenVINO] Use torch 2.4.0 and newer optimim version (vllm-project#9121)

Co-authored-by: DarkLight1337 <[email protected]> Signed-off-by: Sumit Dubey <[email protected]>
sumitd2 · Nov 14, 2024 · 5af3b76 · 5af3b76
1 parent 225d755
commit 5af3b76
Showing 1 changed file with 5 additions and 5 deletions.
diff --git a/requirements-openvino.txt b/requirements-openvino.txt
@@ -1,8 +1,8 @@
 # Common dependencies
 -r requirements-common.txt
 
-# OpenVINO dependencies
-torch >= 2.1.2
-openvino ~= 2024.4.0
-openvino-tokenizers[transformers] ~= 2024.4.0
-optimum-intel[openvino] >= 1.19.0
+torch == 2.4.0 #  should be aligned with "common" vLLM torch version
+openvino >= 2024.4.0 # since 2024.4.0 both CPU and GPU support Paged Attention
+
+optimum @ git+https://github.com/huggingface/optimum.git@main # latest optimum is used to support latest transformers version
+optimum-intel[nncf] @ git+https://github.com/huggingface/optimum-intel.git@main # latest optimum-intel is used to support latest transformers version