StaticLLMPipeline: Enable chat test

[TolyaTalamanov]

No description provided.

[TolyaTalamanov]

Thanks!

[ilya-lavrenov]

https://github.com/openvinotoolkit/openvino.genai/actions/runs/11627421408/job/32383657944?pr=1117#step:9:870

[TolyaTalamanov]

Any idea why did this happen?

RuntimeError: Exception from src\inference\src\cpp\core.cpp:85:
Check 'util::directory_exists(path) || util::file_exists(path)' failed at src\frontends\common\src\frontend.cpp:117:
FrontEnd API failed with GeneralFailure:
ir: Could not open the file: "Qwen2-0.5B-Instruct\openvino_tokenizer.xml"

[Wovchena]

I don't have a solution to ir: Could not open the file: "Qwen2-0.5B-Instruct\openvino_tokenizer.xml"

[ilya-lavrenov]

it's not a model path, it's a model_id. E.g. from CI error we can see:

model_path = WindowsPath('Qwen2-0.5B-Instruct'), device = 'CPU'

which means model is not even converted by Optimum

In other places, it's used like:

    pipe = read_model(get_models_list()[0])[4]

where read model converts model and created pipe on to top it.

So, the question is - have you run tests locally? do they even magically pass?

[TolyaTalamanov]

get_chat_models_list() returns List[tuple(model_id, model_path)]
https://github.com/openvinotoolkit/openvino.genai/blob/master/tests/python_tests/ov_genai_test_utils.py#L106

I'd assume get_chat_models_list()[0][1] is the path of the first model, but probably I'm wrong... But at least for get_models_list() it works fine: https://github.com/openvinotoolkit/openvino.genai/blob/master/tests/python_tests/test_llm_pipeline_static.py#L37

Perhaps that problem is that I need to call read_model explicitly at least once, let me try it.

So, the question is - have you run tests locally? do they even magically pass?

I've used my own list of models available on local setup, so yes, I didn't check if this machinery works with default models