Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixed some tests run locally #1187

Merged
merged 1 commit into from
Nov 11, 2024
Merged

Conversation

ilya-lavrenov
Copy link
Contributor

Always tokenize as batch to return attention_mask to preserve the error:

The attention mask is not set and cannot be inferred from input because pad token is same as eos token. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.

@ilya-lavrenov ilya-lavrenov added this to the 2025.0 milestone Nov 11, 2024
@github-actions github-actions bot added category: LLM LLM pipeline (stateful, static) category: sampling Sampling / Decoding algorithms labels Nov 11, 2024
@Wovchena Wovchena enabled auto-merge November 11, 2024 11:08
@ilya-lavrenov ilya-lavrenov removed the category: sampling Sampling / Decoding algorithms label Nov 11, 2024
@ilya-lavrenov ilya-lavrenov merged commit f9c38cd into openvinotoolkit:master Nov 11, 2024
51 checks passed
@ilya-lavrenov ilya-lavrenov deleted the cb branch November 11, 2024 12:16
@ilya-lavrenov ilya-lavrenov added bug Something isn't working port to LTS PR needs to be ported to LTS labels Nov 11, 2024
ilya-lavrenov added a commit to ilya-lavrenov/openvino.genai that referenced this pull request Nov 20, 2024
Always tokenize as batch to return `attention_mask` to preserve the
error:
```
The attention mask is not set and cannot be inferred from input because pad token is same as eos token. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.
```
github-merge-queue bot pushed a commit that referenced this pull request Nov 21, 2024
@ilya-lavrenov ilya-lavrenov removed the port to LTS PR needs to be ported to LTS label Nov 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working category: LLM LLM pipeline (stateful, static)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants