Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] fix NLP inference_config bwc serialization tests #89011

Conversation

benwtrent
Copy link
Member

@benwtrent benwtrent commented Aug 1, 2022

The tests were failing because of span not being nulled out for question_answering and text_similarity tasks.

But, this change also attempts to make it more future proof so that if changes occur to the nlp task or tokenization configurations it will cause a failure more quickly and require handling the bwc testing.

closes: #89008

@benwtrent benwtrent added >test Issues or PRs that are addressing/adding tests :ml Machine learning auto-backport-and-merge v8.4.0 v8.5.0 labels Aug 1, 2022
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/ml-core (Team:ML)

@elasticsearchmachine elasticsearchmachine added the Team:ML Meta label for the ML team label Aug 1, 2022
@dimitris-athanasiou
Copy link
Contributor

@benwtrent Could you please add in the description what was causing the test failures?

Copy link
Contributor

@dimitris-athanasiou dimitris-athanasiou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@benwtrent benwtrent merged commit 480479d into elastic:main Aug 2, 2022
@benwtrent benwtrent deleted the tests/ml-fix-bwc-serialization-nlpconfig-tests branch August 2, 2022 15:07
@elasticsearchmachine
Copy link
Collaborator

💔 Backport failed

Status Branch Result
8.4 Commit could not be cherrypicked due to conflicts

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 89011

@benwtrent
Copy link
Member Author

💚 All backports created successfully

Status Branch Result
8.4

Questions ?

Please refer to the Backport tool documentation

benwtrent added a commit to benwtrent/elasticsearch that referenced this pull request Aug 2, 2022
The tests were failing because of span not being nulled out for question_answering and text_similarity tasks.

But, this change also attempts to make it more future proof so that if changes occur to the nlp task or tokenization configurations it will cause a failure more quickly and require handling the bwc testing.

closes: elastic#89008
(cherry picked from commit 480479d)
elasticsearchmachine pushed a commit that referenced this pull request Aug 2, 2022
…89042)

* [ML] fix NLP inference_config bwc serialization tests (#89011)

The tests were failing because of span not being nulled out for question_answering and text_similarity tasks.

But, this change also attempts to make it more future proof so that if changes occur to the nlp task or tokenization configurations it will cause a failure more quickly and require handling the bwc testing.

closes: #89008
(cherry picked from commit 480479d)

* fixing backport
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:ml Machine learning Team:ML Meta label for the ML team >test Issues or PRs that are addressing/adding tests v8.4.0 v8.5.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[CI] TrainedModelConfigTests testBwcSerialization failing
3 participants