Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bwc test #499

Closed
wants to merge 7 commits into from
Closed

Conversation

vibrantvarun
Copy link
Member

Description

[Describe what this change achieves]

Issues Resolved

[List any issues this PR will resolve]

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Commits are signed as per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Varun Jain <[email protected]>
Copy link
Member

@martin-gaievski martin-gaievski left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm curios did you test anything with deployed models? In ml-commons there is this feature of automatic model undeploy/deploy, problem with that is that model id changes, that was one of the reasons we deploy fresh model for each integ test. Same thing can happen when nodes or all cluster got upgraded or/and restarted

public static final float DELTA_FOR_SCORE_ASSERTION = 0.001f;
public static final String CLIENT_TIMEOUT_VALUE = "90s";
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think most of the constants that were moved here belong to exact integ test classes. In this shared util class we need to have something very generic and/or applicable to multiple tests, like NODES_BWC_CLUSTER or UPGRADED_CLUSTER.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some of the settings for ml-commons we're using for integ tests are not supported in earlier versions. we need be a mechanism to handle that, otherwise bwc may start fail if we add some new setting in future. Example is "plugins.ml_commons.allow_registering_model_via_url", added in 2.8

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants