[feature] Add test code for each algorithms

[YujiOshima]

There is no test code for each suggestion and early stop algorithms.
We need to test the algorithms will work as expected.

[lluunn]

Does it mean adding unit test, like grid_service_test.go, in https://github.com/kubeflow/katib/tree/master/pkg/suggestion?

[jlewi]

/area 0.4.0

[jlewi]

Should we split this issue up into multiple issues?

[garganubhav]

@jlewi @YujiOshima is someone already doing this, or I should start working on this?

[YujiOshima]

@garganubhav Thanks. My colleague is working on random, grid, and hyperband.
I'm so happy if you try to add tests to the Bayesian opt algorithm,

[jlewi]

@garganubhav @YujiOshima per my comment above can we file individual issues for adding tests for specific algorithms and assign them to individual owners?

[garganubhav]

@jlewi ok. I will file for Bayesian opt algorithm and work on it.

[jlewi]

@garganubhav any progress? Did you open up an issue for Bayesian optimization?

[garganubhav]

yes, working on it

[jlewi]

@garganubhav Any update on this? What is the remaining work? Do we have an estimate for when it will be completed? Should we move this issue to 0.5 at this point?

[jlewi]

@garganubhav @johnugeorge @YujiOshima @gaocegege

What's the current status of this issue?

It looks like there is #230 for a test for bayesian optimization. Can we close out this issue since that issue exists?

/cc @richardsliu

[jlewi]

@garganubhav @johnugeorge @YujiOshima @gaocegege Ping?

[gaocegege]

We do not have sufficient test coverage for algos, IMO. And it is hard to import tools to show the coverage since we allow different languages to write suggestions.

[jdplatt]

Can we close this now #406 is merged? What is the status of the e2e tests of the algorithms that use https://github.com/kubeflow/katib/blob/master/test/e2e/test-client.go.

[johnugeorge]

Closing this as #406 is merged. Moving algorithms to Python is tracked in #407

/close

[k8s-ci-robot]

@johnugeorge: Closing this issue.

In response to this:

Closing this as #406 is merged. Moving algorithms to Python is tracked in #407

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.