Study controller - Running HP Jobs without writing code

[YujiOshima]

I open PR #86
This is for study controller.
Currently, we need to write some code to use Katib in any case.
I want to make users don't need to write any code In a typical usecase,
The study controller is the implementation of logic for how to call services, run worker, and save models.
This is a POC of the study controller https://github.com/YujiOshima/hp-tuning/blob/51d456da58f2a77648290c175491e0692e0f3d4c/pkg/manager/studycontroller/defaultcontroller.go

In this PR, default study controller request all suggestions at first.
It is not suitable for Bayse Opt or Hyperband since they need to call GetSuggestions several time.
I implement study controller as a go process, but it can separate as a service like the suggestion and the earlystopping.

WDYT? @gaocegege @ddysher @libbyandhelen

[YujiOshima]

@gaocegege @ddysher @libbyandhelen
I drow an overview of Katib API and resources.
https://docs.google.com/presentation/d/1KEA5vTmpDCDUl_zvnlYq2Fc0yIshzwfW6Tb8t4Zmrt0/edit?usp=sharing
Feel free to comment or edit it!

[gaocegege]

Sorry for the late reply. These days I am working one tf-operator 0.2 release thus no time to sync katib. I will take a look in two hours.

[jlewi]

@YujiOshima can you provide an update please? Do you think that by mid September people will be able to submit HP jobs without having to write any code?

I see that:

#141 containing the initial CRD was merged

#152 is open to do some additional refactoring

[jlewi]

@YujiOshima How are we looking for 0.3.0? Where will we be after the next two weeks since we would like to cut 0.3.0 then.

[jlewi]

@YujiOshima What is the status of this issue?

[YujiOshima]

@jlewi Sorry for the late reply.
I have several issues with StudyjobController #165 #166 .
I fixed them in this PR #170 .
I think we can close this since StudyjobController is stable now.

TF-Job or other frameworks will be supported in next release.