Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clean up Feast configuration #611

Merged
merged 17 commits into from
Apr 16, 2020
Merged

Clean up Feast configuration #611

merged 17 commits into from
Apr 16, 2020

Conversation

woop
Copy link
Member

@woop woop commented Apr 11, 2020

What this PR does / why we need it:

This PR is meant to resolve #525 and should be merged on only after the #567 and #533 PRs have been merged in.

The major changes will be that it will restructure and clean up Feast configuration properties in order for developers to find it easier to configure a Feast deployment and easier to know when it is misconfigured.

Additionally I am attempting to create a consistent way to instantiate and configure stores.

Which issue(s) this PR fixes:

Fixes #525

Does this PR introduce a user-facing change?:

Both Feast Serving and Feast Core have breaking changes to the structure of their application.yml files.

@feast-ci-bot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: woop

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@woop
Copy link
Member Author

woop commented Apr 14, 2020

Still to do: Need to make all keys in application.yml use a consistent separator _ vs -

active_store: online

# List of store configurations
stores:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As there are several changes in configurations, should this still be ported into v0.4 branch? On the other hand, if we don't port this, any PR that follows after this PR is merged will have a much higher chance of conflicting with the v0.4 branch.

Copy link
Member Author

@woop woop Apr 15, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are loads of breaking changes. If we backport this then we will have a lot of problems.

any PR that follows after this PR is merged will have a much higher chance of conflicting with the v0.4 branch

That is true, but that is why we maintain a separate branch for 0.4. We should ideally move on from 0.4 because the amount of changes is high and its not worth the upkeep.

Copy link
Collaborator

@khorshuheng khorshuheng Apr 15, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree that we should move on from 0.4. But in that case, do we still want to release 0.4.8? And if we do, what should be the last commit that we should stop at? Storage API refactoring, or possibly earlier?

Copy link
Member Author

@woop woop Apr 15, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The point is that we dont backport anything significant. Only critical functionality like hotfixes or patches should be backported. Otherwise there is no point in having releases if we just backport everything.

@woop woop changed the title [WIP] Clean up Feast configuration Clean up Feast configuration Apr 15, 2020
woop added 16 commits April 16, 2020 14:14
    Refactor, document, and validate Feast Core Properties

    Refactor FeastProperties to support nested store configuration

    Localize all store configuration in Serving in Spring configuration

    Various configuration updates
    * Allow Feast Serving to use types properties instead of maps
    * Reuse Feast Core Store model in serving
    * Remove redundant config classes for Redis
    * Update Serving Beans and Config classes to use ne1w configuration getters
    * Remove hot-loading from store configuration. This reduces a bit of
      flexibility, but simplifies the code and configuration
@woop woop force-pushed the configuration-refactor branch from f3b47b3 to e2b43cc Compare April 16, 2020 06:16
@zhilingc
Copy link
Collaborator

/lgtm

@feast-ci-bot feast-ci-bot merged commit 3fd6c7a into master Apr 16, 2020
@ches ches deleted the configuration-refactor branch April 24, 2020 07:39
@woop woop added the compat/breaking Breaking user-facing change label Apr 30, 2020
@woop woop mentioned this pull request Apr 30, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Clean up Feast configuration
4 participants