-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add feature transformation capabilities to FeatureView #2
base: master
Are you sure you want to change the base?
Conversation
protos/feast/core/FeatureView.proto
Outdated
@@ -75,6 +74,9 @@ message FeatureViewSpec { | |||
|
|||
// Whether these features should be served online or not | |||
bool online = 8; | |||
|
|||
// Transformation metadata for feature transformations | |||
string transformation_metadata = 13; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should use existing transformation proto
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This doesn't support Ibis transformations and doesn't use true "mode" option. We should have a consistent API and try to make the code more like OnDemandFeatureView and StreamFeatureView, particular for the protobuf objects.
def write_to_offline_store( | ||
self, | ||
feature_view_name: str, | ||
df: pd.DataFrame, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This should also support mode="python", which means it requires supporting Dict types.
@@ -78,6 +124,7 @@ class FeatureView(BaseFeatureView): | |||
tags: A dictionary of key-value pairs to store arbitrary metadata. | |||
owner: The owner of the feature view, typically the email of the primary | |||
maintainer. | |||
transformation_metadata: Metadata for feature transformations, including the transformation function. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should just use "transformation" like OnDemandFeatureView
…ctions in FeatureView
Feature transformation capabilities have been added to the FeatureView class to allow for on-demand transformations during materialization, similar to OnDemandFeatureView. This update also includes the necessary documentation changes.
This Devin run was requested by Francisco Javier.