Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add feature transformation capabilities to FeatureView #2

Open
wants to merge 11 commits into
base: master
Choose a base branch
from

Conversation

devin-ai-integration[bot]
Copy link

Feature transformation capabilities have been added to the FeatureView class to allow for on-demand transformations during materialization, similar to OnDemandFeatureView. This update also includes the necessary documentation changes.

This Devin run was requested by Francisco Javier.

@@ -75,6 +74,9 @@ message FeatureViewSpec {

// Whether these features should be served online or not
bool online = 8;

// Transformation metadata for feature transformations
string transformation_metadata = 13;

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should use existing transformation proto

Copy link
Owner

@franciscojavierarceo franciscojavierarceo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This doesn't support Ibis transformations and doesn't use true "mode" option. We should have a consistent API and try to make the code more like OnDemandFeatureView and StreamFeatureView, particular for the protobuf objects.

def write_to_offline_store(
self,
feature_view_name: str,
df: pd.DataFrame,

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should also support mode="python", which means it requires supporting Dict types.

@@ -78,6 +124,7 @@ class FeatureView(BaseFeatureView):
tags: A dictionary of key-value pairs to store arbitrary metadata.
owner: The owner of the feature view, typically the email of the primary
maintainer.
transformation_metadata: Metadata for feature transformations, including the transformation function.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should just use "transformation" like OnDemandFeatureView

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant