Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Labels for feature #499

Closed

Conversation

imjuanleonard
Copy link
Contributor

@imjuanleonard imjuanleonard commented Feb 27, 2020

  1. Ensure that your code follows our code conventions ✅
  2. Run unit tests and ensure that they are passing
  3. If your change introduces any API changes, make sure to update the integration tests scripts here
  4. Make sure documentation is updated for your PR! ✅
  5. Make sure you have signed the CLA https://cla.developers.google.com/clas

What this PR does / why we need it:
Full discussion is available on this issue

Which issue(s) this PR fixes:
Fixes #463 on the service side

Does this PR introduce a user-facing change?:

- Add labels column to Feature/Entity

@feast-ci-bot
Copy link
Collaborator

Hi @imjuanleonard. Thanks for your PR.

I'm waiting for a gojek member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@@ -230,6 +233,23 @@ def max_age(self, max_age):
"""
self._max_age = max_age

@property
def label(self):
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Label isnt a property of a feature set, its a property of a feature.

Copy link
Contributor Author

@imjuanleonard imjuanleonard Feb 27, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My bad, Thanks for clarifying

Hence, this is current to do Checklist:

  • Add Mac development set-up guide using homebrew
  • Create the labels column on Field Class (This will affect the Feature and Entity)
  • Create a gateway to Create, List (Should be able to print the labels column), and Delete to the labels Column in Feature class using python SDK Client
  • Add the test with labels Column empty and labels Column marked in Feature class
  • Update the integration test tree
  • Update the documentation on how to use the labels from Feature function

Notes, Datatype for each of the layers

Python: dict()
Java: Map<String, String>
Table: Varchar(255): with key-value object store in JSON

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Varchar(255): with key-value object store in JSON

Why are you limiting it to that small of a size? I also think you should maybe consider comma or tab separation here and using a Set (in the Java model)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure @woop , now I am using 'TEXT' for a result similar with Varchar(Max), thanks for the input

@feast-ci-bot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: imjuanleonard
To complete the pull request process, please assign woop
You can assign the PR to them by writing /assign @woop in a comment when ready.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@feast-ci-bot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: imjuanleonard
To complete the pull request process, please assign woop
You can assign the PR to them by writing /assign @woop in a comment when ready.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@woop
Copy link
Member

woop commented Mar 2, 2020

/ok-to-test

@@ -48,6 +48,7 @@
"numpy",
"google",
"confluent_kafka",
"tensorflow-metadata>=0.21,<0.22",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What is this for?

Copy link
Contributor Author

@imjuanleonard imjuanleonard Mar 2, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a missing dependency because we are using the TensorFlow metadata proto

Previously I keep facing this bug whenever I tried to generate my proto. We verified on a clean install on @davidheryanto environment as well.

In fact @davidheryanto is the one who found it

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok, but how is it related to your PR? Should it be a separate PR?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think you're right, should created a separate PR
#508

This is the PR @woop, this also generates the python SDK Protos

This will help to reduce the file change in this PR, so we can focus on the features

@imjuanleonard imjuanleonard force-pushed the feature-set-label-and-sdk branch from 15ebc95 to 3f596a9 Compare March 3, 2020 18:25
@feast-ci-bot
Copy link
Collaborator

The following users are mentioned in OWNERS file(s) but are not members of the gojek org.

Once all users have been added as members of the org, you can trigger verification by writing /verify-owners in a comment.

  • imjuanleonard
    • OWNERS

@@ -214,6 +225,40 @@ public Field(EntitySpec entitySpec) {
}
}

public Map<String, String> getLabels() {
ObjectMapper mapper = new ObjectMapper();
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

in TypeUtils we have helper functions convertJsonStringToMap and convertMapToJsonString, you might want to use those for converting to and from json.

@imjuanleonard imjuanleonard force-pushed the feature-set-label-and-sdk branch 2 times, most recently from cd47be2 to abcce8c Compare March 10, 2020 23:21
@imjuanleonard imjuanleonard force-pushed the feature-set-label-and-sdk branch from abcce8c to 8b1380f Compare March 10, 2020 23:44
@imjuanleonard imjuanleonard force-pushed the feature-set-label-and-sdk branch from 8b1380f to f15e976 Compare March 10, 2020 23:45
@imjuanleonard
Copy link
Contributor Author

/retest test-core-and-ingestion

@zhilingc
Copy link
Collaborator

/retest

@imjuanleonard imjuanleonard changed the title [WIP] Do not merge - Feature set label and sdk access to it Labels for feature Mar 11, 2020
@imjuanleonard
Copy link
Contributor Author

imjuanleonard commented Mar 17, 2020

All the comments in this merge have been addressed, it is ported to #536

@imjuanleonard imjuanleonard deleted the feature-set-label-and-sdk branch March 17, 2020 21:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Extend feature set and/or feature metadata
4 participants