Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: Rename stream data source parameters #2804

Merged
merged 7 commits into from
Jun 17, 2022

Conversation

felixwang9817
Copy link
Collaborator

What this PR does / why we need it: This PR renames bootstrap_servers to kafka_bootstrap_servers and watermark to watermark_delay_threshold for KafkaSource. It also deprecates the date_partition_column for all data sources.

Which issue(s) this PR fixes:

Fixes #

Copy link
Collaborator

@kevjumba kevjumba left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@codecov-commenter
Copy link

codecov-commenter commented Jun 16, 2022

Codecov Report

Merging #2804 (fc12f54) into master (19aedc2) will decrease coverage by 0.01%.
The diff coverage is 69.56%.

@@            Coverage Diff             @@
##           master    #2804      +/-   ##
==========================================
- Coverage   80.52%   80.50%   -0.02%     
==========================================
  Files         172      172              
  Lines       15352    15356       +4     
==========================================
+ Hits        12362    12363       +1     
- Misses       2990     2993       +3     
Flag Coverage Δ
integrationtests 70.50% <60.86%> (-0.02%) ⬇️
unittests 59.63% <69.56%> (-0.01%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
...thon/feast/infra/offline_stores/bigquery_source.py 87.50% <ø> (ø)
...k/python/feast/infra/offline_stores/file_source.py 88.07% <ø> (ø)
...thon/feast/infra/offline_stores/redshift_source.py 89.56% <ø> (ø)
...hon/feast/infra/offline_stores/snowflake_source.py 92.37% <ø> (ø)
...on/tests/integration/registration/test_registry.py 94.97% <ø> (ø)
...ion/registration/test_stream_feature_view_apply.py 98.07% <ø> (ø)
sdk/python/tests/unit/test_feature_views.py 98.68% <ø> (ø)
sdk/python/feast/data_source.py 83.33% <68.18%> (-0.37%) ⬇️
sdk/python/tests/unit/test_data_sources.py 100.00% <100.00%> (ø)
...ython/feast/embedded_go/online_features_service.py 89.14% <0.00%> (-0.78%) ⬇️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 19aedc2...fc12f54. Read the comment docs.

@feast-ci-bot feast-ci-bot removed the lgtm label Jun 16, 2022
Copy link
Collaborator

@kevjumba kevjumba left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@feast-ci-bot feast-ci-bot added lgtm and removed lgtm labels Jun 16, 2022
Comment on lines +53 to +56
kafka_bootstrap_servers: str,
message_format: StreamFormat,
topic: str,
watermark: Optional[timedelta] = None,
watermark_delay_threshold: Optional[timedelta] = None,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need to worry about backwards compatibility?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no for watermark_delay_threshold as this was very recently added by Kevin and has not been part of a release yet

yes for kafka_bootstrap_servers, which I believe I handled appropriately

@feast-ci-bot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: achals, felixwang9817

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:
  • OWNERS [achals,felixwang9817]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

name: str. Name of data source, which should be unique within a project
event_timestamp_column (optional): str. (Deprecated) Event timestamp column used for point in time
name: Name of data source, which should be unique within a project
event_timestamp_column: (Deprecated) Event timestamp column used for point in time
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
event_timestamp_column: (Deprecated) Event timestamp column used for point in time
event_timestamp_column: (Deprecated in favor of `timestamp_field`) Event timestamp column used for point in time

applies everywhere

@achals
Copy link
Member

achals commented Jun 17, 2022

/lgtm

@achals achals marked this pull request as draft June 17, 2022 05:08
@achals achals marked this pull request as ready for review June 17, 2022 05:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants