-
Notifications
You must be signed in to change notification settings - Fork 71
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix(taps): Use recent start_date as starting_replication_value #759
fix(taps): Use recent start_date as starting_replication_value #759
Conversation
Codecov Report
@@ Coverage Diff @@
## main #759 +/- ##
==========================================
+ Coverage 80.33% 80.37% +0.04%
==========================================
Files 34 34
Lines 3418 3425 +7
Branches 679 681 +2
==========================================
+ Hits 2746 2753 +7
Misses 499 499
Partials 173 173
📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more |
@edgarrmondragon I added a check for Since we are in the subcase where a start_date is given as an input, I think this should be enough, but we could also add a try/except around the parsing. As an alternative, we can indeed make a simple string comparison, although we are not sure what would happen when comparing a uuid and a date from "start_date". I couldn't find if the format of |
@ericboucher ok, that makes sense and might be good for most use cases. Would you mind adding a test case, perhaps somewhere in sdk/tests/core/test_streams.py Line 132 in b0a3c49
|
@edgarrmondragon done! Not sure why codecov is not passing though... Any clue? The UI is not very readable... 🤷 |
@ericboucher it seems that codecov doesn't like that there isn't an I think I have a quick fix for that, and if that works I might push it to this branch 🙂 EDIT: Ok so I think that worked. @ericboucher let me know if the changes in d586071 make sense to you |
@edgarrmondragon your changes make sense to me! Let me know if you any other changes from me :) |
b39a41f
to
1ccab0a
Compare
1ccab0a
to
a6cdfb8
Compare
@ericboucher thanks for getting this started! It prompted a useful discussion on our side 😄 |
When both a start_date and a replication_start_date are available, I believe that we should take the most recent one.