Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add API backwards-compatibility test #8507

Open
arielshaqed opened this issue Jan 15, 2025 · 0 comments
Open

Add API backwards-compatibility test #8507

arielshaqed opened this issue Jan 15, 2025 · 0 comments
Labels
area/system-tests Improvements or additions to the system-tests feature-request tech-debt

Comments

@arielshaqed
Copy link
Contributor

#8482 details a backwards compatibility failure which bypassed our CI. Currently we test backwards compatibility:

  • vs. lakeFSFS. This cannot catch the bug since lakeFSFS performs a rather limited set of operations.
  • vs. the Python HL SDK. This did catch the bug, but only after release, and somewhat by accident.

We should strengthen our tests so that CI can detect and ideally prevent merging PRs that break backwards compatibility.

For instance, Esti is a fairly comprehensive client-side test of lakeFS. We might take the approach of the lakeFSFS compatibility tests to Esti: run latest Esti (which uses a latest client version) vs. old lakeFS server versions, and run old Esti versions or Esti linked against older client versions vs. latest lakeFS. This is probably too slow to run for all versions, and there is less point here since it's the same release versions, but we could still pick some versions.

@arielshaqed arielshaqed added contributor feature-request area/system-tests Improvements or additions to the system-tests tech-debt and removed contributor labels Jan 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/system-tests Improvements or additions to the system-tests feature-request tech-debt
Projects
None yet
Development

No branches or pull requests

1 participant