Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

present column lineage of a dataset #2293

Merged
merged 9 commits into from
Dec 27, 2022
Merged

Conversation

pawel-big-lebowski
Copy link
Collaborator

@pawel-big-lebowski pawel-big-lebowski commented Dec 7, 2022

Signed-off-by: Pawel Leszczynski [email protected]

Problem

Marquez UI is not presenting column lineage

Solution

This PR provides JSON preview of a column level lineage of a selected dataset.

Note: All database schema changes require discussion. Please link the issue for context.

Checklist

  • You've signed-off your work
  • Your changes are accompanied by tests (if relevant)
  • Your change contains a small diff and is self-contained
  • You've updated any relevant documentation (if relevant)
  • You've updated the CHANGELOG.md with details about your change under the "Unreleased" section (if relevant, depending on the change, this may not be necessary)
  • You've versioned your .sql database schema migration according to Flyway's naming convention (if relevant)
  • You've included a header in any source code files (if relevant)
    Zrzut ekranu 2022-12-7 o 12 40 59
    Zrzut ekranu 2022-12-7 o 12 56 14

@boring-cyborg boring-cyborg bot added the web label Dec 7, 2022
@codecov
Copy link

codecov bot commented Dec 7, 2022

Codecov Report

Merging #2293 (b52f47c) into main (65669ca) will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##               main    #2293   +/-   ##
=========================================
  Coverage     76.72%   76.72%           
  Complexity     1177     1177           
=========================================
  Files           222      222           
  Lines          5354     5354           
  Branches        429      429           
=========================================
  Hits           4108     4108           
  Misses          768      768           
  Partials        478      478           

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@pawel-big-lebowski pawel-big-lebowski force-pushed the web/display-column-lineage-of-dataset branch 2 times, most recently from aabfdff to 365fd5b Compare December 7, 2022 11:23
@boring-cyborg boring-cyborg bot added the docs label Dec 7, 2022
@pawel-big-lebowski pawel-big-lebowski added the javascript Pull requests that update Javascript code label Dec 7, 2022
@pawel-big-lebowski pawel-big-lebowski marked this pull request as ready for review December 7, 2022 11:57
@pawel-big-lebowski pawel-big-lebowski self-assigned this Dec 7, 2022
@pawel-big-lebowski
Copy link
Collaborator Author

Before merging, we need to make sure that backend requests is done after clicking the tab and not by default.

@pawel-big-lebowski pawel-big-lebowski marked this pull request as draft December 8, 2022 12:04
Signed-off-by: Pawel Leszczynski <[email protected]>
Signed-off-by: tito1212 <[email protected]>

Signed-off-by: tito1212 <[email protected]>
Co-authored-by: tito1212 <[email protected]>
* refactoring for display column lineage JSON

Signed-off-by: tito1212 <[email protected]>

* request api after click

Signed-off-by: tito1212 <[email protected]>

Signed-off-by: tito1212 <[email protected]>
Co-authored-by: tito1212 <[email protected]>
@pawel-big-lebowski pawel-big-lebowski force-pushed the web/display-column-lineage-of-dataset branch from 51fae37 to d4110e3 Compare December 12, 2022 08:57
@pawel-big-lebowski pawel-big-lebowski marked this pull request as ready for review December 12, 2022 08:58
Signed-off-by: Pawel Leszczynski <[email protected]>
Copy link
Member

@phixMe phixMe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you look into switching the component that we are fetching from?

@tito12 tito12 force-pushed the web/display-column-lineage-of-dataset branch 2 times, most recently from 461fd19 to 0af28e0 Compare December 21, 2022 13:01
@tito12 tito12 force-pushed the web/display-column-lineage-of-dataset branch from 0af28e0 to a14dfe5 Compare December 21, 2022 13:15
@tito12 tito12 force-pushed the web/display-column-lineage-of-dataset branch from 0572063 to c6d7793 Compare December 21, 2022 15:49
Copy link
Member

@phixMe phixMe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, You'll want to run
npm run eslint-fix to get the project to pass CI, perhaps we need a hook.

Signed-off-by: tito12 <[email protected]>
@tito12 tito12 force-pushed the web/display-column-lineage-of-dataset branch from da84d17 to cfc329e Compare December 23, 2022 19:14
@tito12
Copy link
Contributor

tito12 commented Dec 23, 2022

Thanks, You'll want to run npm run eslint-fix to get the project to pass CI, perhaps we need a hook.

Thanks, just pushed changes

@tito12 tito12 merged commit 39bcd3a into main Dec 27, 2022
@tito12 tito12 deleted the web/display-column-lineage-of-dataset branch December 27, 2022 17:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api API layer changes chart client/java client/python docker docs javascript Pull requests that update Javascript code web
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants