nodeId required | string Example: nodeId=dataset:food_delivery:public.delivery_7_days The ID of the node. A node can either be a dataset node, a dataset field node or a job node. The format of nodeId for dataset is dataset:<namespace_of_dataset>:<name_of_the_dataset> , for dataset field is datasetField:<namespace_of_dataset>:<name_of_the_dataset>:<name_of_field> , and for job is job:<namespace_of_the_job>:<name_of_the_job> .
+ http://localhost:5000/api/v1/lineage Response samples Content typeapplication/json {"graph": [{"id": "string", "type": "JOB", "data": {"type": "DB_TABLE", "name": "my-dataset", "physicalName": "public.mytable", "createdAt": "2019-05-09T19:49:24.201361Z", "upodatedAt": "2019-05-09T19:49:24.201361Z", "namespace": "my-namespace", "sourceName": "my-source", "fields": [{"name'": "a", "type": "INTEGER", "tags": [ ] }, {"name'": "b", "type": "TIMESTAMP", "tags": [ ] }, {"name'": "c", "type": "INTEGER", "tags": [ ] }, {"name'": "d", "type": "INTEGER", "tags": [ ] } ], "tags": [ ], "lastModifiedAt": null, "description": "My first dataset!", "facets": { }, "currentVersion": "b1d626a2-6d3a-475e-9ecf-943176d4a8c6" }, "inEdges": [{"origin": "string", "destination": "string" } ], "outEdges": [{"origin": "string", "destination": "string" } ] } ] } Get the upstream lineage for a given run http://localhost:5000/api/v1/runlineage/upstream Response samples Content typeapplication/json Get a column lineage graph query ParametersnodeId required | string Example: nodeId=dataset:food_delivery:public.delivery_7_days The ID of the node. A node can either be a dataset node, a dataset field node or a job node. The format of nodeId for dataset is dataset:<namespace_of_dataset>:<name_of_the_dataset> , for dataset field is datasetField:<namespace_of_dataset>:<name_of_the_dataset>:<name_of_field> , and for job is job:<namespace_of_the_job>:<name_of_the_job> .
| depth | integer Default: 20 Depth of lineage graph to create.
| withDownstream | boolean Default: false Determines if downstream lineage should be returned.
|
http://localhost:5000/api/v1/column-lineage Response samples Content typeapplication/json {"graph": [{"id": "string", "type": "JOB", "data": {"type": "DB_TABLE", "name": "my-dataset", "physicalName": "public.mytable", "createdAt": "2019-05-09T19:49:24.201361Z", "upodatedAt": "2019-05-09T19:49:24.201361Z", "namespace": "my-namespace", "sourceName": "my-source", "fields": [{"name'": "a", "type": "INTEGER", "tags": [ ] }, {"name'": "b", "type": "TIMESTAMP", "tags": [ ] }, {"name'": "c", "type": "INTEGER", "tags": [ ] }, {"name'": "d", "type": "INTEGER", "tags": [ ] } ], "tags": [ ], "lastModifiedAt": null, "description": "My first dataset!", "facets": { }, "currentVersion": "b1d626a2-6d3a-475e-9ecf-943176d4a8c6" }, "inEdges": [{"origin": "string", "destination": "string" } ], "outEdges": [{"origin": "string", "destination": "string" } ] } ] } Create a tag Creates a new tag object.
+ http://localhost:5000/api/v1/column-lineage Response samples Content typeapplication/json {"graph": [{"id": "string", "type": "JOB", "data": {"type": "DB_TABLE", "name": "my-dataset", "physicalName": "public.mytable", "createdAt": "2019-05-09T19:49:24.201361Z", "upodatedAt": "2019-05-09T19:49:24.201361Z", "namespace": "my-namespace", "sourceName": "my-source", "fields": [{"name'": "a", "type": "INTEGER", "tags": [ ] }, {"name'": "b", "type": "TIMESTAMP", "tags": [ ] }, {"name'": "c", "type": "INTEGER", "tags": [ ] }, {"name'": "d", "type": "INTEGER", "tags": [ ] } ], "tags": [ ], "lastModifiedAt": null, "description": "My first dataset!", "facets": { }, "currentVersion": "b1d626a2-6d3a-475e-9ecf-943176d4a8c6" }, "inEdges": [{"origin": "string", "destination": "string" } ], "outEdges": [{"origin": "string", "destination": "string" } ] } ] } Create a tag Creates a new tag object.
path Parameterstag required | string Example: SENSITIVE |
Request Body schema: application/jsondescription | string The description of the tag.
|
http://localhost:5000/api/v1/tags/{tag} Request samples Content typeapplication/json Response samples Content typeapplication/json Query all datasets and jobs Returns one or more datasets and jobs of your query.
+ http://localhost:5000/api/v1/tags Response samples Content typeapplication/json Query all datasets and jobs Returns one or more datasets and jobs of your query.
query Parametersq required | string Example: q=my-dataset Query containing pattern to match; datasets and jobs pattern matching is string based and case-insensitive. Use percent sign (% ) to match any string of zero or more characters (my-job% ), or an underscore (_ ) to match a single character (_job_ ).
| filter | string Example: filter=dataset Filters the results of your query by dataset or job .
| sort | string Example: sort=name Sorts the results of your query by name or updated_at .
@@ -2393,9 +2395,9 @@
| after | stringYYYY-MM-DD Example: after=2022-09-15 Match jobs or datasets after YYYY-MM-DD .
|
http://localhost:5000/api/v1/search Response samples Content typeapplication/json {"totalCount": 1, "results": [{"type": "DATASET", "name": "public.delivery_7_days", "updatedAt": "2019-05-09T19:49:24.201361Z", "namespace": "food_delivery", "nodeId": "dataset:food_delivery:public.delivery_7_days" } ] }
+http://localhost:5000/api/v1/search Response samples Content typeapplication/json {"totalCount": 1, "results": [{"type": "DATASET", "name": "public.delivery_7_days", "updatedAt": "2019-05-09T19:49:24.201361Z", "namespace": "food_delivery", "nodeId": "dataset:food_delivery:public.delivery_7_days" } ] }
|