Skip to content

Commit

Permalink
Update docstring
Browse files Browse the repository at this point in the history
  • Loading branch information
krysal committed Apr 16, 2024
1 parent bbce778 commit 1f27849
Show file tree
Hide file tree
Showing 2 changed files with 7 additions and 11 deletions.
8 changes: 3 additions & 5 deletions catalog/dags/maintenance/add_license_url.py
Original file line number Diff line number Diff line change
@@ -1,13 +1,11 @@
"""
# Add license URL
Add `license_url` to all rows that have `NULL` in their `meta_data` fields.
This PR sets the meta_data value to "{license_url: https://... }", where the
Add `license_url` to rows without one in their `meta_data` fields.
This PR merges the `meta_data` value with "{license_url: https://... }", where the
url is constructed from the `license` and `license_version` columns.
This is a maintenance DAG that should be run once. If all the null values in
the `meta_data` column are updated, the DAG will only run the first and the
last step, logging the statistics.
This is a maintenance DAG that should be run once.
"""

import logging
Expand Down
10 changes: 4 additions & 6 deletions documentation/catalog/reference/DAGs.md
Original file line number Diff line number Diff line change
Expand Up @@ -184,13 +184,11 @@ The following is documentation associated with each DAG (where available):

#### Add license URL

Add `license_url` to all rows that have `NULL` in their `meta_data` fields. This
PR sets the meta_data value to "{license_url: https://... }", where the url is
constructed from the `license` and `license_version` columns.
Add `license_url` to rows without one in their `meta_data` fields. This PR
merges the `meta_data` value with "{license_url: https://... }", where the url
is constructed from the `license` and `license_version` columns.

This is a maintenance DAG that should be run once. If all the null values in the
`meta_data` column are updated, the DAG will only run the first and the last
step, logging the statistics.
This is a maintenance DAG that should be run once.

### `airflow_log_cleanup`

Expand Down

0 comments on commit 1f27849

Please sign in to comment.