-
Notifications
You must be signed in to change notification settings - Fork 12
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Harmony 571 daac regression tests #2
Conversation
…s to overcome timeouts
…m/nasa/harmony-regression-tests into harmony-571-daac-regression-tests
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Tested locally, in SIT, and UAT.
test/Dockerfile
Outdated
COPY .netrc .netrc | ||
RUN mkdir ./${sub_dir} | ||
COPY ${sub_dir}/conda-linux-64.lock ./${sub_dir} | ||
RUN ls ${sub_dir} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Debugging statement. Should be removed.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done
@@ -0,0 +1,377 @@ | |||
from contextlib import contextmanager |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There are possibly parts of this we could trim down or exclude, based on not caring much about the visual output in the current notebooks. I'd vote for leaving it as is for now but revisiting once we revamp the existing notebooks to use the newly-developed Python lib.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Doing the trimming down could remove a number of hefty dependencies in the current code
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
HARMONY-762
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The latest updates address everything I had.
Updated the regression notebook in the Harmony repo (HarmonyRegression.ipynb) and copied into /test/harmony-regression. Added necessary
harmony_host_url
variable and modified each test to ensure compatibility across providers. Also added a few lines to test intake-stac compatibility of zarr outputs but left direct access of outputs commented out due to known issues with stac (intake/intake-stac#48). A few assumptions:This branch also has several updates and fixes that James completed including updates to the notebook helper functions under /test/harmony-regression to get some of the plotting working in the docker environment, and fixed a timeout issue to enable aws testing.