Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove loops over chunksize in test_Data #248

Merged

Conversation

sadielbartholomew
Copy link
Member

@sadielbartholomew sadielbartholomew commented Aug 23, 2021

Towards #182, remove the loop over, and context management of, chunk sizes in test_Data.

Chunk size is a LAMA-related aspect and we can assume (at least until the Data module migration is more complete and we can think about how rigorous this test module needs to be and how to improve it) that the data array memory management is tested thoroughly by Dask so that we don't need to effectively test over a range of sizes of partitions of the sub-arrays.

As a result, three extra tests pass (after being un-skipped) relative to those passing before, since the non-existent attribute of chunk_sizes being called in the test turned out to be the only migration issue left in those small number of cases.

@sadielbartholomew sadielbartholomew self-assigned this Aug 23, 2021
@sadielbartholomew
Copy link
Member Author

Opening and closing to re-trigger the CI after I fixed a small issue, squashed the commit down into the previous related one, and force-pushed the branch...

@sadielbartholomew
Copy link
Member Author

No peer-review necessary since this is a setup/admin PR rather than a method migration and the general principle of removing the explicit chunksize handling in the test was agreed with David in a chat today. CI jobs all pass, so this is good to merge.

@sadielbartholomew sadielbartholomew merged commit 219343b into NCAS-CMS:lama-to-dask Aug 23, 2021
@sadielbartholomew sadielbartholomew deleted the lama-to-dask-5 branch August 23, 2021 23:44
@davidhassell davidhassell added the dask Relating to the use of Dask label Oct 5, 2021
@davidhassell davidhassell added this to the 3.14.0 milestone Nov 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dask Relating to the use of Dask
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants