Adding helper for Multiple AOI Extraction, along with other features and nice-to-haves #23
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Contributor
nickrsan
commented
Aug 31, 2023
nickrsan
commented
- Multiple AOI extractor splits out into multiple tasks and zonal stats groups to enable exporting portions of very large areas from Earth Engine.
- Splitting out how we open fiona to make it simpler
- Allow use of multiple task registries with the main one used by default - this can help when exporting numerous items so we aren't iterating through as many items or requesting updates on as many items.
- Allow both BBox clipping (faster in most cases, with larger exports) and strict clipping to geometries.
- mosaic_and_zonal callback does all processing on an image from the moment it is finished exporting. Should save quite a bit of time.
…ion to bounding box clip
… callback mosaic_and_zonal will be more time efficient than just mosaicking while we wait. Type checking is going to fail here. Needs some fixes.
Still needs merge code development
This is all running now, but needs more work for merging
Missed a spot! This is why we do these tests!
…during table merges
Also, don't have GDAL mosaic single-image exports. Save time/space/complexity and skip over it.
Error handling and resuming
…not yet in codebase
AdamJCrawford
approved these changes
Sep 6, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.