-
Notifications
You must be signed in to change notification settings - Fork 293
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adapt the SEVIRI native format reader in Satpy to support remote reading #2863
Adapt the SEVIRI native format reader in Satpy to support remote reading #2863
Commits on Aug 12, 2024
-
Add
readers.utils.fromfile()
for remote readingThis function uses `readers.utils.generic_open()` and `np.frombuffer()` to achieve this.
Configuration menu - View commit details
-
Copy full SHA for 5401d28 - Browse repository at this point
Copy the full SHA 5401d28View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7142a68 - Browse repository at this point
Copy the full SHA 7142a68View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8051d50 - Browse repository at this point
Copy the full SHA 8051d50View commit details -
Adapt
readers.seviri_l1b_native
for remote readingIn particular, the following functions/methods have been modified: - `has_archive_header()` now uses `readers.utils.generic_open()` instead of `open()`. - `read_header()` now uses `readers.utils.fromfile()` instead of `np.formfile()`. - `NativeMSGFileHandler._read_trailer()` now uses `readers.utils.fromfile()` instead of `np.formfile()`. - `NativeMSGFileHandler._get_memmap()` has been renamed to `NativeMSGFileHandler._get_array()` and now uses `readers.utils.fromfile()` instead of `np.memmap()`.
Configuration menu - View commit details
-
Copy full SHA for 16f2642 - Browse repository at this point
Copy the full SHA 16f2642View commit details -
Update
test_seviri_l1b_native
with_get_array
Reason: since `NativeMSGFileHandler._get_memmap()` has been renamed to `NativeMSGFileHandler._get_array()`.
Configuration menu - View commit details
-
Copy full SHA for 1f10690 - Browse repository at this point
Copy the full SHA 1f10690View commit details -
Update mock.patch args in
test_seviri_l1b_native
to match changes i……n `seviri_l1b_native`
Configuration menu - View commit details
-
Copy full SHA for 7d516d8 - Browse repository at this point
Copy the full SHA 7d516d8View commit details -
Update
test_seviri_l1b_native
with tests for remote readingThis includes generating an actual file on disk and attempt to read it.
Configuration menu - View commit details
-
Copy full SHA for d01a519 - Browse repository at this point
Copy the full SHA d01a519View commit details -
Parametrize
test_read_physical_seviri_nat_file
to test zip files as…… well as plain files
Configuration menu - View commit details
-
Copy full SHA for 0e5f3e7 - Browse repository at this point
Copy the full SHA 0e5f3e7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 15d17d6 - Browse repository at this point
Copy the full SHA 15d17d6View commit details -
Configuration menu - View commit details
-
Copy full SHA for df4a6db - Browse repository at this point
Copy the full SHA df4a6dbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 43b846b - Browse repository at this point
Copy the full SHA 43b846bView commit details -
Use a header which leads to a smaller seviri nat file on disk
This concerns `test_read_physical_seviri_nat_file()`.
Configuration menu - View commit details
-
Copy full SHA for 816a2c7 - Browse repository at this point
Copy the full SHA 816a2c7View commit details -
Make the returned path posix compliant in
compress_seviri_native_file
This is to ensure that the remote reading tests can also run on Windows. Note: `fsspec` expects a POSIX path.
Configuration menu - View commit details
-
Copy full SHA for d4976c3 - Browse repository at this point
Copy the full SHA d4976c3View commit details -
Resolve warnings raised as a result of
slow
&order
being pytest ……unknown marks We do not need these marks anymore, as we decreased the size of the generated seviri native file. As a result, the tests now run fast enough.
Configuration menu - View commit details
-
Copy full SHA for db3ddb8 - Browse repository at this point
Copy the full SHA db3ddb8View commit details -
Resolve warnings raised as a failure in the orbit polynomial
This warning is totally benign. It is caused as a result of the seviri native file that we create which is essentially filled with zeros.
Configuration menu - View commit details
-
Copy full SHA for fbd02b5 - Browse repository at this point
Copy the full SHA fbd02b5View commit details -
Fix the issue with the docstring in
amend_seviri_native_null_header()
The issue was an unexpected indentation on the last line of the docstring!
Configuration menu - View commit details
-
Copy full SHA for f002b00 - Browse repository at this point
Copy the full SHA f002b00View commit details -
Configuration menu - View commit details
-
Copy full SHA for a7596d3 - Browse repository at this point
Copy the full SHA a7596d3View commit details -
Use dask
map_blocks()
in_get_array()
This includes: - Extracting the `_get_array()` method so that it is now a function in the module and not a class method. - Introduction of `NativeMSGFileHandler_make_dask_array_with_map_blocks()` method to utilize the dask `map_blocks()`. - Introduction of a new method, namely `NativeMSGFileHandler._number_of_visir_channels` to facilitate testing and mock patching. - Adapting the mock patches in tests accordingly.
Configuration menu - View commit details
-
Copy full SHA for 80f3925 - Browse repository at this point
Copy the full SHA 80f3925View commit details
Commits on Aug 13, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 42dfc05 - Browse repository at this point
Copy the full SHA 42dfc05View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1c00de7 - Browse repository at this point
Copy the full SHA 1c00de7View commit details -
Configuration menu - View commit details
-
Copy full SHA for b58823c - Browse repository at this point
Copy the full SHA b58823cView commit details
Commits on Aug 14, 2024
-
Configuration menu - View commit details
-
Copy full SHA for d22d2b6 - Browse repository at this point
Copy the full SHA d22d2b6View commit details