diff --git a/changelog.rst b/changelog.rst index e4bbc5c021..7068853766 100644 --- a/changelog.rst +++ b/changelog.rst @@ -2,6 +2,35 @@ Changelog ========= +v0.8.2 (2018-02-12) +------------------- +- Update changelog. [davidh-ssec] +- Bump version: 0.8.1 → 0.8.2. [davidh-ssec] +- Fix readers so yaml and reader names match. [davidh-ssec] +- Fix nc_olci_l1b reader so config yaml matches reader name. [davidh- + ssec] +- Update abi_l1b.yaml to allow C01 filename. [howff] + + C01 filename from Eumetcast has -{chid:6d}_0 suffix just like C02 + + (cherry picked from commit 3bc63b6) + +- Make flake8 happy. [Martin Raspaud] + + (cherry picked from commit 04e753d) + +- Fix the nc_nwcsaf_pps reader config for file finding compatibility. + [Martin Raspaud] + + (cherry picked from commit e2355ef) + +- Merge pull request #177 from pytroll/bugfix-viirs. [David Hoese] + + Bugfix viirs loading - picked from (xarray)develop branch +- Bugfix viirs loading - picked from (xarray)develop branch. + [Adam.Dybbroe] + + v0.8.1 (2018-01-19) ------------------- @@ -18,8 +47,6 @@ Other - Bump version: 0.8.0 → 0.8.1. [Martin Raspaud] - Merge pull request #162 from pytroll/bugfix-pyorbital-azimuth- difference. [Martin Raspaud] - - Bugfix: The satellite azimuth returned by PyOrbital is not in the ran… - Merge pull request #154 from pytroll/bugfix-viirs-truecolor- ratiosharpening. [Martin Raspaud] @@ -44,8 +71,6 @@ Other - Bump version: 0.7.8 → 0.8.0. [Martin Raspaud] - Merge pull request #152 from pytroll/bugfix-truecolor-viirs. [Martin Raspaud] - - Bugfix: Explicitly set the resolution for sun-satellite geometry - Bugfix viirs_sdr reader: Use correct sunz corrector for ibands. [Adam.Dybbroe] - Merge pull request #91 from pytroll/feature-discover-utility. [Martin @@ -172,8 +197,6 @@ v0.7.7 (2017-12-21) - Merge pull request #138 from pytroll/bugfix-modis-reader. [David Hoese] - - WIP: Fix readers not returning the highest resolution dataset IDs - Add more file patterns to hdfeos_l1b reader. [davidh-ssec] - Fix requesting a specific resolution from a reader. [davidh-ssec] - Merge remote-tracking branch 'origin/fix-resolution' into bugfix- @@ -572,9 +595,6 @@ Other - Fix SCMI writer for lettered grids. [davidh-ssec] - Fix numbered tile counts for SCMI writer. [davidh-ssec] - Add initial SCMI writer. [davidh-ssec] - - WIP: Multiple tiles, lettered tiles, debug images - - Separate EnhancementDecisionTree in to base DecisionTree and subclass. [davidh-ssec] - Add 'goesr' as possible platform in geocat reader. [davidh-ssec] @@ -1027,6 +1047,7 @@ Other Conflicts: satpy/readers/__init__.py satpy/readers/hrit_msg.py + - Fix IR and VIS calibration. [Adam.Dybbroe] - Pep8 and editorial (header) updates. [Adam.Dybbroe] - Adding the native msg header record definitions. [Adam.Dybbroe] @@ -1365,12 +1386,11 @@ v0.3.1 (2017-01-16) and make the `safe_sar_c.py` reader compute coordinate arrays from a collection of GCPs provided in the measurement files. - NB: each polarization has it's set of longitudes and latitudes. - - Restore reducers to their original values. [Martin Raspaud] - Add alternatives for true color on ahi. [Martin Raspaud] Thanks balt + - Add name to the dataset attributes when writing nc files. [Martin Raspaud] - Improve documentation. [Martin Raspaud] @@ -1398,11 +1418,13 @@ v0.3.1 (2017-01-16) - Implement a mipp-free HRIT reader. [Martin Raspaud] WIP, supports only MSG, no calibration yet. + - Concatenate area_def through making new AreaDefinition. [Martin Raspaud] This makes the concatenation independent of the AreaDefinition implementation. + - Allow stacking area_def from bottom-up. [Martin Raspaud] - Fix yaml_reader testing. [Martin Raspaud] - Add support for filetype requirements. [Martin Raspaud] @@ -1469,10 +1491,12 @@ v0.3.0 (2016-12-13) Conflicts: satpy/readers/yaml_reader.py + - Merge branch 'develop' into feature-lonlat-datasets. [Martin Raspaud] Conflicts: satpy/readers/yaml_reader.py + - Pass down the calibration, polarization and resolution from main load. [Martin Raspaud] - Fix typo in sunzenith correction description. Default is 88 deg, not @@ -1491,6 +1515,7 @@ v0.3.0 (2016-12-13) the dataset at hand. + v0.2.1 (2016-12-08) ------------------- - Update changelog. [Martin Raspaud] @@ -1591,6 +1616,7 @@ Fix Prior to h5py 3.0, the h5 files open with h5py are not closed upon deletion, so we have to do it ourselves... + - Bugfix: area.id doesn't exist, use area.area_id. [Martin Raspaud] - Bugfix: return when each file has been loaded independently. [Martin Raspaud] @@ -1826,10 +1852,12 @@ Other This was triggering a `Too many open files` error since the memmap was called for every scanline. + - Fix loading for datasets with no navigation. [Martin Raspaud] - Read start and end time from filename for eps_l1b. [Martin Raspaud] This avoids opening every file just for time checks. + - Rename file handler's get_area to get_lonlats. [davidh-ssec] There is now a get_area_def and get_lonlats method on individual file handlers @@ -1888,6 +1916,7 @@ Other - Add mipp config file for MSG3. [Martin Raspaud] This is needed by mipp when the mipp_hrit reader is used. + - Remove `if True` from viirs sharp true color. [davidh-ssec] - Fix small bug in scene when dataset isn't found in a reader. [davidh- ssec] @@ -1902,9 +1931,11 @@ Other - Put AHI HSD reflectances in % [Martin Raspaud] They were between 0 and 1 by default + - Fix AHI HSD nav dtype. [Martin Raspaud] lon ssp and lat ssp where swaped + - Adjust correct standard names for seviri calibration. [Martin Raspaud] - Fix Seviri CO2 correction buggy yaml def. [Martin Raspaud] - Fix sunz corrector with different resolutions. [davidh-ssec] @@ -1962,6 +1993,7 @@ Other etc/composites/visir.yaml satpy/composites/__init__.py satpy/scene.py + - Add support for new prerequisite syntax. [Martin Raspaud] - Got VIIRS L1B True color working. [davidh-ssec] @@ -1975,6 +2007,7 @@ Other Conflicts: etc/composites/viirs.yaml satpy/readers/yaml_reader.py + - Add viirs composites. [Martin Raspaud] - Fix the area_def concatenation. [Martin Raspaud] - Mask nan in ir calibration for ahi hsd. [Martin Raspaud] @@ -1985,9 +2018,11 @@ Other This is enabled by implementing the `get_area_def` method in the file handler. + - Optimize AHI reading using inplace loading. [Martin Raspaud] Navigation is switched off for now. + - Allow area loading for the data file handlers. [Martin Raspaud] - Use a named tuple to pass both data, mask and info dict for inplace loading. [Martin Raspaud] @@ -2033,6 +2068,7 @@ Other - Avoid raising an error when no files are found. [Martin Raspaud] Instead, a warning is logged. + - Remove unused code from readers/__init__.py. [Martin Raspaud] - Cleanup style. [Martin Raspaud] - Fix unittests. [Martin Raspaud] @@ -2054,6 +2090,7 @@ Other - Add modifiers feature. [Martin Raspaud] Now modifiers can be added to the prerequisites as dictionnaries. + - Add standard_names to channels in mipp_xrit. [Martin Raspaud] - Add a NC4/CF writer. [Martin Raspaud] - Use YAML instead of CFG for composites. [Martin Raspaud] @@ -2094,6 +2131,7 @@ Other not covered by the YAMLBasedReader. Some parts of the class being still valid in this situation, we split the class to avoid code duplication, using subclassing instead. + - Add hrpt reader. [Martin Raspaud] - Change AMSR2 L1B reader config to be 2 spaces instead of 4. [davidh- ssec] @@ -2184,6 +2222,7 @@ Other The multiscene class adds the possibility to blend different datasets together, given a blend function. + - Add a test yaml-based reader for aapp1b. [Martin Raspaud] - Fix manually added datasets not being resampled. [davidh-ssec] - Merge pull request #8 from davidh-ssec/feature-ewa-resampling. [David @@ -2223,15 +2262,18 @@ Other No matching of file was done, resulting in assigning all found files to all readers. + - Fix reader_info reference in yaml base reader. [davidh-ssec] - Keep channels in the wishlist when necessary. [Martin Raspaud] Due to the creation of a DatasetID for each dataset key, the wishlist wasn't matching the actual ids of the datasets. + - Adapt reading to yaml reader way. [Martin Raspaud] Since there is more delegating of tasks to the reader, the reading has to be adapted. + - Cleanup using pep8. [Martin Raspaud] - Allow yaml files as config files. [Martin Raspaud] - Add the dependency tree based reading. [Martin Raspaud] @@ -2242,6 +2284,7 @@ Other The multiscene class adds the possibility to blend different datasets together, given a blend function. + - Add a test yaml-based reader for aapp1b. [Martin Raspaud] - Fix netcdf dimension use to work with older versions of netcdf-python library. [davidh-ssec] @@ -2340,6 +2383,7 @@ Other In the case of true color with crefl corrected channels for example, the true color needs to depend on 3 corrected channels, which in turn can now be composites. + - Add Scene import to __init__ for convience. [davidh-ssec] - Add composites to 'available_datasets' [davidh-ssec] @@ -2386,6 +2430,7 @@ Other In order to merge or keep metadata for Dataset during arithmetic operations we need to implement the numeric type methods. + - Cleanup unused arguments in base reader. [davidh-ssec] Also makes _load_navigation by renaming it to load_navigation to resolve some quantifiedcode code checks. @@ -2430,10 +2475,12 @@ Other 3d array masks were not precomputed correctly, so we now make a workaround. A better solution is yet to be found. + - Fix kd3 precomputation for AreaDefinitions. [Martin Raspaud] The lons and lats attributes aren't defined by default in AreaDefs, so we now make sure to call the get_lonlats method. + - Set default format for dataset saving to geotiff. [Martin Raspaud] - Move `save_datasets` logic from Scene to base Writer. [davidh-ssec] - Fix bug in resample when geolocation is 2D. [davidh-ssec] @@ -2468,10 +2515,12 @@ Other the dict `keys` method return views in py3. We now convert to list for consistency. + - Add a test case for resample caching. [Martin Raspaud] - Revert resample cache changes. [Martin Raspaud] They didn't seem necessary in the way resampling is called. + - Rename to satpy. [Martin Raspaud] - Remove the world_map.ascii file. [Martin Raspaud] - Allow compressed files to be checked by hrit reader. [Martin Raspaud] @@ -2498,29 +2547,35 @@ Other We add the .bumpversion.cfg and .gitchangelog.rc for easy version bumping and changelog updates. + - Remove v from version string. [Martin Raspaud] - Add str and repr methods for composites. [Martin Raspaud] This add simple repl and str methods for compositors. + - Restructure the documentation for mpop2. [Martin Raspaud] This is an attempt to reorganize the documentation to prepare for mpop2. Old stuff has been take away, and a fresh quickstart and api are now provided. + - Improve the ReaderFinder ImportError message to include original error. [Martin Raspaud] To make the ImportError more useful in ReaderFinder, the original error string is now provided. + - Fix save_dataset to allow both empty filename and writer. [Martin Raspaud] When saving a dataset without a filename and writer, save_dataset would crash. Instead, we are now putting writer to "simple_image" in that case. + - Rename projectable when assigning it through setitem. [Martin Raspaud] When a new dataset is added to a scene, it's name should match the string key provided by the user. + - Remove references to deprecated mpop.projector. [Martin Raspaud] - Allow resample to receive strings as area identifiers. [Martin Raspaud] @@ -2530,11 +2585,13 @@ Other area by name, than to get the area definition object from the file. This patch allows the `resample` projectable method to work with string ids also. + - Add a dataset to whishlish when added with setitem. [Martin Raspaud] When adding a dataset to a scene via the datasetdict.__setitem__ method, it is likely that the user case about this dataset. As such, it should be added to the wishlist in order not to get removed accidently. + - Move composite loading out of Scene to mpop.composites. [Martin Raspaud] @@ -2543,6 +2600,7 @@ Other place to have it is the mpop.composites modules. As a conterpart, we now provide the `available_composites` method to the Scene to be able to figure out what we have possibility to generate. + - Fix the travis file to allow python 2.6 to fail. [Martin Raspaud] - Allow travis to fail on python 2.6. [Martin Raspaud] - Install importlib for travis tests on python 2.6. [Martin Raspaud] @@ -2552,28 +2610,34 @@ Other Three scenarios were added, testing showing a dataset, saving a dataset, and bulk saving datasets (`save_datasets`). + - Fix loading behaviour tests. [Martin Raspaud] A little cleanup, and using builtin functions for getting the dataset_names + - Fix DatasetDict's setitem to allow empty md in value. [Martin Raspaud] Sometimes a dataset/projectable doesn't have any info attached to it, eg because the dataset is synthetic. In these cases, setitem would crash. This is now fixed, and if a string is provided as a key in setitem it is used as a name if no better name is already there. + - Simplify dataset saving to disk. [Martin Raspaud] saving datasets can now be done one by one. If a writer is not provided, it is guessed from the filename extension. + - Add a show method to the Scene class. [Martin Raspaud] That allows the user to interactively vizualize the data + - Add a default areas.def file. [Martin Raspaud] - Fix the manifest file to include the config files. [Martin Raspaud] - Add missing config files to setup.py. [Martin Raspaud] - Fix setup.py to add cfg files. [Martin Raspaud] This is in order to make mpop work out of the box after a pip install. + - Add a behaviour test to find out the available dataset. [Martin Raspaud] - Prevent crashing when a load requirement is not available. [Martin @@ -2581,9 +2645,11 @@ Other When requiring a band which isn't available, mpop would crash. This is now fixed and replaced by a warning in the log. + - Use behave to do higher level tests. [Martin Raspaud] Two small scenarios for testing the loading of the data are implemented now. + - Fix import error in scene. [davidh-ssec] A small refactor was done and then undone to move DatasetDict and DatasetID. This little import change wasn't properly cleaned up. @@ -2605,6 +2671,7 @@ Other config changing on the fly, but also more resilience for multiple sensor cases, like one sensor is loaded after another, and the composites wouldn't get updated. + - Fix the name issue in sensor-specific composite requests. [Martin Raspaud] @@ -2612,6 +2679,7 @@ Other should be empty or None, making it not read the sensor config file at all. In turn that meant that generic composites were used instead of sensor- specific ones. + - Got metadata requests working for composites. [davidh-ssec] - Use DatasetID in composite requirements instead of names and wavelengths only. [davidh-ssec] @@ -2695,6 +2763,7 @@ Other Raspaud] The class ReaderFinder was created for this purpose. + - Cleanup. [Martin Raspaud] - Fix overview and natural composites. [Martin Raspaud] - Make read and load argument lists consistent. [Martin Raspaud] @@ -2714,6 +2783,7 @@ Other "natural", "true_color"]) BandIDs are now used internally as key for the scene's projectables dict. + - Add file keys to metop's getitem. [Martin Raspaud] - Rename metop calibration functions. [Martin Raspaud] - Add file keys for start and end times for metop. [Martin Raspaud] @@ -2787,6 +2857,7 @@ Other - we can now provide "nearest" or "kdtree" instead of a resampler class. - The precompute/dump kwarg is now a directory where to save the proj info, defaulting to '.' if precompute=True. + - Switch to containers in travis. [Martin Raspaud] - Fix repo in .travis. [Martin Raspaud] - Add OrderedDict for python < 2.7. [Martin Raspaud] @@ -2797,6 +2868,7 @@ Other - OO architecture allowing other resampling methods to be implemented. - resampling is divided between pre- and actual computation. - hashing of areas is implemented, resampler-specific. + - Fixed bad patch on new scene test. [davidh-ssec] - First try at more scene tests. [davidh-ssec] - Move image generation methods to Dataset and move enh. application to @@ -2826,6 +2898,7 @@ Other mpop/satellites/__init__.py mpop/satin/helper_functions.py mpop/satin/mipp_xrit.py + - Add algorithm version in output cloud products. [Martin Raspaud] - Minor PEP8 tweaks. [Panu Lahtinen] - Script to generate external calibration files for AVHRR instruments. @@ -2920,6 +2993,7 @@ Other * Product dependencies * loading from viirs * generating images + - WIP: successfully loaded the first viirs granule with newscene! [Martin Raspaud] - Rewriting scene. [Martin Raspaud] @@ -2953,6 +3027,7 @@ Other - Fallback to pre-launch if not available. - load(..., pre_launch_coeffs=True) to force using pre-launch coeffs) + - Correct npp name in h5 files. [Martin Raspaud] - Add the pps v2014 h5 reader. [Martin Raspaud] - Use h5py for lonlat reading also. [Martin Raspaud] @@ -3033,6 +3108,7 @@ Other - Fix name matching in hdfeos_l1b. [Martin Raspaud] The full name didn't work with fnmatch, take basename instead. + - Allows hdfeos_l1b to read a batch of files. [Martin Raspaud] - Add delitem, and code cleanup. [Martin Raspaud] - Merge branch 'pre-master' of github.com:mraspaud/mpop into pre-master. @@ -3063,6 +3139,7 @@ Other - Allow loading a file directly for aapp1b and eps_l1b. [Martin Raspaud] Just run global_data.load(..., filename="/path/to/myfile.1b") + - Merge branch 'pre-master' of github.com:mraspaud/mpop into pre-master. [Martin Raspaud] - Viirs_sdr can now load depending on an area. [Martin Raspaud] @@ -3116,8 +3193,8 @@ Other - Merge pull request #10 from pnuu/pre-master. [Martin Raspaud] Fixed failed merging. Thanks Pnuu. -- Fixed failed merging (removed "<<<<<<< HEAD" and ">>>>>>> upstream - /pre-master" lines) [Panu Lahtinen] +- Fixed failed merging (removed "<<<<<<< HEAD" and ">>>>>>> + upstream/pre-master" lines) [Panu Lahtinen] - Merge branch 'pre-master' of https://github.com/mraspaud/mpop into pre-master. [Adam Dybbroe] - Merge branch 'pre-master' of https://github.com/mraspaud/mpop into @@ -3284,6 +3361,7 @@ Other Conflicts: mpop/imageo/geo_image.py + - Night_color (should had beed called night_overview) is the same as cloudtop. [Lars Orum Rasmussen] - Bug fix from Bocheng. [Lars Orum Rasmussen] @@ -3326,6 +3404,7 @@ Other channels 3a and 3b each time, one of them being entirely masked. This of course created some problem further down. Fixed by setting the not loadable channel to None. + - Merge branch 'unstable' of /data/proj/SAF/GIT/mpop into unstable. [Martin Raspaud] - Bugfix in npp.cfg template. [Adam Dybbroe] @@ -3348,6 +3427,7 @@ Other an allclose. This was inefficient, and the programming team decided that it was the user's task to know before projection if the source and target area were the same. In other words, the user should be at least a little smart. + - Remove dummy test to boost projection performance. [Martin Raspaud] Mpop was checking in 2 different places if the source and target areas were @@ -3356,6 +3436,7 @@ Other an allclose. This was inefficient, and the programming team decided that it was the user's task to know before projection if the source and target area were the same. In other words, the user should be at least a little smart. + - Update channel list for modis lvl2. [Martin Raspaud] - Bump up version number: 1.0.0. [Martin Raspaud] - Merge branch 'pre-master' into unstable. [Martin Raspaud] @@ -3536,6 +3617,7 @@ Other This fixes a bug in windows that prevents running strftime on string that contain mapping keys conversion specifiers. + - Catch the error if there is no file to load from. [Martin Raspaud] - Add a proper logger in hdfeos reader. [Martin Raspaud] - Get resolution from filename for eos data. [Martin Raspaud] @@ -3549,6 +3631,7 @@ Other - Fix the loading of BT for VIIRS M13 channel. [Martin Raspaud] Has no scale and offset + - Merge branch 'pre-master' of github.com:mraspaud/mpop into pre-master. [Lars Orum Rasmussen] - Refactor the unsigned netcdf packing code. [Martin Raspaud] @@ -3558,6 +3641,7 @@ Other - Replace auto mask and scale from netcdf4. [Martin Raspaud] Eats up too much memory. + - Merge branch 'pre-master' of github.com:mraspaud/mpop into pre-master. [Lars Orum Rasmussen] - Feature: Added template for electro-l satellite. [Martin Raspaud] @@ -4376,4 +4460,3 @@ Other - New rebase. [Martin Raspaud] -