Process ICESat-2 ATL11 data up to 20200513

[weiji14]

Still 7 ICESat-2 cycles to analyze, but there's 40 extra days to add! See also previous update at #44

Note that this will (hopefully) be the last time I'll do the ATL06_to_ATL11 processing 🤞. The ATL11 schema has changed considerably (see #126), particularly with the removal of the 'corrected_h' group in suzanne64/ATL11#11. This PR is more about updating the scripts to use the new schema, but once the official ATL11 data product comes out, I'll switch to using that instead.

git diff command to only get ATL06_to_ATL11_Antarctica.sh lines that have changed:

git diff --color=always ATL06_to_ATL11_Antarctica.sh | perl -wlne 'print $1 if /^\e\[32m\+\e\[m\e\[32m(.*)\e\[m$/' > ATL06_to_ATL11_Antarctica_20200404_20200513_diff.sh

TODO:

• Update ATLAS catalog to include ATL06 data up to and including 20200513 (154f564)
• Merge in ⬆️ Bump ATL11 from 31830b5 to 22bf569 #130 so that we get lots of float32 dtypes and smaller filesizes (One ATL11_*.zarr folder is now ~20MB instead of ~30MB before). See also suzanne64/ATL11@dbc221a! (d3ace2d)
  Supersedes Downcast ATL11 data variables to lighter dtypes #53:

• at_slope: float32
• complex_surface_flag: int8
• curvature: float32
• cycle_number: int8
• deg_x: int8
• deg_y: int8
• delta_time: float64
• dem_h: float32
• e_slope: float32
• fit_quality: int8
• h_corr: float32
• h_corr_sigma: float32
• h_corr_sigma_systematic: float32
• latitude: float64
• longitude: float64
• misfit_RMS: float32
• misfit_chi2r: float32
• n_slope: float32
• poly_coeffs: float32
• poly_coeffs_sigma: float32
• poly_exponent_x: int8
• poly_exponent_y: int8
• quality_summary: int8
• ref_pt: int32
• rgt_azimuth: float32
• slope_change_rate_x: float32
• slope_change_rate_x_sigma: float32
• slope_change_rate_y: float32
• slope_change_rate_y_sigma: float32
• x_atc: float64
• xt_slope: float32
• y_atc: float64

• Do ATL06_to_ATL11 conversion on changed all files, since the datatypes have become lighter (bff7345)

References:

• https://stackoverflow.com/questions/25497881/git-diff-is-it-possible-to-show-only-changed-lines

[review-notebook-app]

Check out this pull request on 

Review Jupyter notebook visual diffs & provide feedback on notebooks.

---

Powered by ReviewNB

[sourcery-ai]

Sourcery Code Quality Report (beta)

❌  Merging this PR will decrease code quality in the affected files by 0.02 out of 10.

Quality metrics	Before	After	Change
Complexity	3.38	3.56	0.18 🔴
Method Length	226.10	228.91	2.81 🔴
Quality	6.73	6.71	-0.02 🔴

Other metrics	Before	After	Change
Lines	1605	1596	-9

Changed files	Quality Before	Quality After	Quality Change
atl06_play.py	7.13	7.09	-0.04 🔴
atl06_to_atl11.py	6.99	6.98	-0.01 🔴
atl11_play.py	4.91	4.91	0.00
atlxi_dhdt.py	5.96	5.96	0.00

Please see our documentation here for details on how these metrics are calculated.

We are actively working on this report - lots more documentation and extra metrics to come!

Let us know what you think of it via email or our Gitter!