conv metadf to geodataframe on pickle import #415
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
vergauwenthomas
added a commit
that referenced
this pull request
Jan 25, 2024
* Siebe bug (#364) * * add Siebe dataset to testing framework * fixed bug so that outliers in combined df are in obs time frequency * add obstype in qc plot title * fixed bug that qc settings can be update on non existing default obstypes * extended function to check if a qc can be applied to check if all required settings are available. * fixed docstring * build on dev branch * Titanlib extra (#367) * add titanlib in extension group * add documentation + catchers if titanlib is not installed * add all extras in the github actions * less restrictive on titanlib version * upgrade titanversion * include options in template (#368) * include options in template * some minor fixes and tests * update the tests * update docs * code cleanup * add log streamer to console sys.out in the development script * update documentation in the init file of the logger and handlers * Added a save and import (from and to pkl) to the modeldata. Needed by the GUI * added the save and inport methods in the test scripts * added the possibility to provide a full path to save the html file of the gee interactive plot (needed by the GUI) * pass the _ax in the modeldata plot for the GUI * add dynamical keyword to alaro information * update methodname of import model in the test * modeldata pkl for test * devscript update * downgrade gee version for trying to solve gee error * reset gee version * return axes for correlation scatter * return axes and fix loc of ledgend for correlation scatter * add dataset used by the paper to the known datasets * add logo * new logo * code analysis on init * conde analysis on analysis * code analysis on convertors * code analysis on data_import * uncommetent import from db * small bugfix * Update README.md * small logo for readme * Update README.md * code analysis on the dataset updater file * code analysis on the dataset file * conde analysis on df_helpers * code analysis on gap filling * code analysis on gap file * put development scripts in the gitignore * fixed some codereview comments and started code analysis in template prompt file * comment mysql dep. * return ax for heatmap by using arg * Bugfix in syncronization. Now all records are removed for which there are no observations! * bugfix to remove nan lines when reading the template * return plotting axes for heatmap * test install on os-matrix * try error fix * bugfix in action test * new approach * bugfix in test * new approach * update action triggers * specify folder for flake8 * test * test2 * test3 * restart * git push outputfile for flake8 * force flake exitzero status * comment out codestyle test * testing * test again * trigger * remove linitn * fixed issues with extracting tz and passing in trough * fixed tz bug * restore obstypes in metadf of station class * pip install pytest in the action * remove coverage line * avoid pytest * cleanup of action + windows testing * cleanup of action * add testing to os installation action * test * debugging * testing * new test * it does not work to pipeline actions together .... * Update README.md * Update README.md * try windows running * fix? * bash shell for action * windows test * update poetry * remove version 3.8 * reduce version of poetry because of bug * dynamical export of venv * triggers only on dev and main pushes * framework for a python buddy check equivalent of TITAN * tested in comparison with titanlib * update documentation * convert to budd_check name and add the update methods for the settings * write test for buddy check * added haversine approximation for global usage * add options in the default template * remove png from repo and update gitignore * code analysis on geometry functions * code analysis of landcover functions * code analysis of missing observations * code analysis modeldata * code analysis for the plotting functions * proper renaming of diurnal plot to more general cycleplot * remove unused argument * code cleanup of printing module * conda analysis qc_checks * code analysis of qc_statistics module * code analysis of the setting module * code analysis of the Station module * conda analysis of the writing files module * Update README.md * downgrade sphyinx install to 6.2.1 because of writing issue * bugfix (argname) * bug fixes in the qc checks after code analysis (== bool does not do the same as is bool) * Update README.md * setup a os matrix for pip install testing of the metobs toolkit (#376) * setup a os matrix for pip install testing of the metobs toolkit * remove trigger of branch soon to be deleted * start of the obervation type module (#377) * start of the obervation type module * framework for the obstypeclass in the Dataset * fixed implementation of obstype class and test are succesfull * add test for new observation and new units * obstype framework now extended to modeldata * documentation and addition of modelobstype and modelobstype_vectorfields + multi bandname extraction of gee * minor code review fixes * fixes of codereview * update the template prompter to create new obstypes/units * bug fixes in template prompt helper * new build * better naming of variable in the documentation examples * fixed current functions for vector observation types * extend the modelobstype classes with required methods * Update test with new observation types etc * update version * fix interpolation of and import from csv for multi obs for modeldata * bugfix in ylabel representatio * update tests * use rtd theme * add interactive and time evolution folium plot (#381) * add interactive and time evolution folium plot * cleanup * Update README.md * Logo in documentation + small doc fixes * bugfix when creating a new obstype * Update template_mapping.rst (#412) Updated standard name for 'wind speed' i.e, wind_speed in docs. * conv metadf to geodataframe on pickle import (#415) * Update main_workflow.yml * new example on obstypes and added in the documentation * code formatting * include doc build test * code review fixes + remove Stamen tiles * Without worldboundaries data (#423) * replace world boundaries files by using cartopy package * fix test * Saved new PDF of paper --------- Co-authored-by: vergauwenthomas <[email protected]> * Pre commit with black (#424) * Saved new PDF of paper * added an ran pre-commit * Saved new PDF of paper * install pre-commit format for toml file * added flake and toml checks to pre-commit * run flake8 * Saved new PDF of paper * formatted wit flake * Saved new PDF of paper --------- Co-authored-by: vergauwenthomas <[email protected]> * Update draft-pdf.yml * add geos to dep test (#425) * add geos to dep test * Saved new PDF of paper * change cartopy version * Saved new PDF of paper * add shapley and pygeos versions explicitly to pyproject * Saved new PDF of paper * add xarray * Saved new PDF of paper * rely on xarray for cartopy * Saved new PDF of paper * test geos dep * Saved new PDF of paper --------- Co-authored-by: vergauwenthomas <[email protected]> --------- Co-authored-by: C.K Sharma <[email protected]> Co-authored-by: vergauwenthomas <[email protected]>
vergauwenthomas
added a commit
that referenced
this pull request
Jan 26, 2024
* Siebe bug (#364) * * add Siebe dataset to testing framework * fixed bug so that outliers in combined df are in obs time frequency * add obstype in qc plot title * fixed bug that qc settings can be update on non existing default obstypes * extended function to check if a qc can be applied to check if all required settings are available. * fixed docstring * build on dev branch * Titanlib extra (#367) * add titanlib in extension group * add documentation + catchers if titanlib is not installed * add all extras in the github actions * less restrictive on titanlib version * upgrade titanversion * include options in template (#368) * include options in template * some minor fixes and tests * update the tests * update docs * code cleanup * add log streamer to console sys.out in the development script * update documentation in the init file of the logger and handlers * Added a save and import (from and to pkl) to the modeldata. Needed by the GUI * added the save and inport methods in the test scripts * added the possibility to provide a full path to save the html file of the gee interactive plot (needed by the GUI) * pass the _ax in the modeldata plot for the GUI * add dynamical keyword to alaro information * update methodname of import model in the test * modeldata pkl for test * devscript update * downgrade gee version for trying to solve gee error * reset gee version * return axes for correlation scatter * return axes and fix loc of ledgend for correlation scatter * add dataset used by the paper to the known datasets * add logo * new logo * code analysis on init * conde analysis on analysis * code analysis on convertors * code analysis on data_import * uncommetent import from db * small bugfix * Update README.md * small logo for readme * Update README.md * code analysis on the dataset updater file * code analysis on the dataset file * conde analysis on df_helpers * code analysis on gap filling * code analysis on gap file * put development scripts in the gitignore * fixed some codereview comments and started code analysis in template prompt file * comment mysql dep. * return ax for heatmap by using arg * Bugfix in syncronization. Now all records are removed for which there are no observations! * bugfix to remove nan lines when reading the template * return plotting axes for heatmap * test install on os-matrix * try error fix * bugfix in action test * new approach * bugfix in test * new approach * update action triggers * specify folder for flake8 * test * test2 * test3 * restart * git push outputfile for flake8 * force flake exitzero status * comment out codestyle test * testing * test again * trigger * remove linitn * fixed issues with extracting tz and passing in trough * fixed tz bug * restore obstypes in metadf of station class * pip install pytest in the action * remove coverage line * avoid pytest * cleanup of action + windows testing * cleanup of action * add testing to os installation action * test * debugging * testing * new test * it does not work to pipeline actions together .... * Update README.md * Update README.md * try windows running * fix? * bash shell for action * windows test * update poetry * remove version 3.8 * reduce version of poetry because of bug * dynamical export of venv * triggers only on dev and main pushes * framework for a python buddy check equivalent of TITAN * tested in comparison with titanlib * update documentation * convert to budd_check name and add the update methods for the settings * write test for buddy check * added haversine approximation for global usage * add options in the default template * remove png from repo and update gitignore * code analysis on geometry functions * code analysis of landcover functions * code analysis of missing observations * code analysis modeldata * code analysis for the plotting functions * proper renaming of diurnal plot to more general cycleplot * remove unused argument * code cleanup of printing module * conda analysis qc_checks * code analysis of qc_statistics module * code analysis of the setting module * code analysis of the Station module * conda analysis of the writing files module * Update README.md * downgrade sphyinx install to 6.2.1 because of writing issue * bugfix (argname) * bug fixes in the qc checks after code analysis (== bool does not do the same as is bool) * Update README.md * setup a os matrix for pip install testing of the metobs toolkit (#376) * setup a os matrix for pip install testing of the metobs toolkit * remove trigger of branch soon to be deleted * start of the obervation type module (#377) * start of the obervation type module * framework for the obstypeclass in the Dataset * fixed implementation of obstype class and test are succesfull * add test for new observation and new units * obstype framework now extended to modeldata * documentation and addition of modelobstype and modelobstype_vectorfields + multi bandname extraction of gee * minor code review fixes * fixes of codereview * update the template prompter to create new obstypes/units * bug fixes in template prompt helper * new build * better naming of variable in the documentation examples * fixed current functions for vector observation types * extend the modelobstype classes with required methods * Update test with new observation types etc * update version * fix interpolation of and import from csv for multi obs for modeldata * bugfix in ylabel representatio * update tests * use rtd theme * add interactive and time evolution folium plot (#381) * add interactive and time evolution folium plot * cleanup * Update README.md * Logo in documentation + small doc fixes * bugfix when creating a new obstype * Update template_mapping.rst (#412) Updated standard name for 'wind speed' i.e, wind_speed in docs. * conv metadf to geodataframe on pickle import (#415) * Update main_workflow.yml * new example on obstypes and added in the documentation * code formatting * include doc build test * code review fixes + remove Stamen tiles * Without worldboundaries data (#423) * replace world boundaries files by using cartopy package * fix test * Saved new PDF of paper --------- Co-authored-by: vergauwenthomas <[email protected]> * Pre commit with black (#424) * Saved new PDF of paper * added an ran pre-commit * Saved new PDF of paper * install pre-commit format for toml file * added flake and toml checks to pre-commit * run flake8 * Saved new PDF of paper * formatted wit flake * Saved new PDF of paper --------- Co-authored-by: vergauwenthomas <[email protected]> * Update draft-pdf.yml * add geos to dep test (#425) * add geos to dep test * Saved new PDF of paper * change cartopy version * Saved new PDF of paper * add shapley and pygeos versions explicitly to pyproject * Saved new PDF of paper * add xarray * Saved new PDF of paper * rely on xarray for cartopy * Saved new PDF of paper * test geos dep * Saved new PDF of paper --------- Co-authored-by: vergauwenthomas <[email protected]> * trailing white --------- Co-authored-by: C.K Sharma <[email protected]> Co-authored-by: vergauwenthomas <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.