Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix testing bugs #208

Merged
merged 1 commit into from
Apr 6, 2023
Merged

fix testing bugs #208

merged 1 commit into from
Apr 6, 2023

Conversation

odunbar
Copy link
Collaborator

@odunbar odunbar commented Apr 5, 2023

Purpose

No direct issue. Bugs found during other testing,

  • scikit learn leads to conda issues (i.e. trying to install a non-existent package (libstdcxx-ngnothing) presumably due to some typo internally, or "broken SAT solver" message due to pycosat)
  • MarkovChainMonteCarlos sample() export leads to test breaking in some julia versions
  • GP test fails due to random seed changes
  • buildkite fails for scikit-learn

Content

  • removes @sk_learn macro, which ignored the installed Conda/PyCall and created its own (buggy) installation of conda. Instead, always uses PyCall
  • adds MCMC.sample qualifier in tests
  • loosens GP tolerances for more robust testing under different random seeds
  • bug due to changed conda / python paths in buildkite between instantiate project and running plot_GP example. Unifying these paths solves the issue

  • I have read and checked the items on the review checklist.

@odunbar
Copy link
Collaborator Author

odunbar commented Apr 5, 2023

merging without review as this simply bug-fixes tests and no changes to interface

@odunbar
Copy link
Collaborator Author

odunbar commented Apr 5, 2023

bors r+

bors bot added a commit that referenced this pull request Apr 5, 2023
208: fix testing bugs r=odunbar a=odunbar

<!--- THESE LINES ARE COMMENTED -->
## Purpose 
<!--- One sentence to describe the purpose of this PR, refer to any linked issues:
#14 -- this will link to issue 14
Closes #2 -- this will automatically close issue 2 on PR merge
-->
No direct issue. Bugs found during other testing, 
- scikit learn leads to conda issues (i.e. trying to install a non-existent package (`libstdcxx-ngnothing`) presumably due to some typo internally, or "broken SAT solver" message due to pycosat)
- `MarkovChainMonteCarlo`s `sample()` export leads to test breaking in some julia versions
- GP test fails due to random seed changes


## Content
<!---  specific tasks that are currently complete 
- Solution implemented
-->
- removes `@sk_learn` macro, which ignored the installed Conda/PyCall and created its own (buggy) installation of conda. Instead, always uses `PyCall`
- adds `MCMC.sample` qualifier in tests
- loosens GP tolerances for more robust testing under different random seeds


<!---
Review checklist

I have:
- followed the codebase contribution guide: https://clima.github.io/ClimateMachine.jl/latest/Contributing/
- followed the style guide: https://clima.github.io/ClimateMachine.jl/latest/DevDocs/CodeStyle/
- followed the documentation policy: https://github.com/CliMA/policies/wiki/Documentation-Policy
- checked that this PR does not duplicate an open PR.

In the Content, I have included 
- relevant unit tests, and integration tests, 
- appropriate docstrings on all functions, structs, and modules, and included relevant documentation.

-->

----
- [x] I have read and checked the items on the review checklist.


Co-authored-by: odunbar <[email protected]>
@bors
Copy link
Contributor

bors bot commented Apr 5, 2023

Build failed:

@odunbar
Copy link
Collaborator Author

odunbar commented Apr 5, 2023

bors try

bors bot added a commit that referenced this pull request Apr 5, 2023
@bors
Copy link
Contributor

bors bot commented Apr 5, 2023

try

Build failed:

@odunbar
Copy link
Collaborator Author

odunbar commented Apr 6, 2023

bors try

bors bot added a commit that referenced this pull request Apr 6, 2023
@bors
Copy link
Contributor

bors bot commented Apr 6, 2023

remove sample() ambiguity in test

GP robust test tol

add condaforge

try add conda-forge

try changing Python/conda paths

format...;
@odunbar
Copy link
Collaborator Author

odunbar commented Apr 6, 2023

bors r+

@bors
Copy link
Contributor

bors bot commented Apr 6, 2023

@bors bors bot merged commit 328a26c into main Apr 6, 2023
@bors bors bot deleted the orad/testfix branch April 6, 2023 18:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant