Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Individual model checks & null model #86

Open
3 tasks
kathsherratt opened this issue Jan 18, 2021 · 0 comments
Open
3 tasks

Individual model checks & null model #86

kathsherratt opened this issue Jan 18, 2021 · 0 comments

Comments

@kathsherratt
Copy link
Contributor

@seabbs comments on outlier forecasts (wider than #85 so separating into an issue):

I assume that most of the crazy is coming from the Rt forecast (or maybe not?) and so it might be better to do model by model checks and then reset crazy forecasts to something less mad or drop them from the ensemble (but that gets quite complicated when weighting as if a model is not present the weighting will no longer add up to 1).

My preference is that we start submitting forecasts for all of the targets always. Given that it would be good if we swapped crazy forecasts with some kind of null model (no change with overdispersion from recent obs - I think @nikosbosse has code for this).
So the pseudo code would be if not present add in null model forecast and otherwise don't?

Need to:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant