Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

One score-test hangs, others run #97

Closed
almita opened this issue Nov 4, 2024 · 3 comments
Closed

One score-test hangs, others run #97

almita opened this issue Nov 4, 2024 · 3 comments

Comments

@almita
Copy link

almita commented Nov 4, 2024

Hi! I tried to run the score testing on 4 different categories (each on 1 core with 16gb allocated to it) on a model with 1 covariate (2 levels) and 4885 categories. 3 of the tests ran fine, they took less than two hours to finish, but one of them just doesn't finish running (> 15 hours, same parameters as the others), is that something you've experienced? Do some categories just take a really long time to converge?

@svteichman
Copy link
Collaborator

This is something that I've experienced - in an analysis that I ran with ~8,000 categories, I found that the median test took 91 minutes, while some tests took over 5 days. Hopefully this helps!

@almita
Copy link
Author

almita commented Nov 5, 2024

Interesting, good to know it's something I can expect, thank you! I'm curious why it can vary so much, if you have any insights I'd love to know!

@adw96
Copy link
Contributor

adw96 commented Nov 6, 2024

Great question, @almita -- my initial reaction is either that the likelihood is very flat, or that it has a really unusual shape making the locally polynomial approximations poor. I know it's not a great answer but I hope it helps!

FYI We have a few projects in the works to speed up cases exactly like this -- currently documented as #89 and #90 -- but two of our core team members are currently on well-deserved vacations. Please stay tuned for updates and sorry to hear you have to wait a while for this pesky score tests... and thanks for your patience waiting for high quality inference ⭐

@adw96 adw96 closed this as completed Nov 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants