You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'd suggest openai/gpt-3.5-turbo-0613 next (which is relatively inexpensive)
Oh, also EleutherAI/pythia-70m is also small enough to work on CPU
but it is not a built in model in HELM yet, so that forces us to think about how the SUT plugins will work, which is maybe good?
on the HELM CLI, you would run pythia-70m [like so](https://crfm-helm.readthedocs.io/en/latest/huggingface_models/)
GPU models: pythia, mpt, llama 2
llama 2 and the openai models also need credentials, so that also forces us to think about how credentials should be managed
The text was updated successfully, but these errors were encountered:
Yifan's suggestions:
The text was updated successfully, but these errors were encountered: