Use underlying SDKs to automatically fill in model options when creating drivers #1441
Open
1 task done
Labels
type:enhancement
Improvements to existing features
Milestone
Is your feature request related to a problem? Please describe.
Customers can have a difficult time knowing what models to choose when creating drivers if they don't already know what models exist. For things like gpt-4o it's pretty easy to type.. but for options like sonnet unless you know the exact ids, it's a challenge.
It would be wonderful to be able to use the underlying model SDKs to grab the list of models available and dynamically fill them.
Describe the solution you'd like
Here's a loom demonstrating a modification I did with Anthropic to pull from their list:
https://www.loom.com/share/d7299383d6894101bc14db3fe8c05e43?sid=d4fedfee-ec64-45fa-9477-9a0a12dac9db
And to do the same with OpenAiChatPromptDriver I modified
openai_chat_prompt_driver.py
:in the
if TYPE_CHECKING:
section:and then I switched the model param:
Describe alternatives you've considered
We could manually create the list, but this seems way more efficient and will adjust automatically as the libraries change.
The text was updated successfully, but these errors were encountered: