Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to add Azure api key and endpoint and how to access gpt models based on that. #25

Open
sudhanshu-myl opened this issue Sep 25, 2024 · 1 comment

Comments

@sudhanshu-myl
Copy link

Hi,
I am able to access openai key and access gpt models through that.
I have azure endpoints (api key and base_url). How do I configure that top access gpt based models?

@carlini
Copy link
Owner

carlini commented Sep 25, 2024

You'll need to write an interface that connects this project up to Azure. You can see this PR for someone who added a new endpoint (#17), or reference some of the other files that do this

https://github.com/carlini/yet-another-applied-llm-benchmark/blob/a35d306f34d9f5785e60587f175edeaad5c38862/llms/anthropic_model.py

I've never used Azure before but it looks like azure-ai-ml might be what you want to use.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants