Azure OpenAI as Provider

[sqlreport]

Problem

• how do I use Azure Open AI as provider, I do not see the Azure Open AI listed on provider list

Proposed Solution

• can we get a documentation on adding different provider?

Additional context

• link to Azure Open AI https://learn.microsoft.com/en-GB/azure/cognitive-services/openai/overview

[3coins]

@sqlreport
Thanks for your interest in Jupyter AI. We will add more documentation on adding new providers. To get you started, please feel free to submit a PR for adding a new provider in the providers.py file. We can help review or answer code related questions in the PR.

For some reference, here is the provider implementation for ChatOpenAI:

jupyter-ai/packages/jupyter-ai-magics/jupyter_ai_magics/providers.py

Lines 316 to 329 in 42c6d43

	class ChatOpenAINewProvider(BaseProvider, ChatOpenAI):
	id = "openai-chat-new"
	name = "OpenAI"
	models = [
	"gpt-4",
	"gpt-4-0314",
	"gpt-4-32k",
	"gpt-4-32k-0314",
	"gpt-3.5-turbo",
	"gpt-3.5-turbo-0301",
	]
	model_id_key = "model_name"
	pypi_package_deps = ["openai"]
	auth_strategy = EnvAuthStrategy(name="OPENAI_API_KEY")

All providers in Jupyter AI should extend from Langchain LLM class. Here is the LLM class in Langchain, that can help you with required attributes for creating this provider.
https://github.com/hwchase17/langchain/blob/v0.0.159/langchain/llms/openai.py#L562

[VectorZhao]

+1

[c4fun]

Please consider this function as most corporations tend to use Azure OpenAI rather than OpenAI

[qianchen94]

+1

[3coins]

@sqlreport @VectorZhao @c4fun @qianchen94
Thanks for your interest in Jupyter AI. We can work to add AzureChatOpenAI provider but will need your help in verifying once we submit the PR. Would any of you be able to help with this?

[wanbao118]

I can help to test if the Azure OpenAI provider is available.

[klauern]

Related, is it possible to just override the OPENAI_API_BASE environment variable? We have a proxy service that we are required to use that has it's own API keys. If I could just point to our proxy, I could use the OOTB OpenAI models

[dlqqq]

Hey folks, I authored a PR that should add support for Azure OpenAI. Can anybody help verify the PR? None of us have an Azure OpenAI account. I've included replication steps as a comment on the PR.