Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Setup Azure OpenAI Client #4

Closed
mkrueger12 opened this issue Dec 8, 2023 · 3 comments · Fixed by #57
Closed

Setup Azure OpenAI Client #4

mkrueger12 opened this issue Dec 8, 2023 · 3 comments · Fixed by #57

Comments

@mkrueger12
Copy link
Contributor

Max has API key/access on Azure

@mkrueger12 mkrueger12 added this to the Sprint 1 milestone Dec 8, 2023
@mkrueger12 mkrueger12 self-assigned this Dec 8, 2023
@mkrueger12 mkrueger12 changed the title [PROVIDER] Azure OpenAI Setup Azure OpenAI Dec 21, 2023
@mkrueger12 mkrueger12 changed the title Setup Azure OpenAI Setup Azure OpenAI Client Dec 21, 2023
@mkrueger12
Copy link
Contributor Author

mkrueger12 commented Jan 2, 2024

curl $AZURE_OPENAI_ENDPOINT/openai/deployments/gpt-35-turbo/chat/completions?api-version=2023-05-15 \ -H "Content-Type: application/json" \ -H "api-key: $AZURE_OPENAI_KEY" \ -d '{"messages":[{"role": "system", "content": "You are a helpful assistant."},{"role": "user", "content": "Does Azure OpenAI support customer managed keys?"},{"role": "assistant", "content": "Yes, customer managed keys are supported by Azure OpenAI."},{"role": "user", "content": "Do other Azure AI services support this too?"}]}'

@mkrueger12
Copy link
Contributor Author

mkrueger12 commented Jan 2, 2024

{"id":"chatcmpl-6v7mkQj980V1yBec6ETrKPRqFjNw9", "object":"chat.completion","created":1679072642, "model":"gpt-35-turbo", "usage":{"prompt_tokens":58, "completion_tokens":68, "total_tokens":126}, "choices":[{"message":{"role":"assistant", "content":"Yes, other Azure AI services also support customer managed keys. Azure AI services offer multiple options for customers to manage keys, such as using Azure Key Vault, customer-managed keys in Azure Key Vault or customer-managed keys through Azure Storage service. This helps customers ensure that their data is secure and access to their services is controlled."},"finish_reason":"stop","index":0}]}

mkrueger12 added a commit that referenced this issue Jan 2, 2024
mkrueger12 added a commit that referenced this issue Jan 2, 2024
mkrueger12 added a commit that referenced this issue Jan 2, 2024
@mkrueger12 mkrueger12 linked a pull request Jan 2, 2024 that will close this issue
mkrueger12 added a commit that referenced this issue Jan 3, 2024
mkrueger12 added a commit that referenced this issue Jan 3, 2024
mkrueger12 added a commit that referenced this issue Jan 3, 2024
mkrueger12 added a commit that referenced this issue Jan 4, 2024
mkrueger12 added a commit that referenced this issue Jan 5, 2024
mkrueger12 added a commit that referenced this issue Jan 5, 2024
mkrueger12 added a commit that referenced this issue Jan 5, 2024
* #4: add azure openai client

* #4: update testdata

* #4: lint

* #4: add tests

* #4: fix var name

* #4: add tests

* #4: tests

* #4: fix model response

---------

Co-authored-by: Max <[email protected]>
roma-glushko added a commit that referenced this issue Jan 21, 2024
- ✨ [providers] Support for OpenAI Chat API #3 (@mkrueger12 )
- ✨ [API] #54 Unified Chat API  (@mkrueger12 )
- ✨ [providers] Support for Cohere Chat API #5 (@mkrueger12 )
- ✨ [providers] Support for Azure OpenAI Chat API #4  (@mkrueger12 )
- ✨ [providers] Support for OctoML Chat API #58 (@mkrueger12 )
- ✨ [routing] The Routing Mechanism, Adaptive Health Tracking, and Fallbacks #42 #43 #51 (@roma-glushko)
- ✨ [routing] Support for round robin routing strategy #44 (@roma-glushko)
- ✨ [routing] Support for the least latency routing strategy #46 (@roma-glushko)
- ✨ [routing] Support for weighted round robin routing strategy #45 (@roma-glushko)
- ✨ [providers] Support for Anthropic Chat API #60 (@mkrueger12 )
- ✨ [docs] OpenAPI specifications #22 (@roma-glushko )
- 🔧 [chores] Inited the project #6 (@roma-glushko)
- 🔊 [telemetry] Inited logging  #14 (@roma-glushko)
- 🔧 [chores] Inited Glide's CLI #12 (@roma-glushko)
- 👷 [chores] Setup CI workflows #8 (@roma-glushko)
- ⚙️ [config] Inited configs #11 (@roma-glushko)
-  🔧 [chores] Automatic coverage reports #39 (@roma-glushko)
- 👷 [build] Setup release workflows #9 (@roma-glushko)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants