Generative AI Controller: Configure Azure OpenAI, but with "Azure API Management" in between
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
06-04-2024 07:24 AM
Hello all,
i want to get Generative AI controller running on our demo instance. The instance has Generative AI controller and Now Assist installed. For a showcase, i want to configure the credentials for Azure Open AI in Generative AI controller.
Challenge is: Requests to our Azure Open AI resources are managed by Azure API Management (APIM). So I send a request to the APIM, and it will route the request to an available Azure OpenAI resource. So i do not need to know an API-Key for Azure OpenAI.
The authentication is the tricky part. Instead of a "Api-Key", i need to provide an "Ocp-Apim-Subscription-Key" in the header of a HTTP request.
Following the configuration instructions for Generative AI Controller, i can only provide an Azure Open AI API-Key (sn_azure_openai.Azure_OpenAI).
Any idea, if and how i can use GenAI controller out-of-the-box working with a different header to send requests to the LLM provider?