Generative AI Controller: Configure Azure OpenAI, but with "Azure API Management" in between

Rio183246
Tera Contributor

Hello all,

 

i want to get Generative AI controller running on our demo instance. The instance has Generative AI controller and Now Assist installed. For a showcase, i want to configure the credentials for Azure Open AI in Generative AI controller.

 

Challenge is: Requests to our Azure Open AI resources are managed by Azure API Management (APIM). So I send a request to the APIM, and it will route the request to an available Azure OpenAI resource. So i do not need to know an API-Key for Azure OpenAI.

The authentication is the tricky part. Instead of a "Api-Key", i need to provide an "Ocp-Apim-Subscription-Key" in the header of a HTTP request.

Following the configuration instructions for Generative AI Controller, i can only provide an Azure Open AI API-Key (sn_azure_openai.Azure_OpenAI).

Rio183246_0-1717510742677.jpeg

Any idea, if and how i can use GenAI controller out-of-the-box working with a different header to send requests to the LLM provider?

0 REPLIES 0