Set a provider for a generative AI capability

  • Release version: Xanadu
  • Updated August 1, 2024
  • 1 minute to read

    • Determine which AI provider to use for each of the generative AI capabilities of Generative AI Controller.

    Before you begin

    Configure your credentials for your preferred provider. See Configuring API credentials for generative AI capabilities for more details.

    Role required: admin

    About this task

    Generative AI Controller comes with four capabilities by default. You can only configure a provider for the capabilities listed in the table in step 2. If you have installed other Now Assist applications, you may see other capabilities on the OneExtend Capability table. Those other capabilities use the Now LLM Service as their provider and can't be reconfigured.

    Procedure

    1. In the navigation filter, search for the OneExtend Capability table by entering sys_one_extend_capability.list.
    2. Open the record for the capability that you would like to configure, such as Sentiment Analysis.
      Table 1. Generative AI Controller capabilities
      Capability Definition

      Generate Content

      Generate texts about a given topic with Workflow Studio and Virtual Agent Designer.

      Generic Prompt

      Create your own use case and prompt.

      Sentiment Analysis

      Analyze user sentiment with Workflow Studio and Virtual Agent Designer.

      Summarize

      Create summaries of topics with Workflow Studio and Virtual Agent Designer.
    3. In the OneExtend Definition Configs related list, set Default to true for your preferred capability provider.
      Note:
      By default, you can choose only one provider for a capability. For example, if Default is true for Sentiment (OpenAI Completion), you must set Default to false before changing Default to true for Sentiment (Azure OpenAI).
      Default builder config open with builder capability related list. The capability records and default column are highlighted.
      Table 2. Model OptionsYou have the option to choose between several different models for each capability.

      Capability Definition

      Model
      • OpenAI Completion
      • Azure OpenAI Completion

      GPT-3
      • OpenAI Chat Completion
      • Azure OpenAI Chat Completion

      GPT-3.5
      • GPT4 (OpenAI Chat Compl)
      • GPT4 (Azure OpenAI Chat Compl)

      GPT-4
      • AI Studio (Google Cloud Completion)
      • AI Studio (Google Cloud Chat Completion)
      • Vertex AI (Google Cloud Completion)
      • Vertex AI (Google Cloud Chat Completion)

      Google Gemini
      Aleph Alpha Completion Luminous
      IBM watsonx Granite
      Amazon Bedrock Titan

    Result

    Flows, topics, and scripts that use the generative AI capability use the provider you've specified.

    What to do next

    Create flows, build Virtual Agent topics, and write scripts with generative AI to improve efficiency when creating content for agents and users.