Performance Analytics indicators for generative AI

  • Release version: Xanadu
  • Updated November 18, 2024
  • 1 minute to read

    • Indicators for generative AI include information about generative AI logs, executions, tokens, latency, number of users who use a Now Assist skill, and more.

    These indicators can be found by going to the Analytics Hub. To access the Analytics Hub, navigate to Performance Analytics > Analytics Hub. There are two sets of indicators, one for the Generative AI Log table and one for the Generative AI Usage Log table. Both can be accessed by searching for gen ai.

    These indicators measure data on daily intervals. Data is only available for dates before the current date. If you want to see results from the current day, you must wait until the next day.

    Generative AI Log table Indicators

    Generative AI logs on your instance provide details for generative AI executions on the instance. All indicators can be broken done by definition and skill config so you can keep track of the executions of LLM requests on your instance.

    Total Gen AI Logs
    Breakdowns: By Definition, By Skill Config, By Status, By Feedback
    Gen AI Log - Total Internal Now LLM executions
    Breakdowns: By Definition, By Skill Config, By Status, By Feedback
    Gen AI Log - Maximum Prompt Token Count
    Breakdowns: By Definition, By Skill Config
    Gen AI Log - Total Sum Prompt Token Count
    Breakdowns: By Definition, By Skill Config
    Gen AI Log - Minimum latency
    Breakdowns: By Definition, By Skill Config
    Gen AI Log - Maximum latency
    Breakdowns: By Definition, By Skill Config
    Gen AI Log - Total Sum Response Token Count
    Breakdowns: By Definition, By Skill Config
    Gen AI Log - Maximum Response Token Count
    Breakdowns: By Definition, By Skill Config

    Generative AI Usage Log table Indicators

    Generative AI Usage Log table indicators provide information about how and who is using generative AI features in Now Assist skills and Generative AI Controller capabilities.

    Gen AI Actions per day
    Breakdowns: By Generative AI Skill Execution Modality, By Gen AI Feature
    Number of users who used Gen AI actions per day
    Breakdowns: By Gen AI Feature