Access and Reporting on Generative AI Logs (sys_generative_ai_log)

mouradhadj-
Tera Contributor

Hello Community,

I am working on developing Custom Reporting and Performance Analytics (PA) KPIs for our Now Assist adoption and usage. I have identified two key tables for reporting:

  1. sys_gen_ai_usage_log (The main usage log for billing and high-level activity).

  2. sys_generative_ai_log (A deeper log table that seems to contain more granular data).

I've encountered a security issue with the second table and have some related questions on its reporting utility and risks.


 

1. Access Issue with sys_generative_ai_log

 

When attempting to view or report on the sys_generative_ai_log table, I receive a security constraint message (as shown below).

"Security restricted access to data in the table Generative AI Log [sys_generative_ai_log]. Number of rows removed from this list by Security constraints: 20"

My Question:

  • What specific ACL/Role is typically required to gain read access to the sys_generative_ai_log table? I have already added the main usage table (sys_gen_ai_usage_log) to the glide.ui.permitted_tables property, but this deeper log seems to have additional restrictions.


 

2. Reporting Utility: Counting Skills per Ticket

 

Assuming I gain access, I want to confirm if the sys_generative_ai_log table can solve a specific reporting challenge.

The main usage table (sys_gen_ai_usage_log) is great for counting unique tickets where AI was used (COUNT DISTINCT on the Document field). However, I want to know the total number of individual skills or use cases triggered per ticket (e.g., Ticket INC123 had 'Summarize' (1) and 'Suggest Resolution' (1) = 2 Skills/Use Cases used).

My Question:

  • Does the sys_generative_ai_log table contain a more granular record of each skill trigger or AI step that would allow me to accurately calculate the "Average number of use cases used per ticket"?


 

3. KPI Ideas and Data Risks

 

I'm looking for suggestions on valuable KPIs using this granular data. I am already implementing:

  • Adoption: % of tickets resolved with at least one use case used.

My Questions:

  • KPI Suggestions: Does anyone have suggestions for "Value" or "Quality" KPIs using the detailed data from sys_generative_ai_log? (e.g., correlating logs with the Feedback field).

  • Data Access Risks: Given the sensitivity of the data (prompts and potential responses are logged), are there any security or performance risks to be aware of when granting broad read or report_on access to the sys_generative_ai_log table?

Thank you in advance for any insights!

Best regards,

1 ACCEPTED SOLUTION

Yogesh Shinde
ServiceNow Employee
ServiceNow Employee

Hi @mouradhadj- , sys_generative_ai_log is behind the Maint wall, i.e., only ServiceNow internal staff can access it. For Maint operations, raise a support (HI) ticket.

However, you can access sys_gen_ai_log_metadata, which contains a subset of non-sensitive fields from sys_generative_ai_log and is designed for admin reporting and analytics. It does not include all columns or sensitive data, but it is useful for most analytics use cases.

Also, for reporting, check the OOTB KPIs/Metrics in Now Assist Admin > Analytics.

View solution in original post

13 REPLIES 13

GlideFather
Tera Patron

Hi @mouradhadj-,

is this a question or knowledge share? It's not quite clear if you ask for help or sharing info..

 

I remember also having troubles to see records from the AI logs as per the first bulleted point. Security admin didn't help, I was thinking (just a theory) that it was due to the fact that the instance logs were a part of HRSD module which can have some sensitive/classified data... but I might have been wrong with this idea.

 

And please, if you have a question, try to rephrase it to ask, this seems to be copied from chatGPT and it's not clear what's the purpsoe of your post

———
/* If my response wasn’t a total disaster ↙️ drop a Kudos or Accept as Solution ↘️ Cheers! */


Hello @GlideFather ,

Thank you for reply its a question i don't how to have access to sys_generative_ai_log  its restricted table.
the second things i need to know if with this table i can for example build kpi with number of use case used per incident tickets,   usage of custom skills that i build  per assignment groupe etc...
Thanks again 

Hi @mouradhadj-,

 

I didn't get chance to review what kind of data is stored in that table.

 

But according to this Community post, it seems that particular ACLs per table must be adjusted (removing maint role and adding admin), I haven't tested myself because I no longer have available instance with Now Assist capabilities... 

 

So if you have security admin, you can try updating the ACL in order to see the unavailable logs and based on what you see then you might decide if it's possible to use it for another processing. However I personally don't consider logs as a good source for KPIs....

———
/* If my response wasn’t a total disaster ↙️ drop a Kudos or Accept as Solution ↘️ Cheers! */


Hello @GlideFather ,
Thank you for your response