This article outlines how to build a custom report to visualize Now Assist usage by Workflow and Product using the sys_gen_ai_usage_log table and the skill hierarchy metadata. While the data model offers powerful grouping capabilities, there are important caveats to consider when interpreting the results.
In this article, we will walk through:
- Where this data comes from, how it’s used and how you can manipulate it
- Building an analytics dashboard with
- An introductory report to understand the hierarchy
- A view of how the skills fit into the hierarchy
- A usage report leveraging the skill hierarchy
Data Model Overview
The report is based on the following relationships:
- Usage Table: sys_gen_ai_usage_log
- Purpose: Logs assist usage events
- See Reporting on system tables
- Skill Configuration: sn_nowassist_skill_config
- Purpose: Links usage to skill metadata
- Skill Family: sn_nowassist_skill_family
- Purpose: A self-referring table that categorizes or classifies the skill in the visible hierarchy
- Type field: Each node in the skill family may include a type of value: workflow, product, or feature.
- Parent field: Each node in the skill family may include a parent value, referring to another record on the same table
These types reflect how skills are presented in the UX and can be used to infer department alignment. Top-level branches are Workflows, and sub-branches can be Products or Features.
⚠️ Caveats and Disclaimers
- Usage ≠ Value Attribution to Purchasing Departments
There is no reliable way to consistently and directly associate usage with the purchasing department or a specific purchased SKU.
- Many skills are platform-level or cross-product.
- Usage may span multiple departments and would be double counted.
- Skill Family Changes May Cause Records to Be Skipped
Modifying the skill family hierarchy (e.g. changing skill_parent or its type) can cause usage records to be skipped during updates.
- Usage records rely on the current hierarchy to resolve relationships.
- If the hierarchy is incomplete or misconfigured during updates, new records may fail to resolve.
- This can result in missing data in reports.
Steps to Create a Report
Overview
The intent of this section is to provide you with step-by-step instructions to create a dashboard, featuring interactive filters and tabs, to clearly display how skills are classified, and usage is recorded.
Filters
- Skill Family: Isolates one or more Skill Families when unable to locate via browsing.
- Application: Identifies skills based on their installation source.
Tabs
- Skills Families: Displays hierarchical relationships between Skill Families, even if related skills are not activated.
- Skill Configs by Family: Shows how many skills are configured within each Skill Families.
- Usage by Skill Config and Family: Provides a detailed breakdown of usage.
Step 1: Create the Dashboard & Add the First Tab – Skills Families
1. Platform Analytics > Analytics Center > Create New Dashboard > select In-Line Editor
Name Your Dashboard (Example Name: Now Assist Usage Breakdown).
2. Click on Add new Element.
3. Then click on Data visualization.
4. Select New Visualization from the pop-up.
5. On the right side of the screen, in the configuration panel, select Visualization type = Pivot Table.
6. Under the Data sources section, click on Add data source.
7. Search for "now assist skill family" and select it as the data source.
No conditions need to be applied.
Then click on Add this source.
8. Under the Group by section for columns, click + Add.
9. Then, in the drop-down for Field for Now Assist Skill Family, select Type.
This will show a breakdown of Workflow, Product & Feature.
Click Apply.
10. Under the Group by section for rows, click + Add.
11. Then, in the drop-down for Field for Now Assist Skill Family, select the options to reflect the following hierarchy and apply for each item (dot walk as needed):
· Parent > Parent
· Parent
· Name
Click on Apply.
12. Optional: Add a List Visualization.
Click on Add new Element.
Then click on Data visualization.
13. Select New Visualization from the pop-up
14. On the right side of the screen in the configuration panel, select Visualization type = List.
15. Under the Data sources section, click on Add data source.
16. Search for "now assist skill family" and select it as the data source.
No conditions need to be applied.
Then click on Add this source.
17. Click on Save.
Congratulations, you have completed tab 1 of the dashboard and created the visuals for Skill Families.
Step 2: Add the Second Tab - Skill Configs by Family
18. Click on Add a tab, and label it as Skill Configs by Family.
19. Click on Add new element.
Then click on Data visualization.
20. Select New Visualization from the pop-up.
21. On the right side of the screen, in the configuration panel, select Visualization type = Pivot Table.
22. Under the Data sources section, click on Add data source.
23. Search for "Now Assist Skill Config" and select it as the data source.
No conditions need to be applied.
Then click on Add this source.
24. Under the Group by section for columns, click + Add.
25. Then, in the drop-down for Field for Now Assist Skill Config, select State. This will show which Skills have been set up or activated. Click on Apply.
26. Under the Group by section for rows, click + Add.
27. Then, in the drop-down for Field for Now Assist Skill Config, select the options to reflect the following hierarchy and apply for each item (dot walk as needed):
Skill Family > Parent > Parent
Skill Family > Parent
Skill Family.
Click on Apply.
28. The output visualization should look like this.
Note: Many skill families have only one parent level, but not all. This is why the extra parent level, which appears below as (empty), is included.
29. Optional: Add a List Visualization.
Click on Add new Element.
Then click on Data visualization.
30. Select New Visualization from the pop-up.
31. On the right side of the screen, in the configuration panel, select Visualization type = List.
32. Under the Data sources section, click on Add data source.
33. Search for "now assist skill config" and select it as the data source.
No conditions need to be applied.
Then click on Add this source.
34. Click on Save.
Congratulations, you have completed tab 2 of the dashboard and created the visuals for Skill Configs by Family.
Step 3: Add the Third Tab – Usage by Skill Config and Family
35. Click on Add a tab, and label it Usage by Skill Config and Family.
36. Click on Add new Element. Then click on Data visualization.
37. Select New Visualization from the pop-up.
38. On the right side of the screen in the configuration panel, select Visualization type = Pivot Table.
39. Under the Data sources section, click on Add data source.
40. Search for "Generative AI Usage Log " and select it as the data source.
If the table doesn’t appear, reference Reporting on system tables.
No conditions need to be applied.
Then click on Add this source.
41. Under the Metric section, add three values. Click + Add, set the values, and click Apply for each.
Label = Events, Select an aggregation = Count, Field = Entire table
Label = Default, Select an aggregation = Sum, Field = Assists
Label = Default, Select an aggregation = Sum, Field = Trial Assists
42. Under the Group by section for rows, click + Add. Then in the drop-down for Field for Generative AI Usage Log select the options to reflect the following hierarchy and apply for each item:
Skill Config ID > Parent > Parent
Skill Config ID > Parent
Skill Config ID > Name
Feature
