Troubleshoot issues with Topic Recommendations

  • Release version: Yokohama
  • Updated January 30, 2025
  • 2 minutes to read
    • Summarize
    Summarized using AI
    This content was generated using new OpenAI-powered functionality. Results are provided on an as is basis and are not guaranteed to be accurate or complete.

    Summary of Troubleshoot issues with Topic Recommendations

    This guide helps ServiceNow customers diagnose and resolve common issues encountered with Topic Recommendations in the Yokohama release. Topic Recommendations assists in creating and managing Virtual Agent topics by analyzing reports and training models. Understanding these troubleshooting steps ensures smooth topic addition, model training, and report generation.

    Show full answer Show less

    Common Issues and Solutions

    • Blank Topic Recommendations page: Occurs if no analysis reports are configured. Customers should configure an analysis report or activate ITSM Virtual Agent Conversations to load default configurations.
    • Error adding topics to Virtual Agent: Check the System Log > Errors for entries with source "sntopicrecommend" to identify the error message. Model training errors leave the model in a draft state but still add the topic.
    • Reports show intent matches but no pre-built topic matches: Ensure ITSM Virtual Agent Conversations app is installed and activated. If installed, the reports may feature issues not covered by pre-built topics.
    • Analysis reports unavailable in production: This is expected as analysis reports and Intent Discovery work only in a single instance. Topics and models can be migrated, but reports do not transfer.
    • Analysis report stuck on "Analysis in progress": Check the Discovery Report Definitions table for the analysis status. If empty, rerun the analysis and verify intent discovery in the NLU Workbench.
    • Adding new topics takes longer than expected: Review the topic staging list status and System Logs > Events to monitor progress or queued events. If unclear, mark the status as Error and retry adding the recommendation.
    • Report generation limits: Topic Recommendations supports reports with between 10,000 and 300,000 records to maintain performance and data significance.
    • Model not preselected after upgrade: Post-Quebec upgrades require manually selecting a model in Topic Recommendations; once selected, the app remembers it.
    • Unmigrated model support: Models do not need to be grouped, though grouping is recommended.
    • Unlinked topics: Linking recommendations to existing topics is optional and functions as an acknowledgment.
    • Missing Topics/Requests VA Can Handle tab: Set the system property glide.ui.escapeallscript to True via sysproperties to display this tab.

    Practical Takeaways

    • Activate ITSM Virtual Agent Conversations to simplify setup and benefit from default topics and configurations.
    • Use system logs and tables like Discovery Report Definitions and topic staging lists to monitor and troubleshoot topic generation and model training.
    • Be aware of data size constraints to ensure reports generate correctly.
    • Adjust system properties as needed to enable full UI functionality.
    • Understand that some behaviors, like analysis report availability on production instances, are by design.

    Investigate and resolve unexpected behavior with Topic Recommendations, or find answers to common questions.

    For information about using Topic Recommendations, see Quick start for Topic Recommendations.

    Note:
    Topic Recommendations tries to train the model when you add new topics to Virtual Agent. If an error occurs during training, the topic is still added, but the model remains in a draft state.
    Issue Solution

    Topic Recommendations page is blank

    		 No analysis reports have been configured.

    Configure an analysis report. You can also install or activate ITSM Virtual Agent Conversations, which will add default configurations to Topic Recommendations. For more information, see Set up ITSM Virtual Agent.

    Error when adding topics to Virtual Agent

    		 Check the error log for details:
    1. Navigate to All > System Logs > System Log > Errors.
    2. Find the entry that has a value of sn_topic_recommend in the Source column.

      The Message field displays the error.

      Note:
      If model training fails while adding topics, Topic Recommendations will ignore those errors and continue to add your recommendations. In this case, you will be notified that the models are in draft state.
    Reports have intent matches, but no pre-built topic matches

    Make sure ITSM Virtual Agent Conversations is installed and activated for the instance. If the app is installed, then none of the pre-built topics address the issues found in your reports. For more information, see Set up ITSM Virtual Agent.
    Analysis reports are not available in production instances

    This is the expected behavior. Analysis reports and Intent Discovery are designed to live in one instance only. Added topics and NLU models are made available in a "new" instance, but the Topic Recommendations reports do not move between instances.
    Analysis report is stuck and says "Analysis in progress" Check the status in the Discovery Report Definitions table:
    1. Navigate to All > sn_nlu_discovery_report_definition.list.
    2. Sort the table on the Created column, and then find the name of the affected analysis definition.
    3. If the Status column is empty, the analysis failed. Try running it again.

    You can also navigate to NLU Workbench > Intent Discovery to see if something went wrong in the intent discovery process. For more information, see Intent Discovery.
    Adding new topics takes longer than expected Try the following:
    • Navigate to All > sn_topic_recommend_topic_staging.list and view the Status column to see what stage topic generation is in. Training models can take some time.
    • Navigate to All > System Logs > Events to see which event ran last or if the event is queued.
    • If the reason for failure is not clear, navigate to All > sn_topic_recommend_topic_staging.list and change the value of the Status field to Error. You can then try to add the recommendation again.
    Can't generate a report with less than 10,000 or more than 300,000 records

    Topic Recommendations currently supports a minimum of 10,000 records and a maximum of 300,000 records. This is done for performance and to ensure a statistically significant data set.
    Model is not preselected in the app

    If you are upgrading from Quebec and this is your use of the Topic Recommendations app, you must select a model. Once you select a model, Topic Recommendations preserves the selection.
    Unmigrated model support

    While you are encouraged to migrate your models to groups, Topic Recommendations does not require models to be grouped.
    Unlinked topics You don't have to link all recommendations. Topic linking is a way to "acknowledge" a recommendation if you have an existing topic.
    The Topics/Requests VA Can Handle tab is not displayed

    System property glide.ui.escape_all_script is not set to True.

    Navigate to ALL > sys_properties.list (or ALL sys_properties_list.do). Search for and select glide.ui.escape_all_script, then set its Value to True.