The CreatorCon Call for Content is officially open! Get started here.

nilimadesai
ServiceNow Employee
ServiceNow Employee

This article details a few best practices that can be adhered to for building sound NLU models.

Starting your NLU Journey

ServiceNow provides complete out-of-box NLU models for you to use with your Virtual Agent. When creating your own NLU model, here are some tips and best practices to consider that can help steer you on the right path in your model-building journey.

find_real_file.png

  1. Review release notes and product documentation around the latest NLU features and product offerings. You won't know how to improve your NLU model if you don't know about the latest features and tools available to you. Check out our documentation and release notes (as of the San Diego release) below.

    NLU documentation: Link 

    Release Notes: Link

  2. Leverage AI features to help in the model-building process by using available platform tools to assess and finalize your intents​
    • In the documentation and release notes above, you'll see various tools to help you tune your NLU model, including: 
      • Intent Discovery gives you top intent clusters against historical data​
      • Topic Recommendation helps enable off-the-shelf VA topics and NLU intents​
      • Conflict Resolution identifies overlapping samples in an existing model, potentially exposing ambiguous intents​
    • Skip building intents that can be self-solved with AI​
      • Leverage AI Search capabilities​ to intelligently self-serve users via AI Search
      • Understand the knowledge gaps in your knowledge base​ and address them for a better search experience
      • Choose NLU Entities over separate intents and topics for the same or better user experience​
  3. Adhere to recommended guide rails​ as outlined below in this article​.
  4. Use vocabulary items and sources to teach your model. Refer to the 'Using Vocabulary in your Models' sub section under 'Adhere to specific guide rails...' section below for some great tips on using vocabulary
  5. Use an iterative approach to test and tune your models prior to the final Publish of your model. Leverage features such as Model Optimize and Expert Feedback Loop to effortlessly tune your model during final publish.
    • Refer to the 'Additional NLU Resources' section at the bottom of this article for links to other community articles on NLU testing and tuning  capabilities. 

Adhere to specific guide rails during your NLU journey

Here is a graphical illustration of the NLU implementation life cycle:

find_real_file.png

As you start building out the model, below are some tips and best practices that help build a clear and optimally performing model. 

find_real_file.png

 

Specific NLU Model Building Tips

  • Building a clear model
    • No misspellings in model train samples
  • find_real_file.png 
    • Address acronyms and industry specific terms through vocabulary
  • find_real_file.png
  •  
  •  
  •  
  • Avoid ambiguity in your model
  • find_real_file.png
  •  
      • Handle overlap between intents
    • find_real_file.png
    •  
    • find_real_file.png
    •  
    • find_real_file.png
    •  
    • find_real_file.png 
      • Avoid samples with inadequate context
    • find_real_file.png
    •  
    • find_real_file.png
    •  
    • find_real_file.png
    •  
    • find_real_file.png
    •  
      • Avoid combining samples into a single utterance

find_real_file.png

 

  • Create Balanced Intents
    • Follow intent structure recommendations

find_real_file.png

    • Follow Intent size best practices
  • find_real_file.png 
    • Follow best practices for train utterances
  • find_real_file.png 
    • Add variety to your intent samples

find_real_file.png

 

  • Using Vocabulary in your model

This section builds on NLU Best Practice - Using Vocabulary & Vocabulary Sources to provide additional tips and guidance for when and how to use vocabulary in your models.  

Different Vocabulary Types in NLU Models

find_real_file.png

    • Specific Vocabulary Tips and Usage Examples

      • Add only one synonym
  • find_real_file.png 
  • find_real_file.png
  •  
  • find_real_file.png
      • Understand when vocabulary is needed
  • find_real_file.png
  •  
  • find_real_file.png 
      • Vocabulary List - How-tos
    •  find_real_file.png
      • Benefits of a List Vocabulary Source

find_real_file.png

 

Additional NLU Related Resources: 

Additional NLU troubleshooting KBs:  

Conversational Interfaces Academy on NLU Tuning

Comments
Vishwajeet Ghor
Tera Contributor

Hi,

Can I use NLU models with Virtual Agent only? Or I can use it with my custom application as well to detect the intent from the comments by users?

Victor Chen
ServiceNow Employee
ServiceNow Employee

As of now, NLU models are for Virtual Agent and AI Search (Genius Results) only. 

Aleli G
ServiceNow Employee
ServiceNow Employee

Hi Nilima,


Thank you very much for putting this together! Very informative to expound knowledge of fine tuning NLU models.  

Keszia
Giga Guru

What is the difference between a simple entity and a regular vocabulary item? Can you share examples of when either is best?

HeatherSN
ServiceNow Employee
ServiceNow Employee

Hello Keszia.  In a nutshell, NLU entities are "the object of the action that the user wants to perform", and vocabulary is a way to provide synonyms for a range of possible words expressing the same idea.

Entities and vocabulary can interact, so that in an example utterance, a word that you mark as an entity can reference a vocabulary item that you've configured.

Find more details in documentation:
https://www.servicenow.com/docs/bundle/washingtondc-intelligent-experiences/page/administer/natural-...


https://www.servicenow.com/docs/bundle/washingtondc-intelligent-experiences/page/administer/natural-...


https://www.servicenow.com/docs/bundle/washingtondc-intelligent-experiences/page/administer/natural-... (scroll to the last paragraph to see an explanation of the interaction of an entity and a vocabulary item)

Keszia
Giga Guru

Thanks Heather, do you have examples of these interacting or other examples of the differences between entities and vocabulary items? I've read the documentation already and am struggling to grasp the concept with the limited examples given.

Version history
Last update:
‎01-25-2023 03:45 PM
Updated by:
Contributors