Loic1
ServiceNow Employee
ServiceNow Employee

Make AI Search Even Better with some Tuning

Tune the search experience and improve the results based on information specific to your organization. You can quickly test how the search behaves with the Search Preview, add vocabulary specific to your organization and create rules to influence the results.


Test with Search Preview

AI Search administrators (with the ais_admin role) can leverage the Search Preview UI to test AI Search queries using settings from a selected search profile.
The Search Preview UI is installed (along with other useful tools) with the Advanced AI Search Management Tools plugin.

To access the Search Preview UI, navigate to AI Search > Preview > Search Preview.

The Search Preview helps you assess search performance and debug and test queries for a range of profiles and user contexts.

find_real_file.png

Based on the test results, you can make changes to tune the search experience and improve the results. There are three areas: Synonyms, Stop Words and Result Improvement Rules.

Synonym Dictionaries

Although AI Search understands semantics, some unique words or acronyms are specific to your organization. These additional terms can be added to Synonym dictionaries to make the search more relevant. These dictionaries can also be used to add words with similar meanings and expand search queries. Synonyms allow the search to factor variations or ways a search term may be expressed.

You can create a new dictionary using the Synonym related list on the Search Profile or by navigating to Search Query Settings > Dictionaries. A synonym dictionary is language-specific.

By default, the synonym dictionary for English contains synonyms for IT words such as "computer", "laptop", "PC" and "Mac".

Stop Word Dictionaries

Stop words remove search query terms that don't produce meaningful results. Examples of such terms can include articles, conjunctions, personal pronouns, and prepositions. By defining these terms as stop words, you can improve search precision and result relevancy for users. 

You can create a new dictionary using the Stop Words related list on the Search Profile. A stop word dictionary is language-specific.

By default, the list of stop words for English contains over 150 terms including "if", "its", "this" and "the".

Result Improvement Rules

Result Improvement Rules are rules to boost, block, or promote search results for specific searches or the user context, such as a user's location or device.

  • Boost: increase the relevancy scores of search results that satisfy a custom condition
  • Block: prevent specific records from appearing as Genius Results or search results
  • Promote: make specific records appear first

To create a new Result Improvement Rule, navigate to the "Result Improvement Rules" related list on the Search Profile. Each rule is made of a date range, a language and an optional trigger. The rule is only active during the date range and for the user's language.

What's next?

At this stage, you have completed the configuration of AI Search! Learn how to deploy your configuration into production and monitor analytics to capture opportunities for improvement in this article.

Go back to the Quick Start Guide.

References

find_real_file.png

Documentation

Result improvement rules
Synonyms
Stop words

find_real_file.png

FAQ

FAQ


Don't forget to subscribe to our AI & Intelligence forum to get the latest updates!

Comments
austinbuono
ServiceNow Employee
ServiceNow Employee

Good stuff!

cwillard
Tera Expert

Why might the drop down with "recent searches" not be working? Everything else seems to be functioning correctly - but the recently searched drop down is not. 

Shamus Mulhall
ServiceNow Employee
ServiceNow Employee

Hi @cwillard in ESC for example, you'll want to make sure that you have the Autocomplete Suggestions within the AI Search application configuration is configured similar to the example below.

 

Screen Shot 2023-02-09 at 2.36.17 PM.png

 

 

Product doc for reference:

https://docs.servicenow.com/bundle/utah-platform-administration/page/administer/ai-search/concept/au...

cwillard
Tera Expert

@Shamus Mulhall - Thanks. I already have that configured but still nothing is showing up. I will have to do more digging but I haven't yet been able to figure out what is wrong. 

Brian Bakker
ServiceNow Employee
ServiceNow Employee

Hello cwillard,

 

Customers who reported this issue had a custom 'Homepage Search' widget without the required AI search code to enable Recent Searches. Please review our documentation on Reclassify cloned or customized search widgets.

 

I hope this helps with your digging...

 

Regards,

Brian

Jar
Tera Expert

Are there any tips on how to improve the search response times? Right now the average is about 4.3 seconds

Gerard Dwan
ServiceNow Employee
ServiceNow Employee

Hi @Jar ,

 

The most common cause of high query response times is long running user or HR Criteria. AI Search uses an early binding technique for security, where the security filter is generated on the first query for the session. Are queries after the initial one generally faster? 

Jar
Tera Expert

Hi @Gerard Dwan,

Thanks for the reply. For me the search response is about 2 - 3 seconds I would say. I'm looking at the AI Search Analytics dashboard and the average is over the 4 second mark and has been like that since it's been implemented. I've re indexed all our tables to see if this would help at all but aside from that not sure what else we can really do to improve this. 

Is there any way to see where the bottleneck lies? e.g. Whether is platform, network or application related?

 

Last 3 months

Ja1_0-1677746793285.png

 

Last month (01-Feb - 28-Feb)

Ja1_1-1677746868484.png

 

Andrew Twist
Tera Contributor

Would AI search be able to reference HR criteria name used in the can read for a knowledge article?

Shamus Mulhall
ServiceNow Employee
ServiceNow Employee

AI Search filters search query results and displays only records that the currently logged in user can access.

 

Reference: https://docs.servicenow.com/bundle/utah-platform-administration/page/administer/ai-search/concept/co...

Andrew Twist
Tera Contributor

@Shamus Mulhall Understood but we have maybe articles that are scoped to one country for employees but wider access for HR  so if I was able to pull in HR Criteria name from the Can read field on knowledge  where our naming is consistent into AI Search, I as a HR person who has access to many countries could search for example "Maternity Turkey" and because AI search is referencing the can read criteria of "Turkey - All Employees"  would get a more refined search result.

 

Avery Brown
Tera Contributor

Are there any suggestions for quickly increasing relevancy for catalog items? We type in phrases that are essentially the same, maybe slightly different, and get very different results when we use AI Search through Virtual Agent

Gerard Dwan
ServiceNow Employee
ServiceNow Employee

@Avery Brown - you can use a boost action - result improvement rule on the sc_cat_item table. Take a look at this doc page for some guidance: https://docs.servicenow.com/bundle/vancouver-platform-administration/page/administer/ai-search/task/... 

pespinar
Tera Contributor

Dear sirs,

This is a nice article. I wonder if you can help us with one issue: In our portal, we have set up a search on people, and it is giving us results with a very low score relevancy (around 0.0xx). Is there any way to filter this low relevancy results? Lets say, for instance, only show results with a score greater than 10.

Any help on this will be welcomed,
Regards,
Pablo Espinar

Holcim

sachin_namjoshi
Kilo Patron
Kilo Patron

Hi @Loic1 @Gerard Dwan  Is there any documentation available to improve average response time? Based on https://support.servicenow.com/kb?id=kb_article_view&sysparm_article=KB1459876 article, it's recommended to convert scripted user criteria to non scripted user criteria which will not work for us since we are using custom attributes in scripted user criterias.

Version history
Last update:
‎08-21-2023 07:54 AM
Updated by:
Contributors