AI Search returning irrelevant Catalog Items

SheljaS
Tera Contributor

2 hours ago

We are using AI Search (Patch 7) with Standard Chat. When searching for certain prompts, AI Search is returning irrelevant Catalog Items that do not match the user’s intent.

Example:

  • Search prompt entered: “outlook not opening”
  • AI Search correctly returns troubleshooting guidance related to Outlook.
  • However, along with the relevant information, a Catalog Item unrelated to the Outlook issue is also displayed in the results (as shown in the screenshot).

Issue observed:

  • AI Search sometimes includes unrelated catalog items in the results list
  • The presence of irrelevant catalog items creates confusion for end users and reduces search accuracy.

 

Is this a known issue or limitation in AI Search Patch 7 when used with Standard Chat?
Are there any recommended configurations or tuning steps  to reduce irrelevant catalog items?
Any guidance or recommendations would be greatly appreciated.
Preview file
88 KB
0 Helpfuls
  • 104 Views
3 REPLIES 3

rpriyadarshy
Tera Guru

2 hours ago

@SheljaS  Can you also POST the Description of Catalog Item here  which LLM is responding on Query /Prompt- OutLook Not Opening.

 

Regards

RP

0 Helpfuls

SheljaS
Tera Contributor
In response to rpriyadarshy

an hour ago

This form is for EY CRM and Sales Forecasting support only; any Mercury support should be requested via the mercury support fform.

Before requesting support, please review the self-help and How-To videos available within the application and/or the EY CRM SharePoint  site. 

0 Helpfuls

rpriyadarshy
Tera Guru
In response to SheljaS

34m ago

@SheljaS  I get the Form Name in your Original Post Itself. I am looking for the Catalog Description 

which is Configured in ServiceNow. How come You Query/Prompt (outlook not opening) is getting Augmented with Catalog Results from LLM.

 

if Catalog Description  is not using any where above String then LLM is hallucinating.

 

Regards

RP

0 Helpfuls