AI Search returning irrelevant Catalog Items

[SheljaS]

We are using AI Search (Patch 7) with Standard Chat. When searching for certain prompts, AI Search is returning irrelevant Catalog Items that do not match the user’s intent.

Example:

• Search prompt entered: “outlook not opening”
• AI Search correctly returns troubleshooting guidance related to Outlook.
• However, along with the relevant information, a Catalog Item unrelated to the Outlook issue is also displayed in the results (as shown in the screenshot).

Issue observed:

• AI Search sometimes includes unrelated catalog items in the results list
• The presence of irrelevant catalog items creates confusion for end users and reduces search accuracy.

Is this a known issue or limitation in AI Search Patch 7 when used with Standard Chat?

Are there any recommended configurations or tuning steps  to reduce irrelevant catalog items?

Any guidance or recommendations would be greatly appreciated.

[rpriyadarshy]

@SheljaS  Can you also POST the Description of Catalog Item here  which LLM is responding on Query /Prompt- OutLook Not Opening.

Regards

RP

[SheljaS]

This form is for EY CRM and Sales Forecasting support only; any Mercury support should be requested via the mercury support fform.

Before requesting support, please review the self-help and How-To videos available within the application and/or the EY CRM SharePoint  site. 

[rpriyadarshy]

@SheljaS  I get the Form Name in your Original Post Itself. I am looking for the Catalog Description 

which is Configured in ServiceNow. How come You Query/Prompt (outlook not opening) is getting Augmented with Catalog Results from LLM.

if Catalog Description  is not using any where above String then LLM is hallucinating.

Regards

RP