ServiceNow Virtual Agent with ChatGPT, using own data

[Giancarlo Gener]

Hello. Currently through this article: https://www.servicenow.com/community/developer-forum/chatgpt-integration-with-servicenow-virtualagen... we're able to integrate ChatGPT into our virtual agent.

We'd like to have it search now using our own internal data only (PDF, text, webpage, etc.). The guide here: https://harishgarg.com/writing/build-a-chatgpt-for-your-pdf-documents/ shows this process using python packages, Langchain and OpenAIEmbeddings. Can this be implemented in ServiceNow? Any advice?

[Jin Liang]

Hi, 

We are looking to implement something similar. Did you find a solution?

I read somewhere that Microsoft Azure OpenAI may have the same capabilities.

[Giancarlo Gener]

That's awesome, we will look into utilizing Azure. I'll keep you posted and let you know how test process goes. Thanks.

[Cal Riley]

Hello Giancarlo,

It should be possible to execute this within ServiceNow. Have you been able to successfully do so?
Main things to consider with this approach is to ensure your prompts are designed in a way that will limit hallucinations. Since you are using a GPT model to answer based on chunks of relevant text from your data, you want to make sure that it does not make anything up, and if it does not seem to know the answer it would state that. Interested to hear how this project went for you.

[WillWitten]

Good day!

You may want to take a look at the Generative AI Controller

Learn more about Generative AI Controller on the Store!