ServiceNow Virtual Agent with ChatGPT, using own data

[Giancarlo Gener]

Hello. Currently through this article: https://www.servicenow.com/community/developer-forum/chatgpt-integration-with-servicenow-virtualagen... we're able to integrate ChatGPT into our virtual agent.

We'd like to have it search now using our own internal data only (PDF, text, webpage, etc.). The guide here: https://harishgarg.com/writing/build-a-chatgpt-for-your-pdf-documents/ shows this process using python packages, Langchain and OpenAIEmbeddings. Can this be implemented in ServiceNow? Any advice?

[Cal Riley]

Hey Will, thanks for bringing this up. Does this have the ability to query our own data? At first glance it seems to be more generative focused as opposed to searching focused. AKA does it seem like Generative AI Controller can solve the use case posed above

[WillWitten]

You are correct that the GAIC is for generating. However, you could leverage the Generative AI Controller within Flow Designer along with other pieces, such as AI Search.

I would caution that tools such as ChatGPT through OpenAI are experimental, and so there may be some legal considerations to leveraging this technology in this way.

[Cal Riley]

Could you expand on how you could get this done with flow and ai search?

[Giancarlo Gener]

Thank you, this is great! I just looked into this, looks like what we're looking for. We'll put this to test in the next weeks and will post updates here.