Now Assist too slow and not able to scale

[tonyfriot]

We are facing response time over 10s even with ChatGPT4 which 25% faster and during our load testings Now assist stopped working after 200 concurent request. Is there other customer facing the same issues? Now we are considering moving back to NLU topics..Now assist is not a suitable yet to be used widely in a big company. 

[Dr Atul G- LNG]

Hi @tonyfriot 

Now Assist is still in its evolving phase, and I believe this slowness can be considered as feedback for improvement. Did you check with your ServiceNow account representative or report this issue to the ServiceNow product team? It’s possible that a plugin needs to be updated or reimported to help resolve the slowness."

[tonyfriot]

Hello Atul,
Thank you for your quick response.
Yes we seen a lot progress in the last month like the desambiguisation feature we were waiting for. Now that we want to scale to more users, we are stuck and we are told by expert to consider NLU topics.
We are in touch with representative for the load testing and also have a case open for the response time.
For context, we are currently using Yokahama version and all related plugins are up to date.
Service Now is not being charged to customers as a "evolving" product, it's being sold as a fully complete solution.

[Dr Atul G- LNG · Accepted solution]

Thanks for the update mate, if SN recommends then that best.