AI Agent Training?

[Chris McDevitt]

@Victor Chen 

I noticed that the AI Agent Studio, as well as the Now Assist interface, allows you to give a Thumbs-Up or Thumbs-Down to the AI Agent's answer. How does this feedback system work with the AI Agent? Can you train the AI Agent?

[anubhavkapoor76]

I believe the feedback gets logged in table sys_gen_ai_log_metadata which is later used in Now Assist Analytics application to report on.

More info here - https://www.servicenow.com/docs/bundle/yokohama-intelligent-experiences/page/administer/now-assist-a...

Interesting to see if this feedback is used by Now LLM for more synthesized responses.

[Chris McDevitt]

@anubhavkapoor76 Thank you. To your point, reporting is nice, but agent feedback for training is what I am interested in. 😀

[dbook]

@anubhavkapoor76 are you able to advise how and when the sys_gen_ai_log_metadata table is updated? It does not appear to be in real time, are there other depencies, e.g. the conversation is in a closed state?