GenAI controller essentials course content question

TedNivison
ServiceNow Employee
ServiceNow Employee

i reviewed the GenAI controller essentials course and the FAQ included the below statement and response.  Human-in-the-loop is recomended for "such content".  i am wondering, in what specific content scenarios should a human intervene to ensure accuracy?  thanks

 

We know you are worried about accuracy, but do not worry; we have got you covered.

 

We have minimized the risk of hallucinations through selective use cases and prompt engineering, but there is always a chance of inaccurate information in generated content. That is why we recommend a human-in-the-loop review for such content.

2 REPLIES 2

Brian Bakker
ServiceNow Employee
ServiceNow Employee

Hi @TedNivison 

 

We recommend human-in-the-loop review  for content such as creating a KB article using the GenAI Summarization capability from a case/incident that was closed where no existing knowledge was available. In such a scenario, the AI generated content should be checked and edited where needed to ensure it is correct, before it is published to an audience. Hope this helps.

 

Regards,

Brian

TedNivison
ServiceNow Employee
ServiceNow Employee

thanks @Brian Bakker makes sense.  i suppose that step would be embedded into the case/incident knowledge creation process when genai is envoked to create an article.  meaning that we need to know when an article is generated and prevent it from being published without a verification task.