NLU Expert Feedback Loop

[Lynda1]

I think I am missing something when it comes to the Expert Feedback Loop.

I go through the exercise of Match, Mismatch, Corrected Intent. The Enhance Test Set and Optimize Model button is active with the statement "You’re ready to add data to your test set and optimize!"

I created a test set but none of the utterances I just worked on appear. Exactly where do these utterances go when I Match, Mismatch/Correct Intent go??

The test sets are 100% manual to create?

Same question for that Cross Model Conflict review. I worked on that part one day, expecting the changes or corrections I selected during the review to apply to the Intents. I look at the Intents and nothing applied.

What am I missing here?

[Anantha Sai Ram]

Hi,

For Expert feedback loop, please let us know if the below steps help you in resolving the issue

1. After you have given feedback for utterances as Match or Mismatch (and a corrected intent), please do click on 'Save feedback' to the top right. 
2. This will move the utterances you have given feedback to 'Done' tab.
3. Then when you click on 'Enhance Test Set and Optimize Model' button, 20% of the utterances you have given feedback for recently in the 'Done' tab will be moved to test set.

Utterances that are marked as mismatch with a corrected intent are taken in to ensure the previous model doesnt train on predicting once again on these utterances. While match will reinforce to model that it should predict on these kind of utterances.

[Lynda1]

I actually have a Hi ticket open for Expert Feedback Loop. The question is a year ago, we upgraded since then and the new features are awesome, just with a few issues that are being worked on.