Millions of DUPLICATE_PAYLOAD_RECORDS discovery errors daily from probes and patterns - any way to squelch?

[Paul Ciarfella]

We have around 6000 servers being discovered in our networks on a daily basis.

Discovery is generating about 12M error log entries every day with useless error messages about payloads.  I think this is new in Kingston as I do not remember so many daily errors prior to Kingston.

For example, a common error is DUPLICATE_PAYLOAD_RECORDS for everything from DNS aliases to tomcat connectors, with the useless message to remove duplicate items from the payload:

identification_engine : DUPLICATE_PAYLOAD_RECORDS Found duplicate items in the payload (index 87 and 88), using className [cmdb_ci_dns_alias] and fields [name]. Remove duplicate items from the payload

These errors are often proceeded by at least one long message with the output from the probe or pattern with :no thrown error at the end.

I've been unable to determine if these errors are benign as the discovered CIs look ok to me.

Has anyone had similar issues, and if so, is there anything to fix???   Or how can I disable these errors?  Debug properties are false, and logging level is Information.

I don't think we have a performance issue yet, but 2M useless log updates daily cannot be a good thing.

[Achu1]

Thank you! Looks like  my issue is different compared to this.