How to Reduce Event noise?

Looper23
Tera Contributor

We have Dynatrace connected to ServiceNow that's constantly sending out Events to ServiceNow and Incidents are being created from the Alerts. I need to reduce noise, specifically for CPU/Memory saturation events. The requirement is if you get an Event with Type = CPU/Memory saturation, wait 10 minutes before creating an Alert for it. If you get a Clear for the same Event, then ignore and not create an Alert. But if it's after 10 minutes, then go ahead create the Alert. 

Looking to reduce noise as the Events come in with Major/Critical and then within just 10 mins, a Clear will come. This in terms will create an Alert that creates the Incident and then auto resolve it. So we want to reduce the times this happens. 

3 REPLIES 3

palanikumar
Mega Sage

Hi,

You can create a property "evt_mgmt.alert_rule_delay" of type integer and mention the number of second to delay before processing. But this is global. You cant set only for CPU/Memory alerts

Thank you,

Palani

Thank you,
Palani

I think I might have to go the updating the Subflow route, but having issues understanding the steps required. Someone had a similar question, but the answer seems vague. Hoping you can help.

https://community.servicenow.com/community?id=community_question&sys_id=4b55e08ddb2a4510e2adc223059619ab

Rahul Priyadars
Giga Sage
Giga Sage
1 fine tune event threshold in source monitoring tool as performance metrics (cpu , memore) are tricky ones. 2 in event rule you can use threshold and frequency, when to spin Alert. Thus is in event rule.This will control the quick spinning of incidents. Control can be placed at both dynatrace n service now layer. Regards RP